Western Cape Primary Care Assessment Tool (PCAT) study: Measuring primary care organisation and performance in the Western Cape Province, South Africa (2013)

[Systematic review of the primary care quality assessment instruments used in the last 10 years]

OBJECTIVE

There are numerous instruments in the scientific literature for the evaluation of the quality of Primary Care (PC) and to know which of them are the most used and in which countries provides more information to make a well-founded decision. The aim is to determine which, between 2013 and 2023, have been the instruments used to assess the international quality of PC, its evolution and geographical distribution.

DESIGN

Systematic review.

DATA SOURCES

PubMed and Embase. From March to December 2023.

INCLUSION CRITERIA

1) Validation studies of specific assessment instruments to measure the quality of PC and/or the satisfaction of patients, providers or managers. 2) carried out in the field of PC and 3) published between 1/01/2013 and 01/02/2023. 83 full-text articles were included.

DATA EXTRACTION

From each publication, an instrument used to evaluate the quality of the PC, attributes of the PC it evaluates, recipient of the evaluation, user, provider or manager, year, and country.

RESULTS

Fifteen PC assessment instruments were found. The most widely used is the Primary Care Assessing Tool (PCAT), with wide geographical distribution, versions in several languages, is more limited in Europe, except in Spain, and is mostly used in the Primary Care Assessing Tool (PCAT).

CONCLUSIONS

The PCAT, due to its cultural adaptability, availability in several languages, its ability to evaluate the fundamental principles of PC enunciated by the World Health Organization and to contemplate the perspectives of all health agents, is a complete, versatile, and consistent questionnaire for the evaluation of the quality of PC.

User Satisfaction with Primary Health Care Rehabilitation Services in a South African Metropolitan District

Rehabilitation services are critical to improve health outcomes, particularly at community level within primary healthcare settings. As groups with an interest in the health system, rehabilitation service users' and caregivers' involvement in various aspects of health system strengthening is important for healthcare planning and evaluation. This study aimed to explore rehabilitation service users' perceptions of the rehabilitation services and their effect on their functioning in the Johannesburg Metropolitan District. A qualitative study was conducted using purposive sampling of participants attending rehabilitation at nine provincially funded clinics. Semi-structured interviews were conducted, and data were analysed using reflexive thematic analysis. The findings revealed the theme of happy with rehabilitation services and five associated categories, namely (1) service provider actions, (2) service organisation, (3) service user actions, (4) service access, and (5) service outcomes. The participants expressed overall satisfaction with their experiences of rehabilitation services, highlighting the importance of effective communication, patient-centred care, strong therapeutic relationships, and active patient engagement to achieve positive outcomes. This study provides the evidence for maintaining and extending rehabilitation at the PHC level in support of the health policy changes proposed for South Africa.

Adaptation and validation of the Ugandan Primary Care Assessment Tool

BACKGROUND

Health systems based on primary health care (PHC) have better outcomes at lower cost. Such health systems need regular performance assessment for quality improvement and maintenance. In many low- and middle-income countries (LMICs), there are no electronic databases for routine monitoring. There is an urgent need for valid and reliable tools to measure PHC performance.

AIM

This study aimed to adapt and validate the Primary Care Assessment Tool (PCAT) in the Ugandan context.

SETTING

The experts that participated in the Delphi process were recruited from almost all over the country.

METHODS

The study utilised a Delphi process with a panel of 20 experts (14 district health officers, 4 academics in primary care and 2 ministry of health [MOH] technical staff) who responded to iterative rounds of questionnaires in order to reach consensus (defined as 70% agreement).

RESULTS

Consensus was reached after two rounds of the Delphi. In round one, four items in the comprehensiveness domain (services available) were removed and five items needed rephrasing. A new domain on person-centredness with 13 items was suggested. In round two, the new domain with each and every single one of its items and the items for rephrasing all achieved consensus. The final Ugandan version of the PCAT (UG-PCAT) has 12 domains and 91 items.

CONCLUSION

The South African Primary Care Assessment Tool (ZA PCAT) was adapted and validated with an additional domain on person-centredness to measure primary care performance in the Ugandan context, and can now be used to measure the quality of core functions of primary care in Uganda.Contribution: The PCAT could fulfil the need for such a tool in a wider LMIC context. The UG-PCAT will be used to measure the quality of these core functions in Uganda and to assist with the improvement of PHC.

Factors associated with self-rated health in primary care in the South-Western health zone of Malawi

Background

Self-rated health (SRH) is a single-item measure of current health, which is often used in community surveys and has been associated with various objective health outcomes. The prevalence and factors associated with SRH in Sub-Saharan Africa remain largely unknown. This study sought to investigate: (1) the prevalence of poor SRH, (2) possible associations between SRH, and socio-demographic and clinical parameters, and (3) associations between SRH and the patients’ assessment of the quality of primary care.

Methods

A cross-sectional study was conducted in 12 primary care facilities in Blantyre, Neno, and Thyolo districts of Malawi among 962 participants who sought care in these facilities. An interviewer-administered questionnaire containing the Malawian primary care assessment tool, and questions on socio-demographic characteristics and self-rated health was used for data collection. Descriptive statistics were used to determine the distribution of variables of interest and binary logistic regression was used to determine factors associated with poor SRH.

Results

Poor SRH was associated with female sex, increasing age, decreasing education, frequent health care attendance, and with reported disability. Patients content with the service provided and who reported higher scores of relational continuity from their health care providers reported better SRH as compared with others.

Conclusion

This study reports findings from a context where SRH is scarcely examined. The prevalence of poor SRH in Malawi is in line with findings from clinical populations in other countries. The associations between poor SRH and socio-demographic factors are also known from other populations. SRH might be improved by emphasizing continuity of care in primary care services.

Factors associated with accessing and utilisation of healthcare and provision of health services for residents of slums in low and middle-income countries: a scoping review of recent literature

OBJECTIVE

To identify factors associated with accessing and utilisation of healthcare and provision of health services in slums.

DESIGN

A scoping review incorporating a conceptual framework for configuring reported factors.

DATA SOURCES

MEDLINE, Embase, CINAHL, Web of Science and the Cochrane Library were searched from their inception to December 2021 using slum-related terms.

ELIGIBILITY CRITERIA

Empirical studies of all designs reporting relevant factors in slums in low and middle-income countries.

DATA EXTRACTION AND SYNTHESIS

Studies were categorised and data were charted according to a preliminary conceptual framework refined by emerging findings. Results were tabulated and narratively summarised.

RESULTS

Of the 15 469 records retrieved from all years, 4368 records dated between 2016 and 2021 were screened by two independent reviewers and 111 studies were included. The majority (63 studies, 57%) were conducted in Asia, predominantly in India. In total, 104 studies examined healthcare access and utilisation from slum residents' perspective while only 10 studies explored provision of health services from providers/planners' perspective (three studies included both). A multitude of factors are associated with accessing, using and providing healthcare in slums, including recent migration to slums; knowledge, perception and past experience of illness, healthcare needs and health services; financial constraint and competing priorities between health and making a living; lacking social support; unfavourable physical environment and locality; sociocultural expectations and stigma; lack of official recognition; and existing problems in the health system.

CONCLUSION

The scoping review identified a significant body of recent literature reporting factors associated with accessing, utilisation and provision of healthcare services in slums. We classified the diverse factors under seven broad categories. The findings can inform a holistic approach to improving health services in slums by tackling barriers at different levels, taking into account local context and geospatial features of individual slums. SYSTEMATIC REVIEW REGISTRATION NUMBER: https://osf.io/694t2.

General practitioners' communication skills in Nairobi, Kenya: A descriptive observational study

BACKGROUND

High quality primary care is associated with person-centeredness and effective communication that also supports continuity and coordination of care. In Kenya, there is little knowledge about the quality of communication in consultations by general practitioners (GPs).

AIM

To evaluate the quality of communication by GPs.

DESIGN & SETTING

Descriptive, observational study of 23 GPs consultations in 13 private sector primary care facilities in Nairobi, Kenya.

METHOD

One consultation with a randomly selected adult patient was recorded per GP, and 16 communication skills evaluated with the Stellenbosch University Observation Tool. A total percentage score was calculated per consultation, and compared with the GPs' demographics, consultations' complexity and duration using the Statistical Package for Social Sciences.

RESULTS

The GPs' median age was 30.0 years (IQR: 29-32) and median consultation time was 7.0 minutes (IQR =3-9). Median overall score was 64.3% (IQR: 48.4-75.7). They demonstrated skills in gathering information, making and explaining the diagnosis and suggesting appropriate management. They did not make an appropriate introduction, explore the context or patient's perspective, allow shared decision making or provide adequate safety netting. There was a positive correlation between the scores and duration of the consultations (r=0.680, P=0.001). The score was higher in consultations of moderate complexity (78.1; IQR =57.1-86.7) versus low complexity (52.2; IQR =45.1-66.6) (P=0.012).

CONCLUSION

Consultations were brief and biomedical by young and inexperienced GPs. GPs needed further training in communication skills, particularly with regard to person-centredness. Deploying family physicians to the primary care setting would also improve the overall quality of service delivery.

Factors associated with self-rated health in primary care in the South-Western health zone of Malawi

BACKGROUND

Self-rated health (SRH) is a single-item measure of current health, which is often used in community surveys and has been associated with various objective health outcomes. The prevalence and factors associated with SRH in Sub-Saharan Africa remain largely unknown. This study sought to investigate: (1) the prevalence of poor SRH, (2) possible associations between SRH, and socio-demographic and clinical parameters, and (3) associations between SRH and the patients' assessment of the quality of primary care.

METHODS

A cross-sectional study was conducted in 12 primary care facilities in Blantyre, Neno, and Thyolo districts of Malawi among 962 participants who sought care in these facilities. An interviewer-administered questionnaire containing the Malawian primary care assessment tool, and questions on socio-demographic characteristics and self-rated health was used for data collection. Descriptive statistics were used to determine the distribution of variables of interest and binary logistic regression was used to determine factors associated with poor SRH.

RESULTS

Poor SRH was associated with female sex, increasing age, decreasing education, frequent health care attendance, and with reported disability. Patients content with the service provided and who reported higher scores of relational continuity from their health care providers reported better SRH as compared with others.

CONCLUSION

This study reports findings from a context where SRH is scarcely examined. The prevalence of poor SRH in Malawi is in line with findings from clinical populations in other countries. The associations between poor SRH and socio-demographic factors are also known from other populations. SRH might be improved by emphasizing continuity of care in primary care services.

The clinical skills of general practitioners in Nairobi, Kenya: a cross-sectional study

Background

Quality service delivery in primary care requires motivated and competent health professionals. In the Kenyan private sector, general practitioners (GP), with no post-graduate training in family medicine, offer primary care. There is a paucity of evidence on the ability of primary care providers to deliver comprehensive care and no such evidence is available for GPs practising in the private sector in Kenya.

Aim

To evaluate GPs’ training and experience in the skills required for comprehensive primary care.

Design and setting

A cross-sectional descriptive survey in 13 primary care clinics in the private sector of Nairobi, Kenya

Method

A questionnaire, originally designed for a national survey of primary care doctors in South Africa, was adapted. The study collected self-reported data on performance of clinical skills by 25 GPs. Data were analysed in the Statistical Package for Social Sciences.

Results

GPs were mostly under 40 years, with less than 10 years of experience and an equal gender distribution. GPs reported moderate performance with adult health, communication and consultation, and clinical administration; and weak performance with emergencies, child health, surgery, ear-nose-and-throat, eyes, women’s health and orthopaedics. The GPs lacked training in specific skills such as proctoscopy, contraceptive devices, skin procedures, intra-articular injections, red reflex test and use of a genogram.

Conclusion

General practitioners lacked training and performed poorly in some of the essential skills required in primary care. Continuing professional development, training in Family Medicine and deployment of family physicians to the clinics could improve the comprehensiveness of care.

Investigating the effect of the Vula Mobile app on coordination of care and capacity building in district health services, Cape Town: Convergent mixed methods study

BACKGROUND

Coordinating care is a defining characteristic of high quality primary care. Currently, very little is known about coordination of care in South Africa's primary care setting. The Vula Mobile app was introduced in 2018 to assist with referring patients from primary care facilities to the Eerste River District Hospital (ERDH) emergency centre. The aim of this study was to evaluate the use of the app and its effect on coordination of care and capacity building of staff.

METHODS

Convergent mixed methods were used with quantitative data collected from hospital records and the Vula Mobile database, and with qualitative data collected from health professionals in primary care and the district hospital.

RESULTS

Out of 13 321 patients seen in the emergency centre of the district hospital over the 6-month study period, only 1932 (14.5%) of the patients were referred with Vula. Most of these referrals were accepted (85.5%). Sometimes, advice was given to (35.0%) or additional information was requested (27.4%) from the referring doctor. There was little use of Vula in providing other feedback (0.6%). The introduction of the Vula app led to a decrease in the number of inappropriately referred patients (6.7% to 4.2%, p = 0.004). Doctors using the Vula app perceived that it improved care coordination and had the potential for useful feedback.

CONCLUSION

Vula improved coordination of patients referred from primary care facilities in the Metro Health Services to the district hospital, but missed the opportunity to support continuing professional development and learning. Utilisation of the Vula app should be increased and its potential to provide feedback should be enhanced. Attention should be given to reducing the number of patients self-referred or referred without using the Vula app.

Family and community guidance in adolescence: assessment in the family health strategy

Objective:

to evaluate family and community guidance in adolescence, within the scope of Primary Health Care.

Method:

an evaluative and descriptive study with a quantitative approach, developed through the application of the Primary Care Assessment Instrument (PCATool), with 70 professionals from the Family Health Strategy and 140 adolescents from the widerange areas. Data collection took place in Basic Health Units and in the adolescents’ homes in a municipality of southern Brazil, from May to September 2019. The data were analyzed using descriptive and inferential statistics using ANOVA and Tukey’s test, performed using the R Studio software.

Results:

there was divergence in the assessment of the attributes of family and community guidance between users and responsible professionals, showing weaknesses in the communication process and in the formation of the care bond in this reality, with impacts on quality of care.

Conclusion:

there was a need for continued assessment of the care practice in primary health care, as well as for permanent education with a focus on increasing qualification of care for adolescents.

"We have either obsolete knowledge, obsolete equipment or obsolete skills": policy-makers and clinical managers' views on maternal health delivery in rural Nigeria

OBJECTIVE

The objective of this paper is to explore policy-makers and clinical managers' views on maternal health service delivery in rural Nigeria.

DESIGN

This is a qualitative study using key informant interviews. Participants' responses were audio recorded and reflective field notes supplemented the transcripts. Data were further analysed with a deductive approach whereby themes were organised based on existing literature and theories on service delivery.

SETTING

The study was set in Esan South East (ESE) and Etsako East (ETE), two mainly rural local government areas of Edo state, Nigeria.

PARTICIPANTS

The study participants consisted of 13 key informants who are policy-makers and clinical managers in ESE and ETE in Edo state. Key informants were chosen using a purposeful criterion sampling technique whereby participants were identified because they meet or exceed a specific criterion related to the subject matter.

RESULTS

Respondents generally depicted maternal care services in primary healthcare centres as inaccessible due to undue barriers of cost and geographic location but deemed it acceptable to women. Respondents' notion of quality of service delivery encompassed factors such as patient-provider relationships, hygienic conditions of primary healthcare centres, availability of skilled healthcare staff and infrastructural constraints.

CONCLUSION

This study revealed that while some key aspects of service delivery are inadequate in rural primary healthcare centres, there are promising policy reforms underway to address some of the issues. It is important that health officials advocate for strong policies and implementation strategies.

Assessment of access to first contact in the perspective of professionals

OBJECTIVES

to evaluate the "access to first contact" attribute, from the perspective of Primary Care Health professionals.

METHODS

an evaluative and cross-sectional study, carried out from February to March 2017. The sample consisted of 163 health professionals, of both genders, who worked in the basic care of the Municipality of Juazeiro do Norte, Ceará. Access to first contact was evaluated by the Primary Care Assessment Tool (PCATool). The 6.60 mark was used as the cut-off point for the evaluated attribute.

RESULTS

access to first contact reached a score of 3.3, denoting a low degree of orientation for Primary Health Care. Nurses were the ones who evaluated the attribute more negatively (p=3.2).

CONCLUSIONS

access to first contact obtained a low score, pointing to the fragility of the Family Health Strategy as a gateway to the Brazilian Unified Health System (Sistema Único de Saúde).

Usual source of care and experiences with primary care among community health service centre patients in Changchun, China: A cross-sectional survey

Under China's healthcare reforms, community health service centres (CHCs) have been established as the preferred primary care providers. Even with this change, there is still little attention paid to patients' usual source of care (USC) from CHCs in Northeastern China. The main purposes of this study were to explore the determinants of usual source of community health service and to examine the association between usual source of community health service and patients' experiences with primary care. A cross-sectional survey with 515 adult patients at CHCs in Jilin Province, China, was conducted between July 2016 and November 2016. The patients' experiences with primary care were assessed with the Primary Care Assessment Tool (PCAT). Patients with self-perceived poor health status (odds ratio = 1.984, 95% confidence interval = 1.145-3.437) and chronic disease (odds ratio = 2.207, 95% confidence interval = 1.203-4.051) were more likely to have a usual source of community health service than patients with self-perceived good health status or without chronic disease. Patients scored the highest on comprehensiveness of services available (Mean = 2.87) and the lowest on community orientation (Mean = 1.83) in all domains of the PCAT, with values ranging from 1 to 4. A multiple linear regression analysis revealed that patients with a usual source of community health service had significantly higher overall scores than those without (B = 0.205, p < .001). This study demonstrated the important role of CHCs in providing affordable health services for patients with chronic disease or poor health status. Moreover, patients who chose a CHC as a USC had better experiences with primary care compared with patients who did not choose a CHC as a USC. However, community-oriented services need to be improved, and efforts to improve patients' experiences should include policies that incentivise patients to adopt a CHC as their USC.

Primary care quality in Vietnam: Perceptions and opinions of primary care physicians in commune health centers - a mixed-methods study

INTRODUCTION

Measuring the performance of a primary care system is one of the very first steps to find out whether there is room for improvement. To obtain an objective and comprehensive view, this measurement should come from both the supply and demand sides of the system. Patients' experiences of primary care have been studied around the world, but much less energy has been invested in researching providers' perspectives. This research aims to explore how primary care physicians working at commune health centers in Vietnam evaluate their performance and their opinions on how to improve the quality of primary care services.

MATERIALS AND METHODS

First, a quantitative study was conducted using the validated Vietnamese PCAT questionnaire-provider expanded version (VN PCAT PE) targeting all primary care physicians (PCPs) working at commune health centers in a province of Central Vietnam. Next, a qualitative study was carried out, consisting of in-depth interviews with PCPs, to better understand the results of the quantitative survey and gain insight on barriers of primary care services and how to overcome them.

RESULTS

In the quantitative portion of our study, 150 PCPs rated the quality of ongoing care and first contact in CHCs as the best (3.09 and 3.11 out of 4, respectively), and coordination as the worst performing core domain (2.53). Twenty-two PCPs also participated in our qualitative research. In regards to challenges that primary care physicians face during their daily practice, three central themes emerged: 1) patient factors such as client attitude and knowledge, 2) provider factors such as the burden of administrative work and lack of training opportunities, and 3) contextual factors such as low income and lack of resources including medicines and diagnostics. Participants recommended more health promotion campaigns in the media, increasing the number of services available at CHCs (such as being able to take blood samples), reducing the workload related to administration for CHC leaders, greater government subsidies, and providing more training courses for PCPs.

CONCLUSIONS

Findings from this study offer a valuable view from the supply-side of the primary care system, specifically those who directly deliver primary care services. Along with the earlier study on consumers' evaluation of the Vietnamese primary care system, and literature from other low and middle-income countries, these findings offer emerging evidence for policymakers to improve the quality of primary care in Vietnam.

Evaluation of the quality of service delivery in private sector, primary care clinics in Kenya: A descriptive patient survey

BACKGROUND

The quality of service delivery in primary care (PC) is an important determinant of clinical outcomes. The patients' perspective is one significant predictor of this quality. Little is known of the quality of such service delivery in the private sector in Kenya. The aim of the study was to evaluate the quality of service delivery in private sector, PC clinics in Nairobi, Kenya.

METHODS

The study employed a descriptive cross-sectional survey by using the General Practice Assessment Questionnaire in 378 randomly selected patients from 13 PC clinics. Data were analysed using the Statistical Package for Social Sciences.

RESULTS

Overall, 76% were below 45 years, 74% employed and 73% without chronic diseases. Majority (97%) were happy to see the general practitioner (GP) again, 99% were satisfied with their consultation and 83% likely to recommend the GP to others. Participants (97%) found in receptionist helpful and the majority were happy with the opening hours (73%) and waiting times (85%). Although 84% thought appointments were important, only 48% felt this was easy to make, and only 44% were able to access a particular GP on the same day. Overall satisfaction was higher in employed (98%) versus those unemployed (95%), studying (93%) or retired (94%) (p 0.001).

CONCLUSION

Patients reported a high quality of service delivery. Utilisation was skewed towards younger, employed adults, without chronic conditions, suggesting that PC was not fully comprehensive. Services were easily accessible, although with little expectation of relational continuity. Further studies should continue to evaluate the quality of service delivery from other perspectives and tools.

Comparison of Patients' Perceived Quality of Primary Care Between Urban and Rural Community Health Centers in Guangdong, China

Background: A series of reforms were implemented to improve the quality of primary care services in China. This study aims to assess patients’ perceived quality of primary healthcare between rural and urban community health centers in Guangdong. Methods: A cross-sectional survey was conducted from July to December 2015 in Guangdong. We surveyed 1010 respondents who visited either community health centers/stations (CHCs/CHSs) in urban areas or township health centers/rural health stations (THCs/RHSs) in rural areas. A validated Chinese version of the Primary Care Assessment Tool-Adult Short Version (PCAT-AS), representing ten primary care domains, was used to collect information on patients’ primary care experiences. A t-test was used for comparison on domain scores and total scores between patients from CHCs/CHSs and THCs/RHSs. An analysis of covariance was employed to compare the adjusted PCAT domain scores and total scores. Multilevel models were used to explore factors associated with PCAT total scores. Results: Overall, patients reported a lower level of experience of community orientation and family centeredness compared to other primary care domains. Patients from THCs/RHSs settings in the rural area reported better primary care experience in four domains, including first contact, accessibility, ongoing care, and community orientation. Higher education background and those with a chronic disease were associated with better primary care experience, after controlling for confounding factors. Patients who preferred primary care institutions when getting sick or used health services more frequently reported better primary care experiences. Conclusion: Continued efforts are needed to strengthen primary care performances, particularly in a community orientation and family centeredness. Primary care delivery in CHCs/CHSs settings should be improved in four domains, including first contact, accessibility, ongoing care, and community orientation.

Measuring the quality of primary care in national health surveys: Lessons from Brazil

Background

South Africa started to lead the cross-culturally validation and use of the Primary Care Assessment Tool (PCAT) in Africa, when Professor Bresick filled a gap, as this continent was until then the only one that had never used it in evaluation of primary health care facilities until 2015.

Aim

The authors aim to demonstrate that after the consolidation of Bresick’s team to an African version of PCAT, it had been adapted to household survey in Brazil.

Methods

In this letter, authors reflect on how Brazil had adapted PCAT to a national random household survey with Brazilian National Institute of Geography and Statistics (IBGE) – the Brazilian Census Bureau.

Results

In the the beginning of 2019, Brazilian Ministry of Health brought back the PCAT as the official national primary health care assessment tool. Brazilian National Institute of Geography and Statistics (IBGE) included a new module (set of questions) in its National Health Survey (PNS-2019) and collected more than 100 000 households interviews in about 40% of the country’s municipalities. This module had 25 questions of the Brazilian validated version of the adult reduced PCAT.

Conclusion

We believe that IBGE innovation with the Ministry of Health can encourage South Africa to establish a similar partnership with its National Institute of Statistics (Statistics South Africa) for the country to establish a baseline for future planning of primary health care, for decision-making based on scientific evidence.

Primary health care performance: a scoping review of the current state of measurement in Africa

INTRODUCTION

Countries with strong primary healthcare (PHC) report better health outcomes, fewer hospital admissions and lower expenditure. People-centred care that delivers essential elements of primary care (PC) leads to improved health outcomes and reduced costs and disparities. Such outcomes underscore the need for validated instruments that measure the extent to which essential, evidence-based features of PC are available and applied to users; and to ensure quality care and provider accountability.

METHODS

A systematic scoping review method was used to identify peer-reviewed African studies and grey literature on PC performance measurement. The service delivery dimension in the Primary Healthcare Performance Initiative conceptual framework was used to identify key measurable components of PC.

RESULTS

The review identified 19 African studies and reports that address measuring elements of PC performance. 13 studies included eight nationally validated performance measuring instruments. Of the eight, the South African and Malawian versions of Primary Care Assessment Tool measured service delivery comprehensively and involved PC user, provider and manager stakeholders.

CONCLUSION

40 years after Alma Ata and despite strong evidence for people-centred care, significant gaps remain regarding use of validated instruments to measure PC performance in Africa; few validated instruments have been used. Agreement on indicators, fit-for-purpose validated instruments and harmonising existing instruments is needed. Rigorous performance-based research is necessary to inform policy, resource allocation, practice and health worker training; and to ensure access to high quality care in a universal health coverage (UHC) system-research with potential to promote socially responsive, accountable PHC in the true spirit of the Alma Ata and Astana Declarations.

Performance of primary care in different healthcare facilities: a cross-sectional study of patients' experiences in Southern Malawi

OBJECTIVE

In most African countries, primary care is delivered through a district health system. Many factors, including staffing levels, staff experience, availability of equipment and facility management, affect the quality of primary care between and within countries. The purpose of this study was to assess the quality of primary care in different types of public health facilities in Southern Malawi.

STUDY DESIGN

This was a cross-sectional quantitative study.

SETTING

The study was conducted in 12 public primary care facilities in Neno, Blantyre and Thyolo districts in July 2018.

PARTICIPANTS

Patients aged ≥18 years, excluding the severely ill, were selected to participate in the study.

PRIMARY OUTCOMES

We used the Malawian primary care assessment tool to conduct face-to-face interviews. Analysis of variance at 0.05 significance level was performed to compare primary care dimension means and total primary care scores. Linear regression models at 95% CI were used to assess associations between primary care dimension scores, patients' characteristics and healthcare setting.

RESULTS

The final number of respondents was 962 representing 96.1% response rate. Patients in Neno hospitals scored 3.77 points higher than those in Thyolo health centres, and 2.87 higher than those in Blantyre health centres in total primary care performance. Primary care performance in health centres and in hospital clinics was similar in Neno (20.9 vs 19.0, p=0.608) while in Thyolo, it was higher at the hospital than at the health centres (19.9 vs 15.2, p<0.001). Urban and rural facilities showed a similar pattern of performance.

CONCLUSION

These results showed considerable variation in experiences among primary care users in the public health facilities in Malawi. Factors such as funding, policy and clinic-level interventions influence patients' reports of primary care performance. These factors should be further examined in longitudinal and experimental settings.

Development and validation of the Vietnamese Primary Care Assessment Tool - provider version

Aim:

To adapt the provider version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity.

Background:

There is a growing need to measure and explore the impact of various characteristics of health care systems on the quality of primary care. It would provide the best evidence for policy makers if these evaluations come from both the demand and supply sides of the health care sector. Comparatively more researchers have studied primary care quality from the consumer perspective than from the provider’s perspective. This study aims at the latter.

Method:

Our study translated and adapted the PCAT provider version (PCAT PE) into a Vietnamese version, after which a cross-sectional survey was conducted to examine the feasibility, internal consistency and validity of the Vietnamese PCAT provider version (VN PCAT PE). All general doctors working at 152 commune health centres in Thua Thien Hue province had been selected to participate in the survey.

Findings:

The VN PCAT PE is an instrument for evaluation of primary care in Vietnam with 116 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. From the translation and cultural adaptation stage, two items were combined, two items were removed and one item was added. Six other items were excluded due to problems in item-total correlations. All items have a low non-response or ‘don’t know/don’t remember’ response rate, and there were no floor or ceiling effects. All scales had a Cronbach’s alpha above 0.80, except for the Coordination scale, which still was above the minimum level of 0.70.

Conclusion:

The VN PCAT PE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the provider perspective.

Quality of primary care from patients' perspective: a cross sectional study of outpatients' experience in public health facilities in rural Malawi

BACKGROUND

Assessing patients' experience with primary care complements measures of clinical health outcomes in evaluating service performance. Measuring patients' experience and satisfaction are among Malawi's health sector strategic goals. The purpose of this study was to investigate patients' experience with primary care and to identify associated patients' sociodemographic, healthcare and health characteristics.

METHODS

This was a cross sectional survey using questionnaires administered in public primary care facilities in Neno district, Malawi. Data on patients' primary care experience and their sociodemographic, healthcare and health characteristics were collected through face to face interviews using a validated Malawian version of the primary care assessment tool (PCAT-Mw). Mean scores were derived for the following dimensions: first contact access, continuity of care, comprehensiveness, community orientation and total primary care. Linear regression models were used to assess association between primary care dimension scores and patients' characteristics.

RESULTS

From 631 completed questionnaires, first contact access, relational continuity and comprehensiveness of services available scored below the defined minimum. Sex, geographical location, self-rated health status, duration of contact with facility and facility affiliation were associated with patients' experience with primary care. These factors explained 10.9% of the variance in total primary care scores; 25.2% in comprehensiveness of services available and 29.4% in first contact access.

CONCLUSION

This paper presents results from the first use of the validated PCAT-Mw. The study provides a baseline indicating areas that need improvement. The results can also be used alongside clinical outcome studies to provide comprehensive evaluation of primary care performance in Malawi.

Development and validation of a tool to measure patient experience in chronic disease care

BACKGROUND

 There is a global increase in the prevalence of non-communicable diseases and a growing understanding that patients need to be involved in their care. Patient experience should be assessed and the information used to improve on the planning and delivery of health services.

AIM

 This study described the development and validation of a patient-reported experience measure (PREM) tool which is appropriate for the South African context, to assess self-reported patient experience of chronic care.

SETTING

 The study was conducted at four primary health care facilities in the Cape Town Metropole.

METHODS

 This was a validity and reliability study with multiple phases to develop and determine the psychometric properties of a novel tool. It consisted of three phases, namely: Phase 1 - Consensus Validity; Phase 2 - Face Validity; Phase 3 - Reliability. Phase 1 consisted of an expert panel reaching consensus on a draft tool. Phase 2a consisted of qualitative semi-structured interviews and cognitive interviews. Phase 3 tested the internal consistency of the tool, the time necessary to complete, as well as floor and ceiling effects with 200 questionnaires.

RESULTS

 The process described resulted in a final questionnaire with n = 10 items in three languages that was easily understood by patients. Internal consistency was determined with the overall Cronbach's alpha 0.86. This PREM has been named Chronic Care Assessment of Patient Experience.

CONCLUSION

 Using best practice guidance in tool construction and validation, we delivered a PREM with the potential to improve the quality of care from the perspective of patients. Implementation studies are now required to determine how best to use this tool in routine practice.

Baseline measures of primary health care team functioning and overall primary health care performance at Du Noon Community Health Centre

BACKGROUND

 Research consistently demonstrates the importance of effective team work for improving the quality of health care. We conducted a baseline measure of primary health care (PHC) team effectiveness and overall PHC performance at a primary care facility.

AIM

 To improve PHC team effectiveness and ultimately the quality and user experience of primary care at a community health centre (CHC).

SETTING

 Du Noon CHC in the southern and western substructure of the Cape Town Metro district services (MDHS).

METHODS

 A cross-sectional study using a combination of the Nominal Group Technique (NGT) consensus method and the South African Primary Care Assessment Tool (ZA PCAT) to assess PHC team effectiveness and PHC organisation and performance.

RESULTS

 The ZA PCAT was administered to 110 CHC users (patients) and 12 providers (doctors and clinical nurse practitioners). Data from 20 PHC team members showed they perceived their team as well functioning (70% agreement on a 7-item PHC team assessment tool incorporated into the ZA PCAT). The NGT method achieved participant (20) consensus on communication and leadership as the main challenges to effective team functioning and on ideas to overcome the challenges. The ZA PCAT user data showed 18.2% of users rated first contact access as acceptable to good; 47.3% of users rated ongoing care as acceptable to good. Provider data showed that 33% of providers rated first contact access as acceptable to good; 25% of providers rated ongoing care as acceptable to good. First contact access received the lowest acceptable to good score (18.2%) and comprehensiveness (services available) the highest score (88.2%) from users. For the providers, the lowest acceptable to good score was for ongoing care (25%) and the highest acceptable to good score was for primary health care team availability (100%). The ZA PCAT total primary scores were good (above 60%) for both users and providers but moderately higher for the providers.

CONCLUSION

 Knowledge of how teams perceive their effectiveness can motivate them to generate ideas for improving performance. There were discrepancies between providers' assessment of team functioning using the ZA PCAT measure and the NGT method results. The ZA PCAT also showed differences between providers' and users' perceptions of PHC performance - consistent with the findings of the multi-CHC Western Cape ZA PCAT study. These findings should encourage and support CHC and district level staff in their efforts to improve the quality and user experience of primary care, as well as PHC team performance.

How well do public sector primary care providers function as medical generalists in Cape Town: a descriptive survey

BACKGROUND

Effective primary health care requires a workforce of competent medical generalists. In South Africa nurses are the main primary care providers, supported by doctors. Medical generalists should practice person-centred care for patients of all ages, with a wide variety of undifferentiated conditions and should support continuity and co-ordination of care. The aim of this study was to assess the ability of primary care providers to function as medical generalists in the Tygerberg sub-district of the Cape Town Metropole.

METHODS

A randomly selected adult consultation was audio-recorded from each primary care provider in the sub-district. A validated local assessment tool based on the Calgary-Cambridge guide was used to score 16 skills from each consultation. Consultations were also coded for reasons for encounter, diagnoses and complexity. The coders inter- and intra-rater reliability was evaluated. Analysis described the consultation skills and compared doctors with nurses.

RESULTS

45 practitioners participated (response rate 85%) with 20 nurses and 25 doctors. Nurses were older and more experienced than the doctors. Doctors saw more complicated patients. Good inter- and intra-rater reliability was shown for the coder with an intra-class correlation coefficient of 0.84 (95% CI 0.045-0.996) and 0.99 (95% CI 0.984-0.998) respectively. The overall median consultation score was 25.0% (IQR 18.8-34.4). The median consultation score for nurses was 21.6% (95% CL 16.7-28.1) and for doctors was 26.7% (95% CL 23.3-34.4) (p = 0.17). There was no difference in score with the complexity of the consultation. Ten of the 16 skills were not performed in more than half of the consultations. Six of the 16 skills were partly or fully performed in more than half of the consultations and these included the more biomedical skills.

CONCLUSION

Practitioners did not demonstrate a person-centred approach to the consultation and lacked many of the skills required of a medical generalist. Doctors and nurses were not significantly different. Improving medical generalism may require attention to how access to care is organised as well as to training programmes.

Adaptación transcultural colaborativa de cuestionarios PCAT para Colombia

Objetivo: obtener versiones de los cuestionarios Primary Care Assessment Tool (PCAT) para Colombia (CO-PCAT), dirigidos a profesionales (PCAT-PE), gestores y directivos de atención primaria (PCAT-FE) a través de un proceso colaborativo internacional. Metodos: proceso de adaptación transcultural modificado a partir de las versiones adaptadas y validadas en español, en consenso con la Colaboración Iberoamericana IA-PCAT. El método busca conseguir la equivalencia de la versión CO-PCAT de los cuestionarios con la versión original de Estados Unidos de América. Se desarrollaron tres fases de trabajo: I) valoración de la adecuación de versiones iberoamericanas en lengua española y adaptación al contexto colombiano, II) revisión internacional realizada por investigadores de la Colaboración Iberoamericana PCAT y III) pruebas preliminares de los cuestionarios. Consideraciones éticas: es una investigación sin riesgos para los seres humanos conforme a la Resolución 08430 de 1993 de Colombia y la Declaración de Helsinki. Resultados: del PCAT-PE se incluyeron en la versión colombiana 182 ítems. En cuanto al PCAT-FE se trabajó con 197 ítems en total. Conclusión: se obtuvieron versiones adaptadas al sistema de salud colombiano. La metodología empleada puede contribuir al logro de mayor equivalencia entre instrumentos de diferentes países.

Development and validation of a Malawian version of the primary care assessment tool

BACKGROUND

Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi.

METHODS

A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability.

RESULTS

From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI = 0.90, CFI = 0.91, RMSEA = 0.05, PCLOSE = 0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n = 44, 95% CI 0.81-0.94, p < 0.001) for intra-rater reliability and 0.84 (n = 42, 95% CI 0.71-0.96, p < 0.001) for inter-rater reliability.

CONCLUSIONS

Comprehensive metric analyses supported the reliability and validity of PCAT-Mw in assessing the core concepts of primary care from adult patients' experience. This tool could be used for health service research in primary care in Malawi.