Field experience in implementing ISO 15189 in Kisumu, Kenya

Implementing laboratory quality management in Africa and central Asia: a model for healthcare improvement

BACKGROUND

Optimized laboratory services are recognized as an integral part of high-quality healthcare delivery. However, these services are often unavailable or substandard in resource-limited countries. The implementation of quality management systems (QMSs) in the laboratory can transform laboratory services and ultimately improve patient care in these settings.

METHODS

The Clinical and Laboratory Standards Institute, through its Global Health Partnerships (GHP) program, has intervened in 32 laboratories to implement QMSs and improve performance. Standardized checklists were used before and after the structured intervention to quantify the impact of this program.

RESULTS

QMS implementation resulted in a statistically significant improvement in overall mean checklist scores. All participating laboratories demonstrated improvement in their quality and performance, with 13 laboratories achieving national accreditation within the time frame of this study.

CONCLUSION

A structured program that utilizes well-recognized, standardized checklists and has leadership and laboratory team support, professional training with onsite guidance (i.e. train the trainer) and access to professionals experienced with QMS implementation and maintenance can lead to significant improvements in quality in resource-limited countries.

Multi-site comparison of factors influencing progress of African insecticide testing facilities towards an international Quality Management System certification

BACKGROUND

Insecticidal mosquito vector control products are vital components of malaria control programmes. Test facilities are key in assessing the effectiveness of vector control products against local mosquito populations, in environments where they will be used. Data from these test facilities must be of a high quality to be accepted by regulatory authorities, including the WHO Prequalification Team for vector control products. In 2013-4, seven insecticide testing facilities across sub-Saharan Africa, with technical and financial support from Innovative Vector Control Consortium (IVCC), began development and implementation of quality management system compliant with the principles of Good Laboratory Practice (GLP) to improve data quality and reliability.

METHODS AND PRINCIPLE FINDINGS

We conducted semi-structured interviews, emails, and video-call interviews with individuals at five test facilities engaged in the IVCC-supported programme and working towards or having achieved GLP. We used framework analysis to identify and describe factors affeting progress towards GLP. We found that eight factors were instrumental in progress, and that test facilities had varying levels of control over these factors. They had high control over the training programme, project planning, and senior leadership support; medium control over infrastructure development, staff structure, and procurement; and low control over funding the availability and accessibility of relevant expertise. Collaboration with IVCC and other partners was key to overcoming the challenges associated with low and medium control factors.

CONCLUSION

For partnership and consortia models of research capacity strengthening, test facilities can use their own internal resources to address identified high-control factors. Project plans should allow additional time for interaction with external agencies to address medium-control factors, and partners with access to expertise and funding should concentrate their efforts on supporting institutions to address low-control factors. In practice, this includes planning for financial sustainability at the outset, and acting to strengthen national and regional training capacity.

Developing laboratory capacity for Good Laboratory Practice certification: lessons from a Tanzanian insecticide testing facility

Background: With increasing insecticide resistance in malaria-endemic countries there is an urgent need for safe and effective novel vector control products. To improve the capacity of facilities that test insecticides in sub-Saharan Africa, a programme is supporting seven facilities towards Good Laboratory Practice (GLP) certification, the globally recognized standard for quality management system (QMS) for the conduct of non-clinical and environmental studies. The World Health Organization (WHO) GLP Handbook provides guidance on a stepwise approach to implement a GLP compliant QMS. This study assesses auditor GLP checklists and timings outlined in the WHO GLP Handbook in the real-life context of a Tanzanian insecticide-testing facility, evaluating their implementation in this context. Methods and Principle Findings: We conducted document review and semi-structured interviews with staff at all levels of the test facility to explore factors that influenced progress towards GLP certification. We found that while auditor GLP checklists underemphasised computer systems, they were otherwise broadly applicable. Factors that delayed time to completion of GLP certification included the need for extensive infrastructure improvements, the availability of regional expertise related to GLP, the capacity of national and regional external systems and services to meet GLP compliance requirements, and training development required for Standard Operating Procedure implementation. Conclusion: The standards required for full GLP compliance are rigorous, with an expected completion timeline to implementation of 24 months. This study shows that in low and middle-income countries this timeline may be unrealistic due to challenges related to infrastructure development and lack of regional capacity and expertise. We recommend a comprehensive gap analysis when starting a project, including these areas which are beyond those recommended by the WHO GLP Handbook. These challenges can be successfully overcome and the experience in Tanzania provides key lessons for other facilities seeking GLP certification or the development of similar QMS.

Diagnosis of Human Immunodeficiency Virus Infection

HIV diagnostics have played a central role in the remarkable progress in identifying, staging, initiating, and monitoring infected individuals on life-saving antiretroviral therapy. They are also useful in surveillance and outbreak responses, allowing for assessment of disease burden and identification of vulnerable populations and transmission "hot spots," thus enabling planning, appropriate interventions, and allocation of appropriate funding. HIV diagnostics are critical in achieving epidemic control and require a hybrid of conventional laboratory-based diagnostic tests and new technologies, including point-of-care (POC) testing, to expand coverage, increase access, and positively impact patient management. In this review, we provide (i) a historical perspective on the evolution of HIV diagnostics (serologic and molecular) and their interplay with WHO normative guidelines, (ii) a description of the role of conventional and POC testing within the tiered laboratory diagnostic network, (iii) information on the evaluations and selection of appropriate diagnostics, (iv) a description of the quality management systems needed to ensure reliability of testing, and (v) strategies to increase access while reducing the time to return results to patients. Maintaining the central role of HIV diagnostics in programs requires periodic monitoring and optimization with quality assurance in order to inform adjustments or alignment to achieve epidemic control.

Improving Laboratory Efficiency in the Caribbean to Attain the World Health Organization HIV Treat All Recommendations

Scientific evidence showing the benefits of early initiation of antiretroviral therapy (ART) prompted World Health organization (WHO) to recommend that all persons diagnosed as HIV positive should commence ART irrespective of CD4 count and disease progression. Based on this recommendation, countries should adopt and implement the HIV "Treat All" policy to achieve the UNAIDS 90-90-90 targets and ultimately reach epidemic control. Attaining this goal along the HIV treatment cascade depends on the laboratory to monitor progress and measure impact. The laboratory plays an important role in HIV diagnosis to attain the first 90 and in viral load (VL) and HIV drug resistance testing to reinforce adherence, improve viral suppression, and measure the third 90. Countries in the Caribbean region have endorsed the WHO HIV "Treat all" recommendation; however, they are faced with diminishing financial resources to support laboratory testing, seen as a rate-limiting factor to achieving this goal. To improve laboratory coverage with fewer resources in the Caribbean there is the need to optimize laboratory operations to ensure the implementation of high quality, less expensive evidence-based approaches that will result in more efficient and effective service delivery. Suggested practical and innovative approaches to achieve this include: (1) targeted testing within HIV hotspots; (2) strengthening sample referral systems for VL; (3) better laboratory data collection systems; and (4) use of treatment cascade data for programmatic decision-making. Furthermore, strengthening quality improvement and procurement systems will minimize diagnostic errors and guarantee a continuum of uninterrupted testing which is critical for routine monitoring of patients to meet the stated goal.

Improving laboratory efficiencies to scale-up HIV viral load testing

PURPOSE OF REVIEW

Viral load measurement is a key indicator that determines patients' response to treatment and risk for disease progression. Efforts are ongoing in different countries to scale-up access to viral load testing to meet the Joint United Nations Programme on HIV and AIDS target of achieving 90% viral suppression among HIV-infected patients receiving antiretroviral therapy. However, the impact of these initiatives may be challenged by increased inefficiencies along the viral load testing spectrum. This will translate to increased costs and ineffectiveness of scale-up approaches. This review describes different parameters that could be addressed across the viral load testing spectrum aimed at improving efficiencies and utilizing test results for patient management.

RECENT FINDINGS

Though progress is being made in some countries to scale-up viral load, many others still face numerous challenges that may affect scale-up efficiencies: weak demand creation, ineffective supply chain management systems; poor specimen referral systems; inadequate data and quality management systems; and weak laboratory-clinical interface leading to diminished uptake of test results.

SUMMARY

In scaling up access to viral load testing, there should be a renewed focus to address efficiencies across the entire spectrum, including factors related to access, uptake, and impact of test results.

Mozambique's journey toward accreditation of the National Tuberculosis Reference Laboratory

Background

Internationally-accredited laboratories are recognised for their superior test reliability, operational performance, quality management and competence. In a bid to meet international quality standards, the Mozambique National Institute of Health enrolled the National Tuberculosis Reference Laboratory (NTRL) in a continuous quality improvement process towards ISO 15189 accreditation. Here, we describe the road map taken by the NTRL to achieve international accreditation.

Methods

The NTRL adopted the Strengthening Laboratory Management Toward Accreditation (SLMTA) programme as a strategy to implement a quality management system. After SLMTA, the Mozambique National Institute of Health committed to accelerate the NTRL’s process toward accreditation. An action plan was designed to streamline the process. Quality indicators were defined to benchmark progress. Staff were trained to improve performance. Mentorship from an experienced assessor was provided. Fulfilment of accreditation standards was assessed by the Portuguese Accreditation Board.

Results

Of the eight laboratories participating in SLMTA, the NTRL was the best-performing laboratory, achieving a 53.6% improvement over the SLMTA baseline conducted in February 2011 to the Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) assessment in June 2013. During the accreditation assessment in September 2014, 25 minor nonconformities were identified and addressed. In March 2015, the NTRL received Portuguese Accreditation Board recognition of technical competency for fluorescence smear microscopy, and solid and liquid culture. The NTRL is the first laboratory in Mozambique to achieve ISO 15189 accreditation.

Conclusions

From our experience, accreditation was made possible by institutional commitment, strong laboratory leadership, staff motivation, adequate infrastructure and a comprehensive action plan.

Development and implementation of the Caribbean Laboratory Quality Management Systems Stepwise Improvement Process (LQMS-SIP) Towards Accreditation

BACKGROUND

Implementing quality management systems and accrediting laboratories in the Caribbean has been a challenge.

OBJECTIVES

We report the development of a stepwise process for quality systems improvement in the Caribbean Region.

METHODS

The Caribbean Laboratory Stakeholders met under a joint Pan American Health Organization/US Centers for Disease Control and Prevention initiative and developed a user-friendly framework called 'Laboratory Quality Management System - Stepwise Improvement Process (LQMS-SIP) Towards Accreditation' to support countries in strengthening laboratory services through a stepwise approach toward fulfilling the ISO 15189: 2012 requirements.

RESULTS

This approach consists of a three-tiered framework. Tier 1 represents the minimum requirements corresponding to the mandatory criteria for obtaining a licence from the Ministry of Health of the participating country. The next two tiers are quality improvement milestones that are achieved through the implementation of specific quality management system requirements. Laboratories that meet the requirements of the three tiers will be encouraged to apply for accreditation. The Caribbean Regional Organisation for Standards and Quality hosts the LQMS-SIP Secretariat and will work with countries, including the Ministry of Health and stakeholders, including laboratory staff, to coordinate and implement LQMS-SIP activities. The Caribbean Public Health Agency will coordinate and advocate for the LQMS-SIP implementation.

CONCLUSION

This article presents the Caribbean LQMS-SIP framework and describes how it will be implemented among various countries in the region to achieve quality improvement.

Implementation research: a mentoring programme to improve laboratory quality in Cambodia

OBJECTIVE

To implement a mentored laboratory quality stepwise implementation (LQSI) programme to strengthen the quality and capacity of Cambodian hospital laboratories.

METHODS

We recruited four laboratory technicians to be mentors and trained them in mentoring skills, laboratory quality management practices and international standard organization (ISO) 15189 requirements for medical laboratories. Separately, we trained staff from 12 referral hospital laboratories in laboratory quality management systems followed by tri-weekly in-person mentoring on quality management systems implementation using the LQSI tool, which is aligned with the ISO 15189 standard. The tool was adapted from a web-based resource into a software-based spreadsheet checklist, which includes a detailed action plan and can be used to qualitatively monitor each laboratory's progress. The tool - translated into Khmer - included a set of quality improvement activities grouped into four phases for implementation with increasing complexity. Project staff reviewed the laboratories' progress and challenges in weekly conference calls and bi-monthly meetings with focal points of the health ministry, participating laboratories and local partners. We present the achievements in implementation from September 2014 to March 2016.

FINDINGS

As of March 2016, the 12 laboratories have completed 74-90% of the 104 activities in phase 1, 53-78% of the 178 activities in phase 2, and 18-26% of the 129 activities in phase 3.

CONCLUSION

Regular on-site mentoring of laboratories using a detailed action plan in the local language allows staff to learn concepts of quality management system and learn on the job without disruption to laboratory service provision.

The status of medical laboratory towards of AFRO-WHO accreditation process in government and private health facilities in Addis Ababa, Ethiopia

Introduction

The World Health Organization Regional Office for Africa (WHO AFRO) introduces a step wise incremental accreditation approach to improving quality of laboratory and it is a new initiative in Ethiopia and activities are performed for implementation of accreditation program.

Methods

Descriptive cross sectional study was conducted in 30 laboratory facilities including 6 laboratory sections to determine their status towards of accreditation using WHO AFRO accreditation checklist and 213 laboratory professionals were interviewed to assess their knowledge on quality system essentials and accreditation in Addis Ababa Ethiopia.

Results

Out of 30 laboratory facilities 1 private laboratory scored 156 (62%) points, which is the minimum required point for WHO accreditation and the least score was 32 (12.8%) points from government laboratory. The assessment finding from each section indicate that 2 Clinical chemistry (55.2% & 62.8%), 2 Hematology (55.2% & 62.8%), 2 Serology (55.2% & 62.8%), 2 Microbiology (55.2% & 62.4%), 1 Parasitology (62.8%) & 1 Urinalysis (61.6%) sections scored the minimum required point for WHO accreditation. The average score for government laboratories was 78.2 (31.2%) points, of these 6 laboratories were under accreditation process with 106.2 (42.5%) average score, while the private laboratories had 71.2 (28.5%) average score. Of 213 respondents 197 (92.5%) professionals had a knowledge on quality system essentials whereas 155 (72.8%) respondents on accreditation.

Conclusion

Although majority of the laboratory professionals had knowledge on quality system and accreditation, laboratories professionals were not able to practice the quality system properly and most of the laboratories had poor status towards the WHO accreditation process. Thus government as well as stakeholders should integrate accreditation program into planning and health policy.

Comparison of laboratories directors' and assessors' opinions on challenges and solutions of standardization in Iran: a qualitative study

OBJECTIVE

The quality medical laboratory services play a vital role in healthcare systems. Iran has set national standards based on the international standard ISO15189. These standards came into force in September 2007. Given the important role of both laboratories professional and assessors in the standardization, this study aims to compare and analyze medical laboratory directors' and assessors' opinions about this process, its challenges and relevant solutions.

METHODS

This qualitative study was conducted on two populations in 2013. The first survey population consisted of 150 assessors. The second group consisted of directors working in medical laboratory settings. From all universities of medical sciences, 258 medical laboratories were randomly selected. Data were gathered using two open-ended questionnaires and analyzed using the thematic analysis.

RESULTS

Challenges and relevant solutions regarding the standardization and standards, the assessment process and assessor, laboratories, external entities and contextual factors across laboratories directors and assessors were derived and compared. Both groups had a positive attitude towards the standardization process. However, they expressed some concerns regarding the process and accordingly proposed solutions to overcome the challenges.

CONCLUSION

This study provides insights into the challenges and solutions of the standardization from two professional groups' viewpoint. These two factors are closely related and should be considered when implementing standards since a positive perception of them increases the likelihood of successful standardization. Similarities and divergences regarding challenges and solutions of the standardization, in turn, can provide insights into how this process can be improved and deserve policy makers' attention to continue the progress.

The impact of SLMTA in improving laboratory quality systems in the Caribbean Region

Background

Past efforts to improve laboratory quality systems and to achieve accreditation for better patient care in the Caribbean Region have been slow.

Objective

To describe the impact of the Strengthening of Laboratory Management Toward Accreditation (SLMTA) training programme and mentorship amongst five clinical laboratories in the Caribbean after 18 months.

Method

Five national reference laboratories from four countries participated in the SLMTA programme that incorporated classroom teaching and implementation of improvement projects. Mentors were assigned to the laboratories to guide trainees on their improvement projects and to assist in the development of Quality Management Systems (QMS). Audits were conducted at baseline, six months, exit (at 12 months) and post-SLMTA (at 18 months) using the Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) checklist to measure changes in implementation of the QMS during the period. At the end of each audit, a comprehensive implementation plan was developed in order to address gaps.

Results

Baseline audit scores ranged from 19% to 52%, corresponding to 0 stars on the SLIPTA five-star scale. After 18 months, one laboratory reached four stars, two reached three stars and two reached two stars. There was a corresponding decrease in nonconformities and development of over 100 management and technical standard operating procedures in each of the five laboratories.

Conclusion

The tremendous improvement in these five Caribbean laboratories shows that SLMTA coupled with mentorship is an effective, user-friendly, flexible and customisable approach to the implementation of laboratory QMS. It is recommended that other laboratories in the region consider using the SLMTA training programme as they engage in quality systems improvement and preparation for accreditation.

Attaining ISO 15189 accreditation through SLMTA: A journey by Kenya's National HIV Reference Laboratory

Background

The National HIV Reference Laboratory (NHRL) serves as Kenya’s referral HIV laboratory, offering specialised testing and external quality assessment, as well as operating the national HIV serology proficiency scheme. In 2010, the Kenya Ministry of Health established a goal for NHRL to achieve international accreditation.

Objectives

This study chronicles the journey that NHRL took in pursuit of accreditation, along with the challenges and lessons learned.

Methods

NHRL participated in the Strengthening Laboratory Management Toward Accreditation (SLMTA) programme from 2010–2011. Improvement projects were undertaken to address gaps in the 12 quality system essentials through development of work plans, team formation, training and mentorship of personnel. Audits were conducted and the scores used to track progress along a five-star grading scale. Standard quality indicators (turn-around time, specimen rejection rates and service interruptions) were measured. Costs of improvement projects and accreditation were estimated based on expenditures.

Results

NHRL scored 45% (zero stars) at baseline in March 2010 and 95% (five stars) after programme completion in October 2011; in 2013 it became the first public health laboratory in Kenya to attain ISO 15189 accreditation. From 2010–2013, turn-around times decreased by 50% – 95%, specimen rejections decreased by 93% and service interruptions dropped from 15 to zero days. Laboratory expenditures associated with achieving accreditation were approximately US $36 500.

Conclusion

International accreditation is achievable through SLMTA, even for a laboratory with limited initial quality management systems. Key success factors were dedication to a shared goal, leadership commitment, team formation and effective mentorship. Countries wishing to achieve accreditation must ensure adequate funding and support.

Progressing beyond SLMTA: Are internal audits and corrective action the key drivers of quality improvement?

Background

Kenya has implemented the Strengthening Laboratory Management Toward Accreditation (SLMTA) programme to facilitate quality improvement in medical laboratories and to support national accreditation goals. Continuous quality improvement after SLMTA completion is needed to ensure sustainability and continue progress toward accreditation.

Methods

Audits were conducted by qualified, independent auditors to assess the performance of five enrolled laboratories using the Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) checklist. End-of-programme (exit) and one year post-programme (surveillance) audits were compared for overall score, star level (from zero to five, based on scores) and scores for each of the 12 Quality System Essential (QSE) areas that make up the SLIPTA checklist.

Results

All laboratories improved from exit to surveillance audit (median improvement 38 percentage points, range 5–45 percentage points). Two laboratories improved from zero to one star, two improved from zero to three stars and one laboratory improved from three to four stars. The lowest median QSE scores at exit were: internal audit; corrective action; and occurrence management and process improvement (< 20%). Each of the 12 QSEs improved substantially at surveillance audit, with the greatest improvement in client management and customer service, internal audit and information management (≥ 50 percentage points). The two laboratories with the greatest overall improvement focused heavily on the internal audit and corrective action QSEs.

Conclusion

Whilst all laboratories improved from exit to surveillance audit, those that focused on the internal audit and corrective action QSEs improved substantially more than those that did not; internal audits and corrective actions may have acted as catalysts, leading to improvements in other QSEs. Systematic identification of core areas and best practices to address them is a critical step toward strengthening public medical laboratories.

Building local human resources to implement SLMTA with limited donor funding: The Ghana experience

BACKGROUND

In 2009, Ghana adopted the Strengthening Laboratory Management Toward Accreditation (SLMTA) programme in order to improve laboratory quality. The programme was implemented successfully with limited donor funding and local human resources.

OBJECTIVES

To demonstrate how Ghana, which received very limited PEPFAR funding, was able to achieve marked quality improvement using local human resources.

METHOD

Local partners led the SLMTA implementation and local mentors were embedded in each laboratory. An in-country training-of-trainers workshop was conducted in order to increase the pool of local SLMTA implementers. Three laboratory cohorts were enrolled in SLMTA in 2011, 2012 and 2013. Participants from each cohort attended in a series of three workshops interspersed with improvement projects and mentorship. Supplemental training on internal audit was provided. Baseline, exit and follow-up audits were conducted using the Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA) checklist. In November 2013, four laboratories underwent official SLIPTA audits by the African Society for Laboratory Medicine (ASLM).

RESULTS

The local SLMTA team successfully implemented three cohorts of SLMTA in 15 laboratories. Seven out of the nine laboratories that underwent follow-up audits have reached at least one star. Three out of the four laboratories that underwent official ASLM audits were awarded four stars. Patient satisfaction increased from 25% to 70% and sample rejection rates decreased from 32% to 10%. On average, $40 000 was spent per laboratory to cover mentors' salaries, SLMTA training and improvement project support.

CONCLUSION

Building in-country capacity through local partners is a sustainable model for improving service quality in resource-constrained countries such as Ghana. Such models promote country ownership, capacity building and the use of local human resources for the expansion of SLMTA.

Strengthening national health laboratories in sub-Saharan Africa: a decade of remarkable progress

OBJECTIVES

Efforts to combat the HIV/AIDS pandemic have underscored the fragile and neglected nature of some national health laboratories in Africa. In response, national and international partners and various governments have worked collaboratively over the last several years to build sustainable laboratory capacities within the continent. Key accomplishments reflecting this successful partnership include the establishment of the African-based World Health Organization Regional Office for Africa (WHO-AFRO) Stepwise Laboratory Quality Improvement Process Towards Accreditation (SLIPTA); development of the Strengthening Laboratory Management Toward Accreditation (SLMTA) training programme; and launching of a Pan African-based institution, the African Society for Laboratory Medicine (ASLM). These platforms continue to serve as the foundations for national health laboratory infrastructure enhancement, capacity development and overall quality system improvement. Further targeted interventions should encourage countries to aim at integrated tiered referral networks, promote quality system improvement and accreditation, develop laboratory policies and strategic plans, enhance training and laboratory workforce development and a retention strategy, create career paths for laboratory professionals and establish public-private partnerships. Maintaining the gains and ensuring sustainability will require concerted action by all stakeholders with strong leadership and funding from African governments and from the African Union.

Measurement of improvement achieved by participation in international laboratory accreditation in sub-Saharan Africa: the Aga Khan University Hospital Nairobi experience

OBJECTIVES

As part of the ISO 15189:2007 accreditation process, the Aga Khan University Hospital Nairobi laboratory became the first internationally accredited hospital laboratory in sub-Saharan Africa outside South Africa in 2011 through the South Africa National Accreditation System.

METHODS

Seven preanalytic, 10 analytic, eight postanalytic, and five administrative performance parameters were monitored from 2009 to 2012 to measure the impact of the accreditation process.

RESULTS

Most measures in all four categories showed substantial improvement. The seven preanalytic measures all showed major improvement-between a quarter and a half sigma. Real but less dramatic improvement appeared in analytic and postanalytic measures, but greater than one sigma decrease in analytic "procedure violations" and a three-quarter sigma decrease in excessive turnaround time were noted in these categories. Administrative improvements included dramatic decreases in misdirected and missing reports and complaints.

CONCLUSIONS

This study demonstrates the correlation of the accreditation process with improvement in quality measures in a low-resource region.

Investigation of HIV Incidence Rates in a High-Risk, High-Prevalence Kenyan Population: Potential Lessons for Intervention Trials and Programmatic Strategies

Cost-effective HIV prevention programs should target persons at high risk of HIV acquisition. We conducted an observational HIV incidence cohort study in Kisumu, Kenya, where HIV prevalence is triple that of the national rate. We used referral and venue-sampling approaches to enroll HIV-negative persons for a 12-month observational cohort, August 2010 to September 2011, collected data using computer-assisted interviews, and performed HIV testing quarterly. Among 1292 eligible persons, 648 (50%) were excluded for HIV positivity and other reasons. Of the 644 enrollees, 52% were women who were significantly older than men (P<.01). In all, 7 persons seroconverted (incidence rate [IR] per 100 person-years=1.11; 95% confidence interval [CI] 0.45-2.30), 6 were women; 5 (IR=3.14; 95% CI 1.02-7.34) of whom were ≤25 years. Most new infections occurred in young women, an observation consistent with other findings in sub-Saharan Africa that women aged ≤25 years are an important population for HIV intervention trials in Africa.

Stakeholder perspectives on implementing accreditation programs: a qualitative study of enabling factors

BACKGROUND

Accreditation programs are complex, system-wide quality and safety interventions. Despite their international popularity, evidence of their effectiveness is weak and contradictory. This may be due to variable implementation in different contexts. However, there is limited research that informs implementation strategies. We aimed to advance knowledge in this area by identifying factors that enable effective implementation of accreditation programs across different healthcare settings.

METHODS

We conducted 39 focus groups and eight interviews between 2011 and 2012, involving 258 diverse healthcare stakeholders from every Australian State and Territory. Interviews were semi-structured and focused on the aims, implementation and consequences of three prominent accreditation programs in the aged, primary and acute care sectors. Data were thematically analysed to distil and categorise facilitators of effective implementation.

RESULTS

Four factors were identified as critical enablers of effective implementation: the accreditation program is collaborative, valid and uses relevant standards; accreditation is favourably received by health professionals; healthcare organisations are capable of embracing accreditation; and accreditation is appropriately aligned with other regulatory initiatives and supported by relevant incentives.

CONCLUSIONS

Strategic implementation of accreditation programs should target the four factors emerging from this study, which may increase the likelihood of accreditation being implemented successfully.

Development of a checklist of quality indicators for clinical trials in resource-limited countries: the French National Agency for Research on AIDS and Viral Hepatitis (ANRS) experience

BACKGROUND

Since 1994, the French National Agency for Research on AIDS and Viral Hepatitis (ANRS) has funded research sites in resource-limited countries (RLCs). These sites implement research on human immunodeficiency virus (HIV) infection and Hepatitis C. In parallel, international regulations and recommendations for clinical trials have evolved and proliferated. However, little guidance exists on how these should be interpreted and applied within academic trials and in the context of RLCs. After developing a specific Ethical Charter for research in developing countries in 2002, ANRS developed a set of quality indicators (QIs) as a monitoring tool for assessing compliance to international guidelines.

PURPOSE

We describe here the development process, QIs adopted, and areas for improvement.

METHODS

In 2008, a group of experts was convened that included a researcher representing each ANRS site (Cote d'Ivoire, Senegal, Cameroun, Burkina Faso, Egypt, and Cambodia). Our structuring interaction development process combined evidence and expert opinion in two nominal group meetings to identify (1) clinical trial processes involved, (2) issues specific to RLCs in terms of Good Clinical Practice (GCP) and the application of ethical recommendations, and (3) checklists of QIs adapted to clinical trials conducted in RLCs.

RESULTS

The trial process reviewed and proposed for RLCs was mostly similar to the one produced in wealthier countries. The scheme generated by our work group added two further processes: 'drug management' and 'biological investigations'. Specific issues regarding trial management in RLCs were therefore described for eight trial steps (1) protocol conception and seeking authorizations, (2) participant enrollment and follow-up, (3) site monitoring, (4) drug management, (5) biological investigations, (6) record management, (7) data management, and (8) site closeout. A total of 58 indicators were identified with at least one indicator for each trial process.

LIMITATIONS

Some trial activities require further consideration, that is, in the case of vulnerable participants (children, pregnant women). Proposed indicators are the result of expert consensus and reflect their experience in the HIV field. Relevance to existing trials and extrapolation to other fields must be assessed.

CONCLUSIONS

This innovative program allowed ANRS sites located in RLCs to share their GCP implementation experiences in order to build a list of relevant indicators for clinical trials. The next step is to collect data from ongoing HIV and hepatitis C trials in these settings and will assess the relevance of these indicators to document current quality of performance among trials in resource-limited settings.

Baseline findings of an HIV incidence cohort study to prepare for future HIV prevention clinical trials in Kisumu, Kenya

Introduction

In an analysis of baseline findings of an HIV incidence cohort study, an assessment was made of HIV prevalence among persons presenting for enrollment and any differences in demographic characteristics between persons not enrolled compared to those enrolled. We also described and compared HIV risk behaviors in males and females enrolled in the study.

Methodology

A computer-assisted survey was administered to collect baseline demographic and HIV risk data from 1,277 men and women aged 18–34 years. Testing for HIV and other sexually transmitted infections (STI) was conducted. Out of 1,277 persons prescreened for eligibility, 625 were enrolled.

Results

HIV prevalence of all persons who completed screening was 14.8% (females: 21.1%; males: 8.1%). The odds of being enrolled in the study were higher for persons 18–24 years compared to those 30–34 years of age [adjusted odds ratio (AOR)=2.18, CI=1.13, 4.21] and males compared to females [AOR=2.07, CI=1.43, 2.99]. Among those enrolled in the study, the most prevalent HIV risk behaviors were unprotected sex (49%), alcohol use (45%), and transactional sex (30%) in the last three months. Compared to females, a significantly greater proportion of males reported using any alcohol or recreational drug in the last three months, a history of oral sex, sex with partner other than a spouse or main partner, ever having a blood transfusion, ever being treated for an STI, and having knowledge of their last HIV test result.

Conclusion

The Kisumu Field Station successfully recruited individuals with HIV risk characteristics for the HIV incidence cohort study.

The World Health Organization African region external quality assessment scheme for anti-HIV serology

A regional external quality assessment scheme (REQAS) for anti-HIV serology aimed to objectively assess reliability and quality of HIV testing processes in the African region. This involved the distribution of proficiency testing (PT) panels to participating laboratories from 2002 to 2010. During the survey period, this included 16 distributions of PT panels to 49 laboratories in 30 countries, and the overall average score during the nine-year survey period was 98.9%, with a frequency of accurate detection, of anti-HIV-1 and/or anti-HIV-2 antibodies in the PT panels, ranging from 93% to 100%. Problems highlighted included lack of human resources and frequent stock outs of test kits, reagents and consumables for routine HIV testing. The design of the REQAS allowed appraisal of the reliability of anti-HIV serological testing methods utilised by laboratories for clinical assessment of patients and/or surveillance programmes. The REQAS was able to demonstrate that laboratories participating in the REQAS performed well and sustained their participation in the scheme. This bodes well for clinical diagnosis, surveillance and training activities at these reference laboratories.

Narrative synthesis of health service accreditation literature

AIMS

To systematically identify and synthesise health service accreditation literature.

METHODS

A systematic identification and narrative synthesis of health service accreditation literature published prior to 2012 were conducted. The search identified 122 empirical studies that examined either the processes or impacts of accreditation programmes. Study components were recorded, including: dates of publication; research settings; levels of study evidence and quality using established rating frameworks; and key results. A content analysis was conducted to determine the frequency of key themes and subthemes examined in the literature and identify knowledge-gaps requiring research attention.

RESULTS

The majority of studies (n=67) were published since 2006, occurred in the USA (n=60) and focused on acute care (n=79). Two thematic categories, that is, 'organisational impacts' and 'relationship to quality measures', were addressed 60 or more times in the literature. 'Financial impacts', 'consumer or patient satisfaction' and 'survey and surveyor issues' were each examined fewer than 15 times. The literature is limited in terms of the level of evidence and quality of studies, but highlights potential relationships among accreditation programmes, high quality organisational processes and safe clinical care.

CONCLUSIONS

Due to the limitations of the literature, it is not prudent to make strong claims about the effectiveness of health service accreditation. Nonetheless, several critical issues and knowledge-gaps were identified that may help stimulate and inform discussion among healthcare stakeholders. Ongoing effort is required to build upon the accreditation evidence-base by using high quality experimental study designs to examine the processes, effectiveness and financial value of accreditation programmes and their critical components in different healthcare domains.