Study protocol: Audit and Best Practice for Chronic Disease Extension (ABCDE) Project

The TransFORmation of IndiGEnous PrimAry HEAlthcare Delivery (FORGE AHEAD): economic analysis

BACKGROUND

Indigenous populations have increased risk of developing diabetes and experience poorer treatment outcomes than the general population. The FORGE AHEAD program partnered with First Nations communities across Canada to improve access to resources by developing community-driven primary healthcare models.

METHODS

This was an economic assessment of FORGE AHEAD using a payer perspective. Costs of diabetes management and complications during the 18-month intervention were compared to the costs prior to intervention implementation. Cost-effectiveness of the program assessed incremental differences in cost and number of resources utilization events (pre and post). Primary outcome was all-cause hospitalizations. Secondary outcomes were specialist visits, clinic visits and community resource use. Data were obtained from a diabetes registry and published literature. Costs are expressed in 2023 Can$.

RESULTS

Study population was ~ 60.5 years old; 57.2% female; median duration of diabetes of 8 years; 87.5% residing in non-isolated communities; 75% residing in communities < 5000 members. Total cost of implementation was $1,221,413.60 and cost/person $27.89. There was increase in the number and cost of hospitalizations visits from 8/$68,765.85 (pre period) to 243/$2,735,612.37. Specialist visits, clinic visits and community resource use followed this trend.

CONCLUSION

Considering the low cost of intervention and increased care access, FORGE AHEAD represents a successful community-driven partnership resulting in improved access to resources.

A realist synthesis of multicentre comparative audit implementation: exploring what works and in which healthcare contexts

BACKGROUND

Multicentre comparative clinical audits have the potential to improve patient care, allow benchmarking and inform resource allocation. However, implementing effective and sustainable large-scale audit can be difficult within busy and resource-constrained contemporary healthcare settings. There are little data on what facilitates the successful implementation of multicentre audits. As healthcare environments are complex sociocultural organisational environments, implementing multicentre audits within them is likely to be highly context dependent.

OBJECTIVE

We aimed to examine factors that were influential in the implementation process of multicentre comparative audits within healthcare contexts-what worked, why, how and for whom?

METHODS

A realist review was conducted in accordance with the Realist and Meta-narrative Evidence Syntheses: Evolving Standards reporting standards. A preliminary programme theory informed two systematic literature searches of peer-reviewed and grey literature. The main context-mechanism-outcome (CMO) configurations underlying the implementation processes of multicentre audits were identified and formed a final programme theory.

RESULTS

69 original articles were included in the realist synthesis. Four discrete CMO configurations were deduced from this synthesis, which together made up the final programme theory. These were: (1) generating trustworthy data; (2) encouraging audit participation; (3) ensuring audit sustainability; and (4) facilitating audit cycle completion.

CONCLUSIONS

This study elucidated contexts, mechanisms and outcomes influential to the implementation processes of multicentre or national comparative audits in healthcare. The relevance of these contextual factors and generative mechanisms were supported by established theories of behaviour and findings from previous empirical research. These findings highlight the importance of balancing reliability with pragmatism within complex adaptive systems, generating and protecting human capital, ensuring fair and credible leadership and prioritising change facilitation.

Safeguarding against Dementia in Aboriginal and Torres Strait Islander Communities through the Optimisation of Primary Health Care: A Project Protocol

This protocol describes the methodology and methods for a collaborative project with eight Aboriginal and Torres Strait Islander primary health care (PHC) organisations, across three Australian states and one territory, to increase clinical service performance and access to preventive health and health promotion services for preventing, identifying, treating, and managing dementia risk in Aboriginal and Torres Strait Islander communities. Aboriginal participatory action research (APAR) methodology will be the framework for this project, incorporating continuous quality improvement (CQI), informed by research yarning with stakeholder groups, comprising community members and PHC staff and service providers and data collected from the auditing of client health records and the mapping of existing clinical processes and health services at each partnering PHC organisation. The qualitative and quantitative data will be summarised and discussed with stakeholder groups. Priorities will be identified and broken down into tangible PHC organisation deliverable strategies and programs, which will be co-developed with stakeholder groups and implemented cyclically over 24 months using the Plan, Do, Study, Act model of change. Key project outcome measures include increased clinical service performance and availability of preventive health and health promotion services for safeguarding against dementia. Project implementation will be evaluated for quality and transparency from an Indigenous perspective using an appropriate appraisal tool. The project processes, impact, and sustainability will be evaluated using the RE-AIM framework. A dementia safeguarding framework and accompanying tool kit will be developed from this work to support Aboriginal and Torres Strait Islander PHC organisations to identify, implement, and evaluate dementia safeguarding practice and service improvements on a broader scale.

Health services for aboriginal and Torres Strait Islander children in remote Australia: A scoping review

In Australia, there is a significant gap between health outcomes in Indigenous and non-Indigenous children, which may relate to inequity in health service provision, particularly in remote areas. The aim was to conduct a scoping review to identify publications in the academic and grey literature and describe 1) Existing health services for Indigenous children in remote Australia and service use, 2) Workforce challenges in remote settings, 3) Characteristics of an effective health service, and 4) Models of care and solutions. Electronic databases of medical/health literature were searched (Jan 1990 to May 2021). Grey literature was identified through investigation of websites, including of local, state and national health departments. Identified papers (n = 1775) were screened and duplicates removed. Information was extracted and summarised from 116 papers that met review inclusion criteria (70 from electronic medical databases and 45 from the grey literature). This review identified that existing services struggle to meet demand. Barriers to effective child health service delivery in remote Australia include availability of trained staff, limited services, and difficult access. Aboriginal and Community Controlled Health Organisations are effective and should receive increased support including increased training and remuneration for Aboriginal Health Workers. Continuous quality assessment of existing and future programs will improve quality; as will measures that reflect aboriginal ways of knowing and being, that go beyond traditional Key Performance Indicators. Best practice models for service delivery have community leadership and collaboration. Increased resources with a focus on primary prevention and health promotion are essential.

A scoping review to inform the use of continuous quality improvement in Australian Aboriginal oral health care

Objective The need to improve existing services to Aboriginal communities is prioritised by Australia's National Oral Health Plan. Although only an emerging area in dentistry, continuous quality improvement (CQI) approaches have positively impacted the delivery of primary health services to Aboriginal communities. This scoping review maps the applicability of CQI strategies to Aboriginal Australian oral healthcare services. Methods A scoping review was conducted and studies that reported using CQI approaches to improve existing oral health services or quality of care deemed relevant to Aboriginal Australian communities were included. Results A total of 73 articles were retrieved and eight articles were included in the final synthesis. Several CQI tools were identified, including: plan-do-study-act cycles, dental quality alliance measures, prioritisation matrices, causal mapping and the use of collective impact methodology. Conclusion Data exploring CQI in the context of Aboriginal oral health is scarce. The plan-do-study-act cycle and its variations show potential applicability to Aboriginal oral health care. However, for CQI approaches to be adequately implemented, the prevailing model of dental care requires a paradigm shift from quality assurance to quality improvement, acknowledging the impact of structural and process elements on care.

Quality management systems in Aboriginal Community Controlled Health Services: a review of the literature

BACKGROUND

A national accreditation policy for the Australian primary healthcare (PHC) system was initiated in 2008. While certification standards are mandatory, little is known about their effects on the efficiency and sustainability of organisations, particularly in the Aboriginal Community Controlled Health Service (ACCHS) sector.

AIM

The literature review aims to answer the following: to what extent does the implementation of the International Organisation for Standardization 9001:2008 quality management system (QMS) facilitate efficiency and sustainability in the ACCHS sector?

METHODS

Thematic analysis of peer-reviewed and grey literature was undertaken from Australia and New Zealand PHC sector with a focus on First Nations people. The databases searched included Medline, Scopus and three Informit sites (AHB-ATSIS, AEI-ATSIS and AGIS-ATSIS). The initial search strategy included quality improvement, continuous quality improvement, efficiency and sustainability.

RESULTS

Sixteen included studies were assessed for quality using the McMaster criteria. The studies were ranked against the criteria of credibility, transferability, dependability and confirmability. Three central themes emerged: accreditation (n=4), quality improvement (n=9) and systems strengthening (n=3). The accreditation theme included effects on health service expenditure and clinical outcomes, consistency and validity of accreditation standards and linkages to clinical governance frameworks. The quality improvement theme included audit effectiveness and value for specific population health. The theme of systems strengthening included prerequisite systems and embedded clinical governance measures for innovative models of care.

CONCLUSION

The ACCHS sector warrants reliable evidence to understand the value of QMSs and enhancement tools, particularly given ACCHS (client-centric) services and their specialist status. Limited evidence exists for the value of standards on health system sustainability and efficiency in Australia. Despite a mandatory second certification standard, no studies reported on sustainability and efficiency of a QMS in PHC.

Collaboration and knowledge generation in an 18-year quality improvement research programme in Australian Indigenous primary healthcare: a coauthorship network analysis

OBJECTIVES

Though multidisciplinary research networks support the practice and effectiveness of continuous quality improvement (CQI) programmes, their characteristics and development are poorly understood. In this study, we examine publication outputs from a research network in Australian Indigenous primary healthcare (PHC) to assess to what extent the research network changed over time.

SETTING

Australian CQI research network in Indigenous PHC from 2002 to 2019.

PARTICIPANTS

Authors from peer-reviewed journal articles and books published by the network.

DESIGN

Coauthor networks across four phases of the network (2002-2004; 2005-2009; 2010-2014; 2015-2019) were constructed based on author affiliations and examined using social network analysis methods. Descriptive characteristics included organisation types, Indigenous representation, gender, student authorship and thematic research trends.

RESULTS

We identified 128 publications written by 308 individual authors from 79 different organisations. Publications increased in number and diversity over each funding phase. During the final phase, publication outputs accelerated for organisations, students, project officers, Indigenous and female authors. Over time there was also a shift in research themes to encompass new clinical areas and social, environmental or behavioural determinants of health. Average degree (8.1), clustering (0.81) and diameter (3) indicated a well-connected network, with a core-periphery structure in each phase (p≤0.03) rather than a single central organisation (degree centralisation=0.55-0.65). Academic organisations dominated the core structure in all funding phases.

CONCLUSION

Collaboration in publications increased with network consolidation and expansion. Increased productivity was associated with increased authorship diversity and a decentralised network, suggesting these may be important factors in enhancing research impact and advancing the knowledge and practice of CQI in PHC. Publication diversity and growth occurred mainly in the fourth phase, suggesting long-term relationship building among diverse partners is required to facilitate participatory research in CQI. Despite improvements, further work is needed to address inequities in female authorship and Indigenous authorship.

Closing the indigenous health gap in Canada: Results from the TransFORmation of IndiGEnous PrimAry HEAlthcare delivery (FORGE AHEAD) program

AIMS

TransFORmation of IndiGEnous PrimAry HEAlthcare Delivery (FORGE AHEAD) partnered with local clinical and community teams in 11 First Nations (FN) communities across Canada to develop quality improvement (QI) initiatives aimed at improving T2DM.

METHODS

Pre-post mixed-methods case study design was used. The 18-month intervention included community and clinical readiness, development of a community diabetes registry and clinical system, and QI activities. Participants consisted of community members, 18 yrs and older, with diabetes. Changes in clinical outcomes and clinical practice guideline (CPG) recommendations were assessed pre and post intervention using multilevel regression (patients nested within communities) adjusted forindividual andcommunity baseline characteristics.

RESULTS

No significant change in HbA1c orsBP, but a small reduction indBP(-0.75 mmHg, p < 0.05) and LDL (-0.09 mmol/L, p < 0.05) was observed in 2008 adults with T2DM (mean age: 60·5 (SD:14·6) years; female: 57·2%). Individuals not at CPG targets at baseline had significant reductions in: %HbA1c (N = 616): -0.40 (95%CI:-0·55,-0·24),sBP (N = 561): -7·67 mmHg (95%CI:-9·23, -5·72),dBP (N = 291): -7·46 mmHg (95%CI:-8·69, -6·26), LDL (N = 450): -0·37mmo/l (95%CI:-0·44, -0·29).Annual HbA1c (OR: 1·95; 95%CI:1·66, 2·29), BP (OR: 1·78; 95%CI:1·52, 2·09), LDL (OR: 1·27; 95%CI:1·10, 1·47) and CKD screening (OR: 6·37; 95%CI:5·16, 7·92)increased but retinopathy screening decreased (OR: 0·68; 95%CI:0·57, 0·82). No significant change in foot exams (OR: 0·97; 95%CI:0·76, 1·23) or BMI recordings (OR: 0·96; 95%CI:0·82, 1·12) was seen. Overall, individualsweremorelikely to receive ≥75% of CPG recommended services compared to baseline (OR: 1·51; 95%CI:1·27, 1·80).

CONCLUSIONS

FORGE AHEAD is the first Canadian study to demonstrate that a FN community-led QI intervention can lead to diabetes improvements.

Using quality improvement strategies to strengthen regional systems for Aboriginal and Torres Strait Islander eye health in the Northern Territory

PROBLEM

In the Katherine region, Northern Territory, barriers to eye care for Aboriginal and Torres Strait Islander people include unclear eye care referral processes, challenges coordinating patient eye care between various providers, complex socioeconomic determinants and a lengthy outpatient ophthalmology waiting list.

DESIGN

Mixed methods participatory approach using a regional needs analysis, clinical file audit and stakeholder survey, to develop, implement and monitor quality improvement strategies.

SETTING

Collaboration with Aboriginal Community Controlled Health Services and regional eye care stakeholders in the Katherine region.

KEY MEASURES FOR IMPROVEMENT

Clinical audit data captured frequency and rates of primary eye checks, ophthalmology referrals and spectacle prescriptions. A survey was developed and applied to assess stakeholder perspectives of regional eye care systems.

STRATEGY FOR CHANGE

Quality improvement strategies informed by regional data (clinical audits and survey) included increasing service delivery to match eye care needs, primary eye care training for Aboriginal Community Controlled Health Services staff, updating Aboriginal Community Controlled Health Services primary care templates and forming a regional eye care coalition group.

EFFECTS OF CHANGE

Post-implementation, rates and frequency of recorded optometry examinations, number of spectacles prescribed and rates of annual dilated fundus examinations for patients with diabetes increased. There was a decrease in the number of patients with diabetes who had never had an eye examination. Eye care stakeholders perceived a marked improvement in the effectiveness of the regional eye care system.

LESSONS LEARNT

Our findings highlight the importance of engaging services and stakeholders to ensure a systems approach that is evidence-informed, contextually appropriate and reflects commitment to improved eye health outcomes.

Quality improvement of medical records through internal auditing: a comparative analysis

Introduction

The systematic evaluation of the quality of medical records is crucial. Nevertheless, even if the improvement of medical records quality represents a priority for every health organization, it might be difficult to realize.

This is the first study to assess the efficacy of internal audit as a tool to improve the quality of medical records in hospital setting.

Methods

The program was carried out in a third level teaching hospital. Trained ad hoc evaluation teams carried out two retrospective assessments of quality of medical records using a random sampling strategy. The quality assessment was performed using a 48-items evaluation grid divided into 9 domains: General; Patient Medical History and Physical Examination; Daily Clinical Progress Notes; Daily Nursing Progress Notes; Drug Therapy Chart; Pain Chart; Discharge Summary; Surgery Register; Informed Consent. After the first evaluation of 1.460 medical records, an audit departmental program was set up. The second evaluation was carried out after the internal auditing for 1.402 medical records.

Results

Compared to the first analysis, a significant quality amelioration in all the sections of the medical chart was shown with the second analysis, with an increase of all the scores above 50%. The differences found for each section of medical records between the first and second analysis are all significant (p<0.01).

Conclusions

Internal audits are not just measurement activities but a necessary activity to support the organization in achieving its objectives and assessing the quality of clinical care and maintaining high quality professional performance

Using developmental evaluation to support knowledge translation: reflections from a large-scale quality improvement project in Indigenous primary healthcare

BACKGROUND

Developmental evaluation is a growing area of evaluation practice, advocated for informing the adaptive development of change initiatives in complex social environments. The utilisation focus, complexity perspective and systems thinking of developmental evaluation suggest suitability for evaluating knowledge translation initiatives in primary healthcare. However, there are few examples in the literature to guide its use in these contexts and in Indigenous settings. In this paper, we reflect on our experience of using developmental evaluation to implement a large-scale knowledge translation research project in Australian Aboriginal and Torres Strait Islander primary healthcare. Drawing on principles of knowledge translation and key features of developmental evaluation, we debate the key benefits and challenges of applying this approach to engage diverse stakeholders in using aggregated quality improvement data to identify and address persistent gaps in care delivery.

DISCUSSION

The developmental evaluation enabled the team to respond to stakeholder feedback and apply learning in real-time to successfully refine theory-informed research and engagement processes, tailor the presentation of findings to stakeholders and context, and support the project's dissemination and knowledge co-production aim. It thereby contributed to the production of robust, useable research findings for informing policy and system change. The use of developmental evaluation appeared to positively influence stakeholders' use of the project reports and their responses to the findings. Challenges included managing a high volume of evaluation data and multiple evaluation purposes, balancing facilitative sense-making processes and change with task-focused project management, and lack of experience in using this evaluation approach. Use of an embedded evaluator with facilitation skills and background knowledge of the project helped to overcome these challenges, as did similarities observed between features of developmental evaluation and continuous quality improvement.

CONCLUSION

Our experience of developmental evaluation confirmed our expectations of the potential value of this approach for strengthening improvement interventions and implementation research, and particularly for adapting healthcare innovations in Indigenous settings. In our project, developmental evaluation successfully encompassed evaluation, project adaptation, capacity development and knowledge translation. Further work is warranted to apply this approach more widely to improve primary healthcare initiatives and outcomes, and to evaluate implementation research.

Anemia in disadvantaged children aged under five years; quality of care in primary practice

BACKGROUND

Anemia rates are over 60% in disadvantaged children yet there is little information about the quality of anemia care for disadvantaged children.

METHODS

Our primary objective was to assess the burden and quality of anemia care for disadvantaged children and to determine how this varied by age and geographic location. We implemented a cross-sectional study using clinical audit data from 2287 Indigenous children aged 6-59 months attending 109 primary health care centers between 2012 and 2014. Data were analysed using multivariable regression models.

RESULTS

Children aged 6-11 months (164, 41.9%) were less likely to receive anemia care than children aged 12-59 months (963, 56.5%) (adjusted odds ratio [aOR] 0.48, CI 0.35, 0.65). Proportion of children receiving anemia care ranged from 10.2% (92) (advice about 'food security') to 72.8% (728) (nutrition advice). 70.2% of children had a hemoglobin measurement in the last 12 months. Non-remote area families (115, 38.2) were less likely to receive anemia care compared to remote families (1012, 56.4%) (aOR 0.34, CI 0.15, 0.74). 57% (111) aged 6-11 months were diagnosed with anemia compared to 42.8% (163) aged 12-23 months and 22.4% (201) aged 24-59 months. 49% (48.5%, 219) of children with anemia received follow up.

CONCLUSIONS

The burden of anemia and quality of care for disadvantaged Indigenous children was concerning across all remote and urban locations assessed in this study. Improved services are needed for children aged 6-11 months, who are particularly at risk.

Improving developmental care in primary practice for disadvantaged children

Our primary objective was to assess if sustained participation in continuous quality improvement (CQI) activities could improve delivery of 'basic developmental care' to disadvantaged children in primary care settings. Secondary objectives were to assess if delivery of developmental care differed by age and geographic location.Data were analysed using multivariable logistic regression and generalised estimating equations. 109 indigenous primary care centres across Australia from 2012 to 2014 and2466 client files from indigenous children aged 3-59 months were included. Outcome measures were delivery of basic developmental care.We found that the proportion of children who received basic developmental care ranged from 55% (advice about physical and mental stimulation of child) (1279, 55.1%) to 74% (assessment of developmental milestones) (1510, 73.7%). Ninety-three per cent (92.6%, 88) of children received follow-up care. Centres with sustained CQI participation (completed three or more consecutive audit cycles) (508, 53.9%) were twofold more likely to deliver basic developmental care compared with centres without sustained CQI (completed less than three consecutive audit cycles) (118, 31.0%) (adjusted OR (aOR) 2.37, 95% CI 1.33 to 4.23). Children aged 3-11 months (229, 54.9%) were more likely to receive basic developmental care than children aged 24-59 months (151, 38.5%) (aOR 2.42, 95% CI 1.67 to 3.51). Geographic location had little effect (aOR 0.68, 95% CI 0.30 to 1.53). Overall our study found that sustained CQI can improve basic developmental care in primary care settings. However, many disadvantaged children are not receiving services. Improved resourcing of developmental care and CQI in primary care centres is needed.

Implementation of continuous quality improvement in Aboriginal and Torres Strait Islander primary health care in Australia: a scoping systematic review

BACKGROUND

Continuous Quality Improvement (CQI) programs have been taken up widely by Indigenous primary health care (PHC) services in Australia and there has been national policy commitment to support this. However, international evidence shows that implementing CQI is challenging, impacts are variable and little is known about the factors that impede or enhance effectiveness. A scoping review was undertaken to explore uptake and implementation in Indigenous PHC, including barriers and enablers to embedding CQI in routine practice. We provide guidance on how research and evaluation might be intensified to support implementation.

METHODS

Searches were conducted in MEDLINE, CINAHL and the Cochrane Database of Systematic Reviews. Key websites and publications were handsearched. Studies conducted in Indigenous PHC which demonstrated some combination of CQI characteristics and assessed some aspect of implementation were included. A two stage analysis was undertaken. Stage 1 identified the breadth and focus of literature. Stage 2 investigated barriers and enablers. The Framework for Performance Assessment in PHC (2008) was used to frame the analysis. Data were extracted on the study type, approach, timeframes, CQI strategies, barriers and enablers.

RESULTS

Sixty articles were included in Stage 1 and 21 in Stage 2. Barriers to implementing CQI processes relate primarily to professional and organisational processes and operate at multiple levels (individual, team, service, health system) whereas barriers to improved care relate more directly to knowledge of best practice and team processes that facilitate appropriate care. Few studies described implementation timeframes, number of CQI cycles or improvement strategies implemented and only two applied a change theory.

CONCLUSION

Investigating barriers and enablers that modify implementation and impacts of CQI poses conceptual and methodological challenges. More complete description of CQI processes, implementation strategies, and barriers and enablers could enhance capacity for comparisons across settings and contribute to better understanding of key success factors.

Impacts of continuous quality improvement in Aboriginal and Torres Strait islander primary health care in Australia

Purpose Continuous quality improvement (CQI) programmes have been taken up widely by indigenous primary health care services in Australia, but as yet there has not been a systematic assessment of their focus and achievements. A scoping review of the literature from studies of CQI in indigenous primary health care services was undertaken to explore impacts on service systems, care and client outcomes with the aim of providing guidance on future evaluation efforts. The paper aims to discuss these issues, Design/methodology/approach Searches were conducted in MEDLINE, CINAHL and the Cochrane Database of Systematic Reviews to December 2016 and handsearching of key websites and publications. Studies of CQI programs or activities in Indigenous primary health care services which demonstrated some combination of CQI characteristics, as described by Rubenstein (2013) were included. A two-stage approach to analysis was undertaken. Stage 1 identified the range and scope of literature, and Stage 2 investigated impacts to service systems, care and client outcomes. The Framework for Performance Assessment in Primary Health Care was used to frame the Stage 2 analysis. Findings The majority of Aboriginal community controlled health services have been involved in CQI but there are gaps in knowledge about uptake in general practice and government clinics. There are as many baseline studies as studies on impacts over time. Of the 14 studies included for further analysis, 6 reported on impacts on service systems; all 14 reported on impacts on care and 6 on client outcomes. Changes to services systems are variable and studies of impacts on care and client outcomes show promising though uneven improvements. There are no economic studies or studies addressing community engagement in CQI activities. Research limitations/implications To supplement existing limited knowledge about which service system change strategies are effective and sustainable for which problems in which settings, there needs to be investment in research and development. Research needs to be grounded in the realities of service delivery and contribute to the development of CQI capacity at the service level. Knowledge translation needs to be built into implementation to ensure maximum benefit to those endeavouring on a daily basis to constantly reflect on and improve the quality of the care they deliver to clients, and to the stewardship structures supporting services at regional, state/territory and national levels. Practical implications Improved approaches, methods, data capture and reporting arrangements are needed to enhance existing activity and to ensure maximum benefit to services endeavouring to reflect on and improve quality of care and to the stewardship structure supporting services at regional, state/territory and national levels. Originality/value Although there is a growing body of research evidence about CQI both nationally and internationally, and considerable investment by the federal government in Australia to support CQI as part of routine practice, there has not been a systematic assessment of the achievements of CQI in Indigenous primary health care services. Many unanswered questions remain about the extent of uptake, implementation and impacts. This is a barrier to future investment and regional and local programme design, monitoring and evaluation. The authors conducted a scoping review to address these questions. From this, the authors draw conclusions about the state of knowledge in Australia with a view to informing how future CQI research and evaluation might be intensified.

Perspectives of primary health care staff on the implementation of a sexual health quality improvement program: a qualitative study in remote aboriginal communities in Australia

BACKGROUND

Young people living in remote Australian Aboriginal communities experience high rates of sexually transmissible infections (STIs). STRIVE (STIs in Remote communities, ImproVed and Enhanced primary care) was a cluster randomised control trial of a sexual health continuous quality improvement (CQI) program. As part of the trial, qualitative research was conducted to explore staff perceptions of the CQI components, their normalisation and integration into routine practice, and the factors which influenced these processes.

METHODS

In-depth semi-structured interviews were conducted with 41 clinical staff at 22 remote community clinics during 2011-2013. Normalisation process theory was used to frame the analysis of interview data and to provide insights into enablers and barriers to the integration and normalisation of the CQI program and its six specific components.

RESULTS

Of the CQI components, participants reported that the clinical data reports had the highest degree of integration and normalisation. Action plan setting, the Systems Assessment Tool, and the STRIVE coordinator role, were perceived as adding value to the program, but were less readily integrated or normalised. The remaining two components (dedicated funding for health promotion and service incentive payments) were seen as least relevant. Our analysis also highlighted factors which enabled greater integration of the CQI components. These included familiarity with CQI tools, increased accountability of health centre staff and the translation of the CQI program into guideline-driven care. The analysis also identified barriers, including high staff turnover, limited time involved in the program and competing clinical demands and programs.

CONCLUSIONS

Across all of the CQI components, the clinical data reports had the highest degree of integration and normalisation. The action plans, systems assessment tool and the STRIVE coordinator role all complemented the data reports and allowed these components to be translated directly into clinical activity. To ensure their uptake, CQI programs must acknowledge local clinical guidelines, be compatible with translation into clinical activity and have managerial support. Sexual health CQI needs to align with other CQI activities, engage staff and promote accountability through the provision of clinic specific data and regular face-to-face meetings.

TRIAL REGISTRATION

Australian and New Zealand Clinical Trials Registry ACTRN12610000358044 . Registered 6/05/2010. Prospectively Registered.

Continuous Quality Improvement and Comprehensive Primary Health Care: A Systems Framework to Improve Service Quality and Health Outcomes

Continuous quality improvement (CQI) processes for improving clinical care and health outcomes have been implemented by primary health-care services, with resultant health-care impacts. But only 10–20% of gain in health outcomes is contributed by health-care services; a much larger share is determined by social and cultural factors. This perspective paper argues that health care and health outcomes can be enhanced through applying CQI as a systems approach to comprehensive primary health care. Referring to the Aboriginal and Torres Strait Islander Australian context as an example, the authors provide a systems framework that includes strategies and conditions to facilitate evidence-based and local decision making by primary health-care services. The framework describes the integration of CQI vertically to improve linkages with governments and community members and horizontally with other sectors to influence the social and cultural determinants of health. Further, government and primary health-care service investment is required to support and extend integration and evaluation of CQI efforts vertically and horizontally.

Exploring Systems That Support Good Clinical Care in Indigenous Primary Health-care Services: A Retrospective Analysis of Longitudinal Systems Assessment Tool Data from High-Improving Services

BACKGROUND

Continuous Quality Improvement is a process for raising the quality of primary health care (PHC) across Indigenous PHC services. In addition to clinical auditing using plan, do, study, and act cycles, engaging staff in a process of reflecting on systems to support quality care is vital. The One21seventy Systems Assessment Tool (SAT) supports staff to assess systems performance in terms of five key components. This study examines quantitative and qualitative SAT data from five high-improving Indigenous PHC services in northern Australia to understand the systems used to support quality care.

METHODS

High-improving services selected for the study were determined by calculating quality of care indices for Indigenous health services participating in the Audit and Best Practice in Chronic Disease National Research Partnership. Services that reported continuing high improvement in quality of care delivered across two or more audit tools in three or more audits were selected for the study. Precollected SAT data (from annual team SAT meetings) are presented longitudinally using radar plots for quantitative scores for each component, and content analysis is used to describe strengths and weaknesses of performance in each systems' component.

RESULTS

High-improving services were able to demonstrate strong processes for assessing system performance and consistent improvement in systems to support quality care across components. Key strengths in the quality support systems included adequate and orientated workforce, appropriate health system supports, and engagement with other organizations and community, while the weaknesses included lack of service infrastructure, recruitment, retention, and support for staff and additional costs. Qualitative data revealed clear voices from health service staff expressing concerns with performance, and subsequent SAT data provided evidence of changes made to address concerns.

CONCLUSION

Learning from the processes and strengths of high-improving services may be useful as we work with services striving to improve the quality of care provided in other areas.

Wide variation in sexually transmitted infection testing and counselling at Aboriginal primary health care centres in Australia: analysis of longitudinal continuous quality improvement data

BACKGROUND

Chlamydia, gonorrhoea and syphilis are readily treatable sexually transmitted infections (STIs) which continue to occur at high rates in Australia, particularly among Aboriginal Australians. This study aimed to: explore the extent of variation in delivery of recommended STI screening investigations and counselling within Aboriginal primary health care (PHC) centres; identify the factors associated with variation in screening practices; and determine if provision of STI testing and counselling increased with participation in continuous quality improvement (CQI).

METHODS

Preventive health audits (n = 16,086) were conducted at 137 Aboriginal PHC centres participating in the Audit and Best Practice for Chronic Disease Program, 2005-2014. STI testing and counselling data were analysed to determine levels of variation in chlamydia, syphilis and gonorrhoea testing and sexual health discussions. Multilevel logistic regression was used to determine factors associated with higher levels of STI-related service delivery and to quantify variation attributable to health centre and client characteristics.

RESULTS

Significant variation in STI testing and counselling exists among Aboriginal PHC centres with health centre factors accounting for 43% of variation between health centres and jurisdictions. Health centre factors independently associated with higher levels of STI testing and counselling included provision of an adult health check (odds ratio (OR) 3.40; 95% Confidence Interval (CI) 3.07-3.77) and having conducted 1-2 cycles of CQI (OR 1.34; 95% CI 1.16-1.55). Client factors associated with higher levels of STI testing and counselling were being female (OR 1.45; 95% CI 1.33-1.57), Aboriginal (OR 1.46; 95% CI 1.15-1.84) and aged 20-24 years (OR 3.84; 95% CI 3.07-4.80). For females, having a Pap smear test was also associated with STI testing and counselling (OR 4.39; 95% CI 3.84-5.03). There was no clear association between CQI experience beyond two CQI cycles and higher levels of documented delivery of STI testing and counselling services.

CONCLUSIONS

A number of Aboriginal PHC centres are achieving high rates of STI testing and counselling, while a significant number are not. STI-related service delivery could be substantially improved through focussed efforts to support health centres with relatively lower documented evidence of adherence to best practice guidelines.

Delivery of Eye and Vision Services in Aboriginal and Torres Strait Islander Primary Healthcare Centers

Background

Routine eye and vision assessments are vital for the detection and subsequent management of vision loss, which is particularly important for Aboriginal and Torres Strait Islander people who face higher rates of vision loss than other Australians. In order to guide improvements, this paper will describe patterns, variations, and gaps in these eye and vision assessments for Aboriginal and Torres Strait Islander people.

Methods

Clinical audits from 124 primary healthcare centers (sample size 15,175) from five Australian states and territories were conducted during 2005–2012. Main outcome measure was adherence to current guidelines for delivery of eye and vision assessments to adults with diabetes, those without a diagnosed major chronic disease and children attending primary healthcare centers.

Results

Overall delivery of recommended eye and vision assessments varied widely between health centers. Of the adults with diabetes, 46% had a visual acuity assessment recorded within the previous 12 months (health center range 0–88%) and 33% had a retinal examination recorded (health center range 0–73%). Of the adults with no diagnosed major chronic disease, 31% had a visual acuity assessment recorded within the previous 2 years (health center range 0–86%) and 13% had received an examination for trichiasis (health center range 0–40%). In children, 49% had a record of a vision assessment (health center range 0–97%) and 25% had a record of an examination for trachoma within the previous 12 months (health center range 0–100%).

Conclusion

There was considerable range and variation in the recorded delivery of scheduled eye and vision assessments across health centers. Sharing the successful strategies of the better-performing health centers to support focused improvements in key areas of need may increase overall rates of eye examinations, which is important for the timely detection, referral, and treatment of eye conditions affecting Aboriginal and Torres Strait Islander people, especially for those with diabetes.

Leveraging quality improvement through use of the Systems Assessment Tool in Indigenous primary health care services: a mixed methods study

BACKGROUND

Assessment of the quality of primary health care health delivery systems is a vital part of continuous quality improvement (CQI) processes. The Systems Assessment Tool (SAT) was designed to support Indigenous PHC services in assessing and improving their health care systems. It was based on the Assessment of Chronic Illness Care scale, and on practical experience with applying systems assessments in quality improvement in Indigenous primary health care. We describe the development and application of the SAT, report on a survey to assess the utility of the SAT and review the use of the SAT in other CQI research programs.

METHODS

The mixed methods approach involved a review of documents and internal reports relating to experience with use of the SAT since its development in 2002 and a survey of key informants on their experience with using the SAT.

RESULTS

The paper drew from documents and internal reports to describe the SAT development and application in primary health care services from 2002 to 2014. Survey feedback highlighted the benefit to the whole primary health care team from participating in the SAT, bringing to light issues that might not emerge with separate individual tool completion. A majority of respondents reported changes in their health centres as a result of using the SAT. Good organisational and management support assisted with ensuring allocation of time and resources for SAT conduct. Respondents identified the importance of having a skilled, external facilitator.

CONCLUSIONS

Originally designed as a measurement tool, the SAT rapidly evolved to become an important development tool, assisting teams in learning about primary health care system functioning, applying best practice and contributing to team strengthening. It is valued by primary health care centres as a lever in implementing improvements to strengthen centre delivery systems, and has potential for further adaptation and wider application in Australia and internationally.

Improving Health Promotion Using Quality Improvement Techniques in Australian Indigenous Primary Health Care

Although some areas of clinical health care are becoming adept at implementing continuous quality improvement (CQI) projects, there has been limited experimentation of CQI in health promotion. In this study, we examined the impact of a CQI intervention on health promotion in four Australian Indigenous primary health care centers. Our study objectives were to (a) describe the scope and quality of health promotion activities, (b) describe the status of health center system support for health promotion activities, and (c) introduce a CQI intervention and examine the impact on health promotion activities and health centers systems over 2 years. Baseline assessments showed suboptimal health center systems support for health promotion and significant evidence-practice gaps. After two annual CQI cycles, there were improvements in staff understanding of health promotion and systems for planning and documenting health promotion activities had been introduced. Actions to improve best practice health promotion, such as community engagement and intersectoral partnerships, were inhibited by the way health center systems were organized, predominately to support clinical and curative services. These findings suggest that CQI can improve the delivery of evidence-based health promotion by engaging front line health practitioners in decision-making processes about the design/redesign of health center systems to support the delivery of best practice health promotion. However, further and sustained improvements in health promotion will require broader engagement of management, senior staff, and members of the local community to address organizational and policy level barriers.

Developing a best practice pathway to support improvements in Indigenous Australians' mental health and well-being: a qualitative study

OBJECTIVE

There is a need to adapt pathways to care to promote access to mental health services for Indigenous people in Australia. This study explored Indigenous community and service provider perspectives of well-being and ways to promote access to care for Indigenous people at risk of depressive illness.

DESIGN

A participatory action research framework was used to inform the development of an agreed early intervention pathway; thematic analysis

SETTING

2 remote communities in the Northern Territory.

PARTICIPANTS

Using snowball and purposive sampling, 27 service providers and community members with knowledge of the local context and the diverse needs of those at risk of depression were interviewed. 30% of participants were Indigenous. The proposed pathway to care was adapted in response to participant feedback.

RESULTS

The study found that Indigenous mental health and well-being is perceived as multifaceted and strongly linked to cultural identity. It also confirms that there is broad support for promotion of a clear pathway to early intervention. Key identified components of this pathway were the health centre, visiting and community-based services, and local community resources including elders, cultural activities and families. Enablers to early intervention were reported. Significant barriers to the detection and treatment of those at risk of depression were identified, including insufficient resources, negative attitudes and stigma, and limited awareness of support options.

CONCLUSIONS

Successful early intervention for well-being concerns requires improved understanding of Indigenous well-being perspectives and a systematic change in service delivery that promotes integration, flexibility and collaboration between services and the community, and recognises the importance of social determinants in health promotion and the healing process. Such changes require policy support, targeted training and education, and ongoing promotion.

Auditing chronic disease care: Does it make a difference?

Background

An integrated audit tool was developed for five chronic diseases, namely diabetes, hypertension, asthma, chronic obstructive pulmonary disease and epilepsy. Annual audits have been done in the Western Cape Metro district since 2009. The year 2012 was the first year that all six districts in South Africa's Western Cape Province participated in the audit process.

Aim

To determine whether clinical audits improve chronic disease care in health districts over time.

Setting

Western Cape Province, South Africa.

Methods

Internal audits were conducted of primary healthcare facility processes and equipment availability as well as a folder review of 10 folders per chronic condition per facility. Random systematic sampling was used to select the 10 folders for the folder review. Combined data for all facilities gave a provincial overview and allowed for comparison between districts. Analysis was done comparing districts that have been participating in the audit process from 2009 to 2010 (‘2012 old’) to districts that started auditing recently (‘2012 new’).

Results

The number of facilities audited has steadily increased from 29 in 2009 to 129 in 2012. Improvements between different years have been modest, and the overall provincial average seemed worse in 2012 compared to 2011. However, there was an improvement in the ‘2012 old’ districts compared to the ‘2012 new’ districts for both the facility audit and the folder review, including for eight clinical indicators, with ‘2012 new’ districts being less likely to record clinical processes (OR 0.25, 95% CI 0.21–0.31).

Conclusion

These findings are an indication of the value of audits to improve care processes over the long term. It is hoped that this improvement will lead to improved patient outcomes.

Identification, summary and comparison of tools used to measure organizational attributes associated with chronic disease management within primary care settings

RATIONALE, AIMS AND OBJECTIVES

Given the increasing emphasis being placed on managing patients with chronic diseases within primary care, there is a need to better understand which primary care organizational attributes affect the quality of care that patients with chronic diseases receive. This study aimed to identify, summarize and compare data collection tools that describe and measure organizational attributes used within the primary care setting worldwide.

METHODS

Systematic search and review methodology consisting of a comprehensive and exhaustive search that is based on a broad question to identify the best available evidence was employed.

RESULTS

A total of 30 organizational attribute data collection tools that have been used within the primary care setting were identified. The tools varied with respect to overall focus and level of organizational detail captured, theoretical foundations, administration and completion methods, types of questions asked, and the extent to which psychometric property testing had been performed. The tools utilized within the Quality and Costs of Primary Care in Europe study and the Canadian Primary Health Care Practice-Based Surveys were the most recently developed tools. Furthermore, of the 30 tools reviewed, the Canadian Primary Health Care Practice-Based Surveys collected the most information on organizational attributes.

CONCLUSIONS

There is a need to collect primary care organizational attribute information at a national level to better understand factors affecting the quality of chronic disease prevention and management across a given country. The data collection tools identified in this review can be used to establish data collection strategies to collect this important information.

Aboriginal health: agreement between general practitioners and patients on their health risk status and screening history

OBJECTIVE

To examine agreement between patients' self-report and general practitioners' perception of their patients' health risk status and screening history.

METHODS

Patients attending an Aboriginal Community Controlled Health Service self-reported via survey their health risk status and screening history, while waiting to see their general practitioner (GP). Following the consultation the GP completed a corresponding survey. Prevalence rates and rates of agreement using the kappa statistic were calculated for both self-reported and GP-reported risk status for smoking, at-risk alcohol consumption and physical inactivity; and screening history for blood pressure, cholesterol, diabetes and cervical cancer.

RESULTS

Prevalence rates of health risks were similar from self-report versus GP-reported, yet differed on screening history. Patients who identified themselves as being at risk were often not the same as those identified by GPs. Agreement between patient and doctor was substantial for smoking, yet poor for at-risk alcohol consumption and physical inactivity. Agreement was fair for cholesterol and cervical cancer screening, and slight for blood pressure and diabetes screening.

CONCLUSIONS AND IMPLICATIONS

This study suggests that for effective preventive care, using self-report for some health risks may be reliable, but less so for screening history. Greater assistance is needed in primary health care settings to identify patients who are at risk.

Improvement in rheumatic fever and rheumatic heart disease management and prevention using a health centre-based continuous quality improvement approach

BACKGROUND

Rheumatic heart disease (RHD) remains a major health concern for Aboriginal Australians. A key component of RHD control is prevention of recurrent acute rheumatic fever (ARF) using long-term secondary prophylaxis with intramuscular benzathine penicillin (BPG). This is the most important and cost-effective step in RHD control. However, there are significant challenges to effective implementation of secondary prophylaxis programs. This project aimed to increase understanding and improve quality of RHD care through development and implementation of a continuous quality improvement (CQI) strategy.

METHODS

We used a CQI strategy to promote implementation of national best-practice ARF/RHD management guidelines at primary health care level in Indigenous communities of the Northern Territory (NT), Australia, 2008-2010. Participatory action research methods were employed to identify system barriers to delivery of high quality care. This entailed facilitated discussion with primary care staff aided by a system assessment tool (SAT). Participants were encouraged to develop and implement strategies to overcome identified barriers, including better record-keeping, triage systems and strategies for patient follow-up. To assess performance, clinical records were audited at baseline, then annually for two years. Key performance indicators included proportion of people receiving adequate secondary prophylaxis (≥80% of scheduled 4-weekly penicillin injections) and quality of documentation.

RESULTS

Six health centres participated, servicing approximately 154 people with ARF/RHD. Improvements occurred in indicators of service delivery including proportion of people receiving ≥40% of their scheduled BPG (increasing from 81/116 [70%] at baseline to 84/103 [82%] in year three, p = 0.04), proportion of people reviewed by a doctor within the past two years (112/154 [73%] and 134/156 [86%], p = 0.003), and proportion of people who received influenza vaccination (57/154 [37%] to 86/156 [55%], p = 0.001). However, the proportion receiving ≥80% of scheduled BPG did not change. Documentation in medical files improved: ARF episode documentation increased from 31/55 (56%) to 50/62 (81%) (p = 0.004), and RHD risk category documentation from 87/154 (56%) to 103/145 (76%) (p < 0.001). Large differences in performance were noted between health centres, reflected to some extent in SAT scores.

CONCLUSIONS

A CQI process using a systems approach and participatory action research methodology can significantly improve delivery of ARF/RHD care.

Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change

Background

Variation in effectiveness of continuous quality improvement (CQI) interventions between services is commonly reported, but with little explanation of how contextual and other factors may interact to produce this variation. Therefore, there is scant information available on which policy makers can draw to inform effective implementation in different settings. In this paper, we explore how patterns of change in delivery of services may have been achieved in a diverse range of health centers participating in a wide-scale program to achieve improvements in quality of care for Indigenous Australians.

Methods

We elicited key informants’ interpretations of factors explaining patterns of change in delivery of guideline-scheduled services over three or more years of a wide-scale CQI project, and inductively analyzed these interpretations to propose fine-grained realist hypotheses about what works for whom and in what circumstances. Data were derived from annual clinical audits from 36 health centers operating in diverse settings, quarterly project monitoring reports, and workshops with 12 key informants who had key roles in project implementation. We abstracted potential context-mechanism-outcome configurations from the data, and based on these, identified potential program-strengthening strategies.

Results

Several context-specific, mechanism-based explanations for effectiveness of this CQI project were identified. These were collective valuing of clinical data for improvement purposes; collective efficacy; and organizational change towards a population health orientation. Health centers with strong central management of CQI, and those in which CQI efforts were more dependent on local health center initiative and were adapted to resonate with local priorities were both favorable contexts for collective valuing of clinical data. Where health centers had prior positive experiences of collaboration, effects appeared to be achieved at least partly through the mechanism of collective efficacy. Strong community linkages, staff ability to identify with patients, and staff having the skills and support to take broad ranging action, were favorable contexts for the mechanism of increased population health orientation.

Conclusions

Our study provides evidence to support strategies for program strengthening described in the literature, and extends the understanding of mechanisms through which strategies may be effective in achieving particular outcomes in different contexts.

Do competing demands of physical illness in type 2 diabetes influence depression screening, documentation and management in primary care: a cross-sectional analytic study in Aboriginal and Torres Strait Islander primary health care settings

Background

Relatively little is known about how depression amongst people with chronic illness is identified and managed in diverse primary health care settings. We evaluated the role of complex physical needs in influencing current practice of depression screening, documentation and antidepressant prescriptions during a 12-month period, among adults with Type 2 diabetes attending Aboriginal and Torres Strait Islander primary care health centres in Australia.

Methods

We analysed clinical audit data from 44 health centres participating in a continuous quality improvement initiative, using previously reported standard sampling and data extraction protocols. Eligible patients were those with Type 2 diabetes with health centre attendance within the past 12 months. We compared current practice in depression screening, documentation and antidepressant prescription between patients with different disease severity and co-morbidity. We used random effects multiple logistic regression models to adjust for potential confounders and for clustering by health centre.

Results

Among the 1174 patients with diabetes included, median time since diagnosis was 7 years, 19% of patients had a co-existing diagnosis of Ischaemic Heart Disease and 1/3 had renal disease. Some 70% of patients had HbAc1>7.0%; 65% had cholesterol >4.0 mmol1-1 and 64% had blood pressure>130/80 mmHg. Documentation of screening for depression and of diagnosed depression were low overall (5% and 6% respectively) and lower for patients with renal disease (Adjusted odds ratio [AOR] 0.21; 95% confidence interval [CI] 0.14 to 0.31 and AOR 0.34; 95% CI 0.15 to 0.75), and for those with poorly controlled disease (HbA1c>7.00 (AOR 0.40; 95% CI 0.23 to 0.68 and AOR 0.51; 95% CI 0.30 to 84)). Screening for depression was lower for those on pharmaceutical treatment for glycaemic control compared to those not on such treatment. Antidepressant prescription was not associated with level of diabetes control or disease severity.

Conclusions

Background levels of depression screening and documentation were low overall and significantly lower for patients with greater disease severity. Strategies to improve depression care for vulnerable populations are urgently required. An important first step in the Australian Indigenous primary care context is to identify and address barriers to the use of current clinical guidelines for depression screening and care.

Telemedicine and ocular health in diabetes mellitus

Teleretinal/teleophthalmological programs that use existing health information technology infrastructure solutions for people with diabetes increase access to and adherence to appropriate eye care. Teleophthalmological studies indicate that the single act of patients viewing their own retinal images improves self-management behaviour and clinical outcomes. In some settings this can be done at lower cost and with improved visual outcomes compared with standard eye care. Cost-effective and sustainable teleretinal surveillance for detection of diabetic retinopathy requires a combination of an inexpensive portable device for taking low light-level retinal images without the use of pharmacological dilation of the pupil and a computer-assisted methodology for rapidly detecting and diagnosing diabetic retinopathy. A more holistic telehealth-care paradigm augmented with the use of health information technology, medical devices, mobile phone and mobile health applications and software applications to improve health-care co-ordination, self-care management and education can significantly impact a broad range of health outcomes, including prevention of diabetes-associated visual loss. This approach will require a collaborative, transformational, patient-centred health-care program that integrates data from medical record systems with remote monitoring of data and a longitudinal health record. This includes data associated with social media applications and personal mobile health technology and should support continuous interactions between the patient, health-care team and the patient's social environment. Taken together, this system will deliver contextually and temporally relevant decision support to patients to facilitate their well-being and to reduce the risk of diabetic complications.

Applying what works: a systematic search of the transfer and implementation of promising Indigenous Australian health services and programs

BACKGROUND

The transfer and implementation of acceptable and effective health services, programs and innovations across settings provides an important and potentially cost-effective strategy for reducing Indigenous Australians' high burden of disease. This study reports a systematic review of Indigenous health services, programs and innovations to examine the extent to which studies considered processes of transfer and implementation within and across Indigenous communities and healthcare settings.

METHODS

Medline, Informit, Infotrac, Blackwells Publishing, Proquest, Taylor and Francis, JStor, and the Indigenous HealthInfoNet were searched using terms: Aborigin* OR Indigen* OR Torres AND health AND service OR program* OR intervention AND Australia to locate publications from 1992-2011. The reference lists of 19 reviews were also checked. Data from peer reviewed journals, reports, and websites were included. The 95% confidence intervals (95% CI) for proportions that referred to and focussed on transfer were calculated as exact binomial confidence intervals. Test comparisons between proportions were calculated using Fisher's exact test with an alpha level of 5%.

RESULTS

Of 1311 publications identified, 119 (9.1%; 95% CI: 7.6%-10.8%) referred to the transfer and implementation of Indigenous Australian health services or programs, but only 21 studies (1.6%; 95% CI: 1.0%-2.4%) actually focused on transfer and implementation. Of the 119 transfer studies, 37 (31.1%; 95% CI: 22.9-40.2%) evaluated the impact of a service or program, 28 (23.5%; 95% CI: 16.2%-32.2%) reported only process measures and 54 were descriptive. Of the 37 impact evaluation studies, 28 (75.7%; 95% CI: 58.8%-88.2%) appeared in peer reviewed journals but none included experimental designs.

CONCLUSION

While services and programs are being transferred and implemented, few studies focus on the process by which this occurred or the effectiveness of the service or program in the new setting. Findings highlight a need for partnerships between researchers and health services to evaluate the transfer and implementation of Indigenous health services and programs using rigorous designs, and publish such efforts in peer-reviewed journals as a quality assurance mechanism.

Optimal type 2 diabetes mellitus management: the randomised controlled OPTIMISE benchmarking study: baseline results from six European countries

BACKGROUND

Micro- and macrovascular complications of type 2 diabetes have an adverse impact on survival, quality of life and healthcare costs. The OPTIMISE (OPtimal Type 2 dIabetes Management Including benchmarking and Standard trEatment) trial comparing physicians' individual performances with a peer group evaluates the hypothesis that benchmarking, using assessments of change in three critical quality indicators of vascular risk: glycated haemoglobin (HbA1c), low-density lipoprotein-cholesterol (LDL-C) and systolic blood pressure (SBP), may improve quality of care in type 2 diabetes in the primary care setting.

DESIGN

This was a randomised, controlled study of 3980 patients with type 2 diabetes.

METHODS

Six European countries participated in the OPTIMISE study (NCT00681850). Quality of care was assessed by the percentage of patients achieving pre-set targets for the three critical quality indicators over 12 months. Physicians were randomly assigned to receive either benchmarked or non-benchmarked feedback. All physicians received feedback on six of their patients' modifiable outcome indicators (HbA1c, fasting glycaemia, total cholesterol, high-density lipoprotein-cholesterol (HDL-C), LDL-C and triglycerides). Physicians in the benchmarking group additionally received information on levels of control achieved for the three critical quality indicators compared with colleagues.

RESULTS

At baseline, the percentage of evaluable patients (N = 3980) achieving pre-set targets was 51.2% (HbA1c; n = 2028/3964); 34.9% (LDL-C; n = 1350/3865); 27.3% (systolic blood pressure; n = 911/3337).

CONCLUSIONS

OPTIMISE confirms that target achievement in the primary care setting is suboptimal for all three critical quality indicators. This represents an unmet but modifiable need to revisit the mechanisms and management of improving care in type 2 diabetes. OPTIMISE will help to assess whether benchmarking is a useful clinical tool for improving outcomes in type 2 diabetes.

Integrated care for chronic conditions: the contribution of the ICCC Framework

OBJECTIVE

The aim of this research is to highlight the current relevance of the Innovative Care for Chronic Conditions (ICCC) Framework, as a model for change in health systems towards better care for chronic conditions, as well as to assess its impact on health policy development and healthcare redesign to date.

METHODS

The authors reviewed the literature to identify initiatives designed and implemented following the ICCC Framework. They also reviewed the evidence on the effectiveness, cost-effectiveness and feasibility of the ICCC and the earlier Chronic Care Model (CCM) that inspired it.

RESULTS

The ICCC Framework has inspired a wide range of types of intervention and has been applied in a number of countries with diverse healthcare systems and socioeconomic contexts. The available evidence supports the effectiveness of this framework's components, although no study explicitly assessing its comprehensive implementation at a health system level has been found.

CONCLUSIONS

As awareness of the need to reorient health systems towards better care for chronic patients grows, there is great potential for the ICCC Framework to serve as a road map for transformation, with its special emphasis on integration, and on the role of the community and of a positive political environment.

Integrating treatment for mental and physical disorders and substance misuse in Indigenous primary care settings

OBJECTIVE

Australian Indigenous peoples in remote and rural settings continue to have limited access to treatment for mental illness. Comorbid disorders complicate presentations in primary care where Indigenous youths and perinatal women are at particular risk. Despite this high comorbidity there are few examples of successful models of integrated treatment. This paper outlines these challenges and provides recommendations for practice that derive from recent developments in the Northern Territory.

CONCLUSIONS

There is a strong need to develop evidence for the effectiveness of integrated and culturally informed individual and service level interventions. We describe the Best practice in Early intervention Assessment and Treatment of depression and substance misuse study which seeks to address this need.

Variation in quality of preventive care for well adults in Indigenous community health centres in Australia

BACKGROUND

Early onset and high prevalence of chronic disease among Indigenous Australians call for action on prevention. However, there is deficiency of information on the extent to which preventive services are delivered in Indigenous communities. This study examined the variation in quality of preventive care for well adults attending Indigenous community health centres in Australia.

METHODS

During 2005-2009, clinical audits were conducted on a random sample (stratified by age and sex) of records of adults with no known chronic disease in 62 Indigenous community health centres in four Australian States/Territories (sample size 1839).

MAIN OUTCOME MEASURES

i) adherence to delivery of guideline-scheduled services within the previous 24 months, including basic measurements, laboratory investigations, oral health checks, and brief intervention on lifestyle modification; and ii) follow-up of abnormal findings.

RESULTS

Overall delivery of guideline-scheduled preventive services varied widely between health centres (range 5-74%). Documentation of abnormal blood pressure reading ([greater than or equal to]140/90 mmHg), proteinuria and abnormal blood glucose ([greater than or equal to]5.5 mmol/L) was found to range between 0 and > 90% at the health centre level. A similarly wide range was found between health centres for documented follow up check/test or management plan for people documented to have an abnormal clinical finding. Health centre level characteristics explained 13-47% of variation in documented preventive care, and the remaining variation was explained by client level characteristics.

CONCLUSIONS

There is substantial room to improve preventive care for well adults in Indigenous primary care settings. Understanding of health centre and client level factors affecting variation in the care should assist clinicians, managers and policy makers to develop strategies to improve quality of preventive care in Indigenous communities.

Assessing quality of diabetes care and its variation in Aboriginal community health centres in Australia

BACKGROUND

Examining variation in diabetes care across regions/organizations provides insight into underlying factors related to quality of care. The aims of this study were to assess quality of diabetes care and its variation among Aboriginal community health centres in Australia, and to estimate partitioning of variation attributable to health centre and individual patient characteristics.

METHODS

During 2005-2009, clinical medical audits were conducted in 62 Aboriginal community health centres from four states/territories. Main outcome measures include adherence to guidelines-scheduled processes of diabetes care, treatment and medication adjustment, and control of HbA(1c), blood pressure, total cholesterol and albumin/creatinine ratio (ACR).

RESULTS

Wide variation was observed across different categories of diabetes care measures and across centres: (1) overall adherence to delivery of services averaged 57% (range 22-83% across centres); (2) medication adjustment rates after elevated HbA(1c): 26% (0-72%); and (3) proportions of patients with HbA(1c) < 7%:27% (0-55%); with blood pressure < 130/80 mmHg: 36% (0-59%). Health centre level characteristics accounted for 36% of the total variation in adherence to process measures, and 3-11% of the total variation in patient intermediate outcomes; the remaining, substantial amount of variation in each measure was attributable to patient level characteristics.

CONCLUSIONS

Deficiencies in a range of quality of care measures provide multiple opportunities for improvement. The majority of variation in quality of diabetes care appears to be attributable to patient level characteristics. Further understanding of factors affecting variation in the care of individuals should assist clinicians, managers and policy makers to develop strategies to improve quality of diabetes care in Aboriginal communities.

Understanding uptake of continuous quality improvement in Indigenous primary health care: lessons from a multi-site case study of the Audit and Best Practice for Chronic Disease project

Background

Experimentation with continuous quality improvement (CQI) processes is well underway in Indigenous Australian primary health care. To date, little research into how health organizations take up, support, and embed these complex innovations is available on which services can draw to inform implementation. In this paper, we examine the practices and processes in the policy and organisational contexts, and aim to explore the ways in which they interact to support and/or hinder services' participation in a large scale Indigenous primary health care CQI program.

Methods

We took a theory-driven approach, drawing on literature on the theory and effectiveness of CQI systems and the Greenhalgh diffusion of innovation framework. Data included routinely collected regional and service profile data; uptake of tools and progress through the first CQI cycle, and data collected quarterly from hub coordinators on their perceptions of barriers and enablers. A total of 48 interviews were also conducted with key people involved in the development, dissemination, and implementation of the Audit and Best Practice for Chronic Disease (ABCD) project. We compiled the various data, conducted thematic analyses, and developed an in-depth narrative account of the processes of uptake and diffusion into services.

Results

Uptake of CQI was a complex and messy process that happened in fits and starts, was often characterised by conflicts and tensions, and was iterative, reactive, and transformational. Despite initial enthusiasm, the mixed successes during the first cycle were associated with the interaction of features of the environment, the service, the quality improvement process, and the stakeholders, which operated to produce a set of circumstances that either inhibited or enabled the process of change. Organisations had different levels of capacity to mobilize resources that could shift the balance toward supporting implementation. Different forms of leadership and organisational linkages were critical to success. The Greenhalgh framework provided a useful starting point for investigation, but we believe it is more a descriptive than explanatory model. As such, it has limitations in the extent to which it could assist us in understanding the interactions of the practices and processes that we observed at different levels of the system.

Summary

Taking up CQI involved engaging multiple stakeholders in new relationships that could support services to construct shared meaning and purpose, operationalise key concepts and tools, and develop and embed new practices into services systems and routines. Promoting quality improvement requires a system approach and organization-wide commitment. At the organization level, a formal high-level mandate, leadership at all levels, and resources to support implementation are needed. At the broader system level, governance arrangements that can fulfil a number of policy objectives related to articulating the linkages between CQI and other aspects of the regulatory, financing, and performance frameworks within the health system would help define a role and vision for quality improvement.