CareTrack Australia: assessing the appropriateness of adult healthcare: protocol for a retrospective medical record review

Developing realistic benchmarks for glaucoma care delivery

CLINICAL RELEVANCE

Realistic benchmarks can serve as comparators for optometrists wishing to engage in clinical practice audits of their glaucoma care.

BACKGROUND

The iCareTrack study established the appropriateness of glaucoma care delivery through clinical record audits of Australian optometry practices. Benchmarks required for monitoring and improving glaucoma care delivery do not exist. This study developed realistic benchmarks for glaucoma care and then benchmarked the performance of practices from the iCareTrack study to establish aspects of care that warrant attention from quality improvement initiatives.

METHODS

Benchmarks were developed from the pre-existing iCareTrack dataset using the Achievable Benchmarks of Care (ABC) method. The iCareTrack study had audited the appropriateness of glaucoma care delivery against 37 clinical indicators for 420 randomly sampled glaucoma patient records from 42 Australian optometry practices. The four-step ABC method calculates benchmarks based on the top 10% of best-performing practices adjusted for low patient encounter numbers. iCareTrack results were compared to the benchmarks to explore the distribution of practices that were at, above or below benchmark.

RESULTS

Benchmarks were developed for 34 of 37 iCareTrack indicators. For 26 (of 34) indicators, the benchmarks were at or above 90% appropriateness. The benchmarks for 14 (of 34) iCareTrack indicators were met by more than 80% of eligible practices, indicating excellent performance. Some aspects of glaucoma care such as peripheral anterior angle assessment, applanation tonometry, and visual field assessment appeared to be delivered sub-optimally by optometrists when compared to the benchmarks.

CONCLUSION

This study established benchmarks for glaucoma care delivery in optometry practices that reflect realistic and top achievable performance. The large number of indicators with benchmarks above 90% confirmed that glaucoma care can and should be delivered by optometrists at very high levels of appropriateness. Benchmarking identified pockets of sub-optimal performance that can now be targeted by quality improvement initiatives.

What is appropriate care? A qualitative study into the perceptions of healthcare professionals in Flemish university hospital intensive care units

Aim

This study examines when healthcare professionals consider intensive care as appropriate care.

Background

Despite attempts to conceptualize appropriate care in prior research, there is a lack of insight into its meaning and implementation in practice. This is an important issue because healthcare professionals as well as patients and relatives report inappropriate care in the intensive care unit (ICU) on a regular basis.

Methods

A qualitative study was designed, based on principles of grounded theory. Seventeen semi-structured interviews were conducted with nurses, doctors and doctors in training from three Flemish university hospitals. Analyses followed the Quagol method; insights were gained by means of the constant comparative method.

Results

Healthcare professionals described appropriate care as socially sustainable care, high-quality care, patient-oriented care, dignified care and meaningful care. They considered it important that care is not only proportional to the expected survival and quality of life of the patient and in line with the patient's or relatives' wishes, but also that the pursuit of the care goals is proportional to the patient's suffering.Although healthcare professionals indicated the same elements of appropriate care, they were defined and interpreted in individual and therefore different ways. This diversity lies at the basis of fields of tension and frustrations among healthcare professionals.

Conclusion

Appropriate care is defined and interpreted in individual and therefore different ways. In order to decide which type of care is appropriate for a specific patient, a process of open and constructive communication in a team is recommended.

Designing Clinical Indicators for Common Residential Aged Care Conditions and Processes of Care: The CareTrack Aged Development and Validation Study

BACKGROUND

People who live in aged care homes have high rates of illness and frailty. Providing evidence-based care to this population is vital to ensure the highest possible quality of life. This study (CareTrack Aged, CT Aged) aimed to develop a comprehensive set of clinical indicators for guideline-adherent, appropriate care of commonly managed conditions and processes of care in aged care.

METHODS

Indicators were formulated from recommendations found through systematic searches of Australian and international clinical practice guidelines (CPGs). Experts reviewed the indicators using a multi-round modified Delphi process to develop consensus on what constitutes appropriate care.

RESULTS

From 139 CPGs, 5,609 recommendations were used to draft 630 indicators. Clinical experts (n=41) reviewed the indicators over two rounds. A final set of 236 indicators resulted, mapped to 16 conditions and processes of care. The conditions and processes were admission assessment; bladder and bowel problems; cognitive impairment; depression; dysphagia and aspiration; end of life/palliative care; hearing and vision; infection; medication; mobility and falls; nutrition and hydration; oral and dental care; pain; restraint use; skin integrity; and sleep.

CONCLUSIONS

The suite of CT Aged clinical indicators can be used for research, assessment of quality of care in individual facilities and across organisations to guide improvement, and to supplement regulation or accreditation of the aged care sector. They are a step forward for Australian and international aged care sectors, helping to improve transparency, so that the level of care delivered to aged care consumers can be rigorously monitored and continuously improved.

The appropriateness of and barriers to glaucoma care delivery by Australian optometrists

CLINICAL RELEVANCE

Establishing the level of appropriateness and barriers to glaucoma care delivery by Australian optometrists are important first steps in developing tailored interventions aimed at improving glaucoma care delivery.

BACKGROUND

To determine the appropriateness of and barriers to glaucoma care by optometrists.

METHODS

A mixed method study was conducted. Phase I was a retrospective cross-sectional medical record audit that assessed glaucoma care appropriateness against 37 clinical indicators from a nationally representative sample of 42 optometry practices. In Phase II, focus groups and interviews involving 31 optometrists explored audit findings to identify barriers to appropriate glaucoma care. Barriers were analysed by deductive and inductive qualitative analysis. Saliency analysis was used to identify key domains that influence glaucoma care.

RESULTS

Appropriate glaucoma care was delivered for 63% (95% CI 61%, 64%) of the 420 patient encounters audited. Appropriate care was delivered above 80% for most (57%) indicators, while 14 (38%) indicators were delivered below 60% appropriateness. Good compliance to appropriate care was noted for key indicators of intraocular pressure measurement (90%, 95% CI 87%, 93%) and optic nerve head/retinal nerve fibre layer imaging (78%, 95% CI 74%, 82%). Important barriers identified were beliefs about expected outcomes, lack of perceived relevancy, time constraints, poor organisational culture, knowledge gaps, focusing on some aspects of glaucoma care to the detriment of others, the complexity of glaucoma care, information recall, and social norms.

CONCLUSION

Glaucoma care was appropriate in most patient encounters, with opportunity to improve some aspects of history taking and physical examinations. Barriers to glaucoma care were diverse, existing at both the practitioner and organisational levels. These findings provide direction for the development of a tailored improvement intervention.

Knowledge translation for the everyday optometrist

A gap exists between best evidence and actual clinical care provided to patients. The advent of evidence-based practice was meant to address this gap by providing practitioners with a method to search, evaluate and incorporate evidence into practice. However, the gap continues to exist. The health research fields of knowledge translation and implementation science have evolved over the last few decades to assist practitioners in embedding research findings and best evidence into routine practice. Knowledge translation seeks to improve public health outcomes by facilitating the movement of best evidence from the bench to clinical practice. Implementation science is the study of methods to integrate research findings and evidence-based practice into routine practice. This literature review aims to revisit the concepts of evidence-based practice and to introduce knowledge translation and implementation science by exploring their roles and influences in the delivery of appropriate glaucoma care by optometrists.

Characterising the types of paediatric adverse events detected by the global trigger tool – CareTrack Kids

Introduction

A common method of learning about adverse events (AEs) is by reviewing medical records using the global trigger tool (GTT). However, these studies generally report rates of harm. The aim of this study is to characterise paediatric AEs detected by the GTT using descriptive and qualitative approaches.

Methods

Medical records of children aged 0–15 were reviewed for presence of harm using the GTT. Records from 2012–2013 were sampled from hospital inpatients, emergency departments, general practice and specialist paediatric practices in three Australian states. Nurses undertook a review of each record and if an AE was suspected a doctor performed a verification review of a summary created by the nurse. A qualitative content analysis was undertaken on the summary of verified AEs.

Results

A total of 232 AEs were detected from 6,689 records reviewed. Over four-fifths of the AEs (193/232, 83%) resulted in minor harm to the patient. Nearly half (112/232, 48%) related to medication/intravenous (IV) fluids. Of these, 83% (93/112) were adverse drug reactions. Problems with medical devices/equipment were the next most frequent with nearly two-thirds (32/51, 63%) of these related to intravenous devices. Problems associated with clinical processes/procedures comprise one in six AEs (38/232, 16%), of which diagnostic problems (12/38, 32%) and procedural complications (11/38, 29%) were the most frequent.

Conclusion

Adverse drug reactions and issues with IVs are frequently identified AEs reflecting their common use in paediatrics. The qualitative approach taken in this study allowed AE types to be characterised, which is a prerequisite for developing and prioritising improvements in practice.

The quality of preventive care for pre-school aged children in Australian general practice

BACKGROUND

Variable and poor care quality are important causes of preventable patient harm. Many patients receive less than recommended care, but the extent of the problem remains largely unknown. The CareTrack Kids (CTK) research programme sought to address this evidence gap by developing a set of indicators to measure the quality of care for common paediatric conditions. In this study, we focus on one clinical area, 'preventive care' for pre-school aged children. Our objectives were two-fold: (i) develop and validate preventive care quality indicators and (ii) apply them in general medical practice to measure adherence.

METHODS

Clinical experts (n = 6) developed indicator questions (IQs) from clinical practice guideline (CPG) recommendations using a multi-stage modified Delphi process, which were pilot tested in general practice. The medical records of Australian children (n = 976) from general practices (n = 80) in Queensland, New South Wales and South Australia identified as having a consultation for one of 17 CTK conditions of interest were retrospectively reviewed by trained paediatric nurses. Statistical analyses were performed to estimate percentage compliance and its 95% confidence intervals.

RESULTS

IQs (n = 43) and eight care 'bundles' were developed and validated. Care was delivered in line with the IQs in 43.3% of eligible healthcare encounters (95% CI 30.5-56.7). The bundles of care with the highest compliance were 'immunisation' (80.1%, 95% CI 65.7-90.4), 'anthropometric measurements' (52.7%, 95% CI 35.6-69.4) and 'nutrition assessments' (38.5%, 95% CI 24.3-54.3), and lowest for 'visual assessment' (17.9%, 95% CI 8.2-31.9), 'musculoskeletal examinations' (24.4%, 95% CI 13.1-39.1) and 'cardiovascular examinations' (30.9%, 95% CI 12.3-55.5).

CONCLUSIONS

This study is the first known attempt to develop specific preventive care quality indicators and measure their delivery to Australian children in general practice. Our findings that preventive care is not reliably delivered to all Australian children and that there is substantial variation in adherence with the IQs provide a starting point for clinicians, researchers and policy makers when considering how the gap between recommended and actual care may be narrowed. The findings may also help inform the development of specific improvement interventions, incentives and national standards.

CareTrack Aged: the appropriateness of care delivered to Australians living in residential aged care facilities: a study protocol

INTRODUCTION

The aged population is increasing rapidly across the world and this is expected to continue. People living in residential aged care facilities (RACFs) represent amongst the sickest and frailest cohort of the aged population, with a high prevalence of chronic conditions and complex comorbidities. Given the vulnerability of RACF residents and the demands on the system, there is a need to determine the extent that care is delivered in line with best practice ('appropriate care') in RACFs. There is also a recognition that systems should provide care that optimises quality of life (QoL), which includes support for physical and psychological well-being, independence, social relationships, personal beliefs and a caring external environment. The aims of CareTrack Aged are to develop sets of indicators for appropriate care and processes of care for commonly managed conditions, and then assess the appropriateness of care delivered and QoL of residents in RACFs in Australia.

METHODS AND ANALYSIS

We will extract recommendations from clinical practice guidelines and, using expert review, convert these into sets of indicators for 15 common conditions and processes of care for people living in RACFs. We will recruit RACFs in three Australian states, and residents within these RACFs, using a stratified multistage sampling method. Experienced nurses, trained in the CareTrack Aged methods ('surveyors'), will review care records of recruited residents within a 1-month period in 2019 and 2020, and assess the care documented against the indicators of appropriate care. Surveyors will concurrently assess residents' QoL using validated questionnaires.

ETHICS AND DISSEMINATION

The study has been reviewed and approved by the Human Research Ethics Committee of Macquarie University (5201800386). The research findings will be published in international and national journals and disseminated through conferences and presentations to interested stakeholder groups, including consumers, national agencies, healthcare professionals, policymakers and researchers.

Can the appropriateness of eye care be measured through cross-sectional retrospective patient record review in eye care practices in Australia? The iCareTrack feasibility study

OBJECTIVES

The CareTrack study found that a wide range of appropriateness of care (ie, care in line with evidence-based or consensus-based guidelines) was delivered across many health conditions in Australia. This study therefore aimed to demonstrate the feasibility of using the CareTrack method (a retrospective onsite record review) to measure the appropriateness of eye care delivery.

DESIGN

Cross-sectional feasibility study.

SETTING AND PARTICIPANTS

Two hundred and thirteen patient records randomly selected from eight optometry and ophthalmology practices in Australia, selected through a combination of convenience and maximum variation sampling.

METHODS

Retrospective record review designed to assess the alignment between eye care delivered and 93 clinical indicators (Delphi method involving 11 experts) extracted from evidence-based clinical practice guidelines.

PRIMARY OUTCOME MEASURE

Number of eligible patient records, sampling rates and data collection time. This feasibility study also tested the ability of 93 clinical indicators to measure percentage appropriate eye care for preventative, glaucoma and diabetic eye care. A secondary outcome was the percentage of practitioner-patient encounters at which appropriate eye care was received.

RESULTS

A median of 20 records (range 9 to 63) per practice were reviewed. Data collection time ranged from 3 to 5.5 hours (median 3.5). The most effective sampling strategy involved random letter generation followed by sequential sampling. The appropriateness of care was 69% (95% CI 67% to 70%) for preventative eye care, 60% (95% CI 56% to 58%) for glaucoma and 63% (95% CI 57% to 69%) for diabetic eye care.

CONCLUSIONS

Appropriateness of eye care can be measured effectively using retrospective record review of eye care practices and consensus-based care indicators.

Clinical indicators for common paediatric conditions: Processes, provenance and products of the CareTrack Kids study

BACKGROUND

In order to determine the extent to which care delivered to children is appropriate (in line with evidence-based care and/or clinical practice guidelines (CPGs)) in Australia, we developed a set of clinical indicators for 21 common paediatric medical conditions for use across a range of primary, secondary and tertiary healthcare practice facilities.

METHODS

Clinical indicators were extracted from recommendations found through systematic searches of national and international guidelines, and formatted with explicit criteria for inclusion, exclusion, time frame and setting. Experts reviewed the indicators using a multi-round modified Delphi process and collaborative online wiki to develop consensus on what constituted appropriate care.

RESULTS

From 121 clinical practice guidelines, 1098 recommendations were used to draft 451 proposed appropriateness indicators. In total, 61 experts (n = 24 internal reviewers, n = 37 external reviewers) reviewed these indicators over 40 weeks. A final set of 234 indicators resulted, from which 597 indicator items were derived suitable for medical record audit. Most indicator items were geared towards capturing information about under-use in healthcare (n = 551, 92%) across emergency department (n = 457, 77%), hospital (n = 450, 75%) and general practice (n = 434, 73%) healthcare facilities, and based on consensus level recommendations (n = 451, 76%). The main reason for rejecting indicators was 'feasibility' (likely to be able to be used for determining compliance with 'appropriate care' from medical record audit).

CONCLUSION

A set of indicators was developed for the appropriateness of care for 21 paediatric conditions. We describe the processes (methods), provenance (origins and evolution of indicators) and products (indicator characteristics) of creating clinical indicators within the context of Australian healthcare settings. Developing consensus on clinical appropriateness indicators using a Delphi approach and collaborative online wiki has methodological utility. The final indicator set can be used by clinicians and organisations to measure and reflect on their own practice.

What is the association between the presence of comorbidities and the appropriateness of care for low back pain? A population-based medical record review study

Background

Although “non-specific” in 90% of cases, low back pain (LBP) is often treated as an independent entity, even though comorbidities are commonly associated with it. There is evidence that some LBP may be related to chronic conditions or be a symptom of poor health. The purpose of this study was to clarify the extent of comorbidities amongst a cohort of Australian adults with LBP and examine if having concurrent conditions has any association with appropriateness of care for LBP.

Methods

A population-based sample of patients with one or more of 22 common conditions was recruited by telephone; consents were obtained to review their medical records. Trained surveyors extracted information from their medical records to examine the care patients received for their LBP with respect to ten indicators of appropriate care, ratified by LBP experts. Using LBP as the index condition, lists of self-reported comorbidities and those that were documented in medical records were compared. Medical records were reviewed and analysed with respect to appropriateness of care to identify any significant differences in care received between patients with LBP only and those with LBP plus comorbidities.

Results

One hundred and sixty four LBP patients were included in the analysis. Over 60% of adults with LBP in Australia had one of 17 comorbidities documented, with females being more likely than males to have comorbid conditions (63% vs 37%, p = 0.012). The more comorbidities, the poorer their reported health status (63% vs 30%, p = 0.006). Patients with comorbidities were significantly less likely to receive appropriate LBP care on nine of the ten LBP indicators (p < 0.05).

Conclusions

This study established that the presence of comorbidities is associated with poorer care for LBP. Understanding why this is so is an important direction for future research. Further studies using a larger cohort are needed to explore the association between comorbidities and appropriateness of care for LBP, to better inform guidelines and practice in this area.

Electronic supplementary material

The online version of this article (10.1186/s12891-018-2316-z) contains supplementary material, which is available to authorized users.

Assessing the Quality of the Management of Tonsillitis among Australian Children: A Population-Based Sample Survey

OBJECTIVE

The aims of this study were twofold: (1) to design and validate a set of clinical indicators of appropriate care for tonsillitis and (2) to measure the level of tonsillitis care that is in line with guideline recommendations in a sample of Australian children.

STUDY DESIGN

A set of tonsillitis care indicators was developed from available national and international guidelines and validated in 4 stages. This research used the same design as the CareTrack Kids study, which was described in detail elsewhere.

SETTING

Samples of patient records from general practices, emergency departments, and hospital admissions were assessed.

SUBJECTS AND METHODS

Patient records of children aged 0 to 15 years were assessed for the presence of, and adherence to, the indicators for care delivered in 2012 and 2013.

RESULTS

Eleven indicators were developed. The records of 821 children (mean age, 5.0 years; SD, 4.0) with tonsillitis were screened. The reviewers conducted 2354 eligible indicator assessments across 1127 visits. Adherence to 6 indicators could be assessed and ranged from 14.3% to 73.2% (interquartile range 31.5% to 72.2%).

CONCLUSION

Our main findings are consistent with the international literature: the treatment of many children who present with confirmed or suspected tonsillitis is inconsistent with current guidelines. Future research should consider how the indicators could be applied in a structured and automated manner to increase the reliability and efficiency of record reviews and help raise clinicians' awareness of appropriate tonsillitis management.

Australian general practitioner attitudes to clinical practice guidelines and some implications for translating osteoarthritis care into practice

Clinical practice guidelines (CPGs) have been shown to improve processes of care and health outcomes, but there is often a discrepancy between recommendations for care and clinical practice. This study sought to explore general practitioner (GP) attitudes towards CPGs, in general and specifically for osteoarthritis (OA), with the implications for translating OA care into practice. A self-administered questionnaire was conducted in January 2013 with a sample of 228 GPs in New South Wales and South Australia. Seventy-nine GPs returned questionnaires (response rate 35%). Nearly all GPs considered that CPGs support decision-making in practice (94%) and medical education (92%). Very few respondents regarded CPGs as a threat to clinical autonomy, and most recognised that individual patient circumstances must be taken into account. Shorter CPG formats were preferred over longer and more comprehensive formats, with preferences being evenly divided among respondents for short, 2-3-page summaries, flowcharts or algorithms and single page checklists. GPs considered accessibility to CPGs to be important, and electronic formats were popular. Familiarity and use of The Royal Australian College of General Practitioners OA Guideline was poor, with most respondents either not aware of it (30%; 95% confidence interval (CI) 27 - 41%), had never used it (19%; 95% CI 12 - 29%) or rarely used it (34%; 95% CI 25-45%). If CPGs are to assist with the translation of evidence into practice, they must be easily accessible and in a format that encourages use.

Measuring Adherence to Evidence-Based Clinical Practice Guidelines

OBJECTIVES

Dental Health Services Victoria publishes evidence-based clinical practice guidelines (CPGs) to assist public oral health practitioners to provide high-quality dental care. How well these CPGs are implemented into practice is unknown. The aim of this study was to assess adherence to selected CPGs.

METHODS

An electronic auditing tool was developed using clinical indicators derived for "stainless steel crown (SSC)," "restorative care for children under general anesthetic (GA)," and "direct restorative materials" CPG. Six trained dentists audited a random sample of 204 dental records of children aged 3-12 years from 2 major public dental agencies.

RESULTS

In total, 319 material-based treatments were audited, comprising 170 resin composite, 81 glass ionomer cement, 64 SSC, and 4 amalgam restorations. Adherence to the current guidelines varied from 94% of the SSC to none of the amalgam treatments audited. Almost half (47%) of the resin composite restorations and 5% of glass ionomer cement restorations were nonadherent to the relevant guideline.

CONCLUSIONS

Average adherence was up to 72% of cases. Clinicians need to consider recording the rationale upon which their professional judgment is based when they decide not to follow an appropriate CPG.

Levers for addressing medical underuse and overuse: achieving high-value health care

The preceding papers in this Series have outlined how underuse and overuse of health-care services occur within a complex system of health-care production, with a multiplicity of causes. Because poor care is ubiquitous and has considerable consequences for the health and wellbeing of billions of people around the world, remedying this problem is a morally and politically urgent task. Universal health coverage is a key step towards achieving the right care. Therefore, full consideration of potential levers of change must include an upstream perspective-ie, an understanding of the system-level factors that drive overuse and underuse, as well as the various incentives at work during a clinical encounter. One example of a system-level factor is the allocation of resources (eg, hospital beds and clinicians) to meet the needs of a local population to minimise underuse or overuse. Another example is priority setting using tools such as health technology assessment to guide the optimum diffusion of safe, effective, and cost-effective health-care services. In this Series paper we investigate a range of levers for eliminating medical underuse and overuse. Some levers could operate effectively (and be politically viable) across many different health and political systems (eg, increase patient activation with decision support) whereas other levers must be tailored to local contexts (eg, basing coverage decisions on a particular cost-effectiveness ratio). Ideally, policies must move beyond the purely incremental; that is, policies that merely tinker at the policy edges after underuse or overuse arises. In this regard, efforts to increase public awareness, mobilisation, and empowerment hold promise as universal methods to reset all other contexts and thereby enhance all other efforts to promote the right care.

CareTrack: Toward Appropriate Care for Low Back Pain

STUDY DESIGN

Retrospective medical record review to assess compliance with low back pain (LBP) care indicators.

OBJECTIVE

To establish baseline estimates of the appropriateness of LBP care in the general Australian population provided by a range of healthcare providers in various real-world settings.

SUMMARY OF BACKGROUND DATA

LBP is a costly condition and accounts for the greatest burden of disease worldwide, yet the care provided is often at variance with guidelines. No baseline estimates of performance are currently available in Australia across various aspects of LBP care, practitioners, and settings.

METHODS

A population-based sample of patients with 22 common conditions was recruited by telephone; consents were obtained to review their medical records against indicators ("CareTrack"). Care for LBP was reviewed against 10 indicators used in a previous study and ratified by experts as representing appropriate LBP care in Australia during 2009 and 2010.

RESULTS

Of the 22 CareTrack conditions, LBP had the highest number of eligible healthcare encounters (6588 of 35,573, 19%), 125 to 884 per indicator among 164 LBP patients. Overall compliance with LBP indicators was 72% (range 42%-98%). Allied health practitioners and hospitals were the most compliant (82%-83% respectively), followed by general practitioners (54%). Some aspects of care were poor, such as documenting a thorough neurological examination, screening for serious diseases such as infection and inappropriate use of drugs such as steroids and treatments such as traction.

CONCLUSION

Over a quarter of LBP care was not appropriate despite the availability of guidelines. There is a need for national and, potentially, international agreement on clinical standards, indicators and tools to guide, document and monitor the appropriateness of care for LBP, and for measures to increase their uptake, particularly where deficiencies have been identified.

LEVEL OF EVIDENCE

N /A.

Assessing the appropriateness of prevention and management of venous thromboembolism in Australia: a cross-sectional study

OBJECTIVES

The prevention and management of venous thromboembolism (VTE) is often at variance with guidelines. The CareTrack Australia (CTA) study reported that appropriate care (in line with evidence-based or consensus-based guidelines) is being provided for VTE at just over half of eligible encounters. The aim of this paper is to present and discuss the detailed CTA findings for VTE as a baseline for compliance with guidelines at a population level.

SETTING

The setting was 27 hospitals in 2 states of Australia.

PARTICIPANTS

A sample of participants designed to be representative of the Australian population was recruited. Participants who had been admitted overnight during 2009 and/or 2010 were eligible. Of the 1154 CTA participants, 481(42%) were admitted overnight to hospital at least once, comprising 751 admissions. There were 279 females (58%), and the mean age was 64 years.

PRIMARY AND SECONDARY OUTCOME MEASURES

The primary measure was compliance with indicators of appropriate care for VTE. The indicators were extracted from Australian VTE clinical practice guidelines and ratified by experts. Participants' medical records from 2009 to 2010 were analysed for compliance with 38 VTE indicators.

RESULTS

Of the 35,145 CTA encounters, 1078 (3%) were eligible for scoring against VTE indicators. There were 2-84 eligible encounters per indicator at 27 hospitals. Overall compliance with indicators for VTE was 51%, and ranged from 34% to 64% for aggregated sets of indicators.

CONCLUSIONS

The prevention and management of VTE was appropriate for only half of the at-risk patients in our sample; this provides a baseline for tracking progress nationally. There is a need for national and, ideally, international agreement on clinical standards, indicators and tools to guide, document and monitor care for VTE, and for measures to increase their uptake, particularly where deficiencies have been identified.

Surgical site infection-a population-based study in Australian adults measuring the compliance with and correct timing of appropriate antibiotic prophylaxis

Prophylaxis for surgical site infection (SSI) is often at variance with guidelines, despite the prevalence of SSI and its associated cost, morbidity, and mortality. The CareTrack Australia study, undertaken by a number of the authors, demonstrated that appropriate care (in line with evidence- or consensus-based guidelines) was provided at 38% of eligible SSI healthcare encounters. Here, we report the indicator-level CareTrack Australia findings for SSI prophylaxis. Indicators were extracted from Australian and international clinical guidelines and ratified by clinical experts. A sample designed to be representative of the Australian population was recruited (n=1154). Participants' medical records were reviewed and analysed for compliance with the five SSI indicators. The main outcome measure was the percentage of eligible healthcare encounters with documented compliance with indicators for appropriate SSI prophylaxis. Of the 35,145 CareTrack Australia encounters, 702 (2%) were eligible for scoring against the SSI indicators. Where antibiotics were recommended, compliance was 49% for contaminated surgery, 57% for clean-contaminated surgery and 85% for surgery involving a prosthesis: these fell to 8%, 10% and 14%, respectively (an average of 11%), when currently recommended timing of antibiotic administration was included. Where antibiotics were not indicated, 72% of patients still received them. SSI prophylaxis in our sample was poor; over two-thirds of patients were given antibiotics, whether indicated or not, mainly at the wrong time. There is a need for national agreement on clinical standards, indicators and tools to guide, document and monitor SSI prophylaxis, with both local and national measures to increase and monitor their uptake.

CareTrack Kids-part 1. Assessing the appropriateness of healthcare delivered to Australian children: study protocol for clinical indicator development

INTRODUCTION

Despite the widespread availability of clinical guidelines, considerable gaps remain between the care that is recommended (appropriate care) and the care provided. This protocol describes a research methodology to develop clinical indicators for appropriate care for common paediatric conditions.

METHODS AND ANALYSIS

We will identify conditions amenable to population-level appropriateness of care research and develop clinical indicators for each condition. Candidate conditions have been identified from published research; burden of disease, prevalence and frequency of presentation data; and quality of care priority lists. Clinical indicators will be developed through searches of national and international guidelines, and formatted with explicit criteria for inclusion, exclusion, time frame and setting. Experts will review the indicators using a wiki-based approach and modified Delphi process. A formative evaluation of the wiki process will be undertaken.

ETHICS AND DISSEMINATION

Human Research Ethics Committee approvals have been received from Sydney Children's Hospital Network, Children's Health Queensland Hospital and Health Service, and the Women's and Children's Health Network (South Australia). Applications are under review with Macquarie University and the Royal Australian College of General Practitioners. We will submit the results of the study to relevant journals and offer national and international presentations.

CareTrack Kids-part 3. Adverse events in children's healthcare in Australia: study protocol for a retrospective medical record review

INTRODUCTION

A high-quality health system should deliver care that is free from harm. Few large-scale studies of adverse events have been undertaken in children's healthcare internationally, and none in Australia. The aim of this study is to measure the frequency and types of adverse events encountered in Australian paediatric care in a range of healthcare settings.

METHODS AND ANALYSIS

A form of retrospective medical record review, the Institute of Healthcare Improvement's Global Trigger Tool, will be modified to collect data. Records of children aged <16 years managed during 2012 and 2013 will be reviewed. We aim to review 6000-8000 records from a sample of healthcare practices (hospitals, general practices and specialists).

ETHICS AND DISSEMINATION

Human Research Ethics Committee approvals have been received from the Sydney Children's Hospital Network, Children's Health Queensland Hospital and Health Service, and the Women's and Children's Hospital Network in South Australia. An application is under review with the Royal Australian College of General Practitioners. The authors will submit the results of the study to relevant journals and undertake national and international oral presentations to researchers, clinicians and policymakers.

CareTrack Kids-part 2. Assessing the appropriateness of the healthcare delivered to Australian children: study protocol for a retrospective medical record review

INTRODUCTION

Australian and international clinical practice guidelines are available for common paediatric conditions. Yet there is evidence that there are substantial variations between the guidelines, recommendations (appropriate care) and the care delivered. This paper describes a study protocol to determine the appropriateness of the healthcare delivered to Australian children for 16 common paediatric conditions in acute and primary healthcare settings.

METHODS AND ANALYSIS

A random sample of 6000-8000 medical records representing a cross-section of the Australian paediatric population will be reviewed for appropriateness of care against a set of indicators within three Australian states (New South Wales, Queensland and South Australia) using multistage, stratified sampling. Medical records of children aged <16 years who presented with at least one of the study conditions during 2012 and 2013 will be reviewed.

ETHICS AND DISSEMINATION

Human Research Ethics Committee approvals have been received from the Sydney Children's Hospital Network, Children's Health Queensland Hospital and Health Service and Women's and Children's Hospital Network (South Australia). An application is under review for the Royal Australian College of General Practitioners. The authors will submit the results of the study to relevant journals and offer oral presentations to researchers, clinicians and policymakers at national and international conferences.

Development of evidence-based Australian medication-related indicators of potentially preventable hospitalisations: a modified RAND appropriateness method

OBJECTIVE

Indicators of potentially preventable hospitalisations have been adopted internationally as a measure of health system performance; however, few assess appropriate processes of care around medication use, that if followed may prevent hospitalisation. The aim of this study was to develop and validate evidence-based medication-related indicators of potentially preventable hospitalisations.

SETTING

Australian primary healthcare.

PARTICIPANTS

Medical specialists, general practitioners and pharmacists. A modified RAND appropriateness method was used for the development of medication-related indicators of potentially preventable hospitalisations, which included a literature review, assessment of the strength of the supporting evidence base, an initial face and content validity by an expert panel, followed by an independent assessment of indicators by an expert clinical panel across various disciplines, using an online survey.

PRIMARY OUTCOME MEASURE

Analysis of ratings was performed on the four key elements of preventability; the medication-related problem must be recognisable, the adverse outcomes foreseeable and the causes and outcomes identifiable and controllable.

RESULTS

A total of 48 potential indicators across all major disease groupings were developed based on level III evidence or greater, that were independently assessed by 78 expert clinicians (22.1% response rate). The expert panel considered 29 of these (60.4%) sufficiently valid. Of these, 21 (72.4%) were based on level I evidence.

CONCLUSIONS

This study provides a set of face and content validated indicators of medication-related potentially preventable hospitalisations, linking suboptimal processes of care and medication use with subsequent hospitalisation. Further analysis is required to establish operational validity in a population-based sample, using an administrative health database. Implementation of these indicators within routine monitoring of healthcare systems will highlight those conditions where hospitalisations could potentially be avoided through improved medication management.