The Total Health Care Audit System: a systematic methodology for clinical practice evaluation and development in NHS provider organizations

The Australian Centre for Evidence-based Clinical Practice generic audit tool: Auditmaker for health professionals

Audit is an important step in the process of health care evaluation and quality improvement. Some of the barriers to audit include the lack of support in initiating an audit, difficulty with data collection and lack of time. Auditmaker is a computer package that guides the clinician through the initial process of designing an audit, choosing factors and outcomes to analyse, then provides customizable data entry forms, and finally simple reports summarizing the data. It has user-friendly features, such as help buttons, drop-down lists and built in comorbidities and outcomes of common interest. It provides a generic tool for performing an audit as well as providing an opportunity for different clinicians in different institutions or practice settings to perform similar audits using the same data collection tool, which can provide the basis of benchmarking. Auditmaker is available for downloading from the ACEPBCP website: http://www.acebcp.org.au.

The evolution of clinical audit as a tool for quality improvement

Clinical auditing practices are recognized universally as a useful tool in evaluating and improving the quality of care provided by a health service. External auditing is a regular activity for mental health services in Australia but internal auditing activities are conducted at the discretion of each service. This paper evaluates the effectiveness of 6 years of internal auditing activities in a mental health service. A review of the scope, audit tools, purpose, sampling and design of the internal audits and identification of the recommendations from six consecutive annual audit reports was completed. Audit recommendations were examined, as well as levels of implementation and reasons for success or failure. Fifty-seven recommendations were identified, with 35% without action, 28% implemented and 33.3% still pending or in progress. The recommendations were more likely to be implemented if they relied on activity, planning and action across a selection of service areas rather than being restricted to individual departments within a service, if they did not involve non-mental health service departments and if they were not reliant on attitudinal change. Tools used, scope and reporting formats have become more sophisticated as part of the evolutionary nature of the auditing process. Internal auditing in the Barwon Health Mental Health Service has been effective in producing change in the quality of care across the organization. A number of evolutionary changes in the audit process have improved the efficiency and effectiveness of the audit.

Central dimensions of clinical practice evaluation: efficiency, appropriateness and effectiveness--II

That a treatment selected for a given condition works, or that it works better than alternative treatments, or that it was selected because it works as well as but is cheaper than alternative treatments, should be of pivotal concern to clinicians and is of central concern to patients and to health care managers. Attempts to address these concerns have resulted in what is now widely termed the 'effectiveness movement'. The protagonists of the movement have been concerned to create a culture of evaluation and inquiry within which the formulation of evidence-based clinical guidelines and their introduction into routine practice have played a prominent part. The need to ensure cost effectiveness of clinical intervention has been at least as emphasized as the need to ensure the clinical effectiveness of health care interventions. Although cost-effectiveness analyses are now an indispensable feature of practice guideline formulation and treatment evaluation, few studies have examined any deterioration in patient outcome associated with successful cost containment. An adequate understanding of the concept of clinical effectiveness and the associated aims of the 'effectiveness movement' is central to an understanding of the future nature and extent of health service provision, not simply in the UK but also internationally. Having examined the concepts of efficiency and appropriateness previously (O'Neill, Miles & Polychronis 1996, Journal of Evaluation in Clinical Practice 2, 13-27) we move in this second of two articles to a detailed explanation of the concept of effectiveness, and to an examination of the derivation and use of clinical practice guideline, concluding with a consideration of the role of practice guidelines in ensuring the cost effectiveness of health care intervention. The reservation is expressed that a 'guidelines culture', when established, will be manipulated by health care commissioners for largely political purposes, creating a systematic bias in the purchasing process that will actively disadvantage a range of patient groups.

Clinical audit in the National Health Service: fact or fiction?

It is increasingly recognized that the repeated rhetorical emphasis from 1989 to date on achieving measurable benefits to patients from audit, in the face of inattention to the development of methodologies with which to realize such benefits in operational practice, has represented a serious deficiency in strategic planning and direction and a consequent failure to establish functional clinical audit within the NHS. A grand revision of strategy is therefore necessary, and this should begin with the development of a research-based method of audit, the training of clinicians and audit support staff in its use and a subsequent trial of its effectiveness prior to its implementation within the NHS. Only then will measurable improvements become possible, value for money be assured and clinicians' attitudes to audit change.

Central dimensions of clinical practice evaluation: efficiency, appropriateness and effectiveness--I

Successful audit of clinical practice focuses upon the systematic investigation of key aspects of the everyday work of busy clinicians. We contend that the nature and quality of local clinical practice can be characterized by critical examinations of the effectiveness and appropriateness of practice and the efficiency with which effective, appropriate clinical care is delivered to patients. When such a baseline has been established, it becomes possible to compare and contrast characterized local practice with so-called 'evidence-based' practice and agree changes aimed at narrowing the discrepancy between the two. The nature of such changes can be described and their implementation into practice studied, with subsequent quantitative measurement and qualitative description of the resulting benefits to patients. A proper understanding of the concepts of efficiency, appropriateness and effectiveness in clinical care is clearly fundamental to the successful design and applications of methodologies aimed at securing measurable improvements in the quality of patient care. In this first of two articles we examine the concepts of efficiency and appropriateness in clinical practice, with particular emphasis on cost-effectiveness and utilization review. The clinical effectiveness of health care intervention is treated in detail within the second paper, to be published within Volume 2 Number 2 of the Journal of Evaluation in Clinical Practice (Miles et al. 1996f).