Section 1: Health and Clinical Mangement: The Safety and Quality of Decision Support Systems

The use of clinical decision support systems (CDSS) can improve the overall safety and quality of health care delivery, but may also introduce machine-related errors. Recent concerns about the potential for CDSS to harm patients have generated much debate, but there is little research available to identify the nature of such errors, or quantify their frequency or clinical impact.

A review of recent literature into electronic prescribing systems, as well as related literature in decision support.

There seems to be some evidence for variation in the outcomes of using CDSS, most likely reflecting variations in clinical setting, culture, training and organizational process, independent of technical variables. There is also preliminary evidence that poorly implemented CDSS can lead to increased mortality in some settings. Studies in the US, UK and Australia have found commercial prescribing systems often fail to uniformly detect significant drug interactions, probably because of errors in their knowledge base. Electronic medication management systems may generate new types of error because of user-interface design, but al so because of events in the workplace such as distraction affecting the actions of system users. Another potential source of CDSS influenced errors are automation biases, including errors of omission where individuals miss important data because the system does not prompt them to notice them, and errors of commission where individuals do what the decision aid tells to do, even when this contradicts their training and other available data. Errors of dismissal occur when relevant alerts are ignored. On-line decision support systems may also result in errors where clinicians come to an incorrect assessment of the evidence, possibly shaped in part by cognitive decision biases.

The effectiveness of decision support systems, like all other health IT, cannot be assessed purely by evaluating the usability and performance of the software, but is the outcome of a complex set of cognitive and socio-technical interactions. A deeper understanding of these issues can result in the design of systems which are not just intrinsically ‘safe’ but which also result in safe outcomes in the hands of busy or poorly resourced clinicians.

Safety and Decision Support in Oncology

The management of patients with cancer involves the administration of complex treatment protocols with frequent monitoring of the effects of treatment on the malignant disease as well as on the general health of the patient. The number and wide variety of protocols used in treatment trials, and the amount of clinical data generated suggest the need for computer-based support. The toxicity of many of the treatments used and the severity of the disease itself underline the safety-critical nature of all decisions made by oncologists, the physicians and surgeons who treat cancer patients. This paper presents recent work on the analysis of safety issues arising from the design and implementation of a protoype decision-support system for oncologists. It illustrates the benefits of combining both informal and formal approaches to the analysis and representation of safety, firmly based on a thorough and detailed study of the domain in cooperation with oncologists, pharmacists and medical informaticians.

Usage of allergy codes in primary care electronic health records: a national evaluation in Scotland

BACKGROUND

The UK's NHS intends to move from the current Read code system to the international, detailed Systematized Nomenclature of Medicine Clinical Terms (SNOMED-CT) to facilitate more clinically appropriate coding of conditions and associated risk factors and outcomes. Given concerns about coding behaviour of general practitioners, we sought to study the current coding patterns in allergies and identify lessons for the future migration to SNOMED-CT.

METHODS

Data from 2 014 551 primary care consultations in over 100 000 patients with one or more of 11 potentially allergic diseases (anaphylaxis, angioedema, asthma, conjunctivitis, drug allergies, eczema, food allergy, rhinitis, urticaria, venom allergy and other probable allergic disorders) from the Scottish Primary Care Clinical Informatics Unit Research (PCCIU-R) database were descriptively analysed and visualized to understand Read code usage patterns.

RESULTS

We identified 352 Read codes for these allergic diseases, but only 36 codes (10%) were used in 95% of consultations; 73 codes (21%) were never used. Half of all usage was for Quality and Outcomes Framework codes for asthma. Despite 149 detailed codes (42%) being available for allergic triggers, these were infrequently used.

CONCLUSIONS

This analysis of Read codes use suggests that introduction of the more detailed SNOMED-CT, in isolation, will not improve the quality of allergy coding in Scottish primary care. The introduction of SNOMED-CT should be accompanied by initiatives aimed at improving coding quality, such as the definition of terms/codes, the availability of terminology browsers, a recommended list of codes and mechanisms to incentivize detailed coding of the condition and the underlying allergic trigger.

Potential effect of patient-assisted teledermatology on outpatient referral rates

We carried out a pilot study on the feasibility and accuracy of store-and-forward teledermatology based on patient-provided images and history as a triage tool for outpatient consultation. Patients referred by their general practitioner provided a history and images via the Internet. The information was reviewed by one of 12 teledermatologists and the patient then visited a different dermatologist in person within two days. Three independent dermatologists compared the remote and in-person diagnoses in random order to determine diagnostic agreement. Broader agreement was also measured, by comparing the main disease groups into which the two diagnoses fell. The teledermatologists indicated whether an in-person consultation or further investigations were necessary. There were 105 eligible patients, aged four months to 72 years, who were willing to participate. For the 96 cases included in the analysis, complete diagnostic agreement was found in 41% ( n= 39), partial diagnostic agreement in 10% ( n= 10) and no agreement in 49% ( n= 47). There was disease group agreement in 66% of cases ( n= 63). Nearly a quarter (23%) of participating patients could have safely been managed without an in-person visit to a dermatologist.

[Better Reporting of Interventions: Template for Intervention Description and Replication (TIDieR) Checklist and Guide]

Without a complete published description of interventions, clinicians and patients cannot reliably implement interventions that are shown to be useful, and other researchers cannot replicate or build on research findings. The quality of description of interventions in publications, however, is remarkably poor. To improve the completeness of reporting, and ultimately the replicability, of interventions, an international group of experts and stakeholders developed the Template for Intervention Description and Replication (TIDieR) checklist and guide. The process involved a literature review for relevant checklists and research, a Delphi survey of an international panel of experts to guide item selection, and a face-to-face panel meeting. The resultant 12-item TIDieR checklist (brief name, why, what (materials), what (procedure), who intervened, how, where, when and how much, tailoring, modifications, how well (planned), how well (actually carried out)) is an extension of the CONSORT 2010 statement (item 5) and the SPIRIT 2013 statement (item 11). While the emphasis of the checklist is on trials, the guidance is intended to apply across all evaluative study designs. This paper presents the TIDieR checklist and guide, with a detailed explanation of each item, and examples of good reporting. The TIDieR checklist and guide should improve the reporting of interventions and make it easier for authors to structure the accounts of their interventions, reviewers and editors to assess the descriptions, and readers to use the information.

Discussion of "Combining Health Data Uses to Ignite Health System Learning"

This article is part of a For-Discussion-Section of Methods of Information in Medicine about the paper "Combining Health Data Uses to Ignite Health System Learning" written by John D. Ainsworth and Iain E. Buchan [1]. It is introduced by an editorial. This article contains the combined commentaries invited to independently comment on the paper of Ainsworth and Buchan. In subsequent issues the discussion can continue through letters to the editor. With these comments on the paper "Combining Health Data Uses to Ignite Health System Learning", written by John D. Ainsworth and Iain E. Buchan [1], the journal seeks to stimulate a broad discussion on new ways for combining data sources for the reuse of health data in order to identify new opportunities for health system learning. An international group of experts has been invited by the editor of Methods to comment on this paper. Each of the invited commentaries forms one section of this paper.

Direct improvement of quality of life using a tailored quality of life diagnosis and therapy pathway: randomised trial in 200 women with breast cancer

BACKGROUND

Despite thousands of papers, the value of quality of life (QoL) in curing disease remains uncertain. Until now, we lacked tools for the diagnosis and specific treatment of diseased QoL. We approached this problem stepwise by theory building, modelling, an exploratory trial and now a definitive randomised controlled trial (RCT) in breast cancer, whose results we report here.

METHODS

In all, 200 representative Bavarian primary breast cancer patients were recruited by five hospitals and treated by 146 care professionals. Patients were randomised to either (1) a novel care pathway including diagnosis of 'diseased' QoL (any QoL measure below 50 points) using a QoL profile and expert report sent to the patient's coordinating practitioner, who arranged QoL therapy consisting of up to five standardised treatments for specific QoL defects or (2) standard postoperative care adhering to the German national guideline for breast cancer. The primary end point was the proportion of patients in each group with diseased QoL 6 months after surgery. Patients were blinded to their allocated group.

RESULTS

At 0 and 3 months after surgery, diseased QoL was diagnosed in 70% of patients. The QoL pathway reduced rates of diseased QoL to 56% at 6 months, especially in emotion and coping, compared with 71% in controls (P=0.048). Relative risk reduction was 21% (95% confidence interval (CI): 0-37), absolute risk reduction 15% (95% CI: 0.3-29), number needed to treat (NNT)=7 (95% CI: 3-37). When QoL therapy finished after successful treatment, diseased QoL often returned again, indicating good responsiveness of the QoL pathway.

CONCLUSION

A three-component outcome system including clinician-derived objective, patient-reported subjective end points and qualitative analysis of clinical relevance was developed in the last 10 years for cancer as a complex intervention. A separate QoL pathway was implemented for the diagnosis and treatment of diseased QoL and its effectiveness tested in a community-based, pragmatic, definitive RCT. While the pathway was active, it was effective with an NNT of 7.

Computerised decision support systems in order communication for diagnostic, screening or monitoring test ordering: systematic reviews of the effects and cost-effectiveness of systems

BACKGROUND

Order communication systems (OCS) are computer applications used to enter diagnostic and therapeutic patient care orders and to view test results. Many potential benefits of OCS have been identified including improvements in clinician ordering patterns, optimisation of clinical time, and aiding communication processes between clinicians and different departments. Many OCS now include computerised decision support systems (CDSS), which are information systems designed to improve clinical decision-making. CDSS match individual patient characteristics to a computerised knowledge base, and software algorithms generate patient-specific recommendations.

OBJECTIVES

To investigate which CDSS in OCS are in use within the UK and the impact of CDSS in OCS for diagnostic, screening or monitoring test ordering compared to OCS without CDSS. To determine what features of CDSS are associated with clinician or patient acceptance of CDSS in OCS and what is known about the cost-effectiveness of CDSS in diagnostic, screening or monitoring test OCS compared to OCS without CDSS.

DATA SOURCES

A generic search to identify potentially relevant studies for inclusion was conducted using MEDLINE, EMBASE, Cochrane Controlled Trials Register (CCTR), CINAHL (Cumulative Index to Nursing and Allied Health Literature), DARE (Database of Abstracts of Reviews of Effects), Health Technology Assessment (HTA) database, IEEE (Institute of Electrical and Electronic Engineers) Xplore digital library, NHS Economic Evaluation Database (NHS EED) and EconLit, searched between 1974 and 2009 with a total of 22,109 titles and abstracts screened for inclusion.

REVIEW METHODS

CDSS for diagnostic, screening and monitoring test ordering OCS in use in the UK were identified through contact with the 24 manufacturers/suppliers currently contracted by the National Project for Information Technology (NpfIT) to provide either national or specialist decision support. A generic search to identify potentially relevant studies for inclusion in the review was conducted on a range of medical, social science and economic databases. The review was undertaken using standard systematic review methods, with studies being screened for inclusion, data extracted and quality assessed by two reviewers. Results were broadly grouped according to the type of CDSS intervention and study design where possible. These were then combined using a narrative synthesis with relevant quantitative results tabulated.

RESULTS

Results of the studies included in review were highly mixed and equivocal, often both within and between studies, but broadly showed a beneficial impact of the use of CDSS in conjunction with OCS over and above OCS alone. Overall, if the findings of both primary and secondary outcomes are taken into account, then CDSS significantly improved practitioner performance in 15 out of 24 studies (62.5%). Only two studies covered the cost-effectiveness of CDSS: a Dutch study reported a mean cost decrease of 3% for blood tests orders (639 euros) in each of the intervention clinics compared with a 2% (208 euros) increase in control clinics in test costs; and a Spanish study reported a significant increase in the cost of laboratory tests from 41.8 euros per patient per annum to 47.2 euros after implementation of the system.

LIMITATIONS

The response rate from the survey of manufacturers and suppliers was extremely low at only 17% and much of the feedback was classified as being commercial-in-confidence (CIC). No studies were identified which assessed the features of CDSS that are associated with clinician or patient acceptance of CDSS in OCS in the test ordering process and only limited data was available on the cost-effectiveness of CDSS plus OCS compared with OCS alone and the findings highly specific. Although CDSS appears to have a potentially small positive impact on diagnostic, screening or monitoring test ordering, the majority of studies come from a limited number of institutions in the USA.

CONCLUSIONS

If the findings of both primary and secondary outcomes are taken into account then CDSS showed a statistically significant benefit on either process or practitioner performance outcomes in nearly two-thirds of the studies. Furthermore, in four studies that assessed adverse effects of either test cancellation or delay, no significant detrimental effects in terms of additional utilisation of health-care resources or adverse events were observed. We believe the key current need is for a well designed and comprehensive survey, and on the basis of the results of this potentially for evaluation studies in the form of cluster randomised controlled trials or randomised controlled trials which incorporate process, and patient outcomes, as well as full economic evaluations alongside the trials to assess the impact of CDSS in conjunction with OCS versus OCS alone for diagnostic, screening or monitoring test ordering in the NHS. The economic evaluation should incorporate the full costs of potentially developing, testing, and installing the system, including staff training costs.

STUDY REGISTRATION

Study registration 61.

Implementing a system of quality-of-life diagnosis and therapy for breast cancer patients: results of an exploratory trial as a prerequisite for a subsequent RCT

A system for quality-of-life diagnosis and therapy (QoL system) was implemented for breast cancer patients. The system fulfilled the criteria for complex interventions (Medical Research Council). Following theory and modeling, this study contains the exploratory trial as a next step before the randomised clinical trial (RCT) answering three questions: (1) Are there differences between implementation sample and general population? (2) Which amount and type of disagreement exist between patient and coordinating practitioners (CPs) in assessed global QoL? (3) Are there empirical reasons for a cutoff of 50 points discriminating between healthy and diseased QoL? Implementation was successful: 74% of CPs worked along the care pathway. However, CPs showed preferences for selecting patients with lower age and UICC prognostic staging. Patients and CPs disagreed considerably in values of global QoL, despite education in QoL assessment by outreach visits, opinion leaders and CME: Zero values of QoL were only expressed by patients. Finally, the cutoff of 50 points was supported by the relationship between QoL in single items and global QoL: no patients with values above 50 dropped global QoL below 50, but values below 50 and especially at 0 points in single items, induced a dramatic fall of global QoL down to below 50. The exploratory trial was important for defining the complex intervention in the definitive RCT: control for age and prognostic stage grading, support for a QoL unit combining patient's and CP's assessment of QoL and support for the 50-point cutoff criterion between healthy and diseased QoL.

Systematic reviews of clinical decision tools for acute abdominal pain

OBJECTIVES

To review for acute abdominal pain (AAP), the diagnostic accuracies of combining decision tools (DTs) and doctors aided by DTs compared with those of unaided doctors. Also to evaluate the impact of providing doctors with an AAP DT on patient outcomes, clinical decisions and actions, what factors are likely to determine the usage rates and usability of a DT and the associated costs and likely cost-effectiveness of these DTs in routine use in the UK.

DESIGN

Electronic databases were searched up to 1 July 2003.

REVIEW METHODS

Data from each eligible study were extracted. Potential sources of heterogeneity were extracted for both questions. For the accuracy review, meta-analysis was conducted. Among studies comparing diagnostic accuracies of DTs with unaided doctors, error rate ratios provided estimates of the differences between the false-negative and false-positive rates of the DT and unaided doctors' performance. Pooled error rate ratios and 95% confidence intervals (CIs) for false-negative rates and false-positive rates were computed. Metaregression was used to explore heterogeneity.

RESULTS

Thirty-two studies from 27 articles, all based in secondary care, were eligible for the review of DT accuracies, while two were eligible for the review of the accuracy of hospital doctors aided by DTs. Sensitivities and specificities for DTs ranged from 53 to 99% and from 30 to 99%, respectively. Those for unaided doctors ranged from 64 to 93% and from 39 to 91%, respectively. Thirteen studies reported false-positive and false-negative rates for both DTs and unaided doctors, enabling a direct comparison of their performance. In random effects meta-analyses, DTs had significantly lower false-positive rates (error rate ratio 0.62, 95% CI 0.46 to 0.83) than unaided doctors. DTs may have higher false-negative rates than unaided doctors (error rate ratio 1.34, 95% CI 0.93 to 1.93). Significant heterogeneity was present. Two studies compared the diagnostic accuracies of doctors aided by DTs to unaided doctors. In a multiarm cluster randomised controlled trial (n = 5193), the diagnostic accuracy of doctors not given access to DTs was not significantly worse (sensitivity 28.4% and specificity 96.0%) than that of three groups of aided doctors (sensitivities of 42.4-47.9%, and specificities of 95.5-96.5%, respectively). In an uncontrolled before-and-after study (n = 1484), the sensitivities and specificities of aided and unaided doctors were 95.5% and 91.5% (p = 0.24) and 78.1% and 86.4% (p < 0.001), respectively. The metaregression of DTs showed that prospective test-set validation at the site of the tool's development was associated with considerably higher diagnostic accuracy than prospective test-set validation at an independent centre [relative diagnostic odds ratio (RDOR) 8.2; 95% CI 3.1 to 14.7]. It also showed that the earlier in the year the study was performed the higher the performance (RDOR 0.88, 0.83 to 0.92), that when developers evaluated their own DT there was better performance than when independent evaluators carried out the study (RDOR = 3.0, 1.3 to 6.8), and that there was no evidence of association between other quality indicators and DT accuracy. The one eligible study of the impact study review, a four-arm cluster randomised trial (n = 5193), showed that hospital admission rates of patients by doctors not allocated to a DT (42.8%) were significantly higher than those by doctors allocated to three combinations of decision support (34.2-38.5%) (p < 0.001). There was no evidence of a difference between perforation rates (p = 0.19) and negative laparotomy rates in the four trial arms (p = 0.46). Usage rates of DTs by doctors in accident and emergency departments ranged from 10 to 77% in the six studies that reported them. Possible determinants of usability include the reasoning method used, the number of items used and the output format. A deterministic cost-effectiveness comparison demonstrated that a paper checklist is likely to be 100-900 times more cost-effective than a computer-based DT, under stated assumptions.

CONCLUSIONS

With their significantly greater specificity and lower false-positive rates than doctors, DTs are potentially useful in confirming a diagnosis of acute appendicitis, but not in ruling it out. The clinical use of well-designed, condition-specific paper or computer-based structured checklists is promising as a way to improve impact on patient outcomes, subject to further research.

The DNA sequence and analysis of human chromosome 6

Chromosome 6 is a metacentric chromosome that constitutes about 6% of the human genome. The finished sequence comprises 166,880,988 base pairs, representing the largest chromosome sequenced so far. The entire sequence has been subjected to high-quality manual annotation, resulting in the evidence-supported identification of 1,557 genes and 633 pseudogenes. Here we report that at least 96% of the protein-coding genes have been identified, as assessed by multi-species comparative sequence analysis, and provide evidence for the presence of further, otherwise unsupported exons/genes. Among these are genes directly implicated in cancer, schizophrenia, autoimmunity and many other diseases. Chromosome 6 harbours the largest transfer RNA gene cluster in the genome; we show that this cluster co-localizes with a region of high transcriptional activity. Within the essential immune loci of the major histocompatibility complex, we find HLA-B to be the most polymorphic gene on chromosome 6 and in the human genome.

Basic concepts in medical informatics

This glossary defines terms used in the comparatively young science of medical informatics. It is hoped that it will be of interest to both novices and professionals in the field.

Safety and computer-aided design of chemotherapy plans

Previously, generic principles were derived empirically from examples of reasoning about the efficacy and safety of chemotherapy. Some of the principles were used in a prototype decision-support system for managing patients through chemotherapy. It reminded clinicians which, how, and when drugs were to be given; suggested treatment modifications as a result of detected adverse events; and warned how unplanned actions undermine efficacy or exacerbate hazardous side effects. Here, we investigate the reuse of these safety principles to generate symbolic and textual representations of new chemotherapy plans. In clinical trials of chemotherapy, a written protocol is essential, especially in obtaining ethical approval. The symbolic representation, from which textual extracts are derived, can be used in conjunction with software for managing chemotherapy.

Evaluating computerized health information systems: hardware, software and human ware: experiences from the Northern Province, South Africa

Despite enormous investment world-wide in computerized health information systems their overall benefits and costs have rarely been fully assessed. A major new initiative in South Africa provides the opportunity to evaluate the introduction of information technology from a global perspective and assess its impact on public health. The Northern Province is implementing a comprehensive integrated hospital information system (HIS) in all of its 42 hospitals. These include two mental health institutions, eight regional hospitals (two acting as a tertiary complex with teaching responsibilities) and 32 district hospitals. The overall goal of the HIS is to improve the efficiency and effectiveness of health (and welfare) services through the creation and use of information, for clinical, administrative and monitoring purposes. This multi-site implementation is being undertaken as a single project at a cost of R130 million (which represents 2.5 per cent of the health and welfare budget on an annual basis). The implementation process commenced on 1 September 1998 with the introduction of the system into Mankweng Hospital as the pilot site and is to be completed in the year 2001. An evaluation programme has been designed to maximize the likelihood of success of the implementation phase (formative evaluation) as well as providing an overall assessment of its benefits and costs (summative evaluation). The evaluation was designed as a form of health technology assessment; the system will have to prove its worth (in terms of cost-effectiveness) relative to other interventions. This is more extensive than the traditional form of technical assessment of hardware and software functionality, and moves into assessing the day-to-day utility of the system, the clinical and managerial environment in which it is situated (humanware), and ultimately its effects on the quality of patient care and public health. In keeping with new South African legislation the evaluation process sought to involve as many stakeholders as possible at the same time as creating a methodologically rigorous study that lived within realistic resource limits. The design chosen for the summative assessment was a randomized controlled trial (RCT) in which 24 district hospitals will receive the HIS either early or late. This is the first attempt to carry out an RCT evaluation of a multi-site implementation of an HIS in the world. Within this design the evaluation will utilize a range of qualitative and quantitative techniques over varying time scales, each addressing specific aims of the evaluation programme. In addition, it will attempt to provide an overview of the general impact on people and organizations of introducing high-technology solutions into a relatively unprepared environment. The study should help to stimulate an evaluation culture in the health and welfare services in the Northern Province as well as building the capacity to undertake such evaluations in the future.

Opportunities for and challenges of computerisation

Information technology offers many potential advantages over paper for the storage and retrieval of patients' data. Enthusiasts predict that soon all records will be stored and viewed on computer, but others are more sceptical. The failure of some computer-based records may be due to poor information design. This paper explores how computers broaden the range of design options but points out that more attention to design is required for computer-based than for paper-based records.

How to limit clinical errors in interpretation of data

We all assume that we can understand and correctly interpret what we read. However, interpretation is a collection of subtle processes that are easily influenced by poor presentation or wording of information. This article examines how evidence-based principles of information design can be applied to medical records to enhance clinical understanding and accuracy in interpretation of the detailed data that they contain.

Helping clinicians to find data and avoid delays

One major criticism of paper medical records is the time and effort required to find data items or to gain an overview. Computerisation does not necessarily help. To help clinicians find data faster and with less effort, everyone designing and writing in records needs to understand how and why we search records and the design features that make searching easier. This paper describes how clinicians search medical records and how to improve record design, whether on paper or computer, to help clinicians find all the data they need without delay.

Design should help use of patients' data

Checklists and other tools help doctors to use published evidence in clinical practice. Two other important sources of evidence, however, are the patient and his or her medical record. This series aims to advance the practice of evidence-based medicine by helping in redesign of medical records, drawing on insights from psychology, information design, and medical informatics; and by promoting changes analogous to those occurring in the medical literature. The four papers look at: the uses of medical records and importance of organising them so doctors can use the data they contain; different methods doctors use to search for data and how design of records can help or hinder these approaches; how we interpret data once found, and how record formatting assists this process; and the issues raised by computerisation of records.

The origin, content, and workload of e-mail consultations

CONTEXT

Despite the common use of e-mail, little beyond anecdote or impressions has been published on patient-clinician e-mail consultation.

OBJECTIVE

To report our experiences with free-of-charge e-mail consultations.

DESIGN

Retrospective review of all e-mail consultation requests received between November 1, 1995, and June 31, 1998.

SETTING AND PARTICIPANTS

Consecutive e-mail consultation requests sent to the Division of Pediatric Gastroenterology at the Children's Medical Center of the University of Virginia in Charlottesville.

MAIN OUTCOME MEASURES

Number of consultation requests per month, time required to respond, who initiated the request and their geographic origin, and the kind of information requested in the consultation.

RESULTS

During the 33-month period studied, we received 1239 requests, an average (SD) of 37.6 (15.9) each month. A total of 1001 consultation requests (81%) were initiated by parents, relatives, or guardians, 126 (10%) by physicians, and 112 (9%) by other health care professionals. Consultation requests were received from 39 states and 37 other countries. In 855 requests (69%), there was a specific question about the cause of a particular child's symptoms, diagnostic tests, and/or therapeutic interventions. In 112 (9%), the requester sought a second opinion about diagnosis or treatment for a particular child, and 272 consultations (22%) requested general information concerning a disorder, treatment, or medication without reference to a particular child. A total of 1078 requests (87%) were answered within 48 hours of the initial request. On average, reading and responding to each e-mail took slightly less than 4 minutes.

CONCLUSION

E-mail provides a means for parents, guardians, and health care professionals to obtain patient and disease-specific information from selected medical consultants in a timely manner.

Randomised trial of educational visits to enhance use of systematic reviews in 25 obstetric units

OBJECTIVE

To evaluate the effectiveness of an educational visit to help obstetricians and midwives select and use evidence from a Cochrane database containing 600 systematic reviews.

DESIGN

Randomised single blind controlled trial with obstetric units allocated to an educational visit or control group.

SETTING

25 of the 26 district general obstetric units in two former NHS regions.

SUBJECTS

The senior obstetrician and midwife from each intervention unit participated in educational visits. Clinical practices of all staff were assessed in 4508 pregnancies.

INTERVENTION

Single informal educational visit by a respected obstetrician including discussion of evidence based obstetrics, guidance on implementation, and donation of Cochrane database and other materials.

MAIN OUTCOME MEASURES

Rates of perineal suturing with polyglycolic acid, ventouse delivery, prophylactic antibiotics in caesarean section, and steroids in preterm delivery, before and 9 months after visits, and concordance of guidelines with review evidence for same marker practices before and after visits.

RESULTS

Rates varied greatly, but the overall baseline mean of 43% (986/2312) increased to 54% (1189/2196) 9 months later. Rates of ventouse delivery increased significantly in intervention units but not in control units; there was no difference between the two types of units in uptake of other practices. Pooling rates from all 25 units, use of antibiotics in caesarean section and use of polyglycolic acid sutures increased significantly over the period, but use of steroids in preterm delivery was unchanged. Labour ward guidelines seldom agreed with evidence at baseline; this hardly improved after visits. Educational visits cost pound860 each (at 1995 prices).

CONCLUSIONS

There was considerable uptake of evidence into practice in both control and intervention units between 1994 and 1995. Our educational visits added little to this, despite the informal setting, targeting of senior staff from two disciplines, and donation of educational materials. Further work is needed to define cost effective methods to enhance the uptake of evidence from systematic reviews and to clarify leadership and roles of senior obstetric staff in implementing the evidence.

Relation of impaired energy metabolism to apoptosis and necrosis following transient cerebral hypoxia-ischaemia

This study investigated whether both mild and severe hypoxia-ischaemia (HI) caused significant numbers of cells to die by apoptosis in the developing brain in vivo. Newborn piglets were subjected to transient global HI and the fraction of all cells in the cingulate gyrus that were apoptotic or necrotic counted 48 h after resuscitation. The mean (S.D.) proportion of apoptotic cells was 11.9% (6.7%) (sham operated controls 4.1% (2.7%)), while 11.4% (8.4%) were necrotic (controls 0.7% (1.3%)) (P<0.05). Apoptotic and necrotic cell counts were both linearly related to the severity of impaired cerebral energy metabolism measured by magnetic resonance spectroscopy (P<0.05), as shown by: (1) the decline in the ratio of nucleotide triphosphates to the exchangeable phosphate pool during HI; (2) the fall in the ratio of phosphocreatine to inorganic phosphate 8 - 48 h after HI; and (3) an increased ratio of lactate to total creatine at both these times. Thus both apoptosis and necrosis occurred in the cingulate gyrus after both severe and mild HI in vivo in proportion to the severity of the insult.

Hospital information management: the need for clinical leadership

On 12 July the Audit Commission published For Your Information, a well researched report about information and its management in acute hospitals in Britain, how and why it is failing, and steps that clinicians, managers, and the NHS should take to correct this. This article discusses why information management matters to clinicians and considers the problems identified by the Audit Commission--most of which will strike chords with doctors--and possible remedies. Finally, it describes possible routes to administer these remedies and the proposal, recently supported by the BMA Council, for a national centre for health informatics with the goals of educating and enthusing clinicians about informatics, empowering them to participate in local and national information management decisions; exploring how information can be used to improve patient care and outcomes; and evaluating clinical information systems and helping to realise their benefits.

Uptake of meta-analytical overviews of effective care in English obstetric units

OBJECTIVE

To establish the current availability of meta-analytical overviews of effective care in perinatal medicine, in the form of Effective Care in Pregnancy and Childbirth and the Oxford Database of Perinatal Trials, in English obstetric units and to find out how obstetricians without either one keep up to date.

DESIGN

Standardised telephone questionnaire.

SUBJECTS

The consultant obstetrician deemed to be the Royal College of Obstetricians and Gynaecologists' administrative contact in each of the 24 teaching hospitals, and in 74 of 173 (43%) district general hospitals in England.

MAIN OUTCOME MEASURES

Knowledge and use of Effective Care and the Oxford Database in the obstetric unit.

RESULTS

Thirty-seven percent of units did not have access to either Effective Care or the Oxford Database, with significant differences between district general hospitals and teaching hospitals in lack of availability (33/74 (45%) versus 3/24 (12%) respectively, P = 0.02). Effective Care was available in 51% of district general hospitals and 79% of teaching hospitals, compared with the availability of the Oxford Database which was only available in 16% and 62%, respectively. Reasons given for not obtaining either included non-awareness, expense, and perceived lack of need. The consultants with neither Effective Care nor the Oxford Database claimed to keep up to date by various methods, usually as information from colleagues.

CONCLUSIONS

These results reflect both inefficient dissemination of medical knowledge in obstetrics and the reluctance of obstetricians to consider adapting their practice as a result of evidence from meta-analyses of randomised controlled trials. Although Effective Care is more widely available than the Oxford Database, its datedness renders it inferior to the database as a means of facilitating effective care in obstetrics.

Formalisation of safety reasoning in protocols and hazard regulations

Written protocols are often employed to guide patient care. For treatment within a clinical trial, compliance with the trial protocol may be critical in ensuring efficacy and safety. Previous empirical work has established generic safety principles for reasoning about adverse events in clinical trials and their formalisation has been applied in a decision support system for managing treatment plans in oncology. The same generic knowledge can be reused to generate specific safety clauses when designing new treatment plans. Typically, clinicians devise trial protocols relatively infrequently and so software aids, especially those assisting with regulatory/safety conformance, will encourage more effective use of their time. A similar approach to the formalisation of safety knowledge in the control of hazardous industrial processes is discussed.

A continuous-speech interface to a decision support system: II. An evaluation using a Wizard-of-Oz experimental paradigm

OBJECTIVE

Evaluate the performance of a continuous-speech interface to a decision support system.

DESIGN

The authors performed a prospective evaluation of a speech interface that matches unconstrained utterances of physicians with controlled-vocabulary terms from Quick Medical Reference (QMR). The performance of the speech interface was assessed in two stages: in the real-time experiment, physician subjects viewed audiovisual stimuli intended to evoke clinical findings, spoke a description of each finding into the speech interface, and then chose from a list generated by the interface the QMR term that most closely matched the finding. Subjects believed that the speech recognizer decoded their utterances; in reality, a hidden experimenter typed utterances into the interface (Wizard-of-Oz experimental design). Later, the authors replayed the same utterances through the speech recognizer and measured how accurately utterances matched with appropriate QMR terms using the results of the real-time experiment as the "gold standard."

MEASUREMENTS

The authors measured how accurately the speech-recognition system converted input utterances to text strings (recognition accuracy) and how accurately the speech interface matched input utterances to appropriate QMR terms (semantic accuracy).

RESULTS

Overall recognition accuracy was less than 50%. However, using language-processing techniques that match keywords in recognized utterances to keywords in QMR terms, the semantic accuracy of the system was 81%.

CONCLUSIONS

Reasonable semantic accuracy was attained when language-processing techniques were used to accommodate for speech misrecognition. In addition, the Wizard-of-Oz experimental design offered many advantages for this evaluation. The authors believe that this technique may be useful to future evaluators of speech-input systems.

Safety and decision support in oncology

The management of patients with cancer involves the administration of complex treatment protocols with frequent monitoring of the effects of treatment on the malignant disease as well as on the general health of the patient. The number and wide variety of protocols used in treatment trials, and the amount of clinical data generated suggest the need for computer-based support. The toxicity of many of the treatments used and the severity of the disease itself underline the safety-critical nature of all decisions made by oncologists, the physicians and surgeons who treat cancer patients. This paper presents recent work on the analysis of safety issues arising from the design and implementation of a prototype decision-support system for oncologists. It illustrates the benefits of combining both informal and formal approaches to the analysis and representation of safety, firmly based on a thorough and detailed study of the domain in cooperation with oncologists, pharmacists and medical informaticians.