A randomised controlled trial of a blended learning education intervention for teaching evidence-based medicine

BACKGROUND

Few studies have been performed to inform how best to teach evidence-based medicine (EBM) to medical trainees. Current evidence can only conclude that any form of teaching increases EBM competency, but cannot distinguish which form of teaching is most effective at increasing student competency in EBM. This study compared the effectiveness of a blended learning (BL) versus didactic learning (DL) approach of teaching EBM to medical students with respect to competency, self-efficacy, attitudes and behaviour toward EBM.

METHODS

A mixed methods study consisting of a randomised controlled trial (RCT) and qualitative case study was performed with medical students undertaking their first clinical year of training in EBM. Students were randomly assigned to receive EBM teaching via either a BL approach or the incumbent DL approach. Competency in EBM was assessed using the Berlin questionnaire and the 'Assessing Competency in EBM' (ACE) tool. Students' self-efficacy, attitudes and behaviour was also assessed. A series of focus groups was also performed to contextualise the quantitative results.

RESULTS

A total of 147 students completed the RCT, and a further 29 students participated in six focus group discussions. Students who received the BL approach to teaching EBM had significantly higher scores in 5 out of 6 behaviour domains, 3 out of 4 attitude domains and 10 out of 14 self-efficacy domains. Competency in EBM did not differ significantly between students receiving the BL approach versus those receiving the DL approach [Mean Difference (MD)=-0.68, (95% CI-1.71, 0.34), p=0.19]. No significant difference was observed between sites (p=0.89) or by student type (p=0.58). Focus group discussions suggested a strong student preference for teaching using a BL approach, which integrates lectures, online learning and small group activities.

CONCLUSIONS

BL is no more effective than DL at increasing medical students' knowledge and skills in EBM, but was significantly more effective at increasing student attitudes toward EBM and self-reported use of EBM in clinical practice. Given the various learning styles preferred by students, a multifaceted approach (incorporating BL) may be best suited when teaching EBM to medical students. Further research on the cost-effectiveness of EBM teaching modalities is required.

Searching for randomized controlled trials and systematic reviews on exercise. A descriptive study

CONTEXT AND OBJECTIVE

The current paradigm of science is to accumulate as much research data as possible, with less thought given to navigation or synthesis of the resulting mass, which hampers locating and using the research. The aim here was to describe the number of randomized controlled trials (RCTs) and systematic reviews (SRs) focusing on exercise, and their journal sources, that have been indexed in PubMed over time.

DESIGN AND SETTING

Descriptive study conducted at Bond University, Australia.

METHOD

To find RCTs, a search was conducted in PubMed Clinical Queries, using the category "Therapy" and the Medical Subject Headings (MeSH) term "Exercise". To find SRs, a search was conducted in PubMed Clinical Queries, using the category "Therapy", the MeSH term "Exercise" and various methodological filters.

RESULTS

Up until 2011, 9,354 RCTs about exercise were published in 1,250 journals and 1,262 SRs in 513 journals. Journals in the area of Sports Science published the greatest number of RCTs and journals categorized as belonging to "Other health professions" area (for example nursing or psychology) published the greatest number of SRs. The Cochrane Database of Systematic Reviews was the principal source for SRs, with 9.8% of the total, while the Journal of Strength and Conditioning Research and Medicine & Science in Sports & Exercise published 4.4% and 5.0% of the RCTs, respectively.

CONCLUSIONS

The rapid growth and resulting scatter of RCTs and SRs on exercise presents challenges for locating and using this research. Solutions for this issue need to be considered.

Better duplicate detection for systematic reviewers: evaluation of Systematic Review Assistant-Deduplication Module

BACKGROUND

A major problem arising from searching across bibliographic databases is the retrieval of duplicate citations. Removing such duplicates is an essential task to ensure systematic reviewers do not waste time screening the same citation multiple times. Although reference management software use algorithms to remove duplicate records, this is only partially successful and necessitates removing the remaining duplicates manually. This time-consuming task leads to wasted resources. We sought to evaluate the effectiveness of a newly developed deduplication program against EndNote.

METHODS

A literature search of 1,988 citations was manually inspected and duplicate citations identified and coded to create a benchmark dataset. The Systematic Review Assistant-Deduplication Module (SRA-DM) was iteratively developed and tested using the benchmark dataset and compared with EndNote's default one step auto-deduplication process matching on ('author', 'year', 'title'). The accuracy of deduplication was reported by calculating the sensitivity and specificity. Further validation tests, with three additional benchmarked literature searches comprising a total of 4,563 citations were performed to determine the reliability of the SRA-DM algorithm.

RESULTS

The sensitivity (84%) and specificity (100%) of the SRA-DM was superior to EndNote (sensitivity 51%, specificity 99.83%). Validation testing on three additional biomedical literature searches demonstrated that SRA-DM consistently achieved higher sensitivity than EndNote (90% vs 63%), (84% vs 73%) and (84% vs 64%). Furthermore, the specificity of SRA-DM was 100%, whereas the specificity of EndNote was imperfect (average 99.75%) with some unique records wrongly assigned as duplicates. Overall, there was a 42.86% increase in the number of duplicates records detected with SRA-DM compared with EndNote auto-deduplication.

CONCLUSIONS

The Systematic Review Assistant-Deduplication Module offers users a reliable program to remove duplicate records with greater sensitivity and specificity than EndNote. This application will save researchers and information specialists time and avoid research waste. The deduplication program is freely available online.

Common harms from amoxicillin: a systematic review and meta-analysis of randomized placebo-controlled trials for any indication

BACKGROUND

When prescribing antibiotics for common indications, clinicians need information about both harms and benefits, information that is currently available only from observational studies. We quantified the common harms of the most frequently prescribed antibiotic, amoxicillin, from randomized placebo-controlled trials.

METHODS

For this systematic review, we searched MEDLINE, Embase and the Cochrane Central Register of Controlled Trials, without language restriction, for any randomized, participant-blinded, placebo-controlled trials of amoxicillin or amoxicillin-clavulanic acid for any indication, in any setting. Our main outcome was any reported adverse event.

RESULTS

Of 730 studies identified, we included 45 trials: 27 involving amoxicillin, 17 involving amoxicillin-clavulanic acid and 1 involving both. The indications for antibiotic therapy were variable. The risk of bias was low, although only 25 trials provided data suitable for assessment of harms, which suggested under-reporting. Diarrhea was attributed to amoxicillin only in the form of amoxicillin-clavulanic acid (Peto odds ratio [OR] 3.30, 95% confidence interval [CI] 2.23-4.87). The OR for candidiasis (3 trials) was significantly higher (OR 7.77, 95% CI 2.23-27.11). Rashes, nausea, itching, vomiting and abnormal results on liver function tests were not significantly increased. The results were not altered by sensitivity analyses, nor did funnel plots suggest publication bias. The number of courses of antibiotics needed to harm was 10 (95% CI 6-17) for diarrhea with amoxicillin-clavulanic acid and 27 (95% CI 24-42) for candidiasis with amoxicillin (with or without clavulanic acid).

INTERPRETATION

Diarrhea was caused by use of amoxicillin-clavulanic acid, and candidiasis was caused by both amoxicillin and amoxicillin-clavulanic acid. Harms were poorly reported in most trials, and their true incidence may have been higher than reported. Nevertheless, these rates of common harms associated with amoxicillin therapy may inform decisions by helping clinicians to balance harms against benefits.

Predicting the Effects of Blood Pressure–Lowering Treatment on Major Cardiovascular Events for Individual Patients With Type 2 Diabetes Mellitus

Abstract—

Blood pressure–lowering treatment reduces cardiovascular risk in patients with diabetes mellitus, but the effect varies between individuals. We sought to identify which patients benefit most from such treatment in a large clinical trial in type 2 diabetes mellitus. In Action in Diabetes and Vascular Disease: Preterax and Diamicron MR Controlled Evaluation (ADVANCE) participants (n=11 140), we estimated the individual patient 5-year absolute risk of major adverse cardiovascular events with and without treatment by perindopril–indapamide (4/1.25 mg). The difference between treated and untreated risk is the estimated individual patient’s absolute risk reduction (ARR). Predictions were based on a Cox proportional hazards model inclusive of demographic and clinical characteristics together with the observed relative treatment effect. The group-level effect of selectively treating patients with an estimated ARR above a range of decision thresholds was compared with treating everyone or those with a blood pressure >140/90 mm Hg using net benefit analysis. In ADVANCE, there was wide variation in treatment effects across individual patients. According to the algorithm, 43% of patients had a large predicted 5-year ARR of ≥1% (number-needed-to-treat [NNT 5 ] ≤100) and 40% had an intermediate predicted ARR of 0.5% to 1% (NNT 5 =100–`200). The proportion of patients with a small ARR of ≤0.5% (NNT 5 ≥200) was 17%. Provided that one is prepared to treat at most 200 patients for 5 years to prevent 1 adverse outcome, prediction-based treatment yielded the highest net benefit. In conclusion, a multivariable treatment algorithm can identify those individuals who benefit most from blood pressure–lowering therapy in terms of ARR of major adverse cardiovascular events and may be used to guide treatment decisions in individual patients with diabetes.

Clinical Trial Registration—

URL: http://www.clinicaltrials.gov . Unique identifier: NCT00145925.

Implications of lower risk thresholds for statin treatment in primary prevention: analysis of CPRD and simulation modelling of annual cholesterol monitoring

OBJECTIVE

To estimate numbers affected by a recent change in UK guidelines for statin use in primary prevention of cardiovascular disease.

METHOD

We modelled cholesterol ratio over time using a sample of 45,151 men (≥40years) and 36,168 women (≥55years) in 2006, without statin treatment or previous cardiovascular disease, from the Clinical Practice Research Datalink. Using simulation methods, we estimated numbers indicated for new statin treatment, if cholesterol was measured annually and used in the QRISK2 CVD risk calculator, using the previous 20% and newly recommended 10% thresholds.

RESULTS

We estimate that 58% of men and 55% of women would be indicated for treatment by five years and 71% of men and 73% of women by ten years using the 20% threshold. Using the proposed threshold of 10%, 84% of men and 90% of women would be indicated for treatment by 5years and 92% of men and 98% of women by ten years.

CONCLUSION

The proposed change of risk threshold from 20% to 10% would result in the substantial majority of those recommended for cholesterol testing being indicated for statin treatment. Implications depend on the value of statins in those at low to medium risk, and whether there are harms.

Deliberative democracy and cancer screening consent: a randomised control trial of the effect of a community jury on men's knowledge about and intentions to participate in PSA screening

OBJECTIVE

Prostate-specific antigen (PSA) screening is controversial. A community jury allows presentation of complex information and may clarify how participants view screening after being well-informed. We examined whether participating in a community jury had an effect on men's knowledge about and their intention to participate in PSA screening.

DESIGN

Random allocation to either a 2-day community jury or a control group, with preassessment, postassessment and 3-month follow-up assessment.

SETTING

Participants from the Gold Coast (Australia) recruited via radio, newspaper and community meetings.

PARTICIPANTS

Twenty-six men aged 50-70 years with no previous diagnosis of prostate cancer.

INTERVENTION

The control group (n=14) received factsheets on PSA screening. Community jury participants (n=12) received the same factsheets and further information about screening for prostate cancer. In addition, three experts presented information on PSA screening: a neutral scientific advisor provided background information, one expert emphasised the potential benefits of screening and another expert emphasised the potential harms. Participants discussed information, asked questions to the experts and deliberated on personal and policy decisions.

MAIN OUTCOME AND MEASURES

Our primary outcome was change in individual intention to have a PSA screening test. We also assessed knowledge about screening for prostate cancer.

RESULTS

Analyses were conducted using intention-to-treat. Immediately after the jury, the community jury group had less intention-to-screen for prostate cancer than men in the control group (effect size=-0.6 SD, p=0.05). This was sustained at 3-month follow-up. Community jury men also correctly identified PSA test accuracy and considered themselves more informed (effect size=1.2 SD, p<0.001).

CONCLUSIONS

Evidence-informed deliberation of the harms and benefits of PSA screening effects men's individual choice to be screened for prostate cancer. Community juries may be a valid method for eliciting target group input to policy decisions.

TRIAL REGISTRATION NUMBER

Australian and New Zealand Clinical Trials Registry (ACTRN12612001079831).

Scatter of orthopaedic research: can orthopods stay up-to-date with research?

BACKGROUND

The volume of orthopaedic literature is increasing exponentially, becoming more widely scattered among journals. The rate of increase in orthopaedics is greater than other specialties. We aimed to identify the number of different journals an orthopaedic surgeon would need to read to stay up-to-date with current evidence.

METHOD

We searched PubMed for all orthopaedic-related systematic reviews (SR) and randomized controlled trials (RCT) published in 2011 using MESH (Medical Subject Headings) terms. The search was based on the Australian Orthopaedic Association syllabus of March 2011. The results of the search were exported to EndNote, then Microsoft Excel. We then calculated the least number of journals needed to read 25%, 50% and 100% of the articles. This was done separately for SRs and RCTs.

RESULTS

We found 1400 orthopaedic RCTs spread over 392 journals. Ten journals contained 25% of the articles, 36 journals contained 50% and 114 journals contained 75%. Three hundred journals contained three or fewer RCTs. We found 354 orthopaedic-relevant SRs spread over 152 journals. Six journals contained 25% of the articles, 23 journals contained 50% and 63 journals contained 75%. Ninety-three journals contained only one SR.

CONCLUSION

Our results demonstrate the vast scatter of orthopaedic research. Four orthopaedic RCTs are published every day. To read even 25% of the new RCTs and SRs published in orthopaedics, a surgeon would require a subscription to 13 different journals monthly, a costly and time-consuming endeavour.

Optimal strategies for identifying kidney disease in diabetes: properties of screening tests, progression of renal dysfunction and impact of treatment - systematic review and modelling of progression and cost-effectiveness

BACKGROUND

Annual screening for adults with type 2 diabetes to detect the early onset of kidney disease is widely recommended, but the recommendations are based on a limited methodological approach. In addition, there are continuing uncertainties about underlying rates of progression of the condition and the benefits of treatments with angiotensin-converting enzyme inhibitors and angiotensin receptor blockers.

OBJECTIVES

We aimed to estimate the clinical value and cost-effectiveness of different screening intervals to diagnose early diabetic kidney disease.

DATA SOURCES

We used the following databases for the literature review (searched January 2005 to August 2010): MEDLINE, EMBASE and the Cochrane Database of Systematic Reviews. Individual patient data were obtained from the Oxford Regional Prospective Diabetes Study and the Collaborative Atorvastatin Diabetes Study.

METHODS

Data from systematically identified randomised trials reporting the impact on renal outcomes of angiotensin-converting enzyme inhibitors and angiotensin 2 receptor blockers for type 1 and type 2 diabetes patients with normoalbuminuria and microalbuminuria were pooled to derive estimates of effect. Individual patient data for type 1 and type 2 diabetes patients were used to obtain parameters describing progression and variability of measurement over time for the albumin-to-creatinine ratio (ACR) and estimated glomerular filtration rate. Based on accepted diagnostic thresholds, we modelled whether these tests accurately identified patients who were developing early diabetic kidney disease and required intensification of treatment. Cost-effectiveness analyses were carried out using simulation outcome models to estimate the incremental costs per quality-adjusted life-year (QALY) for different screening intervals.

RESULTS

In total, 49 trials (n = 34,082 patients) were eligible for inclusion in the systematic review. For type 1 diabetes, pooled estimates of urinary albumin excretion (UAE) for treated patients with microalbuminuria were on average 67% [95% confidence interval (CI) 54% to 77%] lower at the end of the trial than for untreated patients. There was no significant treatment effect for patients with normoalbuminuria (p interaction = 0.006). For treated patients with type 2 diabetes and normoalbuminuria or microalbuminuria, UAE was lower by, on average, 21% (95% CI 97% to 32%) or 27% (95% CI 15% to 38%), respectively. The proportion (95% CI) of men and women with type 1 diabetes screened annually for microalbuminuria over 6 years and inaccurately identified as having microalbuminuria would be 48% (43% to 53%) and 55% (48% to 61%), respectively. The corresponding proportions for type 2 diabetes are 36% (32% to 42%) and 48% (41% to 55%). Decreasing the screening interval to 3-yearly would reduce this for men with type 1 diabetes to 38% (33% to 44%), with an increase in those not identified over 6 years from 1.5% (95% CI 1% to 2%) to 4% (95% CI 3% to 5%). For type 1 diabetes, incremental cost per QALY [standard deviation (SD)] of a 5-yearly compared with a 4-yearly screening interval was £3612 (£6586), increasing to £9601 (£34,112) for annual compared with 2-yearly screening. The probability that the intervention is cost saving is around 25%, and it has around an 80% chance of being below a cost-effectiveness threshold of £30,000. For type 2 diabetes, incremental cost per QALY (SD) of a yearly compared with a 2-yearly screening interval was £606 (£1782). The intervention is almost certainly below a cost-effectiveness threshold of £5000.

CONCLUSIONS

These results support current UK guidance, which recommends annual screening with ACR to identify early kidney disease in patients with diabetes, despite a high false-positive rate leading to, at worst, unnecessary or, at best, early therapeutic intervention. For type 1 diabetes, screening costs for annual compared with 2-yearly screening are well within the bounds of accepted cost-effectiveness. Annual screening is even more cost-effective in type 2 diabetes than in type 1 diabetes. Identification of alternative markers for developing diabetic nephropathy may improve targeting of treatment for those at high risk.

FUNDING

The National Institute for Health Research Health Technology Assessment programme.

PRImary care Streptococcal Management (PRISM) study: in vitro study, diagnostic cohorts and a pragmatic adaptive randomised controlled trial with nested qualitative study and cost-effectiveness study

BACKGROUND

Antibiotics are still prescribed to most patients attending primary care with acute sore throat, despite evidence that there is modest benefit overall from antibiotics. Targeting antibiotics using either clinical scoring methods or rapid antigen detection tests (RADTs) could help. However, there is debate about which groups of streptococci are important (particularly Lancefield groups C and G), and uncertainty about the variables that most clearly predict the presence of streptococci.

OBJECTIVE

This study aimed to compare clinical scores or RADTs with delayed antibiotic prescribing.

DESIGN

The study comprised a RADT in vitro study; two diagnostic cohorts to develop streptococcal scores (score 1; score 2); and, finally, an open pragmatic randomised controlled trial with nested qualitative and cost-effectiveness studies.

SETTING

The setting was UK primary care general practices.

PARTICIPANTS

Participants were patients aged ≥ 3 years with acute sore throat.

INTERVENTIONS

An internet program randomised patients to targeted antibiotic use according to (1) delayed antibiotics (control group), (2) clinical score or (3) RADT used according to clinical score.

MAIN OUTCOME MEASURES

The main outcome measures were self-reported antibiotic use and symptom duration and severity on seven-point Likert scales (primary outcome: mean sore throat/difficulty swallowing score in the first 2-4 days).

RESULTS

The IMI TestPack Plus Strep A (Inverness Medical, Bedford, UK) was sensitive, specific and easy to use. Lancefield group A/C/G streptococci were found in 40% of cohort 2 and 34% of cohort 1. A five-point score predicting the presence of A/C/G streptococci [FeverPAIN: Fever; Purulence; Attend rapidly (≤ 3 days); severe Inflammation; and No cough or coryza] had moderate predictive value (bootstrapped estimates of area under receiver operating characteristic curve: 0.73 cohort 1, 0.71 cohort 2) and identified a substantial number of participants at low risk of streptococcal infection. In total, 38% of cohort 1 and 36% of cohort 2 scored ≤ 1 for FeverPAIN, associated with streptococcal percentages of 13% and 18%, respectively. In an adaptive trial design, the preliminary score (score 1; n = 1129) was replaced by FeverPAIN (n = 631). For score 1, there were no significant differences between groups. For FeverPAIN, symptom severity was documented in 80% of patients, and was lower in the clinical score group than in the delayed prescribing group (-0.33; 95% confidence interval -0.64 to -0.02; p = 0.039; equivalent to one in three rating sore throat a slight rather than moderately bad problem), and a similar reduction was observed for the RADT group (-0.30; -0.61 to 0.00; p = 0.053). Moderately bad or worse symptoms resolved significantly faster (30%) in the clinical score group (hazard ratio 1.30; 1.03 to 1.63) but not the RADT group (1.11; 0.88 to 1.40). In the delayed group, 75/164 (46%) used antibiotics, and 29% fewer used antibiotics in the clinical score group (risk ratio 0.71; 0.50 to 0.95; p = 0.018) and 27% fewer in the RADT group (0.73; 0.52 to 0.98; p = 0.033). No significant differences in complications or reconsultations were found. The clinical score group dominated both other groups for both the cost/quality-adjusted life-years and cost/change in symptom severity analyses, being both less costly and more effective, and cost-effectiveness acceptability curves indicated the clinical score to be the most likely to be cost-effective from an NHS perspective. Patients were positive about RADTs. Health professionals' concerns about test validity, the time the test took and medicalising self-limiting illness lessened after using the tests. For both RADTs and clinical scores, there were tensions with established clinical experience.

CONCLUSIONS

Targeting antibiotics using a clinical score (FeverPAIN) efficiently improves symptoms and reduces antibiotic use. RADTs used in combination with FeverPAIN provide no clear advantages over FeverPAIN alone, and RADTs are unlikely to be incorporated into practice until health professionals' concerns are met and they have experience of using them. Clinical scores also face barriers related to clinicians' perceptions of their utility in the face of experience. This study has demonstrated the limitation of using one data set to develop a clinical score. FeverPAIN, derived from two data sets, appears to be valid and its use improves outcomes, but diagnostic studies to confirm the validity of FeverPAIN in other data sets and settings are needed. Experienced clinicians need to identify barriers to the use of clinical scoring methods. Implementation studies that address perceived barriers in the use of FeverPAIN are needed.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN32027234.

SOURCE OF FUNDING

This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 18, No. 6. See the NIHR Journals Library website for further project information.

Follow-up of blood-pressure lowering and glucose control in type 2 diabetes

BACKGROUND

In the Action in Diabetes and Vascular Disease: Preterax and Diamicron Modified Release Controlled Evaluation (ADVANCE) factorial trial, the combination of perindopril and indapamide reduced mortality among patients with type 2 diabetes, but intensive glucose control, targeting a glycated hemoglobin level of less than 6.5%, did not. We now report results of the 6-year post-trial follow-up.

METHODS

We invited surviving participants, who had previously been assigned to perindopril-indapamide or placebo and to intensive or standard glucose control (with the glucose-control comparison extending for an additional 6 months), to participate in a post-trial follow-up evaluation. The primary end points were death from any cause and major macrovascular events.

RESULTS

The baseline characteristics were similar among the 11,140 patients who originally underwent randomization and the 8494 patients who participated in the post-trial follow-up for a median of 5.9 years (blood-pressure-lowering comparison) or 5.4 years (glucose-control comparison). Between-group differences in blood pressure and glycated hemoglobin levels during the trial were no longer evident by the first post-trial visit. The reductions in the risk of death from any cause and of death from cardiovascular causes that had been observed in the group receiving active blood-pressure-lowering treatment during the trial were attenuated but significant at the end of the post-trial follow-up; the hazard ratios were 0.91 (95% confidence interval [CI], 0.84 to 0.99; P=0.03) and 0.88 (95% CI, 0.77 to 0.99; P=0.04), respectively. No differences were observed during follow-up in the risk of death from any cause or major macrovascular events between the intensive-glucose-control group and the standard-glucose-control group; the hazard ratios were 1.00 (95% CI, 0.92 to 1.08) and 1.00 (95% CI, 0.92 to 1.08), respectively.

CONCLUSIONS

The benefits with respect to mortality that had been observed among patients originally assigned to blood-pressure-lowering therapy were attenuated but still evident at the end of follow-up. There was no evidence that intensive glucose control during the trial led to long-term benefits with respect to mortality or macrovascular events. (Funded by the National Health and Medical Research Council of Australia and others; ADVANCE-ON ClinicalTrials.gov number, NCT00949286.).

Ambulatory blood pressure adds little to Framingham Risk Score for the primary prevention of cardiovascular disease in older men: secondary analysis of observational study data

OBJECTIVE

To determine the incremental value of ambulatory blood pressure (BP) in predicting cardiovascular risk when the Framingham Risk Score (FRS) is known.

METHODS

We included 780 men without cardiovascular disease from the Uppsala Longitudinal Study of Adult Men, all aged approximately 70 years at baseline. We first screened ambulatory systolic BP (ASBP) parameters for their incremental value by adding them to a model with 10-year FRS. For the best ASBP parameter we estimated HRs and changes in discrimination, calibration and reclassification. We also estimated the difference in the number of men started on treatment and in the number of men protected against a cardiovascular event.

RESULTS

Mean daytime ASBP had the highest incremental value; adding other parameters did not yield further improvements. While ASBP was an independent risk factor for cardiovascular disease, addition to FRS led to only small increases to the overall model fit, discrimination (a 1% increase in the area under the receiver operating characteristic (ROC) curve), calibration and reclassification. We estimated that for every 10,000 men screened with ASBP, 141 fewer would start a new BP-lowering treatment (95% CI 62 to 220 less treated), but this would result in 7 fewer cardiovascular events prevented over the subsequent 10 years (95% CI 21 fewer events prevented to 7 more events prevented).

CONCLUSIONS

In addition to a standard cardiovascular risk assessment it is not clear that ambulatory BP measurement provides further incremental value. The clinical role of ambulatory BP requires ongoing careful consideration.

How do general practitioners and patients make decisions about cardiovascular disease risk?

OBJECTIVE

Although current guidelines around the world recommend using absolute risk (AR) thresholds to decide whether cardiovascular disease (CVD) risk should be managed with lifestyle or medication, the use of AR in clinical practice is limited. The aim of this study was to explore the factors that influence general practitioner (GP) and patient decision making about CVD risk management, including the role of risk perception.

METHODS

Qualitative descriptive study involving semi-structured interviews with 25 GPs and 38 patients in Australia in 2011-2012. Transcribed audio-recordings were thematically coded and a Framework Analysis method was used.

RESULTS

GPs rarely mentioned AR thresholds but were influenced by their subjective perception of the patient's risk and motivation, and their own attitudes toward prevention, including concerns about medication side effects and the efficacy of lifestyle change. Patients were influenced by individual risk factors, their own motivation to change lifestyle, and attitudes toward medication: initially negative, but this improved if medication was more effective than lifestyle. High perceived risk led to medication being recommended by GPs and accepted by patients, but this was not necessarily based on AR. Patient perceptions of high risk also increased motivation to change lifestyle, particularly if they were resistant to the idea of taking medication.

CONCLUSIONS

Perceived risk, motivation, and attitudes appeared to be more important than AR thresholds in this study. CVD risk management guidelines could be more useful if they include strategies to help GPs consider patients' risk perception, motivation, and attitudes as well as evidence-based recommendations.

Is there sufficient evidence for tuning fork tests in diagnosing fractures? A systematic review

OBJECTIVE

To determine the diagnostic accuracy of tuning fork tests for detecting fractures.

DESIGN

Systematic review of primary studies evaluating the diagnostic accuracy of tuning fork tests for the presence of fracture.

DATA SOURCE

We searched MEDLINE, CINAHL, AMED, EMBASE, Sports Discus, CAB Abstracts and Web of Science from commencement to November 2012. We manually searched the reference lists of any review papers and any identified relevant studies.

STUDY SELECTION AND DATA EXTRACTION

Two reviewers independently reviewed the list of potentially eligible studies and rated the studies for quality using the QUADAS-2 tool. Data were extracted to form 2×2 contingency tables. The primary outcome measure was the accuracy of the test as measured by its sensitivity and specificity with 95% CIs.

DATA SYNTHESIS

We included six studies (329 patients), with two types of tuning fork tests (pain induction and loss of sound transmission). The studies included patients with an age range 7-60 years. The prevalence of fracture ranged from 10% to 80%. The sensitivity of the tuning fork tests was high, ranging from 75% to 100%. The specificity of the tests was highly heterogeneous, ranging from 18% to 95%.

CONCLUSIONS

Based on the studies in this review, tuning fork tests have some value in ruling out fractures, but are not sufficiently reliable or accurate for widespread clinical use. The small sample size of the studies and the observed heterogeneity make generalisable conclusion difficult.

Quality and reporting of publications by Indonesian researchers: a literature survey

OBJECTIVES

To evaluate the quality of reporting of the risk of bias of the Indonesian medical research.

METHODS

Publications from PubMed and non-PubMed indexed Indonesian medical journals between January 2008 to December 2010 were assessed for risk of bias based on criterion combination from Hedges-criteria and the Oxford Center for Evidence-Based Medicine. We assessed whether the publications addressed the risk of bias adequately (quality of reporting) and whether the risk of bias criterion was fulfilled (quality of methods). The quality (both of reporting and of methods) of a study was classified as "high" if, for at least two-thirds of the criteria were adequately reported and fulfilled. It was classified as "low" when only one-third of the criteria were reported and or fulfilled.

RESULTS

Of the 1753 publications, 29% (n = 507) were original medical research. For 21% (109/507) the quality of reporting was high; for 15% (77/507) the quality of methods was high. The proportion of high quality was significantly higher among PubMed than non-PubMed, with difference between proportions: (95%CI of difference: 3 to 23).

CONCLUSION

A small proportion of Indonesian studies have high quality of reporting or methods. When international reporting guidelines are endorsed and followed, the quality of future studies may improve.

A Delphi survey to determine how educational interventions for evidence-based practice should be reported: stage 2 of the development of a reporting guideline

BACKGROUND

Undertaking a Delphi exercise is recommended during the second stage in the development process for a reporting guideline. To continue the development for the Guideline for Reporting Evidence-based practice Educational interventions and Teaching (GREET) a Delphi survey was undertaken to determine the consensus opinion of researchers, journal editors and educators in evidence-based practice (EBP) regarding the information items that should be reported when describing an educational intervention for EBP.

METHODS

A four round online Delphi survey was conducted from October 2012 to March 2013. The Delphi panel comprised international researchers, educators and journal editors in EBP. Commencing with an open-ended question, participants were invited to volunteer information considered important when reporting educational interventions for EBP. Over three subsequent rounds participants were invited to rate the importance of each of the Delphi items using an 11 point Likert rating scale (low 0 to 4, moderate 5 to 6, high 7 to 8 and very high >8). Consensus agreement was set a priori as at least 80 per cent participant agreement. Consensus agreement was initially calculated within the four categories of importance (low to very high), prior to these four categories being merged into two (<7 and ≥7). Descriptive statistics for each item were computed including the mean Likert scores, standard deviation (SD), range and median participant scores. Mean absolute deviation from the median (MAD-M) was also calculated as a measure of participant disagreement.

RESULTS

Thirty-six experts agreed to participate and 27 (79%) participants completed all four rounds. A total of 76 information items were generated across the four survey rounds. Thirty-nine items (51%) were specific to describing the intervention (as opposed to other elements of study design) and consensus agreement was achieved for two of these items (5%). When the four rating categories were merged into two (<7 and ≥7), 18 intervention items achieved consensus agreement.

CONCLUSION

This Delphi survey has identified 39 items for describing an educational intervention for EBP. These Delphi intervention items will provide the groundwork for the subsequent consensus discussion to determine the final inclusion of items in the GREET, the first reporting guideline for educational interventions in EBP.

A systematic review of how studies describe educational interventions for evidence-based practice: stage 1 of the development of a reporting guideline

BACKGROUND

The aim of this systematic review was to identify which information is included when reporting educational interventions used to facilitate foundational skills and knowledge of evidence-based practice (EBP) training for health professionals. This systematic review comprised the first stage in the three stage development process for a reporting guideline for educational interventions for EBP.

METHODS

The review question was 'What information has been reported when describing educational interventions targeting foundational evidence-based practice knowledge and skills?'MEDLINE, Academic Search Premier, ERIC, CINAHL, Scopus, Embase, Informit health, Cochrane Library and Web of Science databases were searched from inception until October - December 2011. Randomised and non-randomised controlled trials reporting original data on educational interventions specific to developing foundational knowledge and skills of evidence-based practice were included.Studies were not appraised for methodological bias, however, reporting frequency and item commonality were compared between a random selection of studies included in the systematic review and a random selection of studies excluded as they were not controlled trials. Twenty-five data items were extracted by two independent reviewers (consistency > 90%).

RESULTS

Sixty-one studies met the inclusion criteria (n = 29 randomised, n = 32 non-randomised). The most consistently reported items were the learner's stage of training, professional discipline and the evaluation methods used (100%). The least consistently reported items were the instructor(s) previous teaching experience (n = 8, 13%), and student effort outside face to face contact (n = 1, 2%).

CONCLUSION

This systematic review demonstrates inconsistencies in describing educational interventions for EBP in randomised and non-randomised trials. To enable educational interventions to be replicable and comparable, improvements in the reporting for educational interventions for EBP are required. In the absence of a specific reporting guideline, there are a range of items which are reported with variable frequency. Identifying the important items for describing educational interventions for facilitating foundational knowledge and skills in EBP remains to be determined. The findings of this systematic review will be used to inform the next stage in the development of a reporting guideline for educational interventions for EBP.

Systematic review automation technologies

Systematic reviews, a cornerstone of evidence-based medicine, are not produced quickly enough to support clinical practice. The cost of production, availability of the requisite expertise and timeliness are often quoted as major contributors for the delay. This detailed survey of the state of the art of information systems designed to support or automate individual tasks in the systematic review, and in particular systematic reviews of randomized controlled clinical trials, reveals trends that see the convergence of several parallel research projects.We surveyed literature describing informatics systems that support or automate the processes of systematic review or each of the tasks of the systematic review. Several projects focus on automating, simplifying and/or streamlining specific tasks of the systematic review. Some tasks are already fully automated while others are still largely manual. In this review, we describe each task and the effect that its automation would have on the entire systematic review process, summarize the existing information system support for each task, and highlight where further research is needed for realizing automation for the task. Integration of the systems that automate systematic review tasks may lead to a revised systematic review workflow. We envisage the optimized workflow will lead to system in which each systematic review is described as a computer program that automatically retrieves relevant trials, appraises them, extracts and synthesizes data, evaluates the risk of bias, performs meta-analysis calculations, and produces a report in real time.

Development and validation of the ACE tool: assessing medical trainees' competency in evidence based medicine

BACKGROUND

While a variety of instruments have been developed to assess knowledge and skills in evidence based medicine (EBM), few assess all aspects of EBM - including knowledge, skills attitudes and behaviour - or have been psychometrically evaluated. The aim of this study was to develop and validate an instrument that evaluates medical trainees' competency in EBM across knowledge, skills and attitude.

METHODS

The 'Assessing Competency in EBM' (ACE) tool was developed by the authors, with content and face validity assessed by expert opinion. A cross-sectional sample of 342 medical trainees representing 'novice', 'intermediate' and 'advanced' EBM trainees were recruited to complete the ACE tool. Construct validity, item difficulty, internal reliability and item discrimination were analysed.

RESULTS

We recruited 98 EBM-novice, 108 EBM-intermediate and 136 EBM-advanced participants. A statistically significant difference in the total ACE score was observed and corresponded to the level of training: on a 0-15-point test, the mean ACE scores were 8.6 for EBM-novice; 9.5 for EBM-intermediate; and 10.4 for EBM-advanced (p < 0.0001). Individual item discrimination was excellent (Item Discrimination Index ranging from 0.37 to 0.84), with internal reliability consistent across all but three items (Item Total Correlations were all positive ranging from 0.14 to 0.20).

CONCLUSION

The 15-item ACE tool is a reliable and valid instrument to assess medical trainees' competency in EBM. The ACE tool provides a novel assessment that measures user performance across the four main steps of EBM. To provide a complete suite of instruments to assess EBM competency across various patient scenarios, future refinement of the ACE instrument should include further scenarios across harm, diagnosis and prognosis.

Communicating cardiovascular disease risk: an interview study of General Practitioners' use of absolute risk within tailored communication strategies

BACKGROUND

Cardiovascular disease (CVD) prevention guidelines encourage assessment of absolute CVD risk - the probability of a CVD event within a fixed time period, based on the most predictive risk factors. However, few General Practitioners (GPs) use absolute CVD risk consistently, and communication difficulties have been identified as a barrier to changing practice. This study aimed to explore GPs' descriptions of their CVD risk communication strategies, including the role of absolute risk.

METHODS

Semi-structured interviews were conducted with a purposive sample of 25 GPs in New South Wales, Australia. Transcribed audio-recordings were thematically coded, using the Framework Analysis method to ensure rigour.

RESULTS

GPs used absolute CVD risk within three different communication strategies: 'positive', 'scare tactic', and 'indirect'. A 'positive' strategy, which aimed to reassure and motivate, was used for patients with low risk, determination to change lifestyle, and some concern about CVD risk. Absolute risk was used to show how they could reduce risk. A 'scare tactic' strategy was used for patients with high risk, lack of motivation, and a dismissive attitude. Absolute risk was used to 'scare' them into taking action. An 'indirect' strategy, where CVD risk was not the main focus, was used for patients with low risk but some lifestyle risk factors, high anxiety, high resistance to change, or difficulty understanding probabilities. Non-quantitative absolute risk formats were found to be helpful in these situations.

CONCLUSIONS

This study demonstrated how GPs use three different communication strategies to address the issue of CVD risk, depending on their perception of patient risk, motivation and anxiety. Absolute risk played a different role within each strategy. Providing GPs with alternative ways of explaining absolute risk, in order to achieve different communication aims, may improve their use of absolute CVD risk assessment in practice.

General practitioners' use of absolute risk versus individual risk factors in cardiovascular disease prevention: an experimental study

OBJECTIVE

To understand general practitioners' (GPs) use of individual risk factors (blood pressure and cholesterol levels) versus absolute risk in cardiovascular disease (CVD) risk management decision-making.

DESIGN

Randomised experiment. Absolute risk, systolic blood pressure (SBP), cholesterol ratio (total cholesterol/high-density lipoprotein (TC/HDL)) and age were systematically varied in hypothetical cases. High absolute risk was defined as 5-year risk of a cardiovascular event >15%, high blood pressure levels varied between SBP 147 and 179 mm Hg and high cholesterol (TC/HDL ratio) between 6.5 and 7.2 mmol/L.

SETTING

4 GP conferences in Australia.

PARTICIPANTS

144 Australian GPs.

OUTCOMES

GPs indicated whether they would prescribe cholesterol and/or blood pressure lowering medication. Analyses involved logistic regression.

RESULTS

For patients with high blood pressure: 93% (95% CI 86% to 96%) of high absolute risk patients and 83% (95% CI 76% to 88%) of lower absolute risk patients were prescribed blood pressure medication. Conversely, 30% (95% CI 25% to 36%) of lower blood pressure patients were prescribed blood pressure medication if absolute risk was high and 4% (95% CI 3% to 5%) if lower. 69% of high cholesterol/high absolute risk patients were prescribed cholesterol medication (95% CI 61% to 77%) versus 34% of high cholesterol/lower absolute risk patients (95% CI 28% to 41%). 36% of patients with lower cholesterol (95% CI 30% to 43%) were prescribed cholesterol medication if absolute risk was high versus 10% if lower (95% CI 8% to 13%).

CONCLUSIONS

GPs' decision-making was more consistent with the management of individual risk factors than an absolute risk approach, especially when prescribing blood pressure medication. The results suggest medical treatment of lower risk patients (5-year risk of CVD event <15%) with mildly elevated blood pressure or cholesterol levels is likely to occur even when an absolute risk assessment is specifically provided. The results indicate a need for improving uptake of absolute risk guidelines and GP understanding of the rationale for using absolute risk.