Digital Medication Management in Polypharmacy—Findings of a Cluster-Randomized, Controlled Trial With a Stepped-Wedge Design in Primary Care Practices (AdAM)

BACKGROUND

Inappropriate drug prescriptions for patients with polypharmacy can have avoidable adverse consequences. We studied the effects of a clinical decision-support system (CDSS) for medication management on hospitalizations and mortality.

METHODS

This stepped-wedge, cluster-randomized, controlled trial involved an open cohort of adult patients with polypharmacy in primary care practices (=clusters) in Westphalia-Lippe, Germany. During the period of the intervention, their medication lists were checked annually using the CDSS. The CDSS warns against inappropriate prescriptions on the basis of patient-related health insurance data. The combined primary endpoint consisted of overall mortality and hospitalization for any reason. The secondary endpoints were mortality, hospitalizations, and high-risk prescription. We analyzed the quarterly health insurance data of the intention-to-treat population with a mixed logistic model taking account of clustering and repeated measurements. Sensitivity analyses addressed effects of the COVID-19 pandemic and other effects.

RESULTS

688 primary care practices were randomized, and data were obtained on 42 700 patients over 391 994 quarter years. No significant reduction was found in either the primary endpoint (odds ratio [OR] 1.00; 95% confidence interval [0.95; 1.04]; p = 0.8716) or the secondary endpoints (hospitalizations: OR 1.00 [0.95; 1.05]; mortality: OR 1.04 [0.92; 1.17]; high-risk prescription: OR 0.98 [0.92; 1.04]).

CONCLUSION

The planned analyses did not reveal any significant effect of the intervention. Pandemic-adjusted analyses yielded evidence that the mortality of adult patients with polypharmacy might potentially be lowered by the CDSS. Controlled trials with appropriate follow-up are needed to prove that a CDSS has significant effects on mortality in patients with polypharmacy.

Kidney trajectory charts improve GP management of patients with reduced kidney function: a randomised controlled vignette study

BACKGROUND

The stages of chronic kidney disease (CKD) and estimated glomerular filtration rate (eGFR) reference ranges are currently determined without considering age.

AIM

To determine whether a chart that graphs age with eGFR helps GPs make better decisions about managing patients with declining eGFR.

DESIGN & SETTING

A randomised controlled vignette study among Australian GPs using a percentile chart plotting the trajectory of eGFR by age.

METHOD

Three hundred and seventy-three GPs received two case studies of patients with declining renal function. They were randomised to receive the cases with the chart or without the chart, and asked a series of questions about how they would manage the cases.

RESULTS

In an older female patient with stable but reduced kidney function, use of the chart was associated with GPs in the study recommending a longer follow-up period, and longer time until repeat pathology testing. In a younger male First Nations patient with normal but decreasing kidney function, use of the chart was associated with GPs in the study recommending a shorter follow-up period, shorter time to repeat pathology testing, increased management of blood pressure and lifestyle, and avoidance of nephrotoxic medications. This represents more appropriate care in both cases.

CONCLUSION

Having access to a chart of percentile eGFR by age was associated with more appropriate management review periods of patients with reduced kidney function, either by greater compliance with current guidelines or greater awareness of a clinically relevant kidney problem.

Evaluating the use of clinical decision aids in an Australian emergency department: A cross-sectional survey

OBJECTIVE

To identify healthcare professionals' knowledge, self-reported use, and documentation of clinical decision aids (CDAs) in a large ED in Australia, to identify behavioural determinants influencing the use of CDAs, and healthcare professionals preferences for integrating CDAs into the electronic medical record (EMR) system.

METHODS

Healthcare professionals (doctors, nurses and physiotherapists) working in the ED at the Gold Coast Hospital, Queensland were invited to complete an online survey. Quantitative data were analysed using descriptive statistics, and where appropriate, mapped to the theoretical domains framework to identify potential barriers to the use of CDAs. Qualitative data were analysed using content analysis.

RESULTS

Seventy-four healthcare professionals (34 medical officers, 31 nurses and nine physiotherapists) completed the survey. Healthcare professionals' knowledge and self-reported use of 21 validated CDAs was low but differed considerably across CDAs. Only 4 out of 21 CDAs were reported to be used 'sometimes' or 'always' by the majority of respondents (Ottawa Ankle Rule for ankle injury, Wells' criteria for pulmonary embolism, Wells' criteria for deep vein thrombosis and PERC rule for pulmonary embolism). Most respondents wanted to increase their use of valid and reliable CDAs and supported the integration of CDAs into the EMR to facilitate their use and support documentation. Potential barriers impacting the use of CDAs represented three theoretical domains of knowledge, social/professional role and identity, and social influences.

CONCLUSIONS

CDAs are used variably by healthcare professionals and are inconsistently applied in the clinical encounter. Preferences of healthcare professionals need to be considered to allow the successful integration of CDAs into the EMR.

Comparing dietary strategies to manage cardiovascular risk in primary care: a narrative review of systematic reviews

BACKGROUND

Nutrition care in general practice is crucial for cardiovascular disease (CVD) prevention and management, although comparison between dietary strategies is lacking.

AIM

To compare the best available (most recent, relevant, and high-quality) evidence for six dietary strategies that are effective for primary prevention/absolute risk reduction of CVD.

DESIGN AND SETTING

A pragmatic narrative review of systematic reviews of randomised trials focused on primary prevention of cardiovascular events.

METHOD

Studies about: 1) adults without a history of cardiovascular events; 2) target dietary strategies postulated to reduce CVD risk; and 3) direct cardiovascular or all-cause mortality outcomes were included. Six dietary strategies were examined: energy deficit, Mediterranean-like diet, sodium reduction (salt reduction and substitution), the Dietary Approaches to Stop Hypertension (DASH) diet, alcohol reduction, and fish/fish oil consumption. Reviews were selected based on quality, recency, and relevance. Quality and certainty of evidence was assessed using GRADE.

RESULTS

Twenty-five reviews met inclusion criteria; eight were selected as the highest quality, recent, and relevant. Three dietary strategies showed modest, significant reductions in cardiovascular events: energy deficit (relative risk reduction [RRR] 30%, 95% confidence interval [CI] = 13 to 43), Mediterranean-like diet (RRR 40%, 95% CI = 20 to 55), and salt substitution (RRR 30%, 95% CI = 7 to 48). Still, some caveats remain on the effectiveness of these dietary strategies. Salt reduction, DASH diet, and alcohol reduction showed small, significant reductions in blood pressure, but no reduction in cardiovascular events. Fish/fish oil consumption showed little or no effect; supplementation of fish oil alone showed small reductions in CVD events.

CONCLUSION

For primary prevention, energy deficit, Mediterranean-like diets, and sodium substitution have modest evidence for risk reduction of CVD events. Strategies incorporated into clinical nutrition care should ensure guidance is person centred and tailored to clinical circumstances.

Diagnostic performance of clinical prediction rules to detect group A beta-haemolytic streptococci in people with acute pharyngitis: a systematic review

OBJECTIVE

To assess and compare the diagnostic performance of Clinical Prediction Rules (CPRs) developed to detect group A Beta-haemolytic streptococci in people with acute pharyngitis (or sore throat).

STUDY DESIGN

A systematic review.

METHODS

We searched PubMed, Embase and Web of Science (inception-September 2022) for studies deriving and/or validating CPRs comprised of ≥2 predictors from an individual's history or physical examination. Two authors independently screened articles, extracted data and assessed risk of bias in included studies. A meta-analysis was not possible due to heterogeneity. Instead we compared the performance of CPRs when they were validated in the same study population (head-to-head comparisons). We used a modified grading of recommendations, assessment, development, and evaluations (GRADE) approach to assess certainty of the evidence.

RESULTS

We included 63 studies, all judged at high risk of bias. Of 24 derived CPRs, 7 were externally validated (in 46 external validations). Five validation studies provided data for head-to-head comparison of four pairs of CPRs. Very low certainty evidence favoured the Centor CPR over the McIsaac (2 studies) and FeverPain CPRs (1 study) and found the Centor CPR was equivalent to the Walsh CPR (1 study). The AbuReesh and Steinhoff 2005 CPRs had a similar poor discriminative ability (1 study). Within and between study comparisons suggested the performance of the Centor CPR may be better in adults (>18 years).

CONCLUSION

Very low certainty evidence suggests a better performance of the Centor CPR. When deciding about antibiotic prescribing for pharyngitis patients, involving patients in a shared decision making discussion about the likely benefits and harms, including antibiotic resistance, is recommended. Further research of higher rigour, which compares CPRs across multiple settings, is needed.

The effectiveness of telehealth versus face-to face interventions for anxiety disorders: A systematic review and meta-analysis

INTRODUCTION

Worldwide, it is estimated that 264 million people meet the diagnostic criteria for anxiety conditions. Effective treatment regimens consist of cognitive and behavioural therapies. During the COVID-19 pandemic, treatment delivery relied heavily on telemedicine technologies which enabled remote consultation with patients via phone or video platforms. We aim to identify, appraise and synthesise randomised controlled trials comparing telehealth to face-to-face delivery of care to individuals of any age or gender, diagnosed with anxiety disorders, and disorders with anxiety features.

METHODS

To conduct this systematic review and meta-analysis, we searched three electronic databases, clinical trial registries and citing-cited references of included studies.

RESULTS

A total of five small randomised controlled trials were includable; telehealth was conducted by video in three studies, and by telephone in two. The risk of bias for the 5 studies was low to moderate for most domains. Outcomes related to anxiety, depression symptom severity, obsessive-compulsive disorder, function, working alliance, and satisfaction were comparable between the two modes of delivery at each follow-up time point (immediately post-intervention, 3 months, 6 months and 12 months), with no significant differences reported (p > 0.05). None of the trials reported on the costs of telehealth compared to face-to-face care.

DISCUSSION

For effectively treating anxiety and related conditions, interventions delivered by telehealth appear to be as effective as the same therapy delivered in-person. However, further high-quality trials are warranted to determine the effectiveness, acceptability, feasibility, and cost-effectiveness of telehealth interventions for the management of a wider range of anxiety disorders and treatments.

Clinical trials and their impact on policy during COVID-19: a review

Background

Of over 8,000 recorded randomised trials addressing COVID-19, around 80% were of treatments, and 17% have reported results. Approximately 1% were adaptive or platform trials, with 25 having results available, across 29 journal articles and 10 preprint articles.

Methods

We conducted an extensive literature review to address four questions about COVID-19 trials, particularly the role and impact of platform/adaptive trials and lessons learned.

Results

The key findings were: Q1. Social value in conducting trials and uptake into policy? COVID-19 drug treatments varied substantially and changed considerably, with drugs found effective in definitive clinical trials replacing unproven drugs. Dexamethasone has likely saved ½-2 million lives, and was cost effective across a range of countries and populations, whereas the cost effectiveness of remdesivir is uncertain. Published economic and health system impacts of COVID-19 treatments were infrequent. Q2. Issues with adaptive trial designs. Of the 77 platform trials registered, 6 major platform trials, with approximately 50 treatment arms, recruited ~135,000 participants with funding over $100 million. Q3. Models of good practice. Streamlined set-up processes such as flexible and fast-track funding, ethics, and governance approvals are vital. To facilitate recruitment, simple and streamlined research processes, and pre-existing research networks to coordinate trial planning, design, conduct and practice change are crucial to success. Q4. Potential conflicts to avoid? When treating patients through trials, balancing individual and collective rights and allocating scarce resources between healthcare and research are challenging. Tensions occur between commercial and non-commercial sectors, and academic and public health interests, such as publication and funding driven indicators and the public good.

Conclusion

There is a need to (i) reduce small, repetitive, single centre trials, (ii) increase coordination to ensure robust research conducted for treatments, and (iii) a wider adoption of adaptive/platform trial designs to respond to fast-evolving evidence landscape.

Cardiovascular disease risk communication and prevention: a meta-analysis

BACKGROUND AND AIMS

Knowledge of quantifiable cardiovascular disease (CVD) risk may improve health outcomes and trigger behavioural change in patients or clinicians. This review aimed to investigate the impact of CVD risk communication on patient-perceived CVD risk and changes in CVD risk factors.

METHODS

PubMed, Embase, and PsycINFO databases were searched from inception to 6 June 2023, supplemented by citation analysis. Randomized trials that compared any CVD risk communication strategy versus usual care were included. Paired reviewers independently screened the identified records and extracted the data; disagreements were resolved by a third author. The primary outcome was the accuracy of risk perception. Secondary outcomes were clinician-reported changes in CVD risk, psychological responses, intention to modify lifestyle, and self-reported changes in risk factors and clinician prescribing of preventive medicines.

RESULTS

Sixty-two trials were included. Accuracy of risk perception was higher among intervention participants (odds ratio = 2.31, 95% confidence interval = 1.63 to 3.27). A statistically significant improvement in overall CVD risk scores was found at 6-12 months (mean difference = -0.27, 95% confidence interval = -0.45 to -0.09). For primary prevention, risk communication significantly increased self-reported dietary modification (odds ratio = 1.50, 95% confidence interval = 1.21 to 1.86) with no increase in intention or actual changes in smoking cessation or physical activity. A significant impact on patients' intention to start preventive medication was found for primary and secondary prevention, with changes at follow-up for the primary prevention group.

CONCLUSIONS

In this systematic review and meta-analysis, communicating CVD risk information, regardless of the method, reduced the overall risk factors and enhanced patients' self-perceived risk. Communication of CVD risk to patients should be considered in routine consultations.

Attitudes, beliefs, behaviours and perspectives on barriers and enablers of Australian general practitioners towards non-drug interventions: a national survey

BACKGROUND

Many guidelines recommend non-drug interventions (NDIs) for managing common conditions in primary care. However, compared with drug interventions, NDIs are less widely known, promoted and used. We aim to (1) examine general practitioners' (GPs') knowledge, attitudes and practices for NDIs, including their use of the Royal Australian College of General Practitioners (RACGP) Handbook of Non-Drug Interventions (HANDI), and (2) identify factors influencing their use of NDIs and HANDI.

METHODS

We conducted a web-based cross-sectional survey of practicing GP members in Australia during October-November 2022. The survey contained five sections: characteristics of GP; knowledge and use of NDIs; attitudes towards NDIs; barriers and enablers to using HANDI; and suggestions of NDIs and ideas to improve the uptake of NDIs in primary care.

RESULTS

Of the 366 GPs who completed the survey, 242 (66%) were female, and 248 (74%) were ≥45 years old. One in three GPs reported that they regularly ('always') recommend NDIs to their patients when appropriate (34%), whereas one-third of GPs were unaware of HANDI (39%). GPs identified several factors that improve the uptake of HANDI, including 'access and integration of HANDI in clinical practice', 'content and support to use in practice' and 'awareness and training'.

CONCLUSIONS

While many GPs are aware of the effectiveness of NDIs and often endorse their use, obstacles still prevent widespread adoption in primary care. The results of this survey can serve as a foundation for developing implementation strategies to improve the uptake of effective evidence-based NDIs in primary care.

Evidence for overdiagnosis in noncancer conditions was assessed: a metaepidemiological study using the 'Fair Umpire' framework

OBJECTIVES

To evaluate the strength of the evidence for, and the extent of, overdiagnosis in noncancer conditions.

STUDY DESIGN AND SETTING

We systematically searched for studies investigating overdiagnosis in noncancer conditions. Using the 'Fair Umpire' framework to assess the evidence that cases diagnosed by one diagnostic strategy but not by another may be overdiagnosed, two reviewers independently identified whether a Fair Umpire-a disease-specific clinical outcome, a test result or risk factor that can determine whether an additional case does or does not have disease-was present. Disease-specific clinical outcomes provide the strongest evidence for overdiagnosis, follow-up or concurrent tests provide weaker evidence, and risk factors provide only weak evidence. Studies without a Fair Umpire provide the weakest evidence of overdiagnosis.

RESULTS

Of 132 studies, 47 (36%) did not include a Fair Umpire to adjudicate additional diagnoses. When present, the most common Umpire was a single test or risk factor (32% of studies), with disease-specific clinical outcome Umpires used in only 21% of studies. Estimates of overdiagnosis included 43-45% of screen-detected acute abdominal aneurysms, 54% of cases of acute kidney injury, and 77% of cases of oligohydramnios in pregnancy.

CONCLUSION

Much of the current evidence for overdiagnosis in noncancer conditions is weak. Application of the framework can guide development of robust studies to detect and estimate overdiagnosis in noncancer conditions, ultimately informing evidence-based policies to reduce it.

The 2-week systematic review (2weekSR) method was successfully blind-replicated by another team: a case study

OBJECTIVE

To assess the replicability of a 2-week systematic review (index 2weekSR) created with the assistance of automation tools using the fidelity method.

METHODS

A Preferred Reporting Items for Systematic reviews and Meta-Analyses compliant SR protocol was developed based on the published information of the index 2weekSR study. The replication team consisted of three reviewers. Two reviewers blocked off time during the replication. The total time to complete tasks and the meta-analysis results were compared with the index 2weekSR study. Review process fidelity scores (FSs) were calculated for review methods and outcomes. Barriers to completing the replication were identified.

RESULTS

The review was completed over 63 person-hours (11 workdays/15 calendar days). A FS of 0.95 was achieved for the methods, with 3 (of 8) tasks only partially replicated, and an FS of 0.63 for the outcomes, with 6 (of 7) only partially replicated and one task was not replicated. Nonreplication was mainly caused by missing information in the index 2weekSR study that was not required in standard reporting guidelines. The replication arrived at the same conclusions as the original study.

CONCLUSION

A 2weekSR study was replicated by a small team of three reviewers supported by automation tools. Including additional information when reporting SRs should improve their replicability.

Evaluating the use of the ABCD2 score as a clinical decision aid in the emergency department: Retrospective observational study

OBJECTIVE

Clinical decision aids (CDAs) can help clinicians with patient risk assessment. However, there is little data on CDA calculation, interpretation and documentation in real-world ED settings. The ABCD2 score (range 0-7) is a CDA used for patients with transient ischaemic attack (TIA) and assesses risk of stroke, with a score of 0-3 being low risk. The aim of this study was to describe ABCD2 score documentation in patients with an ED diagnosis of TIA.

METHODS

Retrospective observational study of patients with a working diagnosis of a TIA in two Australian EDs. Data were gathered using routinely collected data from health informatics sources and medical records reviewed by a trained data abstractor. ABCD2 scores were calculated and compared with what was documented by the treating clinician. Data were presented using descriptive analysis and scatter plots.

RESULTS

Among the 367 patients with an ED diagnosis of TIA, clinicians documented an ABCD2 score in 45% (95% CI 40-50%, n = 165). Overall, there was very good agreement between calculated and documented scores (Cohen's kappa 0.90). The mean documented and calculated ABCD2 score were similar (3.8, SD = 1.5, n = 165 vs 3.7, SD = 1.8, n = 367). Documented scores on the threshold of low and high risk were more likely to be discordant with calculated scores.

CONCLUSIONS

The ABCD2 score was documented in less than half of eligible patients. When documented, clinicians were generally accurate with their calculation and application of the ABCD2. No independent predictors of ABCD2 documentation were identified.

Anomalies in the review process and interpretation of the evidence in the NICE guideline for chronic fatigue syndrome and myalgic encephalomyelitis

Chronic fatigue syndrome/myalgic encephalomyelitis (CFS/ME) is a disabling long-term condition of unknown cause. The National Institute for Health and Care Excellence (NICE) published a guideline in 2021 that highlighted the seriousness of the condition, but also recommended that graded exercise therapy (GET) should not be used and cognitive-behavioural therapy should only be used to manage symptoms and reduce distress, not to aid recovery. This U-turn in recommendations from the previous 2007 guideline is controversial.We suggest that the controversy stems from anomalies in both processing and interpretation of the evidence by the NICE committee. The committee: (1) created a new definition of CFS/ME, which 'downgraded' the certainty of trial evidence; (2) omitted data from standard trial end points used to assess efficacy; (3) discounted trial data when assessing treatment harm in favour of lower quality surveys and qualitative studies; (4) minimised the importance of fatigue as an outcome; (5) did not use accepted practices to synthesise trial evidence adequately using GRADE (Grading of Recommendations, Assessment, Development and Evaluations trial evidence); (6) interpreted GET as mandating fixed increments of change when trials defined it as collaborative, negotiated and symptom dependent; (7) deviated from NICE recommendations of rehabilitation for related conditions, such as chronic primary pain and (8) recommended an energy management approach in the absence of supportive research evidence.We conclude that the dissonance between this and the previous guideline was the result of deviating from usual scientific standards of the NICE process. The consequences of this are that patients may be denied helpful treatments and therefore risk persistent ill health and disability.

Improving the Reporting of Primary Care Research: Consensus Reporting Items for Studies in Primary Care-the CRISP Statement

Primary care (PC) is a unique clinical specialty and research discipline with its own perspectives and methods. Research in this field uses varied research methods and study designs to investigate myriad topics. The diversity of PC presents challenges for reporting, and despite the proliferation of reporting guidelines, none focuses specifically on the needs of PC. The Consensus Reporting Items for Studies in Primary Care (CRISP) Checklist guides reporting of PC research to include the information needed by the diverse PC community, including practitioners, patients, and communities. CRISP complements current guidelines to enhance the reporting, dissemination, and application of PC research findings and results. Prior CRISP studies documented opportunities to improve research reporting in this field. Our surveys of the international, interdisciplinary, and interprofessional PC community identified essential items to include in PC research reports. A 2-round Delphi study identified a consensus list of items considered necessary. The CRISP Checklist contains 24 items that describe the research team, patients, study participants, health conditions, clinical encounters, care teams, interventions, study measures, settings of care, and implementation of findings/results in PC. Not every item applies to every study design or topic. The CRISP guidelines inform the design and reporting of (1) studies done by PC researchers, (2) studies done by other investigators in PC populations and settings, and (3) studies intended for application in PC practice. Improved reporting of the context of the clinical services and the process of research is critical to interpreting study findings/results and applying them to diverse populations and varied settings in PC.Annals "Online First" article.

Comparison of Telephone and Video Telehealth Consultations: Systematic Review

BACKGROUND

Telehealth has been used for health care delivery for decades, but the COVID-19 pandemic greatly accelerated the uptake of telehealth in many care settings globally. However, few studies have carried out a direct comparison among different telehealth modalities, with very few studies having compared the effectiveness of telephone and video telehealth modalities.

OBJECTIVE

This study aimed to identify and synthesize randomized controlled trials (RCTs) comparing synchronous telehealth consultations delivered by telephone and those conducted by video with outcomes such as clinical effectiveness, patient safety, cost-effectiveness, and patient and clinician satisfaction with care.

METHODS

PubMed (MEDLINE), Embase, and CENTRAL were searched via the Cochrane Library from inception until February 10, 2023, for RCTs without any language restriction. Forward and backward citation searches were conducted on included RCTs. The Cochrane Risk of Bias 2 tool was used to assess the quality of the studies. We included studies carried out in any health setting-involving all types of outpatient cohorts and all types of health care providers-that compared synchronous video consultations directly with telephone consultations and reported outcomes specified in the objective. We excluded studies of clinician-to-clinician telehealth consults, hospitalized patients, and asynchronous consultations.

RESULTS

Sixteen RCTs-10 in the United States, 3 in the United Kingdom, 2 in Canada, and 1 in Australia involving 1719 participants-were included in the qualitative and quantitative analyses. Most of the telehealth interventions were for hospital-based outpatient follow-ups, monitoring, and rehabilitation (n=13). The 3 studies that were conducted in the community all focused on smoking cessation. In half of the studies, nurses delivered the care (n=8). Almost all included studies had high or unclear risk of bias, mainly due to bias in the randomization process and selection of reported results. The trials found no substantial differences between telephone and video telehealth consultations with regard to clinical effectiveness, patient satisfaction, and health care use (cost-effectiveness) outcomes. None of the studies reported on patient safety or adverse events. We did not find any study on telehealth interventions for diagnosis, initiating new treatment, or those conducted in a primary care setting.

CONCLUSIONS

Based on a small set of diverse trials, we found no notable differences between telephone and video consultations for the management of patients with an established diagnosis. There is also a significant lack of telehealth research in primary care settings despite its high uptake.

Telehealth versus face-to-face delivery of cognitive behavioural therapy for insomnia: A systematic review and meta-analysis of randomised controlled trials

OBJECTIVE

This systematic review and meta-analysis compared the effectiveness of the delivery of care to patients with insomnia via telehealth to its delivery face-to-face.

METHODS

We searched Medline, Embase, and Cochrane CENTRAL from inception to 11 January 2023, and conducted a citation analysis on 13 June 2023. No language restrictions were imposed. We included randomised controlled trials. Where feasible, mean differences were calculated; we used a random effects model.

RESULTS

Four trials (239 patients) were included. There were no significant differences between telehealth and face-to-face for insomnia severity scores shortly post-intervention (MD 1.13, 95% CI -0.29-2.55) or at 3 months (mean difference (MD) 1.79, 95% CI -0.01-3.59). There were no differences in Short Form-36 physical and mental scores, Work and Social Adjustment scores, and sleep quality components. Depression scores did not differ post-intervention or at 3 months (MD 0.42, 95% CI -2.42-3.26). Functioning likewise did not differ post-intervention or at 3 months (standardised mean difference (SMD) 0.15, 95% CI -0.37-0.67, P = 0.58). Treatment satisfaction did not differ (one trial) or favoured the face-to-face group (one trial).

CONCLUSIONS

Telehealth may be a viable alternative to the face-to-face provision of cognitive behavioural therapy for insomnia to patients with insomnia. However, the volume of the existing evidence is limited, therefore additional trials are needed, evaluating cognitive behavioural therapy for insomnia and other therapies for individuals for whom cognitive behavioural therapy for insomnia is not effective, and conducted with a wider range of populations, providers and settings.

Misdiagnosis of Uncomplicated Cellulitis: a Systematic Review and Meta-analysis

BACKGROUND

Cellulitis is a clinical diagnosis with several mimics and no gold standard diagnostic criteria. Misdiagnosis is common. This review aims to quantify the proportion of cellulitis misdiagnosis in primary or unscheduled care settings based on a second clinical assessment and describe the proportion and types of alternative diagnoses.

METHODS

Electronic searches of Medline, Embase and Cochrane library (including CENTRAL) using MeSH and other subject terms identified 887 randomised and non-randomised clinical trials, and cohort studies. Included articles assessed the proportion of cellulitis misdiagnosis in primary or unscheduled care settings through a second clinical assessment up to 14 days post initial diagnosis of uncomplicated cellulitis. Studies on infants and patients with (peri-)orbital, purulent and severe or complex cellulitis were excluded. Screening and data extraction was conducted independently in pairs. Risk of bias was assessed using a modified risk of bias tool from Hoy et al. Meta-analyses were undertaken where ≥ 3 studies reported the same outcome.

RESULTS

Nine studies conducted in the USA, UK and Canada, including a total of 1600 participants, were eligible for inclusion. Six studies were conducted in the inpatient setting; three were in outpatient clinics. All nine included studies provided estimates of the proportion cellulitis misdiagnosis, with a range from 19 to 83%. The mean proportion misdiagnosed was 41% (95% CI 28 to 56% for random effects model). Heterogeneity between studies was very high both statistically (I2 96%, p-value for heterogeneity < 0.001) and clinically. Of the misdiagnoses, 54% were attributed to three conditions (stasis dermatitis, eczematous dermatitis and edema/lymphedema).

DISCUSSION

The proportion of cellulitis misdiagnosis when reviewed within 14 days was substantial though highly variable, with the majority attributable to three diagnoses. This highlights the need for timely clinical reassessment and system initiatives to improve diagnostic accuracy of cellulitis and its most common mimics.

TRIAL REGISTRATION

Open Science Framework ( https://osf.io/9zt72 ).

Is requiring Research Integrity Advisors a useful policy for improving research integrity? A census of advisors in Australia

Research Integrity Advisor s are used in Australia to provide impartial guidance to researchers who have questions about any aspect of responsible research practice. Every Australian institution conducting research must provide access to trained advisors. This national policy could be an important part of creating a safe environment for discussing research integrity issues and thus resolving issues. We conducted the first formal study of advisors, using a census of every Australian advisor to discover their workload and attitudes to their role. We estimated there are 739 advisors nationally. We received responses to our questions from 192. Most advisors had a very light workload, with an median of just 0.5 days per month. Thirteen percent of advisors had not received any training, and some advisors only discovered they were an advisor after our approach. Most advisors were positive about their ability to help colleagues deal with integrity issues. The main desired changes were for greater advertising of their role and a desire to promote good practice rather than just supporting potential issues. Advisors might be a useful policy for supporting research integrity, but some advisors need better institutional support in terms of training and raising awareness.

Evaluating an audit and feedback intervention for reducing overuse of pathology test requesting by Australian general practitioners: protocol for a factorial cluster randomised controlled trial

INTRODUCTION

Consistent evidence shows pathology services are overused worldwide and that about one-third of testing is unnecessary. Audit and feedback (AF) is effective for improving care but few trials evaluating AF to reduce pathology test requesting in primary care have been conducted. The aim of this trial is to estimate the effectiveness of AF for reducing requests for commonly overused pathology test combinations by high-requesting Australian general practitioners (GPs) compared with no intervention control. A secondary aim is to evaluate which forms of AF are most effective.

METHODS AND ANALYSIS

This is a factorial cluster randomised trial conducted in Australian general practice. It uses routinely collected Medicare Benefits Schedule data to identify the study population, apply eligibility criteria, generate the interventions and analyse outcomes. On 12 May 2022, all eligible GPs were simultaneously randomised to either no intervention control or to one of eight intervention groups. GPs allocated to an intervention group received individualised AF on their rate of requesting of pathology test combinations compared with their GP peers. Three separate elements of the AF intervention will be evaluated when outcome data become available on 11 August 2023: (1) invitation to participate in continuing professional development-accredited education on appropriate pathology requesting, (2) provision of cost information on pathology test combinations and (3) format of feedback. The primary outcome is the overall rate of requesting of any of the displayed combinations of pathology tests of GPs over 6 months following intervention delivery. With 3371 clusters, assuming no interaction and similar effects for each intervention, we anticipate over 95% power to detect a difference of 4.4 requests in the mean rate of pathology test combination requests between the control and intervention groups.

ETHICS AND DISSEMINATION

Ethics approval was received from the Bond University Human Research Ethics Committee (#JH03507; approved 30 November 2021). The results of this study will be published in a peer-reviewed journal and presented at conferences. Reporting will adhere to Consolidated Standards of Reporting Trials.

TRIAL REGISTRATION NUMBER

ACTRN12622000566730.

Low-risk prostate lesions: An evidence review to inform discussion on losing the "cancer" label

BACKGROUND

Active surveillance (AS) mitigates harms from overtreatment of low-risk prostate lesions. Recalibration of diagnostic thresholds to redefine which prostate lesions are considered "cancer" and/or adopting alternative diagnostic labels could increase AS uptake and continuation.

METHODS

We searched PubMed and EMBASE to October 2021 for evidence on: (1) clinical outcomes of AS, (2) subclinical prostate cancer at autopsy, (3) reproducibility of histopathological diagnosis, and (4) diagnostic drift. Evidence is presented via narrative synthesis.

RESULTS

AS: one systematic review (13 studies) of men undergoing AS found that prostate cancer-specific mortality was 0%-6% at 15 years. There was eventual termination of AS and conversion to treatment in 45%-66% of men. Four additional cohort studies reported very low rates of metastasis (0%-2.1%) and prostate cancer-specific mortality (0%-0.1%) over follow-up to 15 years. Overall, AS was terminated without medical indication in 1%-9% of men. Subclinical reservoir: 1 systematic review (29 studies) estimated that the subclinical cancer prevalence was 5% at <30 years, and increased nonlinearly to 59% by >79 years. Four additional autopsy studies (mean age: 54-72 years) reported prevalences of 12%-43%. Reproducibility: 1 recent well-conducted study found high reproducibility for low-risk prostate cancer diagnosis, but this was more variable in 7 other studies. Diagnostic drift: 4 studies provided consistent evidence of diagnostic drift, with the most recent (published 2020) reporting that 66% of cases were upgraded and 3% were downgraded when using contemporary diagnostic criteria compared to original diagnoses (1985-1995).

CONCLUSIONS

Evidence collated may inform discussion of diagnostic changes for low-risk prostate lesions.

Quantifying the psychological and behavioural consequences of a diagnostic label for non-cancer conditions: systematic review

BACKGROUND

Screening for asymptomatic health conditions is perceived as mostly beneficial, with possible harms receiving little attention.

AIMS

To quantify proximal and longer-term consequences for individuals receiving a diagnostic label following screening for an asymptomatic, non-cancer health condition.

METHOD

Five electronic databases were searched (inception to November 2022) for studies that recruited asymptomatic screened individuals who received or did not receive a diagnostic label. Eligible studies reported psychological, psychosocial and/or behavioural outcomes before and after screening results. Independent reviewers screened titles and abstracts, extracted data from included studies, and assessed risk of bias (Risk of Bias in Non-Randomised Studies of Interventions). Results were meta-analysed or descriptively reported.

RESULTS

Sixteen studies were included. Twelve studies addressed psychological outcomes, four studies examined behavioural outcomes and none reported psychosocial outcomes. Risk of bias was judged as low (n = 8), moderate (n = 5) or serious (n = 3). Immediately after receiving results, anxiety was significantly higher for individuals receiving versus not receiving a diagnostic label (mean difference -7.28, 95% CI -12.85 to -1.71). On average, anxiety increased from the non-clinical to clinical range, but returned to the non-clinical range in the longer term. No significant immediate or longer-term differences were found for depression or general mental health. Absenteeism did not significantly differ from the year before to the year after screening.

CONCLUSIONS

The impacts of screening asymptomatic, non-cancer health conditions are not universally positive. Limited research exists regarding longer-term impacts. Well-designed, high-quality studies further investigating these impacts are required to assist development of protocols that minimise psychological distress following diagnosis.

We extended the two-week systematic review (2weekSR) methodology to larger, more complex systematic reviews: a case series

OBJECTIVE

In 2019, we invented the two-week systematic review (2weekSR) methodology, to complete full, PRISMA-compliant systematic reviews in approximately 2 weeks. Since then, we have continued to develop and adapt the 2weekSR methodology for completing larger, and more complex systematic reviews, including less experienced or inexperienced team members.

STUDY DESIGN AND SETTING

For ten 2weekSRs, we collected data on: 1) systematic review characteristics; 2) systematic review teams; and 3) time to completion and publication. We have also continued to develop new tools and integrate them into the 2weekSR processes.

RESULTS

The 10 2weekSRs addressed intervention, prevalence and utilisation questions, and included a mix of randomised and observational studies. Reviews involved screening from 458 to 5,471 references, and included between 5 and 81 studies. Median team size was 6. Most reviews (7/10) included team-members with limited systematic review experience; three included team-members with no prior experience. Reviews required a median of 11 work-days (range: 5-20) and 17 calendar days (range: 5-84) to complete; time from journal submission to publication ranged from 99-260 days.

CONCLUSION

The 2weekSR methodology scales with review size and complexity, offering a considerable time-saving over traditionally conducted systematic reviews without relying on methodological shortcuts associated with 'rapid reviews.'

Non-drug interventions for reducing SARS-CoV-2 transmission are frequently incompletely reported

OBJECTIVE

To investigate the completeness of reporting of behavioural, environmental, social and system interventions (BESSI) for reducing the transmission of SARS-CoV-2 evaluated in randomised trials, to obtain missing intervention details and to document the interventions assessed.

STUDY DESIGN AND SETTING

We assessed completeness of reporting in randomised trials of BESSI using the Template for Intervention Description and Replication (TIDieR) checklist. Investigators were contacted to provide missing intervention details and if provided, intervention descriptions were reassessed and documented according to the TIDieR items.

RESULTS

Forty-five trials (planned or complete) describing 21 educational interventions, 15 protective measures and 9 social distancing interventions were included. In 30 trials with a protocol or study report, 30% (9/30) of interventions were completely described; this increased to 53% (16/30) after contacting 24 trial investigators (11 responded). Across all interventions, intervention provider training (35%) was the most frequently incompletely described checklist item, followed by the 'when and how much' intervention item.

CONCLUSION

Incomplete reporting of BESSI is a substantial problem, with essential information necessary for implementation of interventions and for building on existing knowledge frequently missing and unable to be obtained. Such reporting is an avoidable source of research waste.

Effect of covid-19 vaccination on long covid: systematic review

OBJECTIVE

To determine the effect of covid-19 vaccination, given before and after acute infection with the SARS-CoV-2 virus, or after a diagnosis of long covid, on the rates and symptoms of long covid.

DESIGN

Systematic review.

DATA SOURCES

PubMed, Embase, and Cochrane covid-19 trials, and Europe PubMed Central (Europe PMC) for preprints, from 1 January 2020 to 3 August 2022.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

Trials, cohort studies, and case-control studies reporting on patients with long covid and symptoms of long covid, with vaccination before and after infection with the SARS-CoV-2 virus, or after a diagnosis of long covid. Risk of bias was assessed with the ROBINS-I tool.

RESULTS

1645 articles were screened but no randomised controlled trials were found. 16 observational studies from five countries (USA, UK, France, Italy, and the Netherlands) were identified that reported on 614 392 patients. The most common symptoms of long covid that were studied were fatigue, cough, loss of sense of smell, shortness of breath, loss of taste, headache, muscle ache, difficulty sleeping, difficulty concentrating, worry or anxiety, and memory loss or confusion. 12 studies reported data on vaccination before infection with the SARS-CoV-2 virus, and 10 showed a significant reduction in the incidence of long covid: the odds ratio of developing long covid with one dose of vaccine ranged from 0.22 to 1.03; with two doses, odds ratios were 0.25-1; with three doses, 0.16; and with any dose, 0.48-1.01. Five studies reported on vaccination after infection, with odds ratios of 0.38-0.91. The high heterogeneity between studies precluded any meaningful meta-analysis. The studies failed to adjust for potential confounders, such as other protective behaviours and missing data, thus increasing the risk of bias and decreasing the certainty of evidence to low.

CONCLUSIONS

Current studies suggest that covid-19 vaccines might have protective and therapeutic effects on long covid. More robust comparative observational studies and trials are needed, however, to clearly determine the effectiveness of vaccines in preventing and treating long covid.

PROTOCOL REGISTRATION

Open Science Framework https://osf.io/e8jdy.

Indicators of questionable research practices were identified in 163,129 randomized controlled trials

OBJECTIVES

To explore indicators of the following questionable research practices (QRPs) in randomized controlled trials (RCTs): (1) risk of bias in four domains (random sequence generation, allocation concealment, blinding of participants and personnel, and blinding of outcome assessment); (2) modifications in primary outcomes that were registered in trial registration records (proxy for selective reporting bias); (3) ratio of the achieved to planned sample sizes; and (4) statistical discrepancy.

STUDY DESIGN AND SETTING

Full texts of all human RCTs published in PubMed in 1996-2017 were automatically identified and information was collected automatically. Potential indicators of QRPs included author-specific, publication-specific, and journal-specific characteristics. Beta, logistic, and linear regression models were used to identify associations between these potential indicators and QRPs.

RESULTS

We included 163,129 RCT publications. The median probability of bias assessed using Robot Reviewer software ranged between 43% and 63% for the four risk of bias domains. A more recent publication year, trial registration, mentioning of CONsolidated Standards Of Reporting Trials-checklist, and a higher journal impact factor were consistently associated with a lower risk of QRPs.

CONCLUSION

This comprehensive analysis provides an insight into indicators of QRPs. Researchers should be aware that certain characteristics of the author team and publication are associated with a higher risk of QRPs.

Which clinical research questions are the most important? Development and preliminary validation of the Australia & New Zealand Musculoskeletal (ANZMUSC) Clinical Trials Network Research Question Importance Tool (ANZMUSC-RQIT)

BACKGROUND AND AIMS

High quality clinical research that addresses important questions requires significant resources. In resource-constrained environments, projects will therefore need to be prioritized. The Australia and New Zealand Musculoskeletal (ANZMUSC) Clinical Trials Network aimed to develop a stakeholder-based, transparent, easily implementable tool that provides a score for the 'importance' of a research question which could be used to rank research projects in order of importance.

METHODS

Using a mixed-methods, multi-stage approach that included a Delphi survey, consensus workshop, inter-rater reliability testing, validity testing and calibration using a discrete-choice methodology, the Research Question Importance Tool (ANZMUSC-RQIT) was developed. The tool incorporated broad stakeholder opinion, including consumers, at each stage and is designed for scoring by committee consensus.

RESULTS

The ANZMUSC-RQIT tool consists of 5 dimensions (compared to 6 dimensions for an earlier version of RQIT): (1) extent of stakeholder consensus, (2) social burden of health condition, (3) patient burden of health condition, (4) anticipated effectiveness of proposed intervention, and (5) extent to which health equity is addressed by the research. Each dimension is assessed by defining ordered levels of a relevant attribute and by assigning a score to each level. The scores for the dimensions are then summed to obtain an overall ANZMUSC-RQIT score, which represents the importance of the research question. The result is a score on an interval scale with an arbitrary unit, ranging from 0 (minimal importance) to 1000. The ANZMUSC-RQIT dimensions can be reliably ordered by committee consensus (ICC 0.73-0.93) and the overall score is positively associated with citation count (standardised regression coefficient 0.33, p<0.001) and journal impact factor group (OR 6.78, 95% CI 3.17 to 14.50 for 3rd tertile compared to 1st tertile of ANZMUSC-RQIT scores) for 200 published musculoskeletal clinical trials.

CONCLUSION

We propose that the ANZMUSC-RQIT is a useful tool for prioritising the importance of a research question.

Key items for reports of primary care research: an international Delphi study

OBJECTIVE

Reporting guidelines can improve dissemination and application of findings and help avoid research waste. Recent studies reveal opportunities to improve primary care (PC) reporting. Despite increasing numbers of guidelines, none exists for PC research. This study aims to prioritise candidate reporting items to inform a reporting guideline for PC research.

DESIGN

Delphi study conducted by the Consensus Reporting Items for Studies in Primary Care (CRISP) Working Group.

SETTING

International online survey.

PARTICIPANTS

Interdisciplinary PC researchers and research users.

MAIN OUTCOME MEASURES

We drew potential reporting items from literature review and a series of international, interdisciplinary surveys. Using an anonymous, online survey, we asked participants to vote on and whether each candidate item should be included, required or recommended in a PC research reporting guideline. Items advanced to the next Delphi round if they received>50% votes to include. Analysis used descriptive statistics plus synthesis of free-text responses.

RESULTS

98/116 respondents completed round 1 (84% response rate) and 89/98 completed round 2 (91%). Respondents included a variety of healthcare professions, research roles, levels of experience and all five world regions. Round 1 presented 29 potential items, and 25 moved into round 2 after rewording and combining items and adding 2 new items. A majority of round 2 respondents voted to include 23 items (90%-100% for 11 items, 80%-89% for 3 items, 70%-79% for 3 items, 60%-69% for 3 items and 50%-59% for 3 items).

CONCLUSION

Our Delphi study identified items to guide the reporting of PC research that has broad endorsement from the community of producers and users of PC research. We will now use these results to inform the final development of the CRISP guidance for reporting PC research.

Approaches to prioritising research for clinical trial networks: a scoping review

BACKGROUND

Prioritisation of clinical trials ensures that the research conducted meets the needs of stakeholders, makes the best use of resources and avoids duplication. The aim of this review was to identify and critically appraise approaches to research prioritisation applicable to clinical trials, to inform best practice guidelines for clinical trial networks and funders.

METHODS

A scoping review of English-language published literature and research organisation websites (January 2000 to January 2020) was undertaken to identify primary studies, approaches and criteria for research prioritisation. Data were extracted and tabulated, and a narrative synthesis was employed.

RESULTS

Seventy-eight primary studies and 18 websites were included. The majority of research prioritisation occurred in oncology and neurology disciplines. The main reasons for prioritisation were to address a knowledge gap (51 of 78 studies [65%]) and to define patient-important topics (28 studies, [35%]). In addition, research organisations prioritised in order to support their institution's mission, invest strategically, and identify best return on investment. Fifty-seven of 78 (73%) studies used interpretative prioritisation approaches (including Delphi surveys, James Lind Alliance and consensus workshops); six studies used quantitative approaches (8%) such as prospective payback or value of information (VOI) analyses; and 14 studies used blended approaches (18%) such as nominal group technique and Child Health Nutritional Research Initiative. Main criteria for prioritisation included relevance, appropriateness, significance, feasibility and cost-effectiveness.

CONCLUSION

Current research prioritisation approaches for groups conducting and funding clinical trials are largely interpretative. There is an opportunity to improve the transparency of prioritisation through the inclusion of quantitative approaches.

Instruments assessing risk of bias of randomized trials frequently included items that are not addressing risk of bias issues

OBJECTIVES

To establish whether items included in instruments published in the last decade assessing risk of bias of randomized controlled trials (RCTs) are indeed addressing risk of bias.

STUDY DESIGN AND SETTING

We searched Medline, Embase, Web of Science, and Scopus from 2010 to October 2021 for instruments assessing risk of bias of RCTs. By extracting items and summarizing their essential content, we generated an item list. Items that two reviewers agreed clearly did not address risk of bias were excluded. We included the remaining items in a survey in which 13 experts judged the issue each item is addressing: risk of bias, applicability, random error, reporting quality, or none of the above.

RESULTS

Seventeen eligible instruments included 127 unique items. After excluding 61 items deemed as clearly not addressing risk of bias, the item classification survey included 66 items, of which the majority of respondents deemed 20 items (30.3%) as addressing risk of bias; the majority deemed 11 (16.7%) as not addressing risk of bias; and there proved substantial disagreement for 35 (53.0%) items.

CONCLUSION

Existing risk of bias instruments frequently include items that do not address risk of bias. For many items, experts disagree on whether or not they are addressing risk of bias.

Knowledge of Musculoskeletal Medicine in Junior Doctors in Australia: Is It Adequate?

PURPOSE

The incidence of musculoskeletal disease is increasing in Australia and around the world. However, medical student education does not necessarily reflect current and projected trends in musculoskeletal medicine. The aim of this study was to assess junior doctors' competency in musculoskeletal medicine using the Freedman and Bernstein Basic Competency Examination in Musculoskeletal Medicine questionnaire.

METHODS

We conducted a cohort study of interns (first year post medical school) across four teaching hospitals in Australia. Interns were asked to take the Freedman and Bernstein examination during organised intern teaching sessions, and results were analysed using the original Freedman and Bernstein marking criteria and validated pass mark.

RESULTS

The mean score for the 92 interns was 13.9 out of 25 (55%) with scores ranging from 8 to 20.8 (29-83%). Only 8 of the 92 interns (8.7%) achieved a score of greater than 73%, the pre-specified pass mark.

CONCLUSION

Our study identifies inadequacies in musculoskeletal medical knowledge in Australian interns. Review of undergraduate medical education may be required to reflect current and predicted trends in the prevalence of musculoskeletal disease and adequately prepare junior doctors.

Including Information on Overdiagnosis in Shared Decision Making: A Review of Prostate Cancer Screening Decision Aids

Background. Overdiagnosis is an accepted harm of cancer screening, but studies of prostate cancer screening decision aids have not examined provision of information important in communicating the risk of overdiagnosis, including overdiagnosis frequency, competing mortality risk, and the high prevalence of indolent cancers in the population. Methods. We undertook a comprehensive review of all publicly available decision aids for prostate cancer screening, published in (or translated to) the English language, without date restrictions. We included all decision aids from a recent systematic review and screened excluded studies to identify further relevant decision aids. We used a Google search to identify further decision aids not published in peer reviewed medical literature. Two reviewers independently screened the decision aids and extracted information on communication of overdiagnosis. Disagreements were resolved through discussion or by consulting a third author. Results. Forty-one decision aids were included out of the 80 records identified through the search. Most decision aids (n = 32, 79%) did not use the term overdiagnosis but included a description of it (n = 38, 92%). Few (n = 7, 17%) reported the frequency of overdiagnosis. Little more than half presented the benefits of prostate cancer screening before the harms (n = 22, 54%) and only 16, (39%) presented information on competing risks of mortality. Only 2 (n = 2, 5%) reported the prevalence of undiagnosed prostate cancer in the general population. Conclusion. Most patient decision aids for prostate cancer screening lacked important information on overdiagnosis. Specific guidance is needed on how to communicate the risks of overdiagnosis in decision aids, including appropriate content, terminology and graphical display.

Highlights

Most patient decision aids for prostate cancer screening lacks important information on overdiagnosis.Specific guidance is needed on how to communicate the risks of overdiagnosis.

Kidney trajectory charts to assist general practitioners in the assessment of patients with reduced kidney function: a randomised vignette study

OBJECTIVE

To investigate the decisional impact of an age-based chart of kidney function decline to support general practitioners (GPs) to appropriately interpret estimated glomerular filtration rate (eGFR) and identify patients with a clinically relevant kidney problem.

DESIGN AND SETTING

Randomised vignette study PARTICIPANTS: 372 Australian GPs from August 2018 to November 2018.

INTERVENTION

GPs were given two patient case scenarios: (1) an older woman with reduced but stable renal function and (2) a younger Aboriginal man with declining kidney function still in the normal range. One group was given an age-based chart of kidney function to assist their assessment of the patient (initial chart group); the second group was asked to assess the patients without the chart, and then again using the chart (delayed chart group).

MAIN OUTCOME MEASURES

GPs' assessment of the likelihood-on a Likert scale-that the patients had chronic kidney disease (CKD) according to the usual definition or a clinical problem with their kidneys.

RESULTS

Prior to viewing the age-based chart GPs were evenly distributed as to whether they thought case 1-the older woman-had CKD or a clinically relevant kidney problem. GPs who had initial access to the chart were less likely to think that the older woman had CKD, and less likely to think she had a clinically relevant problem with her kidneys than GPs who had not viewed the chart. After subsequently viewing the chart, 14% of GPs in the delayed chart group changed their opinion, to indicate she was unlikely to have a clinically relevant problem with her kidneys.Prior to viewing the chart, the majority of GPs (66%) thought case 2-the younger man-did not have CKD, and were evenly distributed as to whether they thought he had a clinically relevant kidney problem. In contrast, GPs who had initial access to the chart were more likely to think he had CKD and the majority (72%) thought he had a clinically relevant kidney problem. After subsequently viewing the chart, 37% of GPs in the delayed chart group changed their opinion to indicate he likely had a clinically relevant problem with his kidneys.

CONCLUSIONS

Use of the chart changed GPs interpretation of eGFR, with increased recognition of the younger male patient's clinically relevant kidney problem, and increased numbers classifying the older female patient's kidney function as normal for her age. This study has shown the potential of an age-based kidney function chart to reduce both overdiagnosis and underdiagnosis.

Telehealth v. face-to-face provision of care to patients with depression: a systematic review and meta-analysis

Ensuring continuity of care for patients with major depressive disorders poses multiple challenges. We conducted a systematic review and meta-analysis of randomised controlled trials comparing real-time telehealth to face-to-face therapy for individuals with depression. We searched Medline, Embase, and Cochrane Central (to November 2020), conducted a citation analysis (January 2021), and searched clinical trial registries (March 2021). We included randomised controlled trials comparing similar or identical care, delivered via real-time telehealth (phone, video) to face-to-face. Outcomes included: depression severity, quality of life, therapeutic alliance, and care satisfaction. Where data were sufficient, mean differences were calculated. Nine trials (1268 patients) were included. There were no differences between telehealth and face-to-face care for depression severity at post-treatment (SMD -0.04, 95% CI -0.21 to 0.13, p = 0.67) or at other time points, except at 9 months post-treatment (SMD -0.39, 95% CI -0.75 to -0.02, p = 0.04). One trial reported no differences in quality-of-life scores at 3- or 12-months post-treatment. One trial found no differences in therapeutic alliance at weeks 4 and 14 of treatment. There were no differences in treatment satisfaction between telehealth and face-to-face immediately post-treatment (SMD -0.14, 95% CI -0.56 to 0.28, p = 0.51) or at 3 or 12-months. Evidence suggests that for patients with depression or depression symptoms, the provision of care via telehealth may be a viable alternative to the provision of care face-to-face. However, additional trials are needed with longer follow-up, conducted in a wider range of settings, and with younger patients.

Effect of an Individualized Audit and Feedback Intervention on Rates of Musculoskeletal Diagnostic Imaging Requests by Australian General Practitioners: A Randomized Clinical Trial

IMPORTANCE

Audit and feedback can improve professional practice, but few trials have evaluated its effectiveness in reducing potential overuse of musculoskeletal diagnostic imaging in general practice.

OBJECTIVE

To evaluate the effectiveness of audit and feedback for reducing musculoskeletal imaging by high-requesting Australian general practitioners (GPs).

DESIGN, SETTING, AND PARTICIPANTS

This factorial cluster-randomized clinical trial included 2271 general practices with at least 1 GP who was in the top 20% of referrers for 11 imaging tests (of the lumbosacral or cervical spine, shoulder, hip, knee, and ankle/hind foot) and for at least 4 individual tests between January and December 2018. Only high-requesting GPs within participating practices were included. The trial was conducted between November 2019 and May 2021, with final follow-up on May 8, 2021.

INTERVENTIONS

Eligible practices were randomized in a 1:1:1:1:1 ratio to 1 of 4 different individualized written audit and feedback interventions (n = 3055 GPs) that varied factorially by (1) frequency of feedback (once vs twice) and (2) visual display (standard vs enhanced display highlighting highly requested tests) or to a control condition of no intervention (n = 764 GPs). Participants were not masked.

MAIN OUTCOMES AND MEASURES

The primary outcome was the overall rate of requests for the 11 targeted imaging tests per 1000 patient consultations over 12 months, assessed using routinely collected administrative data. Primary analyses included all randomized GPs who had at least 1 patient consultation during the study period and were performed by statisticians masked to group allocation.

RESULTS

A total of 3819 high-requesting GPs from 2271 practices were randomized, and 3660 GPs (95.8%; n = 727 control, n = 2933 intervention) were included in the primary analysis. Audit and feedback led to a statistically significant reduction in the overall rate of imaging requests per 1000 consultations compared with control over 12 months (adjusted mean, 27.7 [95% CI, 27.5-28.0] vs 30.4 [95% CI, 29.8-30.9], respectively; adjusted mean difference, -2.66 [95% CI, -3.24 to -2.07]; P < .001).

CONCLUSIONS AND RELEVANCE

Among Australian general practitioners known to frequently request musculoskeletal diagnostic imaging, an individualized audit and feedback intervention, compared with no intervention, significantly decreased the rate of targeted musculoskeletal imaging tests ordered over 12 months.

TRIAL REGISTRATION

ANZCTR Identifier: ACTRN12619001503112.

Testing behaviour may bias observational studies of vaccine effectiveness

BACKGROUND

Recent observational studies suggest that vaccines may have little effect in preventing infection with the Omicron variant of severe acute respiratory syndrome coronavirus 2. However, the observed effects may be confounded by patient factors, preventive behaviours, or differences in testing behaviour. To assess potential confounding, we examined differences in testing behaviour between unvaccinated and vaccinated populations.

METHODS

We recruited 1,526 Australian adults for an online randomized study about coronavirus disease 2019 (COVID-19) testing in late 2021, collecting self-reported vaccination status and three measures of COVID-19 testing behaviour: testing in past month or ever and test intention if they woke with a sore throat. We examined the association between testing intentions and vaccination status in the trial's baseline data.

RESULTS

Of the 1,526 participants (mean age 31 y), 22% had a COVID-19 test in the past month and 61% ever; 17% were unvaccinated, 11% were partially vaccinated (one dose), and 71% were fully vaccinated (two or more doses). Fully vaccinated participants were twice as likely as those who were unvaccinated (relative risk [RR] 2.2, 95% CI 1.8 to 2.8, p < 0.001) to report positive COVID testing intentions. Partially vaccinated participants had less positive intentions than fully vaccinated participants (RR 0.68, 95% CI 0.52 to 0.89, p < 0.001) but higher intentions than unvaccinated participants (RR 1.5, 95% CI 1.4 to 1.6, p = 0.002).

DISCUSSION

Vaccination predicted greater COVID-19 testing intentions and would substantially bias observed vaccine effectiveness. To account for differential testing behaviours, test-negative designs are currently the preferred option, but their assumptions need more thorough examination.

Evaluation of the Incremental Value of a Coronary Artery Calcium Score Beyond Traditional Cardiovascular Risk Assessment: A Systematic Review and Meta-analysis

IMPORTANCE

Coronary artery calcium scores (CACS) are used to help assess patients' cardiovascular status and risk. However, their best use in risk assessment beyond traditional cardiovascular factors in primary prevention is uncertain.

OBJECTIVE

To find, assess, and synthesize all cohort studies that assessed the incremental gain from the addition of a CACS to a standard cardiovascular disease (CVD) risk calculator (or CVD risk factors for a standard calculator), that is, comparing CVD risk score plus CACS with CVD risk score alone.

EVIDENCE REVIEW

Eligible studies needed to be cohort studies in primary prevention populations that used 1 of the CVD risk calculators recommended by national guidelines (Framingham Risk Score, QRISK, pooled cohort equation, NZ PREDICT, NORRISK, or SCORE) and assessed and reported incremental discrimination with CACS for estimating the risk of a future cardiovascular event.

FINDINGS

From 2772 records screened, 6 eligible cohort studies were identified (with 1043 CVD events in 17 961 unique participants) from the US (n = 3), the Netherlands (n = 1), Germany (n = 1), and South Korea (n = 1). Studies varied in size from 470 to 5185 participants (range of mean [SD] ages, 50 [10] to 75.1 [7.3] years; 38.4%-59.4% were women). The C statistic for the CVD risk models without CACS ranged from 0.693 (95% CI, 0.661-0.726) to 0.80. The pooled gain in C statistic from adding CACS was 0.036 (95% CI, 0.020-0.052). Among participants classified as being at low risk by the risk score and reclassified as at intermediate or high risk by CACS, 85.5% (65 of 76) to 96.4% (349 of 362) did not have a CVD event during follow-up (range, 5.1-10.0 years). Among participants classified as being at high risk by the risk score and reclassified as being at low risk by CACS, 91.4% (202 of 221) to 99.2% (502 of 506) did not have a CVD event during follow-up.

CONCLUSIONS AND RELEVANCE

This systematic review and meta-analysis found that the CACS appears to add some further discrimination to the traditional CVD risk assessment equations used in these studies, which appears to be relatively consistent across studies. However, the modest gain may often be outweighed by costs, rates of incidental findings, and radiation risks. Although the CACS may have a role for refining risk assessment in selected patients, which patients would benefit remains unclear. At present, no evidence suggests that adding CACS to traditional risk scores provides clinical benefit.

Real-Time Telehealth Versus Face-to-Face Management for Patients With PTSD in Primary Care: A Systematic Review and Meta-Analysis

Objective: We conducted a systematic review and meta-analysis of randomized controlled trials comparing real-time telehealth (video, phone) with face-to-face therapy delivery to individuals with posttraumatic stress disorder (PTSD), by primary or allied health care practitioners. Data Sources: We searched MEDLINE, Embase, CINAHL, and Cochrane Central (inception to November 18, 2020); conducted a citation analysis on included studies (January 7, 2021) in Web of Science; and searched ClinicalTrials.gov and WHO ICTRP (March 25, 2021). No language or publication date restrictions were used. Study Selection: From 4,651 individual records screened, 13 trials (27 references) met the inclusion criteria. Data Extraction: Data on PTSD severity, depression severity, quality of life, therapeutic alliance, and treatment satisfaction outcomes were extracted. Results: There were no differences between telehealth and face-to-face for PTSD severity (at 6 months: standardized mean difference [SMD]  = -0.11; 95% CI, -0.28 to 0.06), depression severity (at 6 months: SMD = -0.02; 95% CI, -0.26 to 0.22; P = .87), therapeutic alliance (at 3 months: SMD = 0.04; 95% CI, -0.51 to 0.59; P = .90), or treatment satisfaction (at 3 months: mean difference = 3.09; 95% CI, -7.76 to 13.94; P = .58). One trial reported similar changes in quality of life in telehealth and face-to-face. Conclusions: Telehealth appears to be a viable alternative for care provision to patients with PTSD. Trials evaluating therapy provision by telephone, and in populations other than veterans, are warranted.

The impact of antibiotics on clinical response over time in uncomplicated cellulitis: a systematic review and meta-analysis

PURPOSE

Antibiotic treatment of uncomplicated cellulitis is highly variable with respect to agent, dose, and route of administration. As there is uncertainty about optimal/appropriate time to reassess, we aimed to assess time to clinical response.

METHODS

We conducted a systematic review of randomized controlled trials reporting clinical response of uncomplicated cellulitis to antibiotic treatment over multiple timepoints. PubMed, Embase, CENTRAL, WHO ICTRP, and clinicaltrials.gov were searched from inception to June 2021 without language restrictions. The primary outcome was time to clinical response. Other outcomes were components of clinical response (pain, severity score, redness, edema measured at ≥ 2 timepoints) and the proportion of patients with treatment failure. We performed a pooled estimate of the average time to clinical response together with 95% confidence intervals using a random effects model.

RESULTS

We included 32 randomized controlled trials (n = 13,576 participants). The mean time to clinical response was 1.68 days (95%CI 1.48-1.88; I² = 76%). The response to treatment for specific components was as follows: ~ 50% reduction of pain and severity score by day 5, a ~ 33% reduction in area of redness by day 2-3, and a 30-50% reduction of proportion of patients with edema by day 2-4. Treatment failure was variably defined with an overall failure rate of 12% (95%CI 9-16%).

CONCLUSION

The best available data suggest the optimal time to clinical reassessment is between 2 and 4 days, but this must be interpreted with caution due to considerable heterogeneity and small number of included studies.

Telehealth Versus Face-to-face Psychotherapy for Less Common Mental Health Conditions: Systematic Review and Meta-analysis of Randomized Controlled Trials

BACKGROUND

Mental disorders are a leading cause of distress and disability worldwide. To meet patient demand, there is a need for increased access to high-quality, evidence-based mental health care. Telehealth has become well established in the treatment of illnesses, including mental health conditions.

OBJECTIVE

This study aims to conduct a robust evidence synthesis to assess whether there is evidence of differences between telehealth and face-to-face care for the management of less common mental and physical health conditions requiring psychotherapy.

METHODS

In this systematic review, we included randomized controlled trials comparing telehealth (telephone, video, or both) versus the face-to-face delivery of psychotherapy for less common mental health conditions and physical health conditions requiring psychotherapy. The psychotherapy delivered had to be comparable between the telehealth and face-to-face groups, and it had to be delivered by general practitioners, primary care nurses, or allied health staff (such as psychologists and counselors). Patient (symptom severity, overall improvement in psychological symptoms, and function), process (working alliance and client satisfaction), and financial (cost) outcomes were included.

RESULTS

A total of 12 randomized controlled trials were included, with 931 patients in aggregate; therapies included cognitive behavioral and family therapies delivered in populations encompassing addiction disorders, eating disorders, childhood mental health problems, and chronic conditions. Telehealth was delivered by video in 7 trials, by telephone in 3 trials, and by both in 1 trial, and the delivery mode was unclear in 1 trial. The risk of bias for the 12 trials was low or unclear for most domains, except for the lack of the blinding of participants, owing to the nature of the comparison. There were no significant differences in symptom severity between telehealth and face-to-face therapy immediately after treatment (standardized mean difference [SMD] 0.05, 95% CI -0.17 to 0.27) or at any other follow-up time point. Similarly, there were no significant differences immediately after treatment between telehealth and face-to-face care delivery on any of the other outcomes meta-analyzed, including overall improvement (SMD 0.00, 95% CI -0.40 to 0.39), function (SMD 0.13, 95% CI -0.16 to 0.42), working alliance client (SMD 0.11, 95% CI -0.34 to 0.57), working alliance therapist (SMD -0.16, 95% CI -0.91 to 0.59), and client satisfaction (SMD 0.12, 95% CI -0.30 to 0.53), or at any other time point (3, 6, and 12 months).

CONCLUSIONS

With regard to effectively treating less common mental health conditions and physical conditions requiring psychological support, there is insufficient evidence of a difference between psychotherapy delivered via telehealth and the same therapy delivered face-to-face. However, there was no includable evidence in this review for some serious mental health conditions, such as schizophrenia and bipolar disorders, and further high-quality research is needed to determine whether telehealth is a viable, equivalent treatment option for these conditions.

"I was prepared to become infected as a frontline medical staff": a survey of Australian emergency department staff experiences during COVID-19

Objective

To identify challenges faced by Australian hospital healthcare staff during the COVID‐19 pandemic.

Methods

We conducted an online survey (30 June–15 August 2020) of healthcare staff from Australian emergency and infectious disease departments. Participants were contacted via professional organisations and asked about preparedness, personal protective equipment (PPE), information flow, patient care, infection concerns, workload and mental health. We calculated the proportion of answers to yes/no and Likert‐style questions; free‐text responses were analysed thematically.

Results

Respondents (n = 162) were 23–67 years old, 98% worked in EDs, 68% were female, 87% from Queensland, and most worked as nurses (46%) or specialists (31%). Respondents felt their workplace was prepared for the pandemic (79%), had sufficient information about PPE (83%); none were sent home because of PPE shortages. Eighty‐five percent received sufficient information from official bodies and 50% were aware of the National COVID‐19 Clinical Evidence Taskforce guidelines. Most (83%) had sufficient information to provide optimal patient care, but 24% experienced unfair/abusive patient behaviour. Most (76%) were concerned about becoming infected by patients, 67% about infecting patients, and 78% about infecting someone at home. Workload decreased for 82% but 42% looked after more patients. Fifty‐seven percent experienced additional work‐related stress: 60% reporting experiencing anxiety and 53% experiencing burnout, with 36% and 46% continuing to experience these, respectively. Key challenges included: emotional, workplace/organisational, family/loved ones and PPE factors.

Conclusion

The Australian system provided sufficient information and PPE. Staff experienced considerable stress, infection concerns and emotional challenges, which merit consideration in preparing for the future.

We surveyed Australian hospital healthcare staff during the second wave of the COVID‐19 pandemic. Majority felt they had sufficient information and amounts of PPE and knew enough to provide optimal care to patients. However, many reported concerns about becoming infected with and transmitting COVID‐19, half suffered from additional stress, and many continue to experience burnout and anxiety.

Antibiotic stewardship: A review of successful, evidence-based primary care strategies

BACKGROUND

Antibiotic resistance is a rising global threat with only two options for mitigation: 1) invent new antibiotics and/or 2) use current antibiotics more wisely. In Australia, the majority of antibiotic usage is in the community, hence primary care has a key role.  OBJECTIVE: With no single 'magic bullet', a range of approaches is needed. The aim of this article is to describe the options and evidence in three broad categories: 1) regulatory changes such as repeats and pack sizes, 2) policy initiatives such as public campaigns, academic detailing and education and 3) clinical strategies including delayed prescribing, clinical decision support tools, practice-based audit and feedback, and patient information sheets.

DISCUSSION

Australia has good antibiotic regulation and guidelines but must invest in sustained primary care stewardship programs, which should include surveillance, information for consumers, support for general practitioners and general practice training, and an ongoing evaluation and research program.