An innovative artificial intelligence-based method to compress complex models into explainable, model-agnostic and reduced decision support systems with application to healthcare (NEAR)

BACKGROUND AND OBJECTIVE

In everyday clinical practice, medical decision is currently based on clinical guidelines which are often static and rigid, and do not account for population variability, while individualized, patient-oriented decision and/or treatment are the paradigm change necessary to enter into the era of precision medicine. Most of the limitations of a guideline-based system could be overcome through the adoption of Clinical Decision Support Systems (CDSSs) based on Artificial Intelligence (AI) algorithms. However, the black-box nature of AI algorithms has hampered a large adoption of AI-based CDSSs in clinical practice. In this study, an innovative AI-based method to compress AI-based prediction models into explainable, model-agnostic, and reduced decision support systems (NEAR) with application to healthcare is presented and validated.

METHODS

NEAR is based on the Shapley Additive Explanations framework and can be applied to complex input models to obtain the contributions of each input feature to the output. Technically, the simplified NEAR models approximate contributions from input features using a custom library and merge them to determine the final output. Finally, NEAR estimates the confidence error associated with the single input feature contributing to the final score, making the result more interpretable. Here, NEAR is evaluated on a clinical real-world use case, the mortality prediction in patients who experienced Acute Coronary Syndrome (ACS), applying three different Machine Learning/Deep Learning models as implementation examples.

RESULTS

NEAR, when applied to the ACS use case, exhibits performances like the ones of the AI-based model from which it is derived, as in the case of the Adaptive Boosting classifier, whose Area Under the Curve is not statistically different from the NEAR one, even the model's simplification. Moreover, NEAR comes with intrinsic explainability and modularity, as it can be tested on the developed web application platform (https://neardashboard.pythonanywhere.com/).

CONCLUSIONS

An explainable and reliable CDSS tailored to single-patient analysis has been developed. The proposed AI-based system has the potential to be used alongside the clinical guidelines currently employed in the medical setting making them more personalized and dynamic and assisting doctors in taking their everyday clinical decisions.

Validation of Pediatric Emergency Care Applied Research Network (PECARN) rule in children with minor head trauma

The Pediatric Emergency Care Applied Research Network (PECARN) rule is commonly used for predicting the need for computed tomography (CT) scans in children with mild head trauma. The objective of this study was to validate the PECARN rule in Korean children presenting to the pediatric emergency department (PED) with head trauma. This study was a multicenter, retrospective, observational cohort study in two teaching PEDs in Korea between August 2015 and August 2016. In this observational study, 448 patients who visited PEDs were included in the final analysis. Risk stratification was performed with clinical decision support software based on the PECARN rule, and decisions to perform CT scans were subsequently made. Patients were followed-up by phone call between 7 days and 90 days after discharge from the PED. The sensitivity and specificity were analyzed. The sensitivity was 100% for all age groups, and no cases of clinically important traumatic brain injury (ciTBI) were identified in the very-low-risk group. CT scans were performed for 14.7% of patients in this study and for 33.8% in the original PECARN study. The PECARN rule successfully identified low-risk patients, and no cases of ciTBI were missed despite the reduced proportion of patients undergoing CT scans.

Clinical efficacy of a Decision Support Tool (Link-me) to guide intensity of mental health care in primary practice: a pragmatic stratified randomised controlled trial

BACKGROUND

The volume and heterogeneity of mental health problems that primary care patients present with is a substantial challenge for health systems, and both undertreatment and overtreatment are common. We developed Link-me, a patient-completed Decision Support Tool, to predict severity of depression or anxiety, identify priorities, and recommend interventions. In this study, we aimed to examine if Link-me reduces psychological distress among individuals predicted to have minimal/mild or severe symptoms of anxiety or depression.

METHODS

In this pragmatic stratified randomised controlled trial, adults aged 18-75 years reporting depressive or anxiety symptoms or use of mental health medication were recruited from 23 general practices in Australia. Participants completed the Decision Support Tool and were classified into three prognostic groups (minimal/mild, moderate, severe), and those in the minimal/mild and severe groups were eligible for inclusion. Participants were individually and randomly assigned (1:1) by a computer-generated allocation sequence to receive either prognosis-matched care (intervention group) or usual care plus attention control (control group). Participants were not blinded but intervention providers were only notified of those allocated to the intervention group. Outcome assessment was blinded. The primary outcome was the difference in the change in scores between the intervention and control group, and within prognostic groups, on the 10-item Kessler Psychological Distress Scale at 6 months post randomisation. The trial was registered on the Australian and New Zealand Clinical Trials Registry, ACTRN12617001333303.

OUTCOMES

Between Nov 21, 2017, and Oct 31, 2018, 24 616 patients were invited to complete the eligibility screening survey. 1671 of these patients were included and randomly assigned to either the intervention group (n=834) or the control group (n=837). Prognosis-matched care was associated with greater reductions in psychological distress than usual care plus attention control at 6 months (p=0·03), with a standardised mean difference (SMD) of -0·09 (95% CI -0·17 to -0·01). This reduction was also seen in the severe prognostic group (p=0·003), with a SMD of -0·26 (-0·43 to -0·09), but not in the minimal/mild group (p=0·73), with a SMD of 0·04 (-0·17 to 0·24). In the complier average causal effect analysis in the severe prognostic group, differences were larger among those who received some or all aspects of the intervention (SMD range -0·58 to -1·15). No serious adverse effects were recorded.

INTERPRETATION

Prognosis-based matching of interventions reduces psychological distress in patients with anxiety or depressive symptoms, particularly in those with severe symptoms, and is associated with better outcomes when patients access the recommended treatment. Optimisation of the Link-me approach and implementation into routine practice could help reduce the burden of disease associated with common mental health conditions such as anxiety and depression.

FUNDING

Australian Government Department of Health.

Optimizing clinical decision support alerts in electronic medical records: a systematic review of reported strategies adopted by hospitals

OBJECTIVE

To identify and summarize the current internal governance processes adopted by hospitals, as reported in the literature, for selecting, optimizing, and evaluating clinical decision support (CDS) alerts in order to identify effective approaches.

MATERIALS AND METHODS

Databases (Medline, Embase, CINAHL, Scopus, Web of Science, IEEE Xplore Digital Library, CADTH, and WorldCat) were searched to identify relevant papers published from January 2010 to April 2020. All paper types published in English that reported governance processes for selecting and/or optimizing CDS alerts in hospitals were included.

RESULTS

Eight papers were included in the review. Seven papers focused specifically on medication-related CDS alerts. All papers described the use of a multidisciplinary committee to optimize alerts. Other strategies included the use of clinician feedback, alert data, literature and drug references, and a visual dashboard. Six of the 8 papers reported evaluations of their CDS alert modifications following the adoption of optimization strategies, and of these, 5 reported a reduction in alert rate.

CONCLUSIONS

A multidisciplinary committee, often in combination with other approaches, was the most frequent strategy reported by hospitals to optimize their CDS alerts. Due to the limited number of published processes, variation in system changes, and evaluation results, we were unable to compare the effectiveness of different strategies, although employing multiple strategies appears to be an effective approach for reducing CDS alert numbers. We recommend hospitals report on descriptions and evaluations of governance processes to enable identification of effective strategies for optimization of CDS alerts in hospitals.

Systematic Review of Clinical Decision Support Systems for Prehospital Acute Coronary Syndrome Identification

OBJECTIVES

Timely prehospital diagnosis and treatment of acute coronary syndrome (ACS) are required to achieve optimal outcomes. Clinical decision support systems (CDSS) are platforms designed to integrate multiple data and can aid with management decisions in the prehospital environment. The review aim was to describe the accuracy of CDSS and individual components in the prehospital ACS management.

METHODS

This systematic review examined the current literature regarding the accuracy of CDSS for ACS in the prehospital setting, the influence of computer-aided decision-making and of 4 components: electrocardiogram, biomarkers, patient history, and examination findings. The impact of these components on sensitivity, specificity, and positive and negative predictive values was assessed.

RESULTS

A total of 11,439 articles were identified from a search of databases, of which 199 were screened against the eligibility criteria. Eight studies were found to meet the eligibility and quality criteria. There was marked heterogeneity between studies which precluded formal meta-analysis. However, individual components analysis found that patient history led to significant improvement in the sensitivity and negative predictive values. CDSS which incorporated all 4 components tended to show higher sensitivities and negative predictive values. CDSS incorporating computer-aided electrocardiogram diagnosis showed higher specificities and positive predictive values.

CONCLUSIONS

Although heterogeneity precluded meta-analysis, this review emphasizes the potential of ACS CDSS in prehospital environments that incorporate patient history in addition to integration of multiple components. The higher sensitivity of certain components, along with higher specificity of computer-aided decision-making, highlights the opportunity for developing an integrated algorithm with computer-aided decision support.

Artificial Intelligence and Clinical Decision Support for Radiologists and Referring Providers

Recent advances in artificial intelligence (AI) are providing an opportunity to enhance existing clinical decision support (CDS) tools to improve patient safety and drive value-based imaging. We discuss the advantages and potential applications that may be realized with the synergy between AI and CDS systems. From the perspective of both radiologist and ordering provider, CDS could be significantly empowered using AI. CDS enhanced by AI could reduce friction in radiology workflows and can aid AI developers to identify relevant imaging features their tools should be seeking to extract from images. Furthermore, these systems can generate structured data to be used as input to develop machine learning algorithms, which can drive downstream care pathways. For referring providers, an AI-enabled CDS solution could enable an evolution from existing imaging-centric CDS toward decision support that takes into account a holistic patient perspective. More intelligent CDS could suggest imaging examinations in highly complex clinical scenarios, assist on the identification of appropriate imaging opportunities at the health system level, suggest appropriate individualized screening, or aid health care providers to ensure continuity of care. AI has the potential to enable the next generation of CDS, improving patient care and enhancing providers' and radiologists' experience.

Clinical decision support tool and rapid point-of-care platform for determining disease severity in patients with COVID-19

SARS-CoV-2 is the virus that causes coronavirus disease (COVID-19) which has reached pandemic levels resulting in significant morbidity and mortality affecting every inhabited continent. The large number of patients requiring intensive care threatens to overwhelm healthcare systems globally. Likewise, there is a compelling need for a COVID-19 disease severity test to prioritize care and resources for patients at elevated risk of mortality. Here, an integrated point-of-care COVID-19 Severity Score and clinical decision support system is presented using biomarker measurements of C-reactive protein (CRP), N-terminus pro B type natriuretic peptide (NT-proBNP), myoglobin (MYO), D-dimer, procalcitonin (PCT), creatine kinase-myocardial band (CK-MB), and cardiac troponin I (cTnI). The COVID-19 Severity Score combines multiplex biomarker measurements and risk factors in a statistical learning algorithm to predict mortality. The COVID-19 Severity Score was trained and evaluated using data from 160 hospitalized COVID-19 patients from Wuhan, China. Our analysis finds that COVID-19 Severity Scores were significantly higher for the group that died versus the group that was discharged with median (interquartile range) scores of 59 (40-83) and 9 (6-17), respectively, and area under the curve of 0.94 (95% CI 0.89-0.99). Although this analysis represents patients with cardiac comorbidities (hypertension), the inclusion of biomarkers from other pathophysiologies implicated in COVID-19 (e.g., D-dimer for thrombotic events, CRP for infection or inflammation, and PCT for bacterial co-infection and sepsis) may improve future predictions for a more general population. These promising initial models pave the way for a point-of-care COVID-19 Severity Score system to impact patient care after further validation with externally collected clinical data. Clinical decision support tools for COVID-19 have strong potential to empower healthcare providers to save lives by prioritizing critical care in patients at high risk for adverse outcomes.

Confronting challenges to opioid risk mitigation in the U.S. health system: Recommendations from a panel of national experts

BACKGROUND

Amid the ongoing U.S. opioid crisis, achieving safe and effective chronic pain management while reducing opioid-related morbidity and mortality is likely to require multi-level efforts across health systems, including the Military Health System (MHS), Department of Veterans Affairs (VA), and civilian sectors.

OBJECTIVE

We conducted a series of qualitative panel discussions with national experts to identify core challenges and elicit recommendations toward improving the safety of opioid prescribing in the U.S.

DESIGN

We invited national experts to participate in qualitative panel discussions regarding challenges in opioid risk mitigation and how best to support providers in delivery of safe and effective opioid prescribing across MHS, VA, and civilian health systems.

PARTICIPANTS

Eighteen experts representing primary care, emergency medicine, psychology, pharmacy, and public health/policy participated.

APPROACH

Six qualitative panel discussions were conducted via teleconference with experts. Transcripts were coded using team-based qualitative content analysis to identify key challenges and recommendations in opioid risk mitigation.

KEY RESULTS

Panelists provided insight into challenges across multiple levels of the U.S. health system, including the technical complexity of treating chronic pain, the fraught national climate around opioids, the need to integrate surveillance data across a fragmented U.S. health system, a lack of access to non-pharmacological options for chronic pain care, and difficulties in provider and patient communication. Participating experts identified recommendations for multi-level change efforts spanning policy, research, education, and the organization of healthcare delivery.

CONCLUSIONS

Reducing opioid risk while ensuring safe and effective pain management, according to participating experts, is likely to require multi-level efforts spanning military, veteran, and civilian health systems. Efforts to implement risk mitigation strategies at the patient level should be accompanied by efforts to increase education for patients and providers, increase access to non-pharmacological pain care, and support use of existing clinical decision support, including state-level prescription drug monitoring programs.

The Value of the Surgeon Informatician

Clinical informatics is an interdisciplinary specialty that leverages big data, health information technologies, and the science of biomedical informatics within clinical environments to improve quality and outcomes in the increasingly complex and often siloed health care systems. Core competencies of clinical informatics primarily focus on clinical decision making and care process improvement, health information systems, and leadership and change management. Although the broad relevance of clinical informatics is apparent, this review focuses on its application and pertinence to the discipline of surgery, which is less well defined. In doing so, we hope to highlight the importance of the surgeon informatician. Topics covered include electronic health records, clinical decision support systems, computerized order entry, data analytics, clinical documentation, information architectures, implementation science, quality improvement, simulation, education, and telemedicine. The formal pathway for surgeons to become clinical informaticians is also discussed.

Implementation of clinical decision support to manage acute kidney injury in secondary care: an ethnographic study

BACKGROUND

Over the past decade, acute kidney injury (AKI) has become a global priority for improving patient safety and health outcomes. In the UK, a confidential inquiry into AKI led to the publication of clinical guidance and a range of policy initiatives. National patient safety directives have focused on the mandatory establishment of clinical decision support systems (CDSSs) within all acute National Health Service (NHS) trusts to improve the detection, alerting and response to AKI. We studied the organisational work of implementing AKI CDSSs within routine hospital care.

METHODS

An ethnographic study comprising non-participant observation and interviews was conducted in two NHS hospitals, delivering AKI quality improvement programmes, located in one region of England. Three researchers conducted a total of 49 interviews and 150 hours of observation over an 18-month period. Analysis was conducted collaboratively and iteratively around emergent themes, relating to the organisational work of technology adoption.

RESULTS

The two hospitals developed and implemented AKI CDSSs using very different approaches. Nevertheless, both resulted in adaptive work and trade-offs relating to the technology, the users, the organisation and the wider system of care. A common tension was associated with attempts to maximise benefit while minimise additional burden. In both hospitals, resource pressures exacerbated the tensions of translating AKI recommendations into routine practice.

CONCLUSIONS

Our analysis highlights a conflicted relationship between external context (policy and resources), and organisational structure and culture (eg, digital capability, attitudes to quality improvement). Greater consideration is required to the long-term effectiveness of the approaches taken, particularly in light of the ongoing need for adaptation to incorporate new practices into routine work.

Association between GP participation in a primary care group and monitoring of biomedical and lifestyle target indicators in people with type 2 diabetes: a cohort study (ELZHA cohort-1)

OBJECTIVE

Whether care group participation by general practitioners improves delivery of diabetes care is unknown. Using 'monitoring of biomedical and lifestyle target indicators as recommended by professional guidelines' as an operationalisation for quality of care, we explored whether (1) in new practices monitoring as recommended improved a year after initial care group participation (aim 1); (2) new practices and experienced practices differed regarding monitoring (aim 2).

DESIGN

Observational, real-life cohort study.

SETTING

Primary care registry data from Eerstelijns Zorggroep Haaglanden (ELZHA) care group.

PARTICIPANTS

Aim 1: From six new practices (n=538 people with diabetes) that joined care group ELZHA in January 2014, two practices (n=211 people) were excluded because of missing baseline data; four practices (n=182 people) were included. Aim 2: From all six new practices (n=538 people), 295 individuals were included. From 145 experienced practices (n=21 465 people), 13 744 individuals were included.

EXPOSURE

Care group participation includes support by staff nurses on protocolised diabetes care implementation and availability of a system providing individual monitoring information. 'Monitoring as recommended' represented minimally one annual registration of each biomedical (HbA1c, systolic blood pressure, low-density lipoprotein) and lifestyle-related target indicator (body mass index, smoking behaviour, physical exercise).

PRIMARY OUTCOME MEASURES

Aim 1: In new practices, odds of people being monitored as recommended in 2014 were compared with baseline (2013). Aim 2: Odds of monitoring as recommended in new and experienced practices in 2014 were compared.

RESULTS

Aim 1: After 1-year care group participation, odds of being monitored as recommended increased threefold (OR 3.00, 95% CI 1.84 to 4.88, p<0.001). Aim 2: Compared with new practices, no significant differences in the odds of monitoring as recommended were found in experienced practices (OR 1.21, 95% CI 0.18 to 8.37, p=0.844).

CONCLUSIONS

We observed a sharp increase concerning biomedical and lifestyle monitoring as recommended after 1-year care group participation, and subsequently no significant difference between new and experienced practices-indicating that providing diabetes care within a collective approach rapidly improves registration of care.

Tele-Critical Care: An Update From the Society of Critical Care Medicine Tele-ICU Committee

OBJECTIVES

In 2014, the Tele-ICU Committee of the Society of Critical Care Medicine published an article regarding the state of ICU telemedicine, one better defined today as tele-critical care. Given the rapid evolution in the field, the authors now provide an updated review.

DATA SOURCES AND STUDY SELECTION

We searched PubMed and OVID for peer-reviewed literature published between 2010 and 2018 related to significant developments in tele-critical care, including its prevalence, function, activity, and technologies. Search terms included electronic ICU, tele-ICU, critical care telemedicine, and ICU telemedicine with appropriate descriptors relevant to each sub-section. Additionally, information from surveys done by the Society of Critical Care Medicine was included given the relevance to the discussion and was referenced accordingly.

DATA EXTRACTION AND DATA SYNTHESIS

Tele-critical care continues to evolve in multiple domains, including organizational structure, technologies, expanded-use case scenarios, and novel applications. Insights have been gained in economic impact and human and organizational factors affecting tele-critical care delivery. Legislation and credentialing continue to significantly influence the pace of tele-critical care growth and adoption.

CONCLUSIONS

Tele-critical care is an established mechanism to leverage critical care expertise to ICUs and beyond, but systematic research comparing different models, approaches, and technologies is still needed.

Pragmatic trial design of an intervention to reduce cardiovascular risk in people with serious mental illness

BACKGROUND

Cardiovascular (CV) disease is the leading cause of death for people with serious mental illness (SMI), but clinicians are often slow to address this risk.

METHODS/DESIGN

78 Midwestern primary care clinics were randomized to receive or not receive access to a clinical decision support (CDS) tool. Between March 2016 and September 2018, primary care clinicians (PCPs) received CDS alerts during visits with adult patients with SMI who met minimal inclusion criteria and had at least one CV risk factor not at goal. The PCP CDS included a summary of six modifiable CV risk factors and patient-specific treatment recommendations. Psychiatrists received CDS alerts during their next visit with an eligible patient with SMI that alerted them to an elevated body mass index or recent weight gain and the presence of an obesogenic SMI medication. Study outcomes include total modifiable CV risk, six modifiable CV risk factors, and use of obesogenic SMI medications.

DISCUSSION

This cluster-randomized pragmatic trial allowed PCPs and psychiatrists the opportunity to improve CV risk in a timely manner for patients with SMI. Effectiveness will be assessed using an intent-to-treat analysis, and outcomes will be assessed largely through electronic health record data harvested by the CDS tool itself. In total, 10,347 patients with SMI had an index primary care visit in a randomized clinic, and 8937 patients had at least one follow-up visit. Analyses are ongoing, and trial results are expected in mid-2020.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02451670.

Mixed-methods approach to understanding clinician macrocognition in the design of a clinical decision support tool: a study protocol

INTRODUCTION

The anatomic variants of congenital heart disease (CHD) are multiple. The increased survival of these patients and disposition into communities has led to an increase in their acute presentation to non-CHD experts in primary care clinics and emergency departments. Given the vulnerability and fragility of these patients in the face of acute illness, new clinical decision support systems (CDSS) are urgently needed to better translate the best practice recommendations for the care of these patients. This study aims to understand the perceived confidence and macrocognitive processes of non-CHD experts (emergency medicine physicians) and CHD experts (paediatric cardiac intensivists) when treating children with CHD during acute illness and apply this to optimise the design of a CDSS (MyHeartPass^™) for these patients.

METHODS AND ANALYSIS

The first phase of the study involves a survey of non-CHD experts and CHD experts to understand their perceived confidence as it relates to treating acutely ill patients with CHD. The second phase is a qualitative cognitive task analysis using critical decision method to characterise and compare the macrocognitive processes used by non-CHD experts and CHD experts during the critical decision making. In phases 3 and 4, heuristic evaluation and usability testing of the CDSS will be completed. These results will be used to inform design changes to the chosen CDSS (MyHeartPass^™). In the final phase, a within-participant simulation design will be used to study the effect of the CDSS on clinical decision making compared with baseline (without use of CDSS).

ETHICS AND DISSEMINATION

Ethics approval from The Hospital for Sick Children in Toronto, Ontario, Canada has been obtained for all phases. Results will be published in peer-reviewed journals and presented at relevant conferences. On successful completion of these studies, it is anticipated that there will be a controlled implementation of the redesigned CDSS.

How, in what contexts, and why do quality dashboards lead to improvements in care quality in acute hospitals? Protocol for a realist feasibility evaluation

INTRODUCTION

National audits are used to monitor care quality and safety and are anticipated to reduce unexplained variations in quality by stimulating quality improvement (QI). However, variation within and between providers in the extent of engagement with national audits means that the potential for national audit data to inform QI is not being realised. This study will undertake a feasibility evaluation of QualDash, a quality dashboard designed to support clinical teams and managers to explore data from two national audits, the Myocardial Ischaemia National Audit Project (MINAP) and the Paediatric Intensive Care Audit Network (PICANet).

METHODS AND ANALYSIS

Realist evaluation, which involves building, testing and refining theories of how an intervention works, provides an overall framework for this feasibility study. Realist hypotheses that describe how, in what contexts, and why QualDash is expected to provide benefit will be tested across five hospitals. A controlled interrupted time series analysis, using key MINAP and PICANet measures, will provide preliminary evidence of the impact of QualDash, while ethnographic observations and interviews over 12 months will provide initial insight into contexts and mechanisms that lead to those impacts. Feasibility outcomes include the extent to which MINAP and PICANet data are used, data completeness in the audits, and the extent to which participants perceive QualDash to be useful and express the intention to continue using it after the study period.

ETHICS AND DISSEMINATION

The study has been approved by the University of Leeds School of Healthcare Research Ethics Committee. Study results will provide an initial understanding of how, in what contexts, and why quality dashboards lead to improvements in care quality. These will be disseminated to academic audiences, study participants, hospital IT departments and national audits. If the results show a trial is feasible, we will disseminate the QualDash software through a stepped wedge cluster randomised trial.

A unique framework for the Persian clinical guidelines: addressing an evidence-based CDSS development need

BACKGROUND AND AIM

One of the prerequisites to develop Computerised Decision Support Systems is Clinical Practice Guidelines (CPGs) which provide a systematic aid to make complex medical decisions. In order to provide an automated CPG, it is needed to have a unique structure for the CPGs. This study aims to propose a unique framework for the Persian guidelines.

MATERIALS AND METHODS

20 Persian CPGs were selected and divided into the creation and validation sets (n=10 for each). The first group was studied independently and their headings were listed; wherever possible, the headings were merged into a new heading that was applicable to all the guidelines. The developed framework was validated by the second group of the guidelines.

RESULTS

Studied guidelines had a very heterogeneous structure. The number of original headings was 249; they were reduced to 14 main headings with 16 subheadings in a unique developed framework. The framework is able to represent and cover 100% of the guidelines.

CONCLUSION

The heterogeneity of guidelines was high as they were not developed based on the unique framework. The proposed framework provides a layout for designing the CPGs with a homogeneous structure. Guideline developers can use this framework to develop structured CPGs. This will facilitate the integration of the guidelines into electronic medical records as well as clinical decision support systems.

More Guidelines than states: variations in U.S. lead screening and management guidance and impacts on shareable CDS development

BACKGROUND

Pediatric lead exposure in the United States (U.S.) remains a preventable public health crisis. Shareable electronic clinical decision support (CDS) could improve lead screening and management. However, discrepancies between federal, state and local recommendations could present significant challenges for implementation.

METHODS

We identified publically available guidance on lead screening and management. We extracted definitions for elevated lead and recommendations for screening, follow-up, reporting, and management. We compared thresholds and level of obligation for management actions. Finally, we assessed the feasibility of development of shareable CDS.

RESULTS

We identified 54 guidance sources. States offered different definitions of elevated lead, and recommendations for screening, reporting, follow-up and management. Only 37 of 48 states providing guidance used the Center for Disease Control (CDC) definition for elevated lead. There were 17 distinct management actions. Guidance sources indicated an average of 5.5 management actions, but offered different criteria and levels of obligation for these actions. Despite differences, the recommendations were well-structured, actionable, and encodable, indicating shareable CDS is feasible.

CONCLUSION

Current variability across guidance poses challenges for clinicians. Developing shareable CDS is feasible and could improve pediatric lead screening and management. Shareable CDS would need to account for local variability in guidance.

Results from one-year use of an electronic Clinical Decision Support System in a post-conflict context: An implementation research

BACKGROUND

In 2017, the Adamawa State Primary Healthcare Development Agency introduced ALMANACH, an electronic clinical decision support system based on a modified version of IMCI. The target area was the Federal State of Adamawa (Nigeria), a region recovering after the Boko Haram insurgency. The aim of this implementation research was to assess the improvement in terms of quality care offered after one year of utilization of the tool.

METHODS

We carried out two cross-sectional studies in six Primary Health Care Centres to assess the improvements in comparison with the baseline carried out before the implementation. One survey was carried out inside the consultation room and was based on the direct observation of 235 consultations of children aged from 2 to 59 months old. The second survey questioned 189 caregivers outside the health facility for their opinion about the consultation carried out through using the tablet, the prescriptions and medications given.

RESULTS

In comparison with the baseline, more children were checked for danger signs (60.0% vs. 37.1% at baseline) and in addition, children were actually weighed (61.1% vs. 27.7%) during consultation. Malnutrition screening was performed in 35.1% of children (vs. 12.1%). Through ALMANACH, also performance of preventive measures was significantly improved (p<0.01): vaccination status was checked in 39.8% of cases (vs. 10.6% at baseline), and deworming and vitamin A prescription was increased to 46.5% (vs. 0.7%) and 48.3% (vs. 2.8%) respectively. Furthermore, children received a complete physical examination (58.3% vs. 45.5%, p<0.01) and correct treatment (48.4% vs. 29.5%, p<0.01). Regarding antibiotic prescription, 69.3% patients received at least one antibiotic (baseline 77.7%, p<0.05).

CONCLUSIONS

Our findings highlight major improvements in terms of quality of care despite many questions still pending to be answered in relation to a full integration of the tool in the Adamawa health system.

Availability and usage of clinical decision support systems (CDSSs) in office-based primary care settings in the USA

BACKGROUND

A clinical decision support system (CDSS) covers a broad spectrum of applications, for example, screening reminders, can reduce malpractice, improve preventive services and enable better management of chronic conditions. CDSSs have traditionally been used successfully in large hospitals. The availability (ie, whether the function is provided by the software) and usage (ie, actual use) of a CDSS in office-based primary care settings, however, are less well studied.

OBJECTIVE

To establish a benchmark of CDSS availability and usage in office-based primary care settings, particularly given the large volume of visits in such settings.

METHODS

We used the 2015 Centers for Disease Control and Prevention's National Ambulatory Medical Care Survey to conduct secondary data analysis. We selected preventive services reminders and drug interaction alerts, along with several other variables as examples of a CDSS.

RESULTS

CDSS usage rates ranged from 68.5% to 100% among solo or non-solo primary care practices owned by physicians or physician groups that have electronic medical records (EMRs)/electronic health records (EHRs) and 44.7% to 96.1%, regardless of EMR/EHR status. According to proportion tests, solo practices had significantly lower CDSS usage and availability rates on several measures if the practice is entirely EMR/EHR based and significantly lower (16.3%-28.9%) CDSS usage rates than did non-solo practices on each measure, regardless of EMR/EHR status.

CONCLUSION

In the USA, a CDSS, especially under the categories of basic preventive reminders and drug interaction alerts, is used routinely between 68% and 100% in primary care if a practice is entirely EMR/EHR based. More work is needed, however, to determine the reasons for large usage gaps between solo and non-solo practices and to reduce such gaps.

Merits, features, and desiderata to be considered when developing electronic health records with embedded clinical decision support systems in Palestinian hospitals: a consensus study

BACKGROUND

Electronic health records (EHRs) with embedded clinical decision support systems (CDSSs) have the potential to improve healthcare delivery. This study was conducted to explore merits, features, and desiderata to be considered when planning for, designing, developing, implementing, piloting, evaluating, maintaining, upgrading, and/or using EHRs with CDSSs.

METHODS

A mixed-method combining the Delphi technique and Analytic Hierarchy Process was used. Potentially important items were collected after a thorough search of the literature and from interviews with key contact experts (n = 19). Opinions and views of the 76 panelists on the use of EHRs were also explored. Iterative Delphi rounds were conducted to achieve consensus on 122 potentially important items by a panel of 76 participants. Items on which consensus was achieved were ranked in the order of their importance using the Analytic Hierarchy Process.

RESULTS

Of the 122 potentially important items presented to the panelists in the Delphi rounds, consensus was achieved on 110 (90.2%) items. Of these, 16 (14.5%) items were related to the demographic characteristics of the patient, 16 (14.5%) were related to prescribing medications, 16 (14.5%) were related to checking prescriptions and alerts, 14 (12.7%) items were related to the patient's identity, 13 (11.8%) items were related to patient assessment, 12 (10.9%) items were related to the quality of alerts, 11 (10%) items were related to admission and discharge of the patient, 9 (8.2%) items were general features, and 3 (2.7%) items were related to diseases and making diagnosis.

CONCLUSIONS

In this study, merits, features, and desiderata to be considered when planning for, designing, developing, implementing, piloting, evaluating, maintaining, upgrading, and/or using EHRs with CDSSs were explored. Considering items on which consensus was achieved might promote congruence and safe use of EHRs. Further studies are still needed to determine if these recommendations can improve patient safety and outcomes in Palestinian hospitals.

General Practitioner's use of online resources during medical visits: managing the boundary between inside and outside the clinic

In an increasingly connected world, information about health can be exchanged at any time, in any location or direction, and is no longer dominated by traditional authoritative sources. We consider the ways information and advice given in consultations by doctors transcends the boundary between the clinic and the home. We explore how information that is widely accessible outside the consultation is transformed by General Practitioners (GPs) into a medical offering. Data comprise 18 consultations identified from 144 consultations between unselected patients and five GPs. We use conversation analytic methods to explore four ways in which GPs used online resources; (i) to check information; (ii) as an explanatory tool; (iii) to provide information for patients for outside the consultation; (iv) to signpost further explanation and self-help. We demonstrate the interactional delicacy with which resources from the Internet are introduced and discussed, developing and extending Nettleton's (2004) idea of 'e-scaped medicine' to argue that Internet resources may be 'recaptured' by GPs, with information transformed and translated into a medical offering so as to maintain the asymmetry between patients and practitioners necessary for the successful functioning of medical practice.

A usability study to improve a clinical decision support system for the prescription of antibiotic drugs

OBJECTIVE

A clinical decision support system (CDSS) for empirical antibiotic treatment has the potential to increase appropriate antibiotic use. Before using such a system on a broad scale, it needs to be tailored to the users preferred way of working. We have developed a CDSS for empirical antibiotic treatment in hospitalized adult patients. Here we determined in a usability study if the developed CDSS needed changes.

METHODS

Four prespecified patient cases, based on real life clinical scenarios, were evaluated by 8 medical residents in the study. The "think-aloud" method was used, and sessions were recorded and analyzed afterwards. Usability was assessed by 3 evaluators using an augmented classification scheme, which combines the User Action Framework with severity rating of the usability problems and the assessment of the potential impact of these problems on the final task outcomes.

RESULTS

In total 51 usability problems were identified, which could be grouped into 29 different categories. Most (n = 17/29) of the usability problems were cosmetic problems or minor problems. Eighteen (out of 29) of the usability categories could have an ordering error as a result. Classification of the problems showed that some of the problems would get a low priority based on their severity rating, but got a high priority for their impact on the task outcome. This effectively provided information to prioritize system redesign efforts.

CONCLUSION

Usability studies improve lay-out and functionality of a CDSS for empirical antibiotic treatment, even after development by a multidisciplinary system.

How do general practitioners access guidelines and utilise electronic medical records to make clinical decisions on antibiotic use? Results from an Australian qualitative study

OBJECTIVE

This study aimed to explore how general practitioners (GPs) access and use both guidelines and electronic medical records (EMRs) to assist in clinical decision-making when prescribing antibiotics in Australia.

DESIGN

This is an exploratory qualitative study with thematic analysis interpreted using the Theory of Planned Behaviour (TPB) framework.

SETTING

This study was conducted in general practice in Victoria, Australia.

PARTICIPANTS

Twenty-six GPs from five general practices were recruited to participate in five focus groups between February and April 2018.

RESULTS

GPs expressed that current EMR systems do not provide clinical decision support to assist with antibiotic prescribing. Access and use of guidelines were variable. GPs who had more clinical experience were less likely to access guidelines than younger and less experienced GPs. Guideline use and guideline-concordant prescribing was facilitated if there was a practice culture encouraging evidence-based practice. However, a lack of access to guidelines and perceived patients' expectation and demand for antibiotics were barriers to guideline-concordant prescribing. Furthermore, guidelines that were easy to access and navigate, free, embedded within EMRs and fit into the clinical workflow were seen as likely to enhance guideline use.

CONCLUSIONS

Current barriers to the use of antibiotic guidelines include GPs' experience, patient factors, practice culture, and ease of access and cost of guidelines. To reduce inappropriate antibiotic prescribing and to promote more rational use of antibiotic in the community, guidelines should be made available, accessible and easy to use, with minimal cost to practicing GPs. Integration of evidence-based antibiotic guidelines within the EMR in the form of a clinical decision support tool could optimise guideline use and increase guideline-concordant prescribing.