A Human(e) Factor in Clinical Decision Support Systems

Safety and Feasibility Evaluation of Automated User Profile Settings Initialization and Adaptation With Control-IQ Technology

BACKGROUND

Optimization of automated insulin delivery (AID) settings is required to achieve desirable glycemic outcomes. We evaluated safety and efficacy of a computerized system to initialize and adjust insulin delivery settings for the t:slim X2 insulin pump with Control-IQ technology in adults with type 1 diabetes (T1D).

METHODS

After a 2-week continuous glucose monitoring (CGM) run-in period, adults with T1D using multiple daily injections (MDI) (N = 33, mean age 36.1 years, 57.6% female, diabetes duration 19.7 years) were transitioned to 13 weeks of Control-IQ technology usage. A computerized algorithm generated recommendations for initial pump settings (basal rate, insulin-to-carbohydrate ratio, and correction factor) and weekly follow-up settings to optimize glycemic outcomes. Physicians could override the automated settings changes for safety concerns.

RESULTS

Time in range 70 to 180 mg/dL improved from 45.7% during run-in to 69.1% during the last 30 days of Control-IQ use, a median improvement of 18.8% (95% confidence interval [CI]: 13.6-23.9, P < .001). This improvement was evident early in the study and was sustained over 13 weeks. Time <70 mg/dL showed a gradual decreasing trend over time. Percentage of participants achieving HbA1c <7% went from zero at baseline to 55% at study end (P < .001). Only six of the 318 automated settings adaptations (1.9%) were overridden by study investigators.

CONCLUSIONS

Computerized initiation and adaptation of Control-IQ technology settings from baseline MDI therapy was safe in adults with T1D. The use of this simplified system for onboarding and optimizing Control-IQ technology may be useful to increase uptake of AID and reduce staff and patient burden in clinical care.

Factors Guiding Clinical Decision-Making in Genitourinary Oncology

INTRODUCTION

Clinical decision-making in oncology is a complex process, with the primary goal of identifying the most effective treatment tailored to individual cancer patients. Many factors influence the treatment decision: disease- and patient-specific criteria, the increasingly complex treatment landscape, market authorization and drug availability, financial aspects, and personal treatment expertise. In the domain of genitourinary cancers, particularly prostate cancer, decision-making is challenging. Despite the prevalence of this malignancy, there are few in-depth explorations of these factors within real-world scenarios. Understanding and refining this intricate decision-making process is essential for future successful clinical decisions and the integration of computerized decision support into clinicians' workflows.

AIM

The objective of this study is to improve the current knowledge base and evidence of the factors that influence treatment decision-making for patients with genitourinary cancers.

METHODS

Assessment of how routine treatment decisions are made for genitourinary cancers was performed by a mixed-methods study, encompassing field observations and focus group discussions.

RESULTS

In total, we identified 59 factors that influence clinical decision-making in oncology, specifically for genitourinary and prostate cancer. Of these, 23 criteria can be classified as decision-maker-related criteria encompassing personal, cognitive, and emotional attributes and factors of both, healthcare professionals and patients. Moreover, 20 decision-specific criteria have been identified that refer to clinical and disease-related factors, followed by 16 contextual decision factors that describe the relevant criteria introduced by the specific circumstances and environment in which the treatment decision is made.

CONCLUSION

By presenting an exhaustive set of decision factors and providing specific examples for genitourinary cancers, this observational study establishes a possible framework for a better understanding of decision-making. Moreover, we specify and expand the set of decision factors, while emphasizing the importance of cognitive, emotional, and human factors, as well as the quality and accessibility of decision-relevant information.

Federated systems for automated infection surveillance: a perspective

Automation of surveillance of infectious diseases-where algorithms are applied to routine care data to replace manual decisions-likely reduces workload and improves quality of surveillance. However, various barriers limit large-scale implementation of automated surveillance (AS). Current implementation strategies for AS in surveillance networks include central implementation (i.e. collecting all data centrally, and central algorithm application for case ascertainment) or local implementation (i.e. local algorithm application and sharing surveillance results with the network coordinating center). In this perspective, we explore whether current challenges can be solved by federated AS. In federated AS, scripts for analyses are developed centrally and applied locally. We focus on the potential of federated AS in the context of healthcare associated infections (AS-HAI) and of severe acute respiratory illness (AS-SARI). AS-HAI and AS-SARI have common and specific requirements, but both would benefit from decreased local surveillance burden, alignment of AS and increased central and local oversight, and improved access to data while preserving privacy. Federated AS combines some benefits of a centrally implemented system, such as standardization and alignment of an easily scalable methodology, with some of the benefits of a locally implemented system including (near) real-time access to data and flexibility in algorithms, meeting different information needs and improving sustainability, and allowance of a broader range of clinically relevant case-definitions. From a global perspective, it can promote the development of automated surveillance where it is not currently possible and foster international collaboration.The necessary transformation of source data likely will place a significant burden on healthcare facilities. However, this may be outweighed by the potential benefits: improved comparability of surveillance results, flexibility and reuse of data for multiple purposes. Governance and stakeholder agreement to address accuracy, accountability, transparency, digital literacy, and data protection, warrants clear attention to create acceptance of the methodology. In conclusion, federated automated surveillance seems a potential solution for current barriers of large-scale implementation of AS-HAI and AS-SARI. Prerequisites for successful implementation include validation of results and evaluation requirements of network participants to govern understanding and acceptance of the methodology.

21st century (clinical) decision support in nursing and allied healthcare. Developing a learning health system: a reasoned design of a theoretical framework

In this paper, we present a framework for developing a Learning Health System (LHS) to provide means to a computerized clinical decision support system for allied healthcare and/or nursing professionals. LHSs are well suited to transform healthcare systems in a mission-oriented approach, and is being adopted by an increasing number of countries. Our theoretical framework provides a blueprint for organizing such a transformation with help of evidence based state of the art methodologies and techniques to eventually optimize personalized health and healthcare. Learning via health information technologies using LHS enables users to learn both individually and collectively, and independent of their location. These developments demand healthcare innovations beyond a disease focused orientation since clinical decision making in allied healthcare and nursing is mainly based on aspects of individuals' functioning, wellbeing and (dis)abilities. Developing LHSs depends heavily on intertwined social and technological innovation, and research and development. Crucial factors may be the transformation of the Internet of Things into the Internet of FAIR data & services. However, Electronic Health Record (EHR) data is in up to 80% unstructured including free text narratives and stored in various inaccessible data warehouses. Enabling the use of data as a driver for learning is challenged by interoperability and reusability.To address technical needs, key enabling technologies are suitable to convert relevant health data into machine actionable data and to develop algorithms for computerized decision support. To enable data conversions, existing classification and terminology systems serve as definition providers for natural language processing through (un)supervised learning.To facilitate clinical reasoning and personalized healthcare using LHSs, the development of personomics and functionomics are useful in allied healthcare and nursing. Developing these omics will be determined via text and data mining. This will focus on the relationships between social, psychological, cultural, behavioral and economic determinants, and human functioning.Furthermore, multiparty collaboration is crucial to develop LHSs, and man-machine interaction studies are required to develop a functional design and prototype. During development, validation and maintenance of the LHS continuous attention for challenges like data-drift, ethical, technical and practical implementation difficulties is required.

Effectiveness, quality and implementation of pain, sedation, delirium, and iatrogenic withdrawal syndrome algorithms in pediatric intensive care: a systematic review and meta-analysis

Background

Pain, sedation, delirium, and iatrogenic withdrawal syndrome are conditions that often coexist, algorithms can be used to assist healthcare professionals in decision making. However, a comprehensive review is lacking. This systematic review aimed to assess the effectiveness, quality, and implementation of algorithms for the management of pain, sedation, delirium, and iatrogenic withdrawal syndrome in all pediatric intensive care settings.

Methods

A literature search was conducted on November 29, 2022, in PubMed, Embase, CINAHL and Cochrane Library, ProQuest Dissertations & Theses, and Google Scholar to identify algorithms implemented in pediatric intensive care and published since 2005. Three reviewers independently screened the records for inclusion, verified and extracted data. Included studies were assessed for risk of bias using the JBI checklists, and algorithm quality was assessed using the PROFILE tool (higher % = higher quality). Meta-analyses were performed to compare algorithms to usual care on various outcomes (length of stay, duration and cumulative dose of analgesics and sedatives, length of mechanical ventilation, and incidence of withdrawal).

Results

From 6,779 records, 32 studies, including 28 algorithms, were included. The majority of algorithms (68%) focused on sedation in combination with other conditions. Risk of bias was low in 28 studies. The average overall quality score of the algorithm was 54%, with 11 (39%) scoring as high quality. Four algorithms used clinical practice guidelines during development. The use of algorithms was found to be effective in reducing length of stay (intensive care and hospital), length of mechanical ventilation, duration of analgesic and sedative medications, cumulative dose of analgesics and sedatives, and incidence of withdrawal. Implementation strategies included education and distribution of materials (95%). Supportive determinants of algorithm implementation included leadership support and buy-in, staff training, and integration into electronic health records. The fidelity to algorithm varied from 8.2% to 100%.

Conclusions

The review suggests that algorithm-based management of pain, sedation and withdrawal is more effective than usual care in pediatric intensive care settings. There is a need for more rigorous use of evidence in the development of algorithms and the provision of details on the implementation process.

Systematic Review Registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021276053, PROSPERO [CRD42021276053].

Optimizing cardiovascular risk assessment and registration in a developing cardiovascular learning health care system: Women benefit most

Since 2015 we organized a uniform, structured collection of a fixed set of cardiovascular risk factors according the (inter)national guidelines on cardiovascular risk management. We evaluated the current state of a developing cardiovascular towards learning healthcare system-the Utrecht Cardiovascular Cohort Cardiovascular Risk Management (UCC-CVRM)-and its potential effect on guideline adherence in cardiovascular risk management. We conducted a before-after study comparing data from patients included in UCC-CVRM (2015-2018) and patients treated in our center before UCC-CVRM (2013-2015) who would have been eligible for UCC-CVRM using the Utrecht Patient Oriented Database (UPOD). Proportions of cardiovascular risk factor measurement before and after UCC-CVRM initiation were compared, as were proportions of patients that required (change of) blood pressure, lipid, or blood glucose lowering treatment. We estimated the likelihood to miss patients with hypertension, dyslipidemia, and elevated HbA1c before UCC-CVRM for the whole cohort and stratified for sex. In the present study, patients included up to October 2018 (n = 1904) were matched with 7195 UPOD patients with similar age, sex, department of referral and diagnose description. Completeness of risk factor measurement increased, ranging from 0% -77% before to 82%-94% after UCC-CVRM initiation. Before UCC-CVRM, we found more unmeasured risk factors in women compared to men. This sex-gap resolved in UCC-CVRM. The likelihood to miss hypertension, dyslipidemia, and elevated HbA1c was reduced by 67%, 75% and 90%, respectively, after UCC-CVRM initiation. A finding more pronounced in women compared to men. In conclusion, a systematic registration of the cardiovascular risk profile substantially improves guideline adherent assessment and decreases the risk of missing patients with elevated levels with an indication for treatment. The sex-gap disappeared after UCC-CVRM initiation. Thus, an LHS approach contributes to a more inclusive insight into quality of care and prevention of cardiovascular disease (progression).

Expectations and attitudes towards medical artificial intelligence: A qualitative study in the field of stroke

INTRODUCTION

Artificial intelligence (AI) has the potential to transform clinical decision-making as we know it. Powered by sophisticated machine learning algorithms, clinical decision support systems (CDSS) can generate unprecedented amounts of predictive information about individuals' health. Yet, despite the potential of these systems to promote proactive decision-making and improve health outcomes, their utility and impact remain poorly understood due to their still rare application in clinical practice. Taking the example of AI-powered CDSS in stroke medicine as a case in point, this paper provides a nuanced account of stroke survivors', family members', and healthcare professionals' expectations and attitudes towards medical AI.

METHODS

We followed a qualitative research design informed by the sociology of expectations, which recognizes the generative role of individuals' expectations in shaping scientific and technological change. Semi-structured interviews were conducted with stroke survivors, family members, and healthcare professionals specialized in stroke based in Germany and Switzerland. Data was analyzed using a combination of inductive and deductive thematic analysis.

RESULTS

Based on the participants' deliberations, we identified four presumed roles that medical AI could play in stroke medicine, including an administrative, assistive, advisory, and autonomous role AI. While most participants held positive attitudes towards medical AI and its potential to increase accuracy, speed, and efficiency in medical decision making, they also cautioned that it is not a stand-alone solution and may even lead to new problems. Participants particularly emphasized the importance of relational aspects and raised questions regarding the impact of AI on roles and responsibilities and patients' rights to information and decision-making. These findings shed light on the potential impact of medical AI on professional identities, role perceptions, and the doctor-patient relationship.

CONCLUSION

Our findings highlight the need for a more differentiated approach to identifying and tackling pertinent ethical and legal issues in the context of medical AI. We advocate for stakeholder and public involvement in the development of AI and AI governance to ensure that medical AI offers solutions to the most pressing challenges patients and clinicians face in clinical care.

From computer to bedside, involving neonatologists in artificial intelligence models for neonatal medicine

In recent years, data have become the main driver of medical innovation. With increased availability and decreased price of storage and computing power, the potential for improvement in care is enormous. Many data-driven explorations have started. However, the actual implementation of artificial intelligence in healthcare remains scarce. We describe essential elements during a computer-to-bedside process in a data science project that support the crucial role of the neonatologist. IMPACT: There is a great potential for data science in neonatal medicine. Multidisciplinary teams form the foundation of a data science project. Domain experts will need to play a pivotal role. We need an open learning environment.

A Wolf in Sheep’s Clothing: Reuse of Routinely Obtained Laboratory Data in Research

Electronic health records (EHRs) contain valuable data for reuse in science, quality evaluations, and clinical decision support. Because routinely obtained laboratory data are abundantly present, often numeric, generated by certified laboratories, and stored in a structured way, one may assume that they are immediately fit for (re)use in research. However, behind each test result lies an extensive context of choices and considerations, made by both humans and machines, that introduces hidden patterns in the data. If they are unaware, researchers reusing routine laboratory data may eventually draw incorrect conclusions. In this paper, after discussing health care system characteristics on both the macro and micro level, we introduce the reader to hidden aspects of generating structured routine laboratory data in 4 steps (ordering, preanalysis, analysis, and postanalysis) and explain how each of these steps may interfere with the reuse of routine laboratory data. As researchers reusing these data, we underline the importance of domain knowledge of the health care professional, laboratory specialist, data manager, and patient to turn routine laboratory data into meaningful data sets to help obtain relevant insights that create value for clinical care.

Impact of interactive computerised decision support for hospital antibiotic use (COMPASS): an open-label, cluster-randomised trial in three Swiss hospitals

Background

Computerised decision-support systems (CDSSs) for antibiotic stewardship could help to assist physicians in the appropriate prescribing of antibiotics. However, high-quality evidence for their effect on the quantity and quality of antibiotic use remains scarce. The aim of our study was to assess whether a computerised decision support for antimicrobial stewardship combined with feedback on prescribing indicators can reduce antimicrobial prescriptions for adults admitted to hospital.

Methods

The Computerised Antibiotic Stewardship Study (COMPASS) was a multicentre, cluster-randomised, parallel-group, open-label superiority trial that aimed to assess whether a multimodal computerised antibiotic-stewardship intervention is effective in reducing antibiotic use for adults admitted to hospital. After pairwise matching, 24 wards in three Swiss tertiary-care and secondary-care hospitals were randomised (1:1) to the CDSS intervention or to standard antibiotic stewardship measures using an online random sequence generator. The multimodal intervention consisted of a CDSS providing support for choice, duration, and re-evaluation of antimicrobial therapy, and feedback on antimicrobial prescribing quality. The primary outcome was overall systemic antibiotic use measured in days of therapy per admission, using adjusted-hurdle negative-binomial mixed-effects models. The analysis was done by intention to treat and per protocol. The study was registered with ClinicalTrials.gov (identifier NCT03120975).

Findings

24 clusters (16 at Geneva University Hospitals and eight at Ticino Regional Hospitals) were eligible and randomly assigned to control or intervention between Oct 1, 2018, and Dec 31, 2019. Overall, 4578 (40·2%) of 11 384 admissions received antibiotic therapy in the intervention group and 4142 (42·8%) of 9673 in the control group. The unadjusted overall mean days of therapy per admission was slightly lower in the intervention group than in the control group (3·2 days of therapy per admission, SD 6·2, vs 3·5 days of therapy per admission, SD 6·8; p<0·0001), and was similar among patients receiving antibiotics (7·9 days of therapy per admission, SD 7·6, vs 8·1 days of therapy per admission, SD 8·4; p=0·50). After adjusting for confounders, there was no statistically significant difference between groups for the odds of an admission receiving antibiotics (odds ratio [OR] for intervention vs control 1·12, 95% CI 0·94–1·33). For admissions with antibiotic exposure, days of therapy per admission were also similar (incidence rate ratio 0·98, 95% CI 0·90–1·07). Overall, the CDSS was used at least once in 3466 (75·7%) of 4578 admissions with any antibiotic prescription, but from the first day of antibiotic treatment for only 1602 (58·9%) of 2721 admissions in Geneva. For those for whom the CDSS was not used from the first day, mean time to use of CDSS was 8·9 days. Based on the manual review of 1195 randomly selected charts, transition from intravenous to oral therapy was significantly more frequent in the intervention group after adjusting for confounders (154 [76·6%] of 201 vs 187 [87%] of 215, +10·4%; OR 1·9, 95% CI 1·1–3·3). Consultations by infectious disease specialists were less frequent in the intervention group (388 [13·4%] of 2889) versus the control group (405 [16·9%] of 2390; OR 0·84, 95% CI 0·59–1·25).

Interpretation

An integrated multimodal computerised antibiotic stewardship intervention did not significantly reduce overall antibiotic use, the primary outcome of the study. Contributing factors were probably insufficient uptake, a setting with relatively low antibiotic use at baseline, and delays between ward admission and first CDSS use.

Funding

Swiss National Science Foundation.

Translations

For the French and Italian translations of the abstract see Supplementary Materials section.

Oncological big data platforms for promoting digital competencies and professionalism in Chinese medical students: a cross-sectional study

OBJECTIVES

Advancements in big data technology are reshaping the healthcare system in China. This study aims to explore the role of medical big data in promoting digital competencies and professionalism among Chinese medical students.

DESIGN, SETTING AND PARTICIPANTS

This study was conducted among 274 medical students who attended a workshop on medical big data conducted on 8 July 2021 in Tongji Hospital. The workshop was based on the first nationwide multifunction gynecologic oncology medical big data platform in China, at the National Union of Real-World Gynecologic Oncology Research & Patient Management Platform (NUWA platform).

OUTCOME MEASURES

Data on knowledge, attitudes towards big data technology and professionalism were collected before and after the workshop. We have measured the four skill categories: doctor‒patient relationship skills, reflective skills, time management and interprofessional relationship skills using the Professionalism Mini-Evaluation Exercise (P-MEX) as a reflection for professionalism.

RESULTS

A total of 274 students participated in this workshop and completed all the surveys. Before the workshop, only 27% of them knew the detailed content of medical big data platforms, and 64% knew the potential application of medical big data. The majority of the students believed that big data technology is practical in their clinical practice (77%), medical education (85%) and scientific research (82%). Over 80% of the participants showed positive attitudes toward big data platforms. They also exhibited sufficient professionalism before the workshop. Meanwhile, the workshop significantly promoted students' knowledge of medical big data (p<0.05), and led to more positive attitudes towards big data platforms and higher levels of professionalism.

CONCLUSIONS

Chinese medical students have primitive acquaintance and positive attitudes toward big data technology. The NUWA platform-based workshop may potentially promote their understanding of big data and enhance professionalism, according to the self-measured P-MEX scale.

Multi-Modal Data Analysis for Pneumonia Status Prediction Using Deep Learning (MDA-PSP)

Evaluating several vital signs and chest X-ray (CXR) reports regularly to determine the recovery of the pneumonia patients at general wards is a challenge for doctors. A recent study shows the identification of pneumonia by the history of symptoms and signs including vital signs, CXR, and other clinical parameters, but they lack predicting the recovery status after starting treatment. The goal of this paper is to provide a pneumonia status prediction system for the early affected patient’s discharge from the hospital within 7 days or late discharge more than 7 days. This paper aims to design a multimodal data analysis for pneumonia status prediction using deep learning classification (MDA-PSP). We have developed a system that takes an input of vital signs and CXR images of the affected patient with pneumonia from admission day 1 to day 3. The deep learning then classifies the health status improvement or deterioration for predicting the possible discharge state. Therefore, the scope is to provide a highly accurate prediction of the pneumonia recovery on the 7th day after 3-day treatment by the SHAP (SHapley Additive exPlanation), imputation, adaptive imputation-based preprocessing of the vital signs, and CXR image feature extraction using deep learning based on dense layers-batch normalization (BN) with class weights for the first 7 days’ general ward patient in MDA-PSP. A total of 3972 patients with pneumonia were enrolled by de-identification with an adult age of 71 mean ± 17 sd and 64% of them were male. After analyzing the data behavior, appropriate improvement measures are taken by data preprocessing and feature vectorization algorithm. The deep learning method of Dense-BN with SHAP features has an accuracy of 0.77 for vital signs, 0.92 for CXR, and 0.75 for the combined model with class weights. The MDA-PSP hybrid method-based experiments are proven to demonstrate higher prediction accuracy of 0.75 for pneumonia patient status. Henceforth, the hybrid methods of machine and deep learning for pneumonia patient discharge are concluded to be a better approach.

Assessing organizational health-analytics readiness: artifacts based on elaborated action design method

Purpose

While the adoption of health-analytics (HA) is expanding, not every healthcare organization understands the factors impacting its readiness for HA. An assessment of HA-readiness helps guide organizational strategy and the realization of business value. Past research on HA has not included a comprehensive set of readiness-factors and assessment methods. This study’s objective is to design artifacts to assess the HA-readiness of hospitals.

Design/methodology/approach

The information-systems (IS) theory and methodology entail the iterative Elaborated Action Design Research (EADR)method, combined with cross-sectional field studies involving 14 healthcare organizations and 27 participants. The researchers determine factors and leverage multi-criteria decision-making techniques to assess HA-readiness.

Findings

The artifacts emerging from this research include: (1) a map of readiness factors, (2) multi-criteria decision-making techniques that assess the readiness levels on the factors, the varying levels of factor-importance and the inter-factor relationships and (3) an instantiated system. The in-situ evaluation shows how these artifacts can provide insights and strategic direction to an organization through collective knowledge from stakeholders.

Originality/value

This study finds new factors influencing HA-readiness, validates the well-known and details their industry-specific nuances. The methods used in this research yield a well-rounded HA readiness-assessment (HARA) approach and offer practical insights to hospitals.

The Applied Data Analytics in Medicine Program: Lessons Learned From Four Years' Experience With Personalizing Health Care in an Academic Teaching Hospital

The University Medical Center (UMC) Utrecht piloted a hospital-wide innovation data analytics program over the past 4 years. The goal was, based on available data and innovative data analytics methodologies, to answer clinical questions to improve patient care. In this viewpoint, we aimed to support and inspire others pursuing similar efforts by sharing the three principles of the program: the data analytics value chain (data, insight, action, value), the innovation funnel (structured innovation approach with phases and gates), and the multidisciplinary team (patients, clinicians, and data scientists). We also discussed our most important lessons learned: the importance of a clinical question, collaboration challenges between health care professionals and different types of data scientists, the win-win result of our collaboration with external partners, the prerequisite of available meaningful data, the (legal) complexity of implementation, organizational power, and the embedding of collaborative efforts in the health care system as a whole.

Is it alright to use artificial intelligence in digital health? A systematic literature review on ethical considerations

The application of artificial intelligence (AI) not only yields in advantages for healthcare but raises several ethical questions. Extant research on ethical considerations of AI in digital health is quite sparse and a holistic overview is lacking. A systematic literature review searching across 853 peer-reviewed journals and conferences yielded in 50 relevant articles categorized in five major ethical principles: beneficence, non-maleficence, autonomy, justice, and explicability. The ethical landscape of AI in digital health is portrayed including a snapshot guiding future development. The status quo highlights potential areas with little empirical but required research. Less explored areas with remaining ethical questions are validated and guide scholars' efforts by outlining an overview of addressed ethical principles and intensity of studies including correlations. Practitioners understand novel questions AI raises eventually leading to properly regulated implementations and further comprehend that society is on its way from supporting technologies to autonomous decision-making systems.

Ambiguous definitions for baseline serum creatinine affect acute kidney diagnosis at the emergency department

Background

Acute kidney injury (AKI) incidence is increasing, however AKI is often missed at the emergency department (ED). AKI diagnosis depends on changes in kidney function by comparing a serum creatinine (SCr) measurement to a baseline value. However, it remains unclear to what extent different baseline values may affect AKI diagnosis at ED.

Methods

Routine care data from ED visits between 2012 and 2019 were extracted from the Utrecht Patient Oriented Database. We evaluated baseline definitions with criteria from the RIFLE, AKIN and KDIGO guidelines. We evaluated four baseline SCr definitions (lowest, most recent, mean, median), as well as five different time windows (up to 365 days prior to ED visit) to select a baseline and compared this to the first measured SCr at ED. As an outcome, we assessed AKI prevalence at ED.

Results

We included 47,373 ED visits with both SCr-ED and SCr-BL available. Of these, 46,100 visits had a SCr-BL from the − 365/− 7 days time window. Apart from the lowest value, AKI prevalence remained similar for the other definitions when varying the time window. The lowest value with the − 365/− 7 time window resulted in the highest prevalence (21.4%). Importantly, applying the guidelines with all criteria resulted in major differences in prevalence ranging from 5.9 to 24.0%.

Conclusions

AKI prevalence varies with the use of different baseline definitions in ED patients. Clinicians, as well as researchers and developers of automatic diagnostic tools should take these considerations into account when aiming to diagnose AKI in clinical and research settings.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12882-021-02581-x.

Clinical Utility and Functionality of an Artificial Intelligence-Based App to Predict Mortality in COVID-19: Mixed Methods Analysis

Background

The artificial neural network (ANN) is an increasingly important tool in the context of solving complex medical classification problems. However, one of the principal challenges in leveraging artificial intelligence technology in the health care setting has been the relative inability to translate models into clinician workflow.

Objective

Here we demonstrate the development of a COVID-19 outcome prediction app that utilizes an ANN and assesses its usability in the clinical setting.

Methods

Usability assessment was conducted using the app, followed by a semistructured end-user interview. Usability was specified by effectiveness, efficiency, and satisfaction measures. These data were reported with descriptive statistics. The end-user interview data were analyzed using the thematic framework method, which allowed for the development of themes from the interview narratives. In total, 31 National Health Service physicians at a West London teaching hospital, including foundation physicians, senior house officers, registrars, and consultants, were included in this study.

Results

All participants were able to complete the assessment, with a mean time to complete separate patient vignettes of 59.35 (SD 10.35) seconds. The mean system usability scale score was 91.94 (SD 8.54), which corresponds to a qualitative rating of “excellent.” The clinicians found the app intuitive and easy to use, with the majority describing its predictions as a useful adjunct to their clinical practice. The main concern was related to the use of the app in isolation rather than in conjunction with other clinical parameters. However, most clinicians speculated that the app could positively reinforce or validate their clinical decision-making.

Conclusions

Translating artificial intelligence technologies into the clinical setting remains an important but challenging task. We demonstrate the effectiveness, efficiency, and system usability of a web-based app designed to predict the outcomes of patients with COVID-19 from an ANN.

E-Health Decision Support Technologies in the Prevention and Management of Pressure Ulcers: A Systematic Review

Pressure ulcers are problematic across clinical settings, negatively impacting patient morbidity and mortality while resulting in substantial costs to the healthcare system. E-health clinical decision support technologies can play a key role in improving pressure ulcer-related outcomes. This systematic review aimed to assess the impact of electronic health decision support interventions on pressure ulcer management and prevention. A systematic search was conducted in PubMed, Scopus, Cumulative Index to Nursing and Allied Health Literature, and Cochrane. Nineteen articles, published from 2010 to 2020, were included for review. The findings of this review showed promising results regarding the usability and accuracy of electronic health decision support tools to aid in pressure ulcer prevention and management. Evidence indicated improved clinician adherence to pressure ulcer prevention practices and decreased healthcare costs postimplementation of an electronic health decision support intervention. However, the studies included in this review did not consistently show reductions in pressure ulcer prevalence, incidence, or risk. Most of the articles included in the review were limited by small sample sizes drawn from single hospitals or long-term care homes. More high-quality studies are needed to determine the types of electronic health decision support tools that can drive sustainable improvements to patient outcomes.

How digital health affects the patient-physician relationship: An empirical-ethics study into the perspectives and experiences in obstetric care

BACKGROUND

Digital health technologies are believed to change the patient-physician relationship. Such changes are still speculative, as there are no studies in which both patients and health care professionals are asked for their experiences and perspectives on how digital health affects the patient-physician relationship.

METHODS

We performed a qualitative interview study (n = 25) to identify relevant aspects of the patient-physician relationship as perceived by both health care professionals (n = 14) and patients (n = 11) of a digital monitoring platform for hypertensive disorders related to pregnancy. We focus on roles, responsibilities and medical decision-making.

RESULTS

Digital monitoring helps patients to better understand their own condition and contributes to shared decision-making in terms of information exchange. Yet for clinical decision-making both patients and health care professionals argue that health care professionals should stay in the lead. The collected data is by some health care professionals considered hard data that allows objective and more standardized decision-making, while others believe digital monitoring requires further interpretation in order to personalize the clinical care to the patient.

CONCLUSION

Digital technologies have subtle, yet double-edged, effects on the patient-physician relationship in terms of roles and responsibilities and the value addressed to the digital data. These insights let to 6 ethical recommendations for the implementation of digital health technologies to replace and support clinical care.

MEDLINE search retrieval issues: A longitudinal query analysis of five vendor platforms

This study compared the results of data collected from a longitudinal query analysis of the MEDLINE database hosted on multiple platforms that include PubMed, EBSCOHost, Ovid, ProQuest, and Web of Science. The goal was to identify variations among the search results on the platforms after controlling for search query syntax. We devised twenty-nine cases of search queries comprised of five semantically equivalent queries per case to search against the five MEDLINE database platforms. We ran our queries monthly for a year and collected search result count data to observe changes. We found that search results varied considerably depending on MEDLINE platform. Reasons for variations were due to trends in scholarly publication such as publishing individual papers online first versus complete issues. Some other reasons were metadata differences in bibliographic records; differences in the levels of specificity of search fields provided by the platforms and large fluctuations in monthly search results based on the same query. Database integrity and currency issues were observed as each platform updated its MEDLINE data throughout the year. Specific biomedical bibliographic databases are used to inform clinical decision-making, create systematic reviews, and construct knowledge bases for clinical decision support systems. They serve as essential information retrieval and discovery tools to help identify and collect research data and are used in a broad range of fields and as the basis of multiple research designs. This study should help clinicians, researchers, librarians, informationists, and others understand how these platforms differ and inform future work in their standardization.

Role reconfiguration: what ethnographic studies tell us about the implications of technological change for work and collaboration in healthcare

New technologies including digital health and robotics are driving the evolution of healthcare. At the same time, healthcare systems are transitioning from a multiprofessional model approach of healthcare delivery to an interprofessional model. The concurrence of these two trends may represent an opportunity for leaders in healthcare because both require renegotiation of the complex division of work and enhanced interdependency. This review examines how the introduction of new technologies alters the role boundaries of occupations and interdependencies among health occupations. Based on a scoping review of ethnographic studies of technology implementation in a variety of contexts (from primary care to operating room) and of diverse technologies (from health informatics systems to robotics), we develop the concept of role reconfiguration to capture simultaneous adjustments of multiple, interdependent roles during technological change. Ethnographic and qualitative studies provide rich, detailed accounts of what people actually do and how their work and role is changed (or not) when a new technology arrives. Through a synthesis of these studies, we develop a typology of four types of role reconfiguration: negotiation, clarification, enlargement and restriction. We discuss leadership challenges in managing role reconfiguration and formulate four leadership priorities. We suggest that leaders: redesign roles proactively, paying attention to interdependencies; offer opportunities for collective learning about new technologies; ensure that knowledge of new technologies is distributed across roles and prepare to address resistance.

Evaluation of a clinical decision support system for rare diseases: a qualitative study

BACKGROUND

Rare Diseases (RDs) are difficult to diagnose. Clinical Decision Support Systems (CDSS) could support the diagnosis for RDs. The Medical Informatics in Research and Medicine (MIRACUM) consortium developed a CDSS for RDs based on distributed clinical data from eight German university hospitals. To support the diagnosis for difficult patient cases, the CDSS uses data from the different hospitals to perform a patient similarity analysis to obtain an indication of a diagnosis. To optimize our CDSS, we conducted a qualitative study to investigate usability and functionality of our designed CDSS.

METHODS

We performed a Thinking Aloud Test (TA-Test) with RDs experts working in Rare Diseases Centers (RDCs) at MIRACUM locations which are specialized in diagnosis and treatment of RDs. An instruction sheet with tasks was prepared that the participants should perform with the CDSS during the study. The TA-Test was recorded on audio and video, whereas the resulting transcripts were analysed with a qualitative content analysis, as a ruled-guided fixed procedure to analyse text-based data. Furthermore, a questionnaire was handed out at the end of the study including the System Usability Scale (SUS).

RESULTS

A total of eight experts from eight MIRACUM locations with an established RDC were included in the study. Results indicate that more detailed information about patients, such as descriptive attributes or findings, can help the system perform better. The system was rated positively in terms of functionality, such as functions that enable the user to obtain an overview of similar patients or medical history of a patient. However, there is a lack of transparency in the results of the CDSS patient similarity analysis. The study participants often stated that the system should present the user with an overview of exact symptoms, diagnosis, and other characteristics that define two patients as similar. In the usability section, the CDSS received a score of 73.21 points, which is ranked as good usability.

CONCLUSIONS

This qualitative study investigated the usability and functionality of a CDSS of RDs. Despite positive feedback about functionality of system, the CDSS still requires some revisions and improvement in transparency of the patient similarity analysis.

Real-time imputation of missing predictor values improved the application of prediction models in daily practice

OBJECTIVES

In clinical practice, many prediction models cannot be used when predictor values are missing. We, therefore, propose and evaluate methods for real-time imputation.

STUDY DESIGN AND SETTING

We describe (i) mean imputation (where missing values are replaced by the sample mean), (ii) joint modeling imputation (JMI, where we use a multivariate normal approximation to generate patient-specific imputations), and (iii) conditional modeling imputation (CMI, where a multivariable imputation model is derived for each predictor from a population). We compared these methods in a case study evaluating the root mean squared error (RMSE) and coverage of the 95% confidence intervals (i.e., the proportion of confidence intervals that contain the true predictor value) of imputed predictor values.

RESULTS

-RMSE was lowest when adopting JMI or CMI, although imputation of individual predictors did not always lead to substantial improvements as compared to mean imputation. JMI and CMI appeared particularly useful when the values of multiple predictors of the model were missing. Coverage reached the nominal level (i.e., 95%) for both CMI and JMI.

CONCLUSION

Multiple imputations using either CMI or JMI is recommended when dealing with missing predictor values in real-time settings.

Text Mining of Electronic Health Records Can Accurately Identify and Characterize Patients With Systemic Lupus Erythematosus

Objective

Electronic health records (EHR) are increasingly being recognized as a major source of data reusable for medical research and quality monitoring, although patient identification and assessment of symptoms (characterization) remain challenging, especially in complex diseases such as systemic lupus erythematosus (SLE). Current coding systems are unable to assess information recorded in the physician’s free‐text notes. This study shows that text mining can be used as a reliable alternative.

Methods

In a multidisciplinary research team of data scientists and medical experts, a text mining algorithm on 4607 patient records was developed to assess the diagnosis of 14 different immune‐mediated inflammatory diseases and the presence of 18 different symptoms in the EHR. The text mining algorithm included key words in the EHR, while mining the context for exclusion phrases. The accuracy of the text mining algorithm was assessed by manually checking the EHR of 100 random patients suspected of having SLE for diagnoses and symptoms and comparing the outcome with the outcome of the text mining algorithm.

Results

After evaluation of 100 patient records, the text mining algorithm had a sensitivity of 96.4% and a specificity of 93.3% in assessing the presence of SLE. The algorithm detected potentially life‐threatening symptoms (nephritis, pleuritis) with good sensitivity (80%‐82%) and high specificity (97%‐97%).

Conclusion

We present a text mining algorithm that can accurately identify and characterize patients with SLE using routinely collected data from the EHR. Our study shows that using text mining, data from the EHR can be reused in research and quality control.

A Human-Algorithm Integration System for Hip Fracture Detection on Plain Radiography: System Development and Validation Study

Background

Hip fracture is the most common type of fracture in elderly individuals. Numerous deep learning (DL) algorithms for plain pelvic radiographs (PXRs) have been applied to improve the accuracy of hip fracture diagnosis. However, their efficacy is still undetermined.

Objective

The objective of this study is to develop and validate a human-algorithm integration (HAI) system to improve the accuracy of hip fracture diagnosis in a real clinical environment.

Methods

The HAI system with hip fracture detection ability was developed using a deep learning algorithm trained on trauma registry data and 3605 PXRs from August 2008 to December 2016. To compare their diagnostic performance before and after HAI system assistance using an independent testing dataset, 34 physicians were recruited. We analyzed the physicians’ accuracy, sensitivity, specificity, and agreement with the algorithm; we also performed subgroup analyses according to physician specialty and experience. Furthermore, we applied the HAI system in the emergency departments of different hospitals to validate its value in the real world.

Results

With the support of the algorithm, which achieved 91% accuracy, the diagnostic performance of physicians was significantly improved in the independent testing dataset, as was revealed by the sensitivity (physician alone, median 95%; HAI, median 99%; P<.001), specificity (physician alone, median 90%; HAI, median 95%; P<.001), accuracy (physician alone, median 90%; HAI, median 96%; P<.001), and human-algorithm agreement [physician alone κ, median 0.69 (IQR 0.63-0.74); HAI κ, median 0.80 (IQR 0.76-0.82); P<.001. With the help of the HAI system, the primary physicians showed significant improvement in their diagnostic performance to levels comparable to those of consulting physicians, and both the experienced and less-experienced physicians benefited from the HAI system. After the HAI system had been applied in 3 departments for 5 months, 587 images were examined. The sensitivity, specificity, and accuracy of the HAI system for detecting hip fractures were 97%, 95.7%, and 96.08%, respectively.

Conclusions

HAI currently impacts health care, and integrating this technology into emergency departments is feasible. The developed HAI system can enhance physicians’ hip fracture diagnostic performance.

Ethics parallel research: an approach for (early) ethical guidance of biomedical innovation

Background

Our human societies and certainly also (bio) medicine are more and more permeated with technology. There seems to be an increasing awareness among bioethicists that an effective and comprehensive approach to ethically guide these emerging biomedical innovations into society is needed. Such an approach has not been spelled out yet for bioethics, while there are frequent calls for ethical guidance of biomedical innovation, also by biomedical researchers themselves. New and emerging biotechnologies require anticipation of possible effects and implications, meaning the scope is not evaluative after a technology has been fully developed or about hypothetical technologies, but real-time for a real biotechnology.

Main text

In this paper we aim to substantiate and discuss six ingredients that we increasingly see adopted by ethicists and that together constitute “ethics parallel research”. This approach allows to fulfil two aims: guiding the development process of technologies in biomedicine and providing input for the normative evaluation of such technologies. The six ingredients of ethics parallel research are: (1) disentangling wicked problems, (2) upstream or midstream ethical analysis, (3) ethics from within, (4) inclusion of empirical research, (5) public participation and (6) mapping societal impacts, including hard and soft impacts. We will draw on gene editing, organoid technology and artificial intelligence as examples to illustrate these six ingredients.

Conclusion

Ethics parallel research brings together these ingredients to ethically analyse and proactively or parallel guide technological development. It widens the roles and judgements from the ethicist to a more anticipatory and constructively guiding role. Ethics parallel research is characterised by a constructive, rather than a purely critical perspective, it focusses on developing best-practices rather than outlining worst practice, and draws on insights from social sciences and philosophy of technology.

Evaluating the Impact of the Grading and Assessment of Predictive Tools Framework on Clinicians and Health Care Professionals' Decisions in Selecting Clinical Predictive Tools: Randomized Controlled Trial

BACKGROUND

While selecting predictive tools for implementation in clinical practice or for recommendation in clinical guidelines, clinicians and health care professionals are challenged with an overwhelming number of tools. Many of these tools have never been implemented or evaluated for comparative effectiveness. To overcome this challenge, the authors developed and validated an evidence-based framework for grading and assessment of predictive tools (the GRASP framework). This framework was based on the critical appraisal of the published evidence on such tools.

OBJECTIVE

The aim of the study was to examine the impact of using the GRASP framework on clinicians' and health care professionals' decisions in selecting clinical predictive tools.

METHODS

A controlled experiment was conducted through a web-based survey. Participants were randomized to either review the derivation publications, such as studies describing the development of the predictive tools, on common traumatic brain injury predictive tools (control group) or to review an evidence-based summary, where each tool had been graded and assessed using the GRASP framework (intervention group). Participants in both groups were asked to select the best tool based on the greatest validation or implementation. A wide group of international clinicians and health care professionals were invited to participate in the survey. Task completion time, rate of correct decisions, rate of objective versus subjective decisions, and level of decisional conflict were measured.

RESULTS

We received a total of 194 valid responses. In comparison with not using GRASP, using the framework significantly increased correct decisions by 64%, from 53.7% to 88.1% (88.1/53.7=1.64; t₁₉₃=8.53; P<.001); increased objective decision making by 32%, from 62% (3.11/5) to 82% (4.10/5; t₁₈₉=9.24; P<.001); decreased subjective decision making based on guessing by 20%, from 49% (2.48/5) to 39% (1.98/5; t₁₈₈=-5.47; P<.001); and decreased prior knowledge or experience by 8%, from 71% (3.55/5) to 65% (3.27/5; t₁₈₇=-2.99; P=.003). Using GRASP significantly decreased decisional conflict and increased the confidence and satisfaction of participants with their decisions by 11%, from 71% (3.55/5) to 79% (3.96/5; t₁₈₈=4.27; P<.001), and by 13%, from 70% (3.54/5) to 79% (3.99/5; t₁₈₈=4.89; P<.001), respectively. Using GRASP decreased the task completion time, on the 90th percentile, by 52%, from 12.4 to 6.4 min (t₁₉₃=-0.87; P=.38). The average System Usability Scale of the GRASP framework was very good: 72.5% and 88% (108/122) of the participants found the GRASP useful.

CONCLUSIONS

Using GRASP has positively supported and significantly improved evidence-based decision making. It has increased the accuracy and efficiency of selecting predictive tools. GRASP is not meant to be prescriptive; it represents a high-level approach and an effective, evidence-based, and comprehensive yet simple and feasible method to evaluate, compare, and select clinical predictive tools.

Implementation of artificial intelligence (AI) applications in radiology: hindering and facilitating factors

Objective

The objective was to identify barriers and facilitators to the implementation of artificial intelligence (AI) applications in clinical radiology in The Netherlands.

Materials and methods

Using an embedded multiple case study, an exploratory, qualitative research design was followed. Data collection consisted of 24 semi-structured interviews from seven Dutch hospitals. The analysis of barriers and facilitators was guided by the recently published Non-adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework for new medical technologies in healthcare organizations.

Results

Among the most important facilitating factors for implementation were the following: (i) pressure for cost containment in the Dutch healthcare system, (ii) high expectations of AI’s potential added value, (iii) presence of hospital-wide innovation strategies, and (iv) presence of a “local champion.” Among the most prominent hindering factors were the following: (i) inconsistent technical performance of AI applications, (ii) unstructured implementation processes, (iii) uncertain added value for clinical practice of AI applications, and (iv) large variance in acceptance and trust of direct (the radiologists) and indirect (the referring clinicians) adopters.

Conclusion

In order for AI applications to contribute to the improvement of the quality and efficiency of clinical radiology, implementation processes need to be carried out in a structured manner, thereby providing evidence on the clinical added value of AI applications.

Key Points

• Successful implementation of AI in radiology requires collaboration between radiologists and referring clinicians.

• Implementation of AI in radiology is facilitated by the presence of a local champion.

• Evidence on the clinical added value of AI in radiology is needed for successful implementation.

Electronic supplementary material

The online version of this article (10.1007/s00330-020-06946-y) contains supplementary material, which is available to authorized users.

Imprecise Data and Their Impact on Translational Research in Medicine

The medical field expects from big data essentially two main results: the ability to build predictive models and the possibility of applying them to obtain accurate patient risk profiles and/or health trajectories. Note that the paradigm of precision has determined that similar challenges need to be faced in both population and individualized studies, namely the need of assembling, integrating, modeling, and interpreting data from a variety of information sources and scales potentially influencing disease from onset to progression. In many cases, data require computational treatment through solutions for otherwise intractable problems. However, as precision medicine remains subject to a substantial amount of data imprecision and lack of translational impact, a revision of methodological inference approaches is needed. Both the relevance and the usefulness of such revision crucially deal with the assimilation of data features dynamically interconnected.

Low-Density Lipoprotein Cholesterol Target Attainment in Patients With Established Cardiovascular Disease: Analysis of Routine Care Data

BACKGROUND

Direct feedback on quality of care is one of the key features of a learning health care system (LHS), enabling health care professionals to improve upon the routine clinical care of their patients during practice.

OBJECTIVE

This study aimed to evaluate the potential of routine care data extracted from electronic health records (EHRs) in order to obtain reliable information on low-density lipoprotein cholesterol (LDL-c) management in cardiovascular disease (CVD) patients referred to a tertiary care center.

METHODS

We extracted all LDL-c measurements from the EHRs of patients with a history of CVD referred to the University Medical Center Utrecht. We assessed LDL-c target attainment at the time of referral and per year. In patients with multiple measurements, we analyzed LDL-c trajectories, truncated at 6 follow-up measurements. Lastly, we performed a logistic regression analysis to investigate factors associated with improvement of LDL-c at the next measurement.

RESULTS

Between February 2003 and December 2017, 250,749 LDL-c measurements were taken from 95,795 patients, of whom 23,932 had a history of CVD. At the time of referral, 51% of patients had not reached their LDL-c target. A large proportion of patients (55%) had no follow-up LDL-c measurements. Most of the patients with repeated measurements showed no change in LDL-c levels over time: the transition probability to remain in the same category was up to 0.84. Sequence clustering analysis showed more women (odds ratio 1.18, 95% CI 1.07-1.10) in the cluster with both most measurements off target and the most LDL-c measurements furthest from the target. Timing of drug prescription was difficult to determine from our data, limiting the interpretation of results regarding medication management.

CONCLUSIONS

Routine care data can be used to provide feedback on quality of care, such as LDL-c target attainment. These routine care data show high off-target prevalence and little change in LDL-c over time. Registrations of diagnosis; follow-up trajectory, including primary and secondary care; and medication use need to be improved in order to enhance usability of the EHR system for adequate feedback.

Bridging the "last mile" gap between AI implementation and operation: "data awareness" that matters

Interest in the application of machine learning (ML) techniques to medicine is growing fast and wide because of their ability to endow decision support systems with so-called artificial intelligence, particularly in those medical disciplines that extensively rely on digital imaging. Nonetheless, achieving a pragmatic and ecological validation of medical AI systems in real-world settings is difficult, even when these systems exhibit very high accuracy in laboratory settings. This difficulty has been called the “last mile of implementation.” In this review of the concept, we claim that this metaphorical mile presents two chasms: the hiatus of human trust and the hiatus of machine experience. The former hiatus encompasses all that can hinder the concrete use of AI at the point of care, including availability and usability issues, but also the contradictory phenomena of cognitive ergonomics, such as automation bias (overreliance on technology) and prejudice against the machine (clearly the opposite). The latter hiatus, on the other hand, relates to the production and availability of a sufficient amount of reliable and accurate clinical data that is suitable to be the “experience” with which a machine can be trained. In briefly reviewing the existing literature, we focus on this latter hiatus of the last mile, as it has been largely neglected by both ML developers and doctors. In doing so, we argue that efforts to cross this chasm require data governance practices and a focus on data work, including the practices of data awareness and data hygiene. To address the challenge of bridging the chasms in the last mile of medical AI implementation, we discuss the six main socio-technical challenges that must be overcome in order to build robust bridges and deploy potentially effective AI in real-world clinical settings.

Exploring Abnormal Behavior Patterns of Online Users With Emotional Eating Behavior: Topic Modeling Study

Background

Emotional eating (EE) is one of the most significant symptoms of various eating disorders. It has been difficult to collect a large amount of behavioral data on EE; therefore, only partial studies of this symptom have been conducted. To provide adequate support for online social media users with symptoms of EE, we must understand their behavior patterns to design a sophisticated personalized support system (PSS).

Objective

This study aimed to analyze the behavior patterns of emotional eaters as the first step to designing a personalized intervention system.

Methods

The machine learning (ML) framework and Latent Dirichlet Allocation (LDA) topic modeling tool were used to collect and analyze behavioral data on EE. Data from a subcommunity of Reddit, /r/loseit, were analyzed. This dataset included all posts and feedback from July 2014 to May 2018, comprising 185,950 posts and 3,528,107 comments. In addition, deleted and improperly collected data were eliminated. Stochastic gradient descent–based ML classifier with an accuracy of 90.64% was developed to collect refined behavioral data of online users with EE behaviors. The expert group that labeled the dataset to train the ML classifiers included a medical doctor specializing in EE diagnosis and a nutritionist with profound knowledge of EE behavior. The experts labeled 5126 posts as EE (coded as 1) or others (coded as 0). Finally, the topic modeling process was conducted with LDA.

Results

The following 4 macroperspective topics of online EE behaviors were identified through linguistic evidence regarding each topic: addressing feelings, sharing physical changes, sharing and asking for dietary information, and sharing dietary strategies. The 5 main topics of feedback were dietary information, compliments, consolation, automatic bot feedback, and health information. The feedback topic distribution significantly differed depending on the type of EE behavior (overall P<.001).

Conclusions

This study introduces a data-driven approach for analyzing behavior patterns of social website users with EE behaviors. We discovered the possibility of the LDA topic model as an exploratory user study method for abnormal behaviors in medical research. We also investigated the possibilities of ML- and topic modeling–based classifiers to automatically categorize text-based behavioral data, which could be applied to personalized medicine in future research.

A computerised decision support system for cardiovascular risk management 'live' in the electronic health record environment: development, validation and implementation-the Utrecht Cardiovascular Cohort Initiative

Purpose

We set out to develop a real-time computerised decision support system (CDSS) embedded in the electronic health record (EHR) with information on risk factors, estimated risk, and guideline-based advice on treatment strategy in order to improve adherence to cardiovascular risk management (CVRM) guidelines with the ultimate aim of improving patient healthcare.

Methods

We defined a project plan including the scope and requirements, infrastructure and interface, data quality and study population, validation and evaluation of the CDSS.

Results

In collaboration with clinicians, data scientists, epidemiologists, ICT architects, and user experience and interface designers we developed a CDSS that provides ‘live’ information on CVRM within the environment of the EHR. The CDSS provides information on cardiovascular risk factors (age, sex, medical and family history, smoking, blood pressure, lipids, kidney function, and glucose intolerance measurements), estimated 10-year cardiovascular risk, guideline-compliant suggestions for both pharmacological and non-pharmacological treatment to optimise risk factors, and an estimate on the change in 10-year risk of cardiovascular disease if treatment goals are adhered to. Our pilot study identified a number of issues that needed to be addressed, such as missing data, rules and regulations, privacy, and patient participation.

Conclusion

Development of a CDSS is complex and requires a multidisciplinary approach. We identified opportunities and challenges in our project developing a CDSS aimed at improving adherence to CVRM guidelines. The regulatory environment, including guidance on scientific evaluation, legislation, and privacy issues needs to evolve within this emerging field of eHealth.

Exploring the dark genome: implications for precision medicine

The increase in the number of both patients and healthcare practitioners who grew up using the Internet and computers (so-called "digital natives") is likely to impact the practice of precision medicine, and requires novel platforms for data integration and mining, as well as contextualized information retrieval. The "Illuminating the Druggable Genome Knowledge Management Center" (IDG KMC) quantifies data availability from a wide range of chemical, biological, and clinical resources, and has developed platforms that can be used to navigate understudied proteins (the "dark genome"), and their potential contribution to specific pathologies. Using the "Target Importance and Novelty Explorer" (TIN-X) highlights the role of LRRC10 (a dark gene) in dilated cardiomyopathy. Combining mouse and human phenotype data leads to increased strength of evidence, which is discussed for four additional dark genes: SLX4IP and its role in glucose metabolism, the role of HSF2BP in coronary artery disease, the involvement of ELFN1 in attention-deficit hyperactivity disorder and the role of VPS13D in mouse neural tube development and its confirmed role in childhood onset movement disorders. The workflow and tools described here are aimed at guiding further experimental research, particularly within the context of precision medicine.