Evaluation Criteria of Noninvasive Telemonitoring for Patients With Heart Failure: Systematic Review

BACKGROUND

Telemonitoring can improve heart failure (HF) management, but there is no standardized evaluation framework to comprehensively evaluate its impact.

OBJECTIVE

Our objectives were to list the criteria used in published evaluations of noninvasive HF telemonitoring projects, describe how they are used in the evaluation studies, and organize them into a consistent scheme.

METHODS

Articles published from January 1990 to August 2015 were obtained through MEDLINE, Web of Science, and EMBASE. Articles were eligible if they were original reports of a noninvasive HF telemonitoring evaluation study in the English language. Studies of implantable telemonitoring devices were excluded. Each selected article was screened to extract the description of the telemonitoring project and the evaluation process and criteria. A qualitative synthesis was performed.

RESULTS

We identified and reviewed 128 articles leading to 52 evaluation criteria classified into 6 dimensions: clinical, economic, user perspective, educational, organizational, and technical. The clinical and economic impacts were evaluated in more than 70% of studies, whereas the educational, organizational, and technical impacts were studied in fewer than 15%. User perspective was the most frequently covered dimension in the development phase of telemonitoring projects, whereas clinical and economic impacts were the focus of later phases.

CONCLUSIONS

Telemonitoring evaluation frameworks should cover all 6 dimensions appropriately distributed along the telemonitoring project lifecycle. Our next goal is to build such a comprehensive evaluation framework for telemonitoring and test it on an ongoing noninvasive HF telemonitoring project.

Building a Knowledge-Based Tool for Auto-Assessing the Cardiovascular Risk

The prevention of cardiovascular diseases needs first to quantify the cardiovascular risk. To estimate this risk, French national health authorities provided clinical practice guidelines extending the existing European SCORE, which doesn't include all the cardiovascular risk factors (e.g. diabetes). Hence, French national clinical practice guidelines to quantify the cardiovascular risk is able to deal with more clinical situations than the SCORE. The goal of this paper is to formalize knowledge extracted from these guidelines and implement the rules so that they can be used into an auto-assessing tool of cardiovascular risk. Formalization followed five steps and was conducted under the guidance of medical experts. It resulted into a decision tree fed by eight decision variables. Evaluation of the accuracy of the decision tree showed 80% of agreement with an expert in medical informatics in predicting the cardiovascular risk level for 15 different clinical situations. Discrepancies correspond to the knowledge gaps within Clinical Practice Guidelines. We intend to extend the implementation of the decision tree to a complete tool, for allowing patient to auto-assess their cardiovascular risk. This tool will be integrated into a platform providing recommendations adapted to the calculated level of cardiovascular risk.

Modular Knowledge-Based Decision Support System Dedicated to a Cooperative Decision to Prevent Cardiovascular Diseases

Despite the success of artificial intelligence solutions in the recent years, physicians are still reticent to use integrated functionalities to support their decision. Methods used to create these functionalities can be divided into two groups, each being associated to different questions. Data-based methods are seen as black boxes for which it is impossible to understand how the decision is taken; knowledge-based methods need to rely on formalized knowledge sources on the basis of evidence, which can be discussed and criticized by physicians for their use in real life. This paper presents a new modular decision support system for the prevention of cardiovascular diseases, based on knowledge and on cooperative decision between the patient and the physician. The decision support system is based on two layers: (i) the first layer is a knowledge-based module which generates automatically patient profile, and prevention strategies associated to the profile; (ii) the second layer is a dynamic collaborative graphic user interface which displayed information about the risks of treatment adherence failure, personalized motivation and follow-up strategies. In the future, we aim at assessing the platform in real life.

Parallel Design of Browsing Scheme and Data Model for Multi-Level Hierarchical Application Devoted to Management of Patient with Infectious Disease in Primary Care

Many decision systems are based on a hierarchical approach, enriching the known context used to finally choose the right potential action. Designing the scheme for browsing the clinical guidelines is a task devoted to expert in infectious diseases. Designing the data model is a task devoted to the expert in data modeling. As a consequence, browsing scheme and data model generally differ in terms of abstraction levels. While the browsing scheme proposes to navigate into depth, the data model stays flat. We propose here a novel method to design in parallel the browsing scheme and the data model so that both of them reflect the different abstraction levels in decision process.

From Patient Discharge Summaries to an Ontology for Psychiatry

Psychiatry aims at detecting symptoms, providing diagnoses and treating mental disorders. We developed ONTOPSYCHIA, an ontology for psychiatry in three modules: social and environmental factors of mental disorders, mental disorders, and treatments. The use of ONTOPSYCHIA, associated with dedicated tools, will facilitate semantic research in Patient Discharge Summaries (PDS). To develop the first module of the ontology we propose a PDS text analysis in order to explicit psychiatry concepts. We decided to set aside classifications during the construction of the modu le, to focus only on the information contained in PDS (bottom-up approach) and to return to domain classifications solely for the enrichment phase (top-down approach). Then, we focused our work on the development of the LOVMI methodology (Les Ontologies Validées par Méthode Interactive - Ontologies Validated by Interactive Method), which aims to provide a methodological framework to validate the structure and the semantic of an ontology.

Design of a Visual Interface for Comparing Antibiotics Using Rainbow Boxes

Non-optimal prescriptions of antibiotics have a negative impact on patients and population. Clinical practice guidelines are not always followed by doctors because the rationale of the recommendations is not always clear and can be difficult to understand. In this paper, we propose a new approach consisting in presenting the properties of antibiotics for allowing doctors to compare them and choose the most appropriate one. For that, we used and extended rainbow boxes, a new technique for overlapping set visualization. We tested our approach on 11 clinical situations related to urinary infections, and assessed the simplicity, the interest and utility with 11 doctors. 10 of them found that this approach was interesting and useful in clinical practice. Further studies are needed to confirm this preliminary work.

Exploiting heterogeneous publicly available data sources for drug safety surveillance: computational framework and case studies

OBJECTIVE

Driven by the need of pharmacovigilance centres and companies to routinely collect and review all available data about adverse drug reactions (ADRs) and adverse events of interest, we introduce and validate a computational framework exploiting dominant as well as emerging publicly available data sources for drug safety surveillance.

METHODS

Our approach relies on appropriate query formulation for data acquisition and subsequent filtering, transformation and joint visualization of the obtained data. We acquired data from the FDA Adverse Event Reporting System (FAERS), PubMed and Twitter. In order to assess the validity and the robustness of the approach, we elaborated on two important case studies, namely, clozapine-induced cardiomyopathy/myocarditis versus haloperidol-induced cardiomyopathy/myocarditis, and apixaban-induced cerebral hemorrhage.

RESULTS

The analysis of the obtained data provided interesting insights (identification of potential patient and health-care professional experiences regarding ADRs in Twitter, information/arguments against an ADR existence across all sources), while illustrating the benefits (complementing data from multiple sources to strengthen/confirm evidence) and the underlying challenges (selecting search terms, data presentation) of exploiting heterogeneous information sources, thereby advocating the need for the proposed framework.

CONCLUSIONS

This work contributes in establishing a continuous learning system for drug safety surveillance by exploiting heterogeneous publicly available data sources via appropriate support tools.

[Automated grouping of terms associated to cardiac valve fibrosis in MedDRA]

AIM

To propose an alternative approach for building custom groupings of terms that complements the usual approach based on both hierarchical method (selection of reference groupings in medical dictionary for regulatory activities [MedDRA]) and/or textual method (string search), for case reports extraction from a pharmacovigilance database in response to a safety problem. Here we take cardiac valve fibrosis as an example.

METHODS

The list of terms obtained by an automated approach, based on querying ontology of adverse drug reactions (OntoADR), a knowledge base defining MedDRA terms through relationships with systematized nomenclature of medicine-clinical terms (SNOMED CT) concepts, was compared with the reference list consisting of 53 preferred terms obtained by hierarchical and textual method. Two queries were performed on OntoADR by using a dedicated software: OntoADR query tools. Both queries excluded congenital diseases, and included a procedure or an auscultation method performed on cardiac valve structures. Query 1 also considered MedDRA terms related to fibrosis, narrowing or calcification of heart valves, and query 2 MedDRA terms described according to one of these four SNOMED CT terms: "Insufficiency", "Valvular sclerosis", "Heart valve calcification" or "Heart valve stenosis".

RESULTS

The reference grouping consisted of 53 MedDRA preferred terms. Our automated method achieved recall of 79% and precision of 100% for query 1 privileging morphological abnormalities, and recall of 100% and precision of 96% for query 2 privileging functional abnormalities.

CONCLUSION

An alternative approach to MedDRA reference groupings for building custom groupings is feasible for cardiac valve fibrosis. OntoADR is still in development. Its application to other adverse reactions would require significant work for a knowledge engineer to define every MedDRA term, but such definitions could then be queried as many times as necessary by pharmacovigilance professionals.

Cross border semantic interoperability for clinical research: the EHR4CR semantic resources and services

With the development of platforms enabling the use of routinely collected clinical data in the context of international clinical research, scalable solutions for cross border semantic interoperability need to be developed. Within the context of the IMI EHR4CR project, we first defined the requirements and evaluation criteria of the EHR4CR semantic interoperability platform and then developed the semantic resources and supportive services and tooling to assist hospital sites in standardizing their data for allowing the execution of the project use cases. The experience gained from the evaluation of the EHR4CR platform accessing to semantically equivalent data elements across 11 European participating EHR systems from 5 countries demonstrated how far the mediation model and mapping efforts met the expected requirements of the project. Developers of semantic interoperability platforms are beginning to address a core set of requirements in order to reach the goal of developing cross border semantic integration of data.

OntoADR a semantic resource describing adverse drug reactions to support searching, coding, and information retrieval

INTRODUCTION

Efficient searching and coding in databases that use terminological resources requires that they support efficient data retrieval. The Medical Dictionary for Regulatory Activities (MedDRA) is a reference terminology for several countries and organizations to code adverse drug reactions (ADRs) for pharmacovigilance. Ontologies that are available in the medical domain provide several advantages such as reasoning to improve data retrieval. The field of pharmacovigilance does not yet benefit from a fully operational ontology to formally represent the MedDRA terms. Our objective was to build a semantic resource based on formal description logic to improve MedDRA term retrieval and aid the generation of on-demand custom groupings by appropriately and efficiently selecting terms: OntoADR.

METHODS

The method consists of the following steps: (1) mapping between MedDRA terms and SNOMED-CT, (2) generation of semantic definitions using semi-automatic methods, (3) storage of the resource and (4) manual curation by pharmacovigilance experts.

RESULTS

We built a semantic resource for ADRs enabling a new type of semantics-based term search. OntoADR adds new search capabilities relative to previous approaches, overcoming the usual limitations of computation using lightweight description logic, such as the intractability of unions or negation queries, bringing it closer to user needs. Our automated approach for defining MedDRA terms enabled the association of at least one defining relationship with 67% of preferred terms. The curation work performed on our sample showed an error level of 14% for this automated approach. We tested OntoADR in practice, which allowed us to build custom groupings for several medical topics of interest.

DISCUSSION

The methods we describe in this article could be adapted and extended to other terminologies which do not benefit from a formal semantic representation, thus enabling better data retrieval performance. Our custom groupings of MedDRA terms were used while performing signal detection, which suggests that the graphical user interface we are currently implementing to process OntoADR could be usefully integrated into specialized pharmacovigilance software that rely on MedDRA.

Towards data integration automation for the French rare disease registry

Building a medical registry upon an existing infrastructure and rooted practices is not an easy task. It is the case for the BNDMR project, the French rare disease registry, that aims to collect administrative and medical data of rare disease patients seen in different hospitals. To avoid duplicating data entry for health professionals, the project plans to deploy connectors with the existing systems to automatically retrieve data. Given the data heterogeneity and the large number of source systems, the automation of connectors creation is required. In this context, we propose a methodology that optimizes the use of existing alignment approaches in the data integration processes. The generated mappings are formalized in exploitable mapping expressions. Following this methodology, a process has been experimented on specific data types of a source system: Boolean and predefined lists. As a result, effectiveness of the used alignment approach has been enhanced and more good mappings have been detected. Nonetheless, further improvements could be done to deal with the semantic issue and process other data types.

Adverse Drug Reaction Identification and Extraction in Social Media: A Scoping Review

Background

The underreporting of adverse drug reactions (ADRs) through traditional reporting channels is a limitation in the efficiency of the current pharmacovigilance system. Patients’ experiences with drugs that they report on social media represent a new source of data that may have some value in postmarketing safety surveillance.

Objective

A scoping review was undertaken to explore the breadth of evidence about the use of social media as a new source of knowledge for pharmacovigilance.

Methods

Daubt et al’s recommendations for scoping reviews were followed. The research questions were as follows: How can social media be used as a data source for postmarketing drug surveillance? What are the available methods for extracting data? What are the different ways to use these data? We queried PubMed, Embase, and Google Scholar to extract relevant articles that were published before June 2014 and with no lower date limit. Two pairs of reviewers independently screened the selected studies and proposed two themes of review: manual ADR identification (theme 1) and automated ADR extraction from social media (theme 2). Descriptive characteristics were collected from the publications to create a database for themes 1 and 2.

Results

Of the 1032 citations from PubMed and Embase, 11 were relevant to the research question. An additional 13 citations were added after further research on the Internet and in reference lists. Themes 1 and 2 explored 11 and 13 articles, respectively. Ways of approaching the use of social media as a pharmacovigilance data source were identified.

Conclusions

This scoping review noted multiple methods for identifying target data, extracting them, and evaluating the quality of medical information from social media. It also showed some remaining gaps in the field. Studies related to the identification theme usually failed to accurately assess the completeness, quality, and reliability of the data that were analyzed from social media. Regarding extraction, no study proposed a generic approach to easily adding a new site or data source. Additional studies are required to precisely determine the role of social media in the pharmacovigilance system.

Computational approaches for pharmacovigilance signal detection: toward integrated and semantically-enriched frameworks

Computational signal detection constitutes a key element of postmarketing drug monitoring and surveillance. Diverse data sources are considered within the 'search space' of pharmacovigilance scientists, and respective data analysis methods are employed, all with their qualities and shortcomings, towards more timely and accurate signal detection. Recent systematic comparative studies highlighted not only event-based and data-source-based differential performance across methods but also their complementarity. These findings reinforce the arguments for exploiting all possible information sources for drug safety and the parallel use of multiple signal detection methods. Combinatorial signal detection has been pursued in few studies up to now, employing a rather limited number of methods and data sources but illustrating well-promising outcomes. However, the large-scale realization of this approach requires systematic frameworks to address the challenges of the concurrent analysis setting. In this paper, we argue that semantic technologies provide the means to address some of these challenges, and we particularly highlight their contribution in (a) annotating data sources and analysis methods with quality attributes to facilitate their selection given the analysis scope; (b) consistently defining study parameters such as health outcomes and drugs of interest, and providing guidance for study setup; (c) expressing analysis outcomes in a common format enabling data sharing and systematic comparisons; and (d) assessing/supporting the novelty of the aggregated outcomes through access to reference knowledge sources related to drug safety. A semantically-enriched framework can facilitate seamless access and use of different data sources and computational methods in an integrated fashion, bringing a new perspective for large-scale, knowledge-intensive signal detection.

A "pivot" Model to set up Large Scale Rare Diseases Information Systems: Application to the Fibromuscular Dysplasia Registry

The SIR-FMD project is a partnership between the Department of Genetics and Reference Centre for Rare Vascular Diseases at the Georges Pompidou European Hospital in Paris and the Medical Informatics and Knowledge Engineering Laboratory of Inserm. Its aim is to use an ontological approach to implement an information system for the French Fibromuscular Dysplasia Registry. The existing data was dispersed in numerous databases, which had been created independently. These databases have different structures and contain data of diverse quality. The project aims to provide generic solutions for the management of the communication of medical data. The secondary objective is to demonstrate the applicability of these generic solutions in the field of rare diseases (RD) in an operational context. The construction of the French FMD registry was a multistep process. A secure platform has been available since the beginning of November 2013. The medical records of 471 patients from the initial dataset provided by the HEGP-Paris, France have been included, and are accessible from a secure user account. Users are organized into a collaborative group, and can access patient groups. Each electronic patient record contains more than 2,200 items. The problem of semantic interoperability has become one of the major challenges for the development of applications requiring the sharing and reuse of data. The information system component of the SIR-FMD project has a direct impact on the standardisation of coding of rare diseases and thereby contributes to the development of e-Health.

Building a Semantic Interoperability Framework for Care and Research in Fibromuscular Dysplasia

Identifying patients with Fibromuscular Dysplasia (FMD) at the international level will have considerable value for understanding the epidemiology, clinical manifestations and susceptible genes in this arterial disease, but also for identifying eligible patients in clinical trials or cohorts. We present a two-step methodology to create a general semantic interoperability framework allowing access and comparison of distributed data over various nations, languages, formats and databases.

METHODS

The first step is to develop a pivot multidimensional model based on a core dataset to harmonize existing heterogeneous data sources. The second step is to align the model to additional data, semantically related to FMD and collected currently in various registries. We present the results of the first step that has been fully completed with the validation and implementation of the model in a dedicated information system (SIR-FMD). We discuss the current achievements for step 2 and the extensibility of the methodology in the context of other rare diseases.

Personalized decision support system based on clinical practice guidelines

Personalized medicine is a broad and rapidly advancing field of health care that is informed by each person's unique clinical, genetic, genomic, and environmental information. Health care that embraces personalized medicine is an integrated, coordinated, evidence based approach to individualizing patient care across the continuum. It is very important to make the right treatment decision but before that to obtain a good diagnosis. There are several clinical forms of disease whose symptoms vary depending on the age and etiology. In this study, we investigated and evaluated a model framework, for personalized diagnostic decisions, based on Case Based Fuzzy Cognitive Map (CBFCM, a cognitive process applying the main features of fuzzy logic and neural processors to situations involving imprecision and uncertain descriptions, in a similar way to intuitive human reasoning. We explored the use of this method for modelling clinical practice guidelines.

Ethical, Legal and Social Issues related to the health data-warehouses: re-using health data in the research and public health research

Research derived from the application of information and communication technologies in medicine operates in a context involving the globalization of collecting, sharing, storage, transfer and re-use of personal health data. Health data computerization within Clinical Information Systems (as Electronic Healthcare Records) should allow the re-use of health data for clinical research and public health purposes. One of the objects allowing the integration of healthcare and research information systems is the health data-warehouse (DWH). However, ethical-legal frameworks in force are not adapted to these DWHs because they were not conceived for re-using data in a different context than the one of their acquisition. For that matter, access modalities to data-warehouses must ensure the respect of patients' rights: information to the patient, as well as confidentiality and security. Through a bibliography research, some Ethical, legal and Social Issues (ELSI) have been identified: Patients' rights Modalities of implementation of the DWs; Solidarity and common good; Transparency and Trust. Comparative analysis between the Directive 95/46/CE and the "Proposal for regulation on protection of individuals with regard to the processing of personal data" shows that this regulation pretends allowing the re-use of key-coded data when aimed at a scientific purpose. However, since this new regulation does not align with the ethical and legal requirements at an operational level, a Code of practice on secondary use of Medical Data in scientific Research Projects has been developed at the European Level. This Code provides guidance for Innovative Medicine Initiative (IMI) and will help to propose practical solutions to overcome the issue of the re-use of data for research purposes.

Formalizing MedDRA to support semantic reasoning on adverse drug reaction terms

Although MedDRA has obvious advantages over previous terminologies for coding adverse drug reactions and discovering potential signals using data mining techniques, its terminological organization constrains users to search terms according to predefined categories. Adding formal definitions to MedDRA would allow retrieval of terms according to a case definition that may correspond to novel categories that are not currently available in the terminology. To achieve semantic reasoning with MedDRA, we have associated formal definitions to MedDRA terms in an OWL file named OntoADR that is the result of our first step for providing an "ontologized" version of MedDRA. MedDRA five-levels original hierarchy was converted into a subsumption tree and formal definitions of MedDRA terms were designed using several methods: mappings to SNOMED-CT, semi-automatic definition algorithms or a fully manual way. This article presents the main steps of OntoADR conception process, its structure and content, and discusses problems and limits raised by this attempt to "ontologize" MedDRA.

Automatic annotation of ICD-to-MedDRA mappings with SKOS predicates

Robust alignments between ICD and MedDRA are essential to enable the secondary use of clinical data for pharmacovigilance research. UMLS makes available ICD-to-MedDRA mappings, but they are only poorly specified, which introduces difficulties when exploited in an automatic way. SKOS vocabulary can help achieve quality and machine-processable mappings. We have developed an algorithm based on several simple rules which annotates automatically ICD-to-MedDRA mappings with SKOS predicates. The method was tested and evaluated on a sample of ICD-10-to MedDRA mappings extracted from UMLS. The algorithm demonstrated satisfying performances, especially for skos:exactMatch properties, which suggests that automatic methods can be used to improve the quality of terminology mappings.

Towards an automatic harmonization of the representation of medical reports to assess their similarities

Numerous hospitals contain unexploited knowledge deposits. These often take the form of unstructured records with heterogeneous content, which, at various levels of those organizations, register past cases. Those records are for instance patient medical records. Accessing the knowledge and experience they gather would help us to handle present cases. We present here a method to normalize textual reports in foetopathology in order to constitute a proper case base that will be the target of case-based reasoning techniques. Statistics of noise and silence generated by this method on 10 cases are presented.

Ci4SeR--curation interface for semantic resources--evaluation with adverse drug reactions

Evaluation and validation have become a crucial problem for the development of semantic resources. We developed Ci4SeR, a Graphical User Interface to optimize the curation work (not taking into account structural aspects), suitable for any type of resource with lightweight description logic. We tested it on OntoADR, an ontology of adverse drug reactions. A single curator has reviewed 326 terms (1020 axioms) in an estimated time of 120 hours (2.71 concepts and 8.5 axioms reviewed per hour) and added 1874 new axioms (15.6 axioms per hour). Compared with previous manual endeavours, the interface allows increasing the speed-rate of reviewed concepts by 68% and axiom addition by 486%. A wider use of Ci4SeR would help semantic resources curation and improve completeness of knowledge modelling.

Formalizing mappings to optimize automated schema alignment: application to rare diseases

In the era of data sharing and systems interoperability, the automation of data schema alignment has become a priority. Discovering data mappings is the aim of many alignment approaches that have been described in the literature and the effectiveness of which depends on data specifications. In this context, we propose a method for mappings formalization that allows automated data integration processes optimization. This method, involving both data element level and value element level, allows an automated inference of mappings expressed by rules. In this paper, we start by describing the methods used to achieve this mappings formalization. Then, we explain how it has been validated by characterizing data from two use cases. We end up by discussing the objectives of the proposed formalization.

Application of probabilistic and fuzzy cognitive approaches in semantic web framework for medical decision support

This study aimed to focus on medical knowledge representation and reasoning using the probabilistic and fuzzy influence processes, implemented in the semantic web, for decision support tasks. Bayesian belief networks (BBNs) and fuzzy cognitive maps (FCMs), as dynamic influence graphs, were applied to handle the task of medical knowledge formalization for decision support. In order to perform reasoning on these knowledge models, a general purpose reasoning engine, EYE, with the necessary plug-ins was developed in the semantic web. The two formal approaches constitute the proposed decision support system (DSS) aiming to recognize the appropriate guidelines of a medical problem, and to propose easily understandable course of actions to guide the practitioners. The urinary tract infection (UTI) problem was selected as the proof-of-concept example to examine the proposed formalization techniques implemented in the semantic web. The medical guidelines for UTI treatment were formalized into BBN and FCM knowledge models. To assess the formal models' performance, 55 patient cases were extracted from a database and analyzed. The results showed that the suggested approaches formalized medical knowledge efficiently in the semantic web, and gave a front-end decision on antibiotics' suggestion for UTI.