Clinical research informatics: a conceptual perspective

Development and utility of a clinical research informatics application for participant recruitment and workflow management for a return of results pilot trial in familial hypercholesterolemia in the Million Veteran Program

Objective

The development of clinical research informatics tools and workflow processes associated with re-engaging biobank participants has become necessary as genomic repositories increasingly consider the return of actionable research results.

Materials and Methods

Here we describe the development and utility of an informatics application for participant recruitment and enrollment management for the Veterans Affairs Million Veteran Program Return Of Actionable Results Study, a randomized controlled pilot trial returning individual genetic results associated with familial hypercholesterolemia.

Results

The application is developed in Python-Flask and was placed into production in November 2021. The application includes modules for chart review, medication reconciliation, participant contact and biospecimen logging, survey recording, randomization, and documentation of genetic counseling and result disclosure. Three primary users, a genetic counselor and two research coordinators, and 326 Veteran participants have been integrated into the system as of February 23, 2023. The application has successfully handled 3367 task requests involving greater than 95 000 structured data points. Specifically, application users have recorded 326 chart reviews, 867 recruitment telephone calls, 158 telephone-based surveys, and 61 return of results genetic counseling sessions, among other available study tasks.

Conclusion

The development of usable, customizable, and secure informatics tools will become increasingly important as large genomic repositories begin to return research results at scale. Our work provides a proof-of-concept for developing and using such tools to aid in managing the return of results process within a national biobank.

Recommendations of the International Medical Informatics Association (IMIA) on Education in Biomedical and Health Informatics: Second Revision

BACKGROUND

The purpose of educational recommendations is to assist in establishing courses and programs in a discipline, to further develop existing educational activities in the various nations, and to support international initiatives for collaboration and sharing of courseware. The International Medical Informatics Association (IMIA) has published two versions of its international recommendations in biomedical and health informatics (BMHI) education, initially in 2000 and revised in 2010. Given the recent changes to the science, technology, the needs of the healthcare systems, and the workforce of BMHI, a revision of the recommendations is necessary.

OBJECTIVE

The aim of these updated recommendations is to support educators in developing BMHI curricula at different education levels, to identify essential skills and competencies for certification of healthcare professionals and those working in the field of BMHI, to provide a tool for evaluators of academic BMHI programs to compare and accredit the quality of delivered programs, and to motivate universities, organizations, and health authorities to recognize the need for establishing and further developing BMHI educational programs.

METHOD

An IMIA taskforce, established in 2017, updated the recommendations. The taskforce included representatives from all IMIA regions, with several having been involved in the development of the previous version. Workshops were held at different IMIA conferences, and an international Delphi study was performed to collect expert input on new and revised competencies.

RESULTS

Recommendations are provided for courses/course tracks in BMHI as part of educational programs in biomedical and health sciences, health information management, and informatics/computer science, as well as for dedicated programs in BMHI (leading to bachelor's, master's, or doctoral degree). The educational needs are described for the roles of BMHI user, BMHI generalist, and BMHI specialist across six domain areas - BMHI core principles; health sciences and services; computer, data and information sciences; social and behavioral sciences; management science; and BMHI specialization. Furthermore, recommendations are provided for dedicated educational programs in BMHI at the level of bachelor's, master's, and doctoral degrees. These are the mainstream academic programs in BMHI. In addition, recommendations for continuing education, certification, and accreditation procedures are provided.

CONCLUSION

The IMIA recommendations reflect societal changes related to globalization, digitalization, and digital transformation in general and in healthcare specifically, and center on educational needs for the healthcare workforce, computer scientists, and decision makers to acquire BMHI knowledge and skills at various levels. To support education in BMHI, IMIA offers accreditation of quality BMHI education programs. It supports information exchange on programs and courses in BMHI through its Working Group on Health and Medical Informatics Education.

Informing training needs for the revised certified clinical data manager (CCDMTM) exam: analysis of results from the previous exam

Objective

To inform training needs for the revised Certified Clinical Data Manager (CCDM^TM) Exam.

Introduction

Clinical data managers hold the responsibility for processing the data on which research conclusions and regulatory decisions are based, highlighting the importance of applying effective data management practices. The use of practice standards such as the Good Clinical Data Management Practices increases confidence in data, emphasizing that the study conclusions likely hold much more weight when utilizing standard practices.

Methods

A quantitative, descriptive study, and application of classic test theory was undertaken to analyze past data from the CCDM^TM Exam to identify potential training needs. Data across 952 sequential exam attempts were pooled for analysis.

Results

Competency domain-level analysis identified training needs in 4 areas: design tasks; data processing tasks; programming tasks; and coordination and management tasks.

Conclusions

Analysis of past CCDM^TM Exam results using classic test theory identified training needs reflective of exam takers. Training in the identified areas could benefit CCDM^TM Exam takers and improve their ability to apply effective data management practices. While this may not be reflective of individual or organizational needs, recommendations for assessing individual and organizational training needs are provided.

This study analyzed past data from the Certified Clinical Data Manager^TM Exam (CCDM^TM) to identify potential training needs. Data across 952 sequential exam attempts were pooled for analysis. The study identified training needs in 4 areas of clinical data management: design tasks; data processing tasks; programming tasks; and coordination and management tasks. Training in the 4 identified areas could benefit CCDM^TM Exam takers and improve their ability to apply effective data management practices.

Natural Language Processing and Machine Learning for Identifying Incident Stroke From Electronic Health Records: Algorithm Development and Validation

Background

Stroke is an important clinical outcome in cardiovascular research. However, the ascertainment of incident stroke is typically accomplished via time-consuming manual chart abstraction. Current phenotyping efforts using electronic health records for stroke focus on case ascertainment rather than incident disease, which requires knowledge of the temporal sequence of events.

Objective

The aim of this study was to develop a machine learning–based phenotyping algorithm for incident stroke ascertainment based on diagnosis codes, procedure codes, and clinical concepts extracted from clinical notes using natural language processing.

Methods

The algorithm was trained and validated using an existing epidemiology cohort consisting of 4914 patients with atrial fibrillation (AF) with manually curated incident stroke events. Various combinations of feature sets and machine learning classifiers were compared. Using a heuristic rule based on the composition of concepts and codes, we further detected the stroke subtype (ischemic stroke/transient ischemic attack or hemorrhagic stroke) of each identified stroke. The algorithm was further validated using a cohort (n=150) stratified sampled from a population in Olmsted County, Minnesota (N=74,314).

Results

Among the 4914 patients with AF, 740 had validated incident stroke events. The best-performing stroke phenotyping algorithm used clinical concepts, diagnosis codes, and procedure codes as features in a random forest classifier. Among patients with stroke codes in the general population sample, the best-performing model achieved a positive predictive value of 86% (43/50; 95% CI 0.74-0.93) and a negative predictive value of 96% (96/100). For subtype identification, we achieved an accuracy of 83% in the AF cohort and 80% in the general population sample.

Conclusions

We developed and validated a machine learning–based algorithm that performed well for identifying incident stroke and for determining type of stroke. The algorithm also performed well on a sample from a general population, further demonstrating its generalizability and potential for adoption by other institutions.

Development and usability testing of Riyadh Mother and Baby Multi-center cohort study registry

RATIONAL AND OBJECTIVES

A medical registry is a software application that gather and keep clinical and non-clinical data to serve as recording tool for a specific disease longitudinally. In this study, Riyadh Mother and Baby Multicenter was designed as longitudinal study to understand the effect of non-communicable disease on mothers and their babies. A registry was built for the study; to improve data collection process thus enhance the data analysis and to enhance quality of healthcare provided by timely improvement of the services. The objective of this study is to test the usability of the cohort registry developed for clinical research and service improvement.

METHODS

Think aloud method, a qualitative approach was employed to elicit behaviors of participants while interacting with the registry interface prototype while the focus group session was conducted in order to understand the participants' insights and how participants reach consensus on the functionality and user interface design. Both deductive and inductive thematic analysis were performed on the qualitative data. After two iterative design cycles, improvements were made to the registry prototype.

RESULTS

The registry was found to be efficient, easy to learn, satisfactory, and easy to remember, and resulted in fewer errors. Major design features such as font size and colors were improved based on participants' feedback. In addition to the tested attributes, additional themes of design and benefits were found inductively.

CONCLUSION

Usability testing of the cohort registry showed that the system was easy to use due to its simple and custom- made design. Improvements of the registry based on the participants' feedback helped in enhancing its usability attributes.

The REDCap consortium: Building an international community of software platform partners

The Research Electronic Data Capture (REDCap) data management platform was developed in 2004 to address an institutional need at Vanderbilt University, then shared with a limited number of adopting sites beginning in 2006. Given bi-directional benefit in early sharing experiments, we created a broader consortium sharing and support model for any academic, non-profit, or government partner wishing to adopt the software. Our sharing framework and consortium-based support model have evolved over time along with the size of the consortium (currently more than 3200 REDCap partners across 128 countries). While the "REDCap Consortium" model represents only one example of how to build and disseminate a software platform, lessons learned from our approach may assist other research institutions seeking to build and disseminate innovative technologies.

The REDCap consortium: Building an international community of software platform partners

The Research Electronic Data Capture (REDCap) data management platform was developed in 2004 to address an institutional need at Vanderbilt University, then shared with a limited number of adopting sites beginning in 2006. Given bi-directional benefit in early sharing experiments, we created a broader consortium sharing and support model for any academic, non-profit, or government partner wishing to adopt the software. Our sharing framework and consortium-based support model have evolved over time along with the size of the consortium (currently more than 3200 REDCap partners across 128 countries). While the "REDCap Consortium" model represents only one example of how to build and disseminate a software platform, lessons learned from our approach may assist other research institutions seeking to build and disseminate innovative technologies.

Complexities, variations, and errors of numbering within clinical notes: the potential impact on information extraction and cohort-identification

BACKGROUND

Numbers and numerical concepts appear frequently in free text clinical notes from electronic health records. Knowledge of the frequent lexical variations of these numerical concepts, and their accurate identification, is important for many information extraction tasks. This paper describes an analysis of the variation in how numbers and numerical concepts are represented in clinical notes.

METHODS

We used an inverted index of approximately 100 million notes to obtain the frequency of various permutations of numbers and numerical concepts, including the use of Roman numerals, numbers spelled as English words, and invalid dates, among others. Overall, twelve types of lexical variants were analyzed.

RESULTS

We found substantial variation in how these concepts were represented in the notes, including multiple data quality issues. We also demonstrate that not considering these variations could have substantial real-world implications for cohort identification tasks, with one case missing > 80% of potential patients.

CONCLUSIONS

Numbering within clinical notes can be variable, and not taking these variations into account could result in missing or inaccurate information for natural language processing and information retrieval tasks.

TEPAPA: a novel in silico feature learning pipeline for mining prognostic and associative factors from text-based electronic medical records

Vast amounts of clinically relevant text-based variables lie undiscovered and unexploited in electronic medical records (EMR). To exploit this untapped resource, and thus facilitate the discovery of informative covariates from unstructured clinical narratives, we have built a novel computational pipeline termed Text-based Exploratory Pattern Analyser for Prognosticator and Associator discovery (TEPAPA). This pipeline combines semantic-free natural language processing (NLP), regular expression induction, and statistical association testing to identify conserved text patterns associated with outcome variables of clinical interest. When we applied TEPAPA to a cohort of head and neck squamous cell carcinoma patients, plausible concepts known to be correlated with human papilloma virus (HPV) status were identified from the EMR text, including site of primary disease, tumour stage, pathologic characteristics, and treatment modalities. Similarly, correlates of other variables (including gender, nodal status, recurrent disease, smoking and alcohol status) were also reliably recovered. Using highly-associated patterns as covariates, a patient's HPV status was classifiable using a bootstrap analysis with a mean area under the ROC curve of 0.861, suggesting its predictive utility in supporting EMR-based phenotyping tasks. These data support using this integrative approach to efficiently identify disease-associated factors from unstructured EMR narratives, and thus to efficiently generate testable hypotheses.

Clinical Research Informatics for Big Data and Precision Medicine

OBJECTIVES

To reflect on the notable events and significant developments in Clinical Research Informatics (CRI) in the year of 2015 and discuss near-term trends impacting CRI.

METHODS

We selected key publications that highlight not only important recent advances in CRI but also notable events likely to have significant impact on CRI activities over the next few years or longer, and consulted the discussions in relevant scientific communities and an online living textbook for modern clinical trials. We also related the new concepts with old problems to improve the continuity of CRI research.

RESULTS

The highlights in CRI in 2015 include the growing adoption of electronic health records (EHR), the rapid development of regional, national, and global clinical data research networks for using EHR data to integrate scalable clinical research with clinical care and generate robust medical evidence. Data quality, integration, and fusion, data access by researchers, study transparency, results reproducibility, and infrastructure sustainability are persistent challenges.

CONCLUSION

The advances in Big Data Analytics and Internet technologies together with the engagement of citizens in sciences are shaping the global clinical research enterprise, which is getting more open and increasingly stakeholder-centered, where stakeholders include patients, clinicians, researchers, and sponsors.

Videoconferencing for site initiations in clinical studies: Mixed methods evaluation of usability, acceptability, and impact on recruitment

BACKGROUND

A critical issue for multicentre clinical studies is conducting site initiations, ensuring sites are trained in study procedures and comply with relevant governance requirements before they begin recruiting patients. How technology can support site initiations has not previously been explored.

OBJECTIVE

This study sought to evaluate use of off-the-shelf web-based videoconferencing to deliver site initiations for a large national multicentre study.

METHODS

Participants in the initiations, including podiatrists, diabetologists, trial coordinators, and research nurses, completed an online questionnaire based on the System Usability Scale (SUS) (N = 15). This was followed by semi-structured interviews, with a consultant diabetologist, a trial coordinator, and three research nurses, exploring perceived benefits and limitations of videoconferencing.

RESULTS

The mean SUS score for the videoconferencing platform was 87.2 (SD = 13.7), suggesting a good level of usability. Interview participants perceived initiations delivered by videoconferencing as being more interactive and easier to follow than those delivered by teleconference. In comparison to face-to-face initiations, videoconferencing takes less time, easily fitting in with the work of staff at the local sites. Perceptions of impact on communication varied according to the hardware used.

CONCLUSION

Off-the-shelf videoconferencing is a viable alternative to face-to-face site initiations and confers advantages over teleconferencing.

Scalable analysis of Big pathology image data cohorts using efficient methods and high-performance computing strategies

BACKGROUND

We describe a suite of tools and methods that form a core set of capabilities for researchers and clinical investigators to evaluate multiple analytical pipelines and quantify sensitivity and variability of the results while conducting large-scale studies in investigative pathology and oncology. The overarching objective of the current investigation is to address the challenges of large data sizes and high computational demands.

RESULTS

The proposed tools and methods take advantage of state-of-the-art parallel machines and efficient content-based image searching strategies. The content based image retrieval (CBIR) algorithms can quickly detect and retrieve image patches similar to a query patch using a hierarchical analysis approach. The analysis component based on high performance computing can carry out consensus clustering on 500,000 data points using a large shared memory system.

CONCLUSIONS

Our work demonstrates efficient CBIR algorithms and high performance computing can be leveraged for efficient analysis of large microscopy images to meet the challenges of clinically salient applications in pathology. These technologies enable researchers and clinical investigators to make more effective use of the rich informational content contained within digitized microscopy specimens.

Information Technology for Clinical, Translational and Comparative Effectiveness Research. Findings from the Yearbook 2015 Section on Clinical Research Informatics

OBJECTIVES

To summarize excellent current research in the field of Bioinformatics and Translational Informatics with application in the health domain and clinical care.

METHOD

We provide a synopsis of the articles selected for the IMIA Yearbook 2015, from which we attempt to derive a synthetic overview of current and future activities in the field. As last year, a first step of selection was performed by querying MEDLINE with a list of MeSH descriptors completed by a list of terms adapted to the section. Each section editor has evaluated separately the set of 1,594 articles and the evaluation results were merged for retaining 15 articles for peer-review.

RESULTS

The selection and evaluation process of this Yearbook's section on Bioinformatics and Translational Informatics yielded four excellent articles regarding data management and genome medicine that are mainly tool-based papers. In the first article, the authors present PPISURV a tool for uncovering the role of specific genes in cancer survival outcome. The second article describes the classifier PredictSNP which combines six performing tools for predicting disease-related mutations. In the third article, by presenting a high-coverage map of the human proteome using high resolution mass spectrometry, the authors highlight the need for using mass spectrometry to complement genome annotation. The fourth article is also related to patient survival and decision support. The authors present datamining methods of large-scale datasets of past transplants. The objective is to identify chances of survival.

CONCLUSIONS

The current research activities still attest the continuous convergence of Bioinformatics and Medical Informatics, with a focus this year on dedicated tools and methods to advance clinical care. Indeed, there is a need for powerful tools for managing and interpreting complex, large-scale genomic and biological datasets, but also a need for user-friendly tools developed for the clinicians in their daily practice. All the recent research and development efforts contribute to the challenge of impacting clinically the obtained results towards a personalized medicine.

An Analysis of Information Technology Adoption by IRBs of Large Academic Medical Centers in the United States

The clinical research landscape has changed dramatically in recent years in terms of both volume and complexity. This poses new challenges for Institutional Review Boards’ (IRBs) review efficiency and quality, especially at large academic medical centers. This article discusses the technical facets of IRB modernization. We analyzed the information technology used by IRBs in large academic institutions across the United States. We found that large academic medical centers have a high electronic IRB adoption rate; however, the capabilities of electronic IRB systems vary greatly. We discuss potential use-cases of a fully exploited electronic IRB system that promise to streamline the clinical research work flow. The key to that approach utilizes a structured and standardized information model for the IRB application.

A domain analysis model for eIRB systems: addressing the weak link in clinical research informatics

Institutional Review Boards (IRBs) are a critical component of clinical research and can become a significant bottleneck due to the dramatic increase, in both volume and complexity of clinical research. Despite the interest in developing clinical research informatics (CRI) systems and supporting data standards to increase clinical research efficiency and interoperability, informatics research in the IRB domain has not attracted much attention in the scientific community. The lack of standardized and structured application forms across different IRBs causes inefficient and inconsistent proposal reviews and cumbersome workflows. These issues are even more prominent in multi-institutional clinical research that is rapidly becoming the norm. This paper proposes and evaluates a domain analysis model for electronic IRB (eIRB) systems, paving the way for streamlined clinical research workflow via integration with other CRI systems and improved IRB application throughput via computer-assisted decision support.

RMS: a platform for managing cross-disciplinary and multi-institutional research project collaboration

BACKGROUND

Cross-institutional cross-disciplinary collaboration has become a trend as researchers move toward building more productive and innovative teams for scientific research. Research collaboration is significantly changing the organizational structure and strategies used in the clinical and translational science domain. However, due to the obstacles of diverse administrative structures, differences in area of expertise, and communication barriers, establishing and managing a cross-institutional research project is still a challenging task. We address these challenges by creating an integrated informatics platform to reduce the barriers to biomedical research collaboration.

RESULTS

The Request Management System (RMS) is an informatics infrastructure designed to transform a patchwork of expertise and resources into an integrated support network. The RMS facilitates investigators' initiation of new collaborative projects and supports the management of the collaboration process. In RMS, experts and their knowledge areas are categorized and managed structurally to provide consistent service. A role-based collaborative workflow is tightly integrated with domain experts and services to streamline and monitor the life-cycle of a research project. The RMS has so far tracked over 1,500 investigators with over 4,800 tasks. The research network based on the data collected in RMS illustrated that the investigators' collaborative projects increased close to 3 times from 2009 to 2012. Our experience with RMS indicates that the platform reduces barriers for cross-institutional collaboration of biomedical research projects.

CONCLUSION

Building a new generation of infrastructure to enhance cross-disciplinary and multi-institutional collaboration has become an important yet challenging task. In this paper, we share the experience of developing and utilizing a collaborative project management system. The results of this study demonstrate that a web-based integrated informatics platform can facilitate and increase research interactions among investigators.

Operation room tool handling and miscommunication scenarios: an object-process methodology conceptual model

OBJECTIVE

Errors in the delivery of medical care are the principal cause of inpatient mortality and morbidity, accounting for around 98,000 deaths in the United States of America (USA) annually. Ineffective team communication, especially in the operation room (OR), is a major root of these errors. This miscommunication can be reduced by analyzing and constructing a conceptual model of communication and miscommunication in the OR. We introduce the principles underlying Object-Process Methodology (OPM)-based modeling of the intricate interactions between the surgeon and the surgical technician while handling surgical instruments in the OR. This model is a software- and hardware-independent description of the agents engaged in communication events, their physical activities, and their interactions. The model enables assessing whether the task-related objectives of the surgical procedure were achieved and completed successfully and what errors can occur during the communication.

METHODS AND MATERIAL

The facts used to construct the model were gathered from observations of various types of operations miscommunications in the operating room and its outcomes. The model takes advantage of the compact ontology of OPM, which is comprised of stateful objects - things that exist physically or informatically, and processes - things that transform objects by creating them, consuming them or changing their state. The modeled communication modalities are verbal and non-verbal, and errors are modeled as processes that deviate from the "sunny day" scenario. Using OPM refinement mechanism of in-zooming, key processes are drilled into and elaborated, along with the objects that are required as agents or instruments, or objects that these processes transform. The model was developed through an iterative process of observation, modeling, group discussions, and simplification.

RESULTS

The model faithfully represents the processes related to tool handling that take place in an OR during an operation. The specification is at various levels of detail, each level is depicted in a separate diagram, and all the diagrams are "aware" of each other as part of the whole model. Providing ontology of verbal and non-verbal modalities of communication in the OR, the resulting conceptual model is a solid basis for analyzing and understanding the source of the large variety of errors occurring in the course of an operation, providing an opportunity to decrease the quantity and severity of mistakes related to the use and misuse of surgical instrumentations. Since the model is event driven, rather than person driven, the focus is on the factors causing the errors, rather than the specific person. This approach advocates searching for technological solutions to alleviate tool-related errors rather than finger-pointing. Concretely, the model was validated through a structured questionnaire and it was found that surgeons agreed that the conceptual model was flexible (3.8 of 5, std=0.69), accurate, and it generalizable (3.7 of 5, std=0.37 and 3.7 of 5, std=0.85, respectively).

CONCLUSION

The detailed conceptual model of the tools handling subsystem of the operation performed in an OR focuses on the details of the communication and the interactions taking place between the surgeon and the surgical technician during an operation, with the objective of pinpointing the exact circumstances in which errors can happen. Exact and concise specification of the communication events in general and the surgical instrument requests in particular is a prerequisite for a methodical analysis of the various modes of errors and the circumstances under which they occur. This has significant potential value in both reduction in tool-handling-related errors during an operation and providing a solid formal basis for designing a cybernetic agent which can replace a surgical technician in routine tool handling activities during an operation, freeing the technician to focus on quality assurance, monitoring and control of the cybernetic agent activities. This is a critical step in designing the next generation of cybernetic OR assistants.

Traits and types of health data repositories

We review traits of reusable clinical data and offer a typology of clinical repositories with a range of known examples. Sources of clinical data suitable for research can be classified into types reflecting the data's institutional origin, original purpose, level of integration and governance. Primary data nearly always come from research studies and electronic medical records. Registries collect data on focused populations primarily to track outcomes, often using observational research methods. Warehouses are institutional information utilities repackaging clinical care data. Collections organize data from more organizations than a data warehouse, and more original data sources than a registry. Therefore even if they are heavily curated, their level of internal integration, and thus ease of use, can be less than other types. Federations are like collections except that physical control over data is distributed among donor organizations. Federations sometimes federate, giving a second level of organization. While the size, in number of patients, varies widely within each type of data source, populations over 10 K are relatively numerous, and much larger populations can be seen in warehouses and federations. One imagined ideal structure for research progress has been called an "Information Commons". It would have longitudinal, multi-leveled (environmental through molecular) data on a large population of identified, consenting individuals. These are qualities whose achievement would require long term commitment on the part of many data donors, including a willingness to make their data public.

Seeking health information online: does limited healthcare access matter?

Consumers facing barriers to healthcare access may use online health information seeking and online communication with physicians, but the empirical relationship has not been sufficiently analyzed. Our study examines the association of barriers to healthcare access with consumers' health-related information searching on the internet, use of health chat groups, and email communication with physicians, using data from 27,210 adults from the 2009 National Health Interview Survey. Individuals with financial barriers to healthcare access, difficulty getting timely appointments with doctors, and conflicts in scheduling during clinic hours are more likely to search for general health information online than those without these access barriers. Those unable to get timely appointments with physicians are more likely to participate in health chat groups and email physicians. The internet may offer a low-cost source of health information and could help meet the heightened demand for health-related information among those facing access barriers to care.

Characteristics desired in clinical data warehouse for biomedical research

Objectives

Due to the unique characteristics of clinical data, clinical data warehouses (CDWs) have not been successful so far. Specifically, the use of CDWs for biomedical research has been relatively unsuccessful thus far. The characteristics necessary for the successful implementation and operation of a CDW for biomedical research have not clearly defined yet.

Methods

Three examples of CDWs were reviewed: a multipurpose CDW in a hospital, a CDW for independent multi-institutional research, and a CDW for research use in an institution. After reviewing the three CDW examples, we propose some key characteristics needed in a CDW for biomedical research.

Results

A CDW for research should include an honest broker system and an Institutional Review Board approval interface to comply with governmental regulations. It should also include a simple query interface, an anonymized data review tool, and a data extraction tool. Also, it should be a biomedical research platform for data repository use as well as data analysis.

Conclusions

The proposed characteristics desired in a CDW may have limited transfer value to organizations in other countries. However, these analysis results are still valid in Korea, and we have developed clinical research data warehouse based on these desiderata.

Enhancing electronic health records to support clinical research

The "Learning Health System" has been described as an environment that drives research and innovation as a natural outgrowth of patient care. Electronic health records (EHRs) are necessary to enable the Learning Health System; however, a source of frustration is that current systems fail to adequately support research needs. We propose a model for enhancing EHRs to collect structured and standards-based clinical research data during clinical encounters that promotes efficiency and computational reuse of quality data for both care and research. The model integrates Common Data Elements (CDEs) for clinical research into existing clinical documentation workflows, leveraging executable documentation guidance within the EHR to support coordinated, standardized data collection for both patient care and clinical research.

Building a common pediatric research terminology for accelerating child health research

Longitudinal observational clinical data on pediatric patients in electronic format is becoming widely available. A new era of multi-institutional data networks that study pediatric diseases and outcomes across disparate health delivery models and care settings are also enabling an innovative collaborative rapid improvement paradigm called the Learning Health System. However, the potential alignment of routine clinical care, observational clinical research, pragmatic clinical trials, and health systems improvement requires a data infrastructure capable of combining information from systems and workflows that historically have been isolated from each other. Removing barriers to integrating and reusing data collected in different settings will permit new opportunities to develop a more complete picture of a patient's care and to leverage data from related research studies. One key barrier is the lack of a common terminology that provides uniform definitions and descriptions of clinical observations and data. A well-characterized terminology ensures a common meaning and supports data reuse and integration. A common terminology allows studies to build upon previous findings and to reuse data collection tools and data management processes. We present the current state of terminology harmonization and describe a governance structure and mechanism for coordinating the development of a common pediatric research terminology that links to clinical terminologies and can be used to align existing terminologies. By reducing the barriers between clinical care and clinical research, a Learning Health System can leverage and reuse not only its own data resources but also broader extant data resources.

Alzheimer's disease drug development: translational neuroscience strategies

Alzheimer's disease (AD) is an urgent public health challenge that is rapidly approaching epidemic proportions. New therapies that defer or prevent the onset, delay the decline, or improve the symptoms are urgently needed. All phase 3 drug development programs for disease-modifying agents have failed thus far. New approaches to drug development are needed. Translational neuroscience focuses on the linkages between basic neuroscience and the development of new diagnostic and therapeutic products that will improve the lives of patients or prevent the occurrence of brain disorders. Translational neuroscience includes new preclinical models that may better predict human efficacy and safety, improved clinical trial designs and outcomes that will accelerate drug development, and the use of biomarkers to more rapidly provide information regarding the effects of drugs on the underlying disease biology. Early translational research is complemented by later stage translational approaches regarding how best to use evidence to impact clinical practice and to assess the influence of new treatments on the public health. Funding of translational research is evolving with an increased emphasis on academic and NIH involvement in drug development. Translational neuroscience provides a framework for advancing development of new therapies for AD patients.

Ancillary study management systems: a review of needs

BACKGROUND

The valuable clinical data, specimens, and assay results collected during a primary clinical trial or observational study can enable researchers to answer additional, pressing questions with relatively small investments in new measurements. However, management of such follow-on, "ancillary" studies is complex. It requires coordinating across institutions, sites, repositories, and approval boards, as well as distributing, integrating, and analyzing diverse data types. General-purpose software systems that simplify the management of ancillary studies have not yet been explored in the research literature.

METHODS

We have identified requirements for ancillary study management primarily as part of our ongoing work with a number of large research consortia. These organizations include the Center for HIV/AIDS Vaccine Immunology (CHAVI), the Immune Tolerance Network (ITN), the HIV Vaccine Trials Network (HVTN), the U.S. Military HIV Research Program (MHRP), and the Network for Pancreatic Organ Donors with Diabetes (nPOD). We also consulted with researchers at a range of other disease research organizations regarding their workflows and data management strategies. Lastly, to enhance breadth, we reviewed process documents for ancillary study management from other organizations.

RESULTS

By exploring characteristics of ancillary studies, we identify differentiating requirements and scenarios for ancillary study management systems (ASMSs). Distinguishing characteristics of ancillary studies may include the collection of additional measurements (particularly new analyses of existing specimens); the initiation of studies by investigators unaffiliated with the original study; cross-protocol data pooling and analysis; pre-existing participant consent; and pre-existing data context and provenance. For an ASMS to address these characteristics, it would need to address both operational requirements (e.g., allocating existing specimens) and data management requirements (e.g., securely distributing and integrating primary and ancillary data).

CONCLUSIONS

The scenarios and requirements we describe can help guide the development of systems that make conducting ancillary studies easier, less expensive, and less error-prone. Given the relatively consistent characteristics and challenges of ancillary study management, general-purpose ASMSs are likely to be useful to a wide range of organizations. Using the requirements identified in this paper, we are currently developing an open-source, general-purpose ASMS based on LabKey Server (http://www.labkey.org) in collaboration with CHAVI, the ITN and nPOD.