Combining Health Data Uses to Ignite Health System Learning

Knowledge support for optimising antibiotic prescribing for common infections in general practices: evaluation of the effectiveness of periodic feedback, decision support during consultations and peer comparisons in a cluster randomised trial (BRIT2) - study protocol

INTRODUCTION

This project applies a Learning Healthcare System (LHS) approach to antibiotic prescribing for common infections in primary care. The approach involves iterations of data analysis, feedback to clinicians and implementation of quality improvement activities by the clinicians. The main research question is, can a knowledge support system (KSS) intervention within an LHS implementation improve antibiotic prescribing without increasing the risk of complications?

METHODS AND ANALYSIS

A pragmatic cluster randomised controlled trial will be conducted, with randomisation of at least 112 general practices in North-West England. General practices participating in the trial will be randomised to the following interventions: periodic practice-level and individual prescriber feedback using dashboards; or the same dashboards plus a KSS. Data from large databases of healthcare records are used to characterise heterogeneity in antibiotic uses, and to calculate risk scores for clinical outcomes and for the effectiveness of different treatment strategies. The results provide the baseline content for the dashboards and KSS. The KSS comprises a display within the electronic health record used during the consultation; the prescriber (general practitioner or allied health professional) will answer standard questions about the patient's presentation and will then be presented with information (eg, patient's risk of complications from the infection) to guide decision making. The KSS can generate information sheets for patients, conveyed by the clinicians during consultations. The primary outcome is the practice-level rate of antibiotic prescribing (per 1000 patients) with secondary safety outcomes. The data from practices participating in the trial and the dashboard infrastructure will be held within regional shared care record systems of the National Health Service in the UK.

ETHICS AND DISSEMINATION

Approved by National Health Service Ethics Committee IRAS 290050. The research results will be published in peer-reviewed journals and also disseminated to participating clinical staff and policy and guideline developers.

TRIAL REGISTRATION NUMBER

ISRCTN16230629.

Leveraging Administrative Data to Better Understand and Address Child Maltreatment: A Scoping Review of Data Linkage Studies

BACKGROUND

This scoping review aimed to overview studies that used administrative data linkage in the context of child maltreatment to improve our understanding of the value that data linkage may confer for policy, practice, and research.

METHODS

We searched MEDLINE, Embase, PsycINFO, CINAHL, and ERIC electronic databases in June 2019 and May 2020 for studies that linked two or more datasets (at least one of which was administrative in nature) to study child maltreatment. We report findings with numerical and narrative summary.

RESULTS

We included 121 studies, mainly from the United States or Australia and published in the past decade. Data came primarily from social services and health sectors, and linkage processes and data quality were often not described in sufficient detail to align with current reporting guidelines. Most studies were descriptive in nature and research questions addressed fell under eight themes: descriptive epidemiology, risk factors, outcomes, intergenerational transmission, predictive modelling, intervention/service evaluation, multi-sector involvement, and methodological considerations/advancements.

CONCLUSIONS

Included studies demonstrated the wide variety of ways in which data linkage can contribute to the public health response to child maltreatment. However, how research using linked data can be translated into effective service development and monitoring, or targeting of interventions, is underexplored in terms of privacy protection, ethics and governance, data quality, and evidence of effectiveness.

Rapid systematic review to identify key barriers to access, linkage, and use of local authority administrative data for population health research, practice, and policy in the United Kingdom

BACKGROUND

Improving data access, sharing, and linkage across local authorities and other agencies can contribute to improvements in population health. Whilst progress is being made to achieve linkage and integration of health and social care data, issues still exist in creating such a system. As part of wider work to create the Cambridge Child Health Informatics and Linked Data (Cam-CHILD) database, we wanted to examine barriers to the access, linkage, and use of local authority data.

METHODS

A systematic literature search was conducted of scientific databases and the grey literature. Any publications reporting original research related to barriers or enablers of data linkage of or with local authority data in the United Kingdom were included. Barriers relating to the following issues were extracted from each paper: funding, fragmentation, legal and ethical frameworks, cultural issues, geographical boundaries, technical capability, capacity, data quality, security, and patient and public trust.

RESULTS

Twenty eight articles were identified for inclusion in this review. Issues relating to technical capacity and data quality were cited most often. This was followed by those relating to legal and ethical frameworks. Issue relating to public and patient trust were cited the least, however, there is considerable overlap between this topic and issues relating to legal and ethical frameworks.

CONCLUSIONS

This rapid review is the first step to an in-depth exploration of the barriers to data access, linkage and use; a better understanding of which can aid in creating and implementing effective solutions. These barriers are not novel although they pose specific challenges in the context of local authority data.

Mental illness concordance between hospital clinical records and mentions in domestic violence police narratives: Data linkage study (Preprint)

Background

To better understand domestic violence, data sources from multiple sectors such as police, justice, health, and welfare are needed. Linking police data to data collections from other agencies could provide unique insights and promote an all-of-government response to domestic violence. The New South Wales Police Force attends domestic violence events and records information in the form of both structured data and a free-text narrative, with the latter shown to be a rich source of information on the mental health status of persons of interest (POIs) and victims, abuse types, and sustained injuries.

Objective

This study aims to examine the concordance (ie, matching) between mental illness mentions extracted from the police’s event narratives and mental health diagnoses from hospital and emergency department records.

Methods

We applied a rule-based text mining method on 416,441 domestic violence police event narratives between December 2005 and January 2016 to identify mental illness mentions for POIs and victims. Using different window periods (1, 3, 6, and 12 months) before and after a domestic violence event, we linked the extracted mental illness mentions of victims and POIs to clinical records from the Emergency Department Data Collection and the Admitted Patient Data Collection in New South Wales, Australia using a unique identifier for each individual in the same cohort.

Results

Using a 2-year window period (ie, 12 months before and after the domestic violence event), less than 1% (3020/416,441, 0.73%) of events had a mental illness mention and also a corresponding hospital record. About 16% of domestic violence events for both POIs (382/2395, 15.95%) and victims (101/631, 16.01%) had an agreement between hospital records and police narrative mentions of mental illness. A total of 51,025/416,441 (12.25%) events for POIs and 14,802/416,441 (3.55%) events for victims had mental illness mentions in their narratives but no hospital record. Only 841 events for POIs and 919 events for victims had a documented hospital record within 48 hours of the domestic violence event.

Conclusions

Our findings suggest that current surveillance systems used to report on domestic violence may be enhanced by accessing rich information (ie, mental illness) contained in police text narratives, made available for both POIs and victims through the application of text mining. Additional insights can be gained by linkage to other health and welfare data collections.

An integrated early care pathway for autism

In this Viewpoint, we argue for the need to reconceptualise an integrated early-care provision for autistic children in the light of their enduring support needs and relevant new findings from developmental and intervention research. This model goes beyond short-term reactive care to outline an early proactive, evidenced, developmentally phased, and scalable programme of support for autistic children and their families from the earliest opportunity, with timely access to later step-up care when needed. We also integrate this model with emerging opportunities from data science and digital health technologies as a potential facilitator of such a pathway. Building on this work, we argue that the best current autism intervention evidence can be integrated with concepts and evidence gained in the management of other enduring health conditions to support an autistic child and their family through their early development. The aim is to improve those children's social communication abilities, expand their range and flexibility of interests, and mitigate any negative impacts of sensory difficulties and restricted, repetitive behaviours on the child and their family wellbeing. The pathway solutions described could also be adapted for older adolescents and adults and could be used within the health systems of different countries, including within low-income and middle-income contexts.

Modeling Data Journeys to Inform the Digital Transformation of Kidney Transplant Services: Observational Study

Background

Data journey modeling is a methodology used to establish a high-level overview of information technology (IT) infrastructure in health care systems. It allows a better understanding of sociotechnical barriers and thus informs meaningful digital transformation. Kidney transplantation is a complex clinical service involving multiple specialists and providers. The referral pathway for a transplant requires the centralization of patient data across multiple IT solutions and health care organizations. At present, there is a poor understanding of the role of IT in this process, specifically regarding the management of patient data, clinical communication, and workflow support.

Objective

To apply data journey modeling to better understand interoperability, data access, and workflow requirements of a regional multicenter kidney transplant service.

Methods

An incremental methodology was used to develop the data journey model. This included review of service documents, domain expert interviews, and iterative modeling sessions. Results were analyzed based on the LOAD (landscape, organizations, actors, and data) framework to provide a meaningful assessment of current data management challenges and inform ways for IT to overcome these challenges.

Results

Results were presented as a diagram of the organizations (n=4), IT systems (n>9), actors (n>4), and data journeys (n=0) involved in the transplant referral pathway. The diagram revealed that all movement of data was dependent on actor interaction with IT systems and manual transcription of data into Microsoft Word (Microsoft, Inc) documents. Each actor had between 2 and 5 interactions with IT systems to capture all relevant data, a process that was reported to be time consuming and error prone. There was no interoperability within or across organizations, which led to delays as clinical teams manually transferred data, such as medical history and test results, via post or email.

Conclusions

Overall, data journey modeling demonstrated that human actors, rather than IT systems, formed the central focus of data movement. The IT landscape did not complement this workflow and exerted a significant administrative burden on clinical teams. Based on this study, future solutions must consider regional interoperability and specialty-specific views of data to support multi-organizational clinical services such as transplantation.

The Social Data Foundation model: Facilitating health and social care transformation through datatrust services

Turning the wealth of health and social data into insights to promote better public health, while enabling more effective personalized care, is critically important for society. In particular, social determinants of health have a significant impact on individual health, well-being, and inequalities in health. However, concerns around accessing and processing such sensitive data, and linking different datasets, involve significant challenges, not least to demonstrate trustworthiness to all stakeholders. Emerging datatrust services provide an opportunity to address key barriers to health and social care data linkage schemes, specifically a loss of control experienced by data providers, including the difficulty to maintain a remote reidentification risk over time, and the challenge of establishing and maintaining a social license. Datatrust services are a sociotechnical evolution that advances databases and data management systems, and brings together stakeholder-sensitive data governance mechanisms with data services to create a trusted research environment. In this article, we explore the requirements for datatrust services, a proposed implementation—the Social Data Foundation, and an illustrative test case. Moving forward, such an approach would help incentivize, accelerate, and join up the sharing of regulated data, and the use of generated outputs safely amongst stakeholders, including healthcare providers, social care providers, researchers, public health authorities, and citizens.

Challenges in the development of digital public health interventions and mapped solutions: Findings from a scoping review

Background

“Digital public health” has emerged from an interest in integrating digital technologies into public health. However, significant challenges which limit the scale and extent of this digital integration in various public health domains have been described. We summarized the literature about these challenges and identified strategies to overcome them.

Methods

We adopted Arksey and O’Malley's framework (2005) integrating adaptations by Levac et al. (2010). OVID Medline, Embase, Google Scholar, and 14 government and intergovernmental agency websites were searched using terms related to “digital” and “public health.” We included conceptual and explicit descriptions of digital technologies in public health published in English between 2000 and June 2020. We excluded primary research articles about digital health interventions. Data were extracted using a codebook created using the European Public Health Association's conceptual framework for digital public health.

Results and analysis

Overall, 163 publications were included from 6953 retrieved articles with the majority (64%, n = 105) published between 2015 and June 2020. Nontechnical challenges to digital integration in public health concerned ethics, policy and governance, health equity, resource gaps, and quality of evidence. Technical challenges included fragmented and unsustainable systems, lack of clear standards, unreliability of available data, infrastructure gaps, and workforce capacity gaps. Identified strategies included securing political commitment, intersectoral collaboration, economic investments, standardized ethical, legal, and regulatory frameworks, adaptive research and evaluation, health workforce capacity building, and transparent communication and public engagement.

Conclusion

Developing and implementing digital public health interventions requires efforts that leverage identified strategies to overcome diverse challenges encountered in integrating digital technologies in public health.

Electronic health records and clinician burnout: A story of three eras

OBJECTIVE

The study sought to provide physicians, informaticians, and institutional policymakers with an introductory tutorial about the history of medical documentation, sources of clinician burnout, and opportunities to improve electronic health records (EHRs). We now have unprecedented opportunities in health care, with the promise of new cures, improved equity, greater sensitivity to social and behavioral determinants of health, and data-driven precision medicine all on the horizon. EHRs have succeeded in making many aspects of care safer and more reliable. Unfortunately, current limitations in EHR usability and problems with clinician burnout distract from these successes. A complex interplay of technology, policy, and healthcare delivery has contributed to our current frustrations with EHRs. Fortunately, there are opportunities to improve the EHR and health system. A stronger emphasis on improving the clinician's experience through close collaboration by informaticians, clinicians, and vendors can combine with specific policy changes to address the causes of burnout.

TARGET AUDIENCE

This tutorial is intended for clinicians, informaticians, policymakers, and regulators, who are essential participants in discussions focused on improving clinician burnout. Learners in biomedicine, regardless of clinical discipline, also may benefit from this primer and review.

SCOPE

We include (1) an overview of medical documentation from a historical perspective; (2) a summary of the forces converging over the past 20 years to develop and disseminate the modern EHR; and (3) future opportunities to improve EHR structure, function, user base, and time required to collect and extract information.

Artificial intelligence projects in healthcare: 10 practical tips for success in a clinical environment

There is much discussion concerning 'digital transformation' in healthcare and the potential of artificial intelligence (AI) in healthcare systems. Yet it remains rare to find AI solutions deployed in routine healthcare settings. This is in part due to the numerous challenges inherent in delivering an AI project in a clinical environment. In this article, several UK healthcare professionals and academics reflect on the challenges they have faced in building AI solutions using routinely collected healthcare data.These personal reflections are summarised as 10 practical tips. In our experience, these are essential considerations for an AI healthcare project to succeed. They are organised into four phases: conceptualisation, data management, AI application and clinical deployment. There is a focus on conceptualisation, reflecting our view that initial set-up is vital to success. We hope that our personal experiences will provide useful insights to others looking to improve patient care through optimal data use.

The Future of Blood Testing Is the Immunome

It is increasingly clear that an extraordinarily diverse range of clinically important conditions—including infections, vaccinations, autoimmune diseases, transplants, transfusion reactions, aging, and cancers—leave telltale signatures in the millions of V(D)J-rearranged antibody and T cell receptor [TR per the Human Genome Organization (HUGO) nomenclature but more commonly known as TCR] genes collectively expressed by a person’s B cells (antibodies) and T cells. We refer to these as the immunome. Because of its diversity and complexity, the immunome provides singular opportunities for advancing personalized medicine by serving as the substrate for a highly multiplexed, near-universal blood test. Here we discuss some of these opportunities, the current state of immunome-based diagnostics, and highlight some of the challenges involved. We conclude with a call to clinicians, researchers, and others to join efforts with the Adaptive Immune Receptor Repertoire Community (AIRR-C) to realize the diagnostic potential of the immunome.

Post-discharge care following acute kidney injury: quality improvement in primary care

BACKGROUND

Over the past decade, targeting acute kidney injury (AKI) has become a priority to improve patient safety and health outcomes. Illness complicated by AKI is common and is associated with adverse outcomes including high rates of unplanned hospital readmission. Through national patient safety directives, NHS England has mandated the implementation of an AKI clinical decision support system in hospitals. In order to improve care following AKI, hospitals have also been incentivised to improve discharge summaries and general practices are recommended to establish registers of people who have had an episode of illness complicated by AKI. However, to date, there is limited evidence surrounding the development and impact of interventions following AKI.

DESIGN

We conducted a quality improvement project in primary care aiming to improve the management of patients following an episode of hospital care complicated by AKI. All 31 general practices within a single NHS Clinical Commissioning Group were incentivised by a locally commissioned service to engage in audit and feedback, education training and to develop an action plan at each practice to improve management of AKI.

RESULTS

AKI coding in general practice increased from 28% of cases in 2015/2016 to 50% in 2017/2018. Coding of AKI was associated with significant improvements in downstream patient management in terms of conducting a medication review within 1 month of hospital discharge, monitoring kidney function within 3 months and providing written information about AKI to patients. However, there was no effect on unplanned hospitalisation and mortality.

CONCLUSION

The findings suggest that the quality improvement intervention successfully engaged a primary care workforce in AKI-related care, but that a higher intensity intervention is likely to be required to improve health outcomes. Development of a real-time audit tool is necessary to better understand and minimise the impact of the high mortality rate following AKI.

A national initiative in data science for health: an evaluation of the UK Farr Institute

OBJECTIVE

To evaluate the extent to which the inter-institutional, inter-disciplinary mobilisation of data and skills in the Farr Institute contributed to establishing the emerging field of data science for health in the UK.

DESIGN AND OUTCOME MEASURES

We evaluated evidence of six domains characterising a new field of science:defining central scientific challenges,demonstrating how the central challenges might be solved,creating novel interactions among groups of scientists,training new types of experts,re-organising universities,demonstrating impacts in society.We carried out citation, network and time trend analyses of publications, and a narrative review of infrastructure, methods and tools.

SETTING

Four UK centres in London, North England, Scotland and Wales (23 university partners), 2013-2018.

RESULTS

1. The Farr Institute helped define a central scientific challenge publishing a research corpus, demonstrating insights from electronic health record (EHR) and administrative data at each stage of the translational cycle in 593 papers with at least one Farr Institute author affiliation on PubMed. 2. The Farr Institute offered some demonstrations of how these scientific challenges might be solved: it established the first four ISO27001 certified trusted research environments in the UK, and approved more than 1000 research users, published on 102 unique EHR and administrative data sources, although there was no clear evidence of an increase in novel, sustained record linkages. The Farr Institute established open platforms for the EHR phenotyping algorithms and validations (>70 diseases, CALIBER). Sample sizes showed some evidence of increase but remained less than 10% of the UK population in primary care-hospital care linked studies. 3.The Farr Institute created novel interactions among researchers: the co-author publication network expanded from 944 unique co-authors (based on 67 publications in the first 30 months) to 3839 unique co-authors (545 papers in the final 30 months). 4. Training expanded substantially with 3 new masters courses, training >400 people at masters, short-course and leadership level and 48 PhD students. 5. Universities reorganised with 4/5 Centres established 27 new faculty (tenured) positions, 3 new university institutes. 6. Emerging evidence of impacts included: > 3200 citations for the 10 most cited papers and Farr research informed eight practice-changing clinical guidelines and policies relevant to the health of millions of UK citizens.

CONCLUSION

The Farr Institute played a major role in establishing and growing the field of data science for health in the UK, with some initial evidence of benefits for health and healthcare. The Farr Institute has now expanded into Health Data Research (HDR) UK but key challenges remain including, how to network such activities internationally.

Commercial use of health data-A public "trial" by citizens' jury

INTRODUCTION

Surveys suggest a dichotomy in how citizens view research for public benefit and research for commercial gain. Therefore, a research initiative, such as a learning health system, which works for both public and commercial benefit, may be controversial and lower public trust.

METHODS

This study aimed to investigate what informed citizens considered to be appropriate uses of health data in a learning health system and why they made those decisions. Two-paired 4-day juries were run, with different jurors but the same purpose, expert witnesses, and facilitators. Overall, 694 people applied; 36 jurors were selected to match criteria based on demographics and privacy views. Jurors considered whether and why eight exemplars of anonymised patient data were acceptable. The exemplars were either planned initiatives to improve care pathways (Planned Examples) or possible commercial data uses (Potential Examples).

RESULTS

These citizens' juries found that all Planned and two of the Potential Examples were considered appropriate by most, but not all, jurors because they could deliver public benefit. In general, positive health outcomes for patients were more acceptable than improved efficiency of services for the NHS, although they recognised that the latter also improved health. Jurors had concerns about whether improving efficiency would lead to inequitable distribution or closure of services, based on their existing understanding from media reports. Commercial gain that accrued secondary to this benefit was acceptable, with some jurors becoming more accepting of commercial uses as they understood them better. Prioritising profit, however, was unacceptable, regardless of any governance arrangements.

CONCLUSIONS

Jurors tended to be more accepting of data sharing to both private and public sectors after the jury process. Many jurors accept commercial gain if public benefit is achieved. Some were suspicious of data sharing for efficiency gains. Juries elicited more informed and nuanced judgement from citizens than surveys.

A framework for value-creating learning health systems

BACKGROUND

Interest in value-based healthcare, generally defined as providing better care at lower cost, has grown worldwide, and learning health systems (LHSs) have been proposed as a key strategy for improving value in healthcare. LHSs are emerging around the world and aim to leverage advancements in science, technology and practice to improve health system performance at lower cost. However, there remains much uncertainty around the implementation of LHSs and the distinctive features of these systems. This paper presents a conceptual framework that has been developed in Canada to support the implementation of value-creating LHSs.

METHODS

The framework was developed by an interdisciplinary team at the Institut national d'excellence en santé et en services sociaux (INESSS). It was informed by a scoping review of the scientific and grey literature on LHSs, regular team discussions over a 14-month period, and consultations with Canadian and international experts.

RESULTS

The framework describes four elements that characterise LHSs, namely (1) core values, (2) pillars and accelerators, (3) processes and (4) outcomes. LHSs embody certain core values, including an emphasis on participatory leadership, inclusiveness, scientific rigour and person-centredness. In addition, values such as equity and solidarity should also guide LHSs and are particularly relevant in countries like Canada. LHS pillars are the infrastructure and resources supporting the LHS, whereas accelerators are those specific structures that enable more rapid learning and improvement. For LHSs to create value, such infrastructures must not only exist within the ecosystem but also be connected and aligned with the LHSs' strategic goals. These pillars support the execution, routinisation and acceleration of learning cycles, which are the fundamental processes of LHSs. The main outcome sought by executing learning cycles is the creation of value, which we define as the striking of a more optimal balance of impacts on patient and provider experience, population health and health system costs.

CONCLUSIONS

Our framework illustrates how the distinctive structures, processes and outcomes of LHSs tie together with the aim of optimising health system performance and delivering greater value in health systems.

Our data, our society, our health: A vision for inclusive and transparent health data science in the United Kingdom and beyond

The last 6 years have seen sustained investment in health data science in the United Kingdom and beyond, which should result in a data science community that is inclusive of all stakeholders, working together to use data to benefit society through the improvement of public health and well-being. However, opportunities made possible through the innovative use of data are still not being fully realised, resulting in research inefficiencies and avoidable health harms. In this paper, we identify the most important barriers to achieving higher productivity in health data science. We then draw on previous research, domain expertise, and theory to outline how to go about overcoming these barriers, applying our core values of inclusivity and transparency. We believe a step change can be achieved through meaningful stakeholder involvement at every stage of research planning, design, and execution and team-based data science, as well as harnessing novel and secure data technologies. Applying these values to health data science will safeguard a social licence for health data research and ensure transparent and secure data usage for public benefit.

Assessing the severity of Type 2 diabetes using clinical data-based measures: a systematic review

AIMS

To identify and critically appraise measures that use clinical data to grade the severity of Type 2 diabetes.

METHODS

We searched MEDLINE, Embase and PubMed between inception and June 2018. Studies reporting on clinical data-based diabetes-specific severity measures in adults with Type 2 diabetes were included. We excluded studies conducted solely in participants with other types of diabetes. After independent screening, the characteristics of the eligible measures including design and severity domains, the clinical utility of developed measures, and the relationship between severity levels and health-related outcomes were assessed.

RESULTS

We identified 6798 studies, of which 17 studies reporting 18 different severity measures (32 314 participants in 17 countries) were included: a diabetes severity index (eight studies, 44%); severity categories (seven studies, 39%); complication count (two studies, 11%); and a severity checklist (one study, 6%). Nearly 89% of the measures included diabetes-related complications and/or glycaemic control indicators. Two of the severity measures were validated in a separate study population. More severe diabetes was associated with increased healthcare costs, poorer cognitive function and significantly greater risks of hospitalization and mortality. The identified measures differed greatly in terms of the included domains. One study reported on the use of a severity measure prospectively.

CONCLUSIONS

Health records are suitable for assessment of diabetes severity; however, the clinical uptake of existing measures is limited. The need to advance this research area is fundamental as higher levels of diabetes severity are associated with greater risks of adverse outcomes. Diabetes severity assessment could help identify people requiring targeted and intensive therapies and provide a major benchmark for efficient healthcare services.

Processing of Electronic Medical Records for Health Services Research in an Academic Medical Center: Methods and Validation

Background

Electronic medical records (EMRs) contain a wealth of information that can support data-driven decision making in health care policy design and service planning. Although research using EMRs has become increasingly prevalent, challenges such as coding inconsistency, data validity, and lack of suitable measures in important domains still hinder the progress.

Objective

The objective of this study was to design a structured way to process records in administrative EMR systems for health services research and assess validity in selected areas.

Methods

On the basis of a local hospital EMR system in Singapore, we developed a structured framework for EMR data processing, including standardization and phenotyping of diagnosis codes, construction of cohort with multilevel views, and generation of variables and proxy measures to supplement primary data. Disease complexity was estimated by Charlson Comorbidity Index (CCI) and Polypharmacy Score (PPS), whereas socioeconomic status (SES) was estimated by housing type. Validity of modified diagnosis codes and derived measures were investigated.

Results

Visit-level (N=7,778,761) and patient-level records (n=549,109) were generated. The International Classification of Diseases, Tenth Revision, Australian Modification (ICD-10-AM) codes were standardized to the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) with a mapping rate of 87.1%. In all, 97.4% of the ICD-9-CM codes were phenotyped successfully using Clinical Classification Software by Agency for Healthcare Research and Quality. Diagnosis codes that underwent modification (truncation or zero addition) in standardization and phenotyping procedures had the modification validated by physicians, with validity rates of more than 90%. Disease complexity measures (CCI and PPS) and SES were found to be valid and robust after a correlation analysis and a multivariate regression analysis. CCI and PPS were correlated with each other and positively correlated with health care utilization measures. Larger housing type was associated with lower government subsidies received, suggesting association with higher SES. Profile of constructed cohorts showed differences in disease prevalence, disease complexity, and health care utilization in those aged above 65 years and those aged 65 years or younger.

Conclusions

The framework proposed in this study would be useful for other researchers working with EMR data for health services research. Further analyses would be needed to better understand differences observed in the cohorts.

Using marginal structural models to adjust for treatment drop-in when developing clinical prediction models

Clinical prediction models (CPMs) can inform decision making about treatment initiation, which requires predicted risks assuming no treatment is given. However, this is challenging since CPMs are usually derived using data sets where patients received treatment, often initiated postbaseline as "treatment drop-ins." This study proposes the use of marginal structural models (MSMs) to adjust for treatment drop-in. We illustrate the use of MSMs in the CPM framework through simulation studies that represent randomized controlled trials and real-world observational data and the example of statin initiation for cardiovascular disease prevention. The simulations include a binary treatment and a covariate, each recorded at two timepoints and having a prognostic effect on a binary outcome. The bias in predicted risk was examined in a model ignoring treatment, a model fitted on treatment-naïve patients (at baseline), a model including baseline treatment, and the MSM. In all simulation scenarios, all models except the MSM underestimated the risk of outcome given absence of treatment. These results were supported in the statin initiation example, which showed that ignoring statin initiation postbaseline resulted in models that significantly underestimated the risk of a cardiovascular disease event occurring within 10 years. Consequently, CPMs that do not acknowledge treatment drop-in can lead to underallocation of treatment. In conclusion, when developing CPMs to predict treatment-naïve risk, researchers should consider using MSMs to adjust for treatment drop-in, and also seek to exploit the ability of MSMs to allow estimation of individual treatment effects.

Developing a learning health system: Insights from a qualitative process evaluation of a pharmacist-led electronic audit and feedback intervention to improve medication safety in primary care

INTRODUCTION

Developments in information technology offer opportunities to enhance medication safety in primary care. We evaluated the implementation and adoption of a complex pharmacist-led intervention involving the use of an electronic audit and feedback surveillance dashboard to identify patients potentially at risk of hazardous prescribing or monitoring of medicines in general practices. The intervention aimed to create a rapid learning health system for medication safety in primary care. This study aimed to explore how the intervention was implemented, adopted and embedded into practice using a qualitative process evaluation.

METHODS

Twenty two participants were purposively recruited from eighteen out of forty-three general practices receiving the intervention as well as clinical commissioning group staff across Salford UK, which reflected the range of contexts in which the intervention was implemented. Interviews explored how pharmacists and GP staff implemented the intervention and how this affected care practice. Data analysis was thematic with emerging themes developed into coding frameworks based on Normalisation Process Theory (NPT).

RESULTS

Engagement with the dashboard involved a process of sense-making in which pharmacists considered it added value to their work. The intervention helped to build respect, improve trust and develop relationships between pharmacists and GPs. Collaboration and communication between pharmacists and clinicians was primarily initiated by pharmacists and was important for establishing the intervention. The intervention operated as a rapid learning health system as it allowed for the evidence in the dashboard to be translated into changes in work practices and into transformations in care.

CONCLUSIONS

Our study highlighted the importance of the combined use of information technology and the role of pharmacists working in general practice settings. Medicine optimisation activities in primary care may be enhanced by the implementation of a pharmacist-led electronic audit and feedback system. This intervention established a rapid learning health system that swiftly translated data from electronic health records into changes in practice to improve patient care. Using NPT provided valuable insights into the ways in which developing relationships, collaborations and communication between health professionals could lead to the implementation, adoption and sustainability of the intervention.

Toward an Information Infrastructure for Global Health Improvement

Profound global challenges to individual and population health, alongside the opportunities to benefit from digital technology, have spawned the concept of the Learning Health System. Learning Health Systems (LHSs)--which can function at organizational, network, regional, and national levels of scale--have the capability of continuous data-driven self-study that promotes change and improvement. The LHS concept, which originated in the U.S. in 2007, is rapidly gaining attention around the world. LHSs require, but also transcend, the secondary use of health data. This paper describes the key features of LHSs, argues that effective and sustainable LHSs must be supported by infrastructures that allow them to function with economies of scale and scope, and describes the services that such infrastructures must provide. While it is relatively straightforward to describe LHSs, achieving them at the high level of capability necessary to promote significant health benefits will require advancements in science and engineering, engaging the field of informatics among a wider range of disciplines. It also follows from this vision that LHSs cannot be built from an imposed blueprint; LHSs will more likely evolve from efforts at smaller scales that compose into larger systems.

Health Data for Public Health: Towards New Ways of Combining Data Sources to Support Research Efforts in Europe

Objectives: To present the European landscape regarding the re-use of health administrative data for research. Methods: We present some collaborative projects and solutions that have been developed by Nordic countries, Italy, Spain, France, Germany, and the UK, to facilitate access to their health data for research purposes. Results: Research in public health is transitioning from siloed systems to more accessible and re-usable data resources. Following the example of the Nordic countries, several European countries aim at facilitating the re-use of their health administrative databases for research purposes. However, the ecosystem is still a complex patchwork, with different rules, policies, and processes for data provision. Conclusion: The challenges are such that with the abundance of health administrative data, only a European, overarching public health research infrastructure, is able to efficiently facilitate access to this data and accelerate research based on these highly valuable resources.

Architectural frameworks: defining the structures for implementing learning health systems

Background

The vision of transforming health systems into learning health systems (LHSs) that rapidly and continuously transform knowledge into improved health outcomes at lower cost is generating increased interest in government agencies, health organizations, and health research communities. While existing initiatives demonstrate that different approaches can succeed in making the LHS vision a reality, they are too varied in their goals, focus, and scale to be reproduced without undue effort. Indeed, the structures necessary to effectively design and implement LHSs on a larger scale are lacking. In this paper, we propose the use of architectural frameworks to develop LHSs that adhere to a recognized vision while being adapted to their specific organizational context. Architectural frameworks are high-level descriptions of an organization as a system; they capture the structure of its main components at varied levels, the interrelationships among these components, and the principles that guide their evolution. Because these frameworks support the analysis of LHSs and allow their outcomes to be simulated, they act as pre-implementation decision-support tools that identify potential barriers and enablers of system development. They thus increase the chances of successful LHS deployment.

Discussion

We present an architectural framework for LHSs that incorporates five dimensions—goals, scientific, social, technical, and ethical—commonly found in the LHS literature. The proposed architectural framework is comprised of six decision layers that model these dimensions. The performance layer models goals, the scientific layer models the scientific dimension, the organizational layer models the social dimension, the data layer and information technology layer model the technical dimension, and the ethics and security layer models the ethical dimension. We describe the types of decisions that must be made within each layer and identify methods to support decision-making.

Conclusion

In this paper, we outline a high-level architectural framework grounded in conceptual and empirical LHS literature. Applying this architectural framework can guide the development and implementation of new LHSs and the evolution of existing ones, as it allows for clear and critical understanding of the types of decisions that underlie LHS operations. Further research is required to assess and refine its generalizability and methods.

Rapid Development of Specialty Population Registries and Quality Measures from Electronic Health Record Data*. An Agile Framework

BACKGROUND

Creation of a new electronic health record (EHR)-based registry often can be a "one-off" complex endeavor: first developing new EHR data collection and clinical decision support tools, followed by developing registry-specific data extractions from the EHR for analysis. Each development phase typically has its own long development and testing time, leading to a prolonged overall cycle time for delivering one functioning registry with companion reporting into production. The next registry request then starts from scratch. Such an approach will not scale to meet the emerging demand for specialty registries to support population health and value-based care.

OBJECTIVE

To determine if the creation of EHR-based specialty registries could be markedly accelerated by employing (a) a finite core set of EHR data collection principles and methods, (b) concurrent engineering of data extraction and data warehouse design using a common dimensional data model for all registries, and (c) agile development methods commonly employed in new product development.

METHODS

We adopted as guiding principles to (a) capture data as a byproduct of care of the patient, (b) reinforce optimal EHR use by clinicians, (c) employ a finite but robust set of EHR data capture tool types, and (d) leverage our existing technology toolkit. Registries were defined by a shared condition (recorded on the Problem List) or a shared exposure to a procedure (recorded on the Surgical History) or to a medication (recorded on the Medication List). Any EHR fields needed - either to determine registry membership or to calculate a registry-associated clinical quality measure (CQM) - were included in the enterprise data warehouse (EDW) shared dimensional data model. Extract-transform-load (ETL) code was written to pull data at defined "grains" from the EHR into the EDW model. All calculated CQM values were stored in a single Fact table in the EDW crossing all registries. Registry-specific dashboards were created in the EHR to display both (a) real-time patient lists of registry patients and (b) EDW-generated CQM data. Agile project management methods were employed, including co-development, lightweight requirements documentation with User Stories and acceptance criteria, and time-boxed iterative development of EHR features in 2-week "sprints" for rapid-cycle feedback and refinement.

RESULTS

Using this approach, in calendar year 2015 we developed a total of 43 specialty chronic disease registries, with 111 new EHR data collection and clinical decision support tools, 163 new clinical quality measures, and 30 clinic-specific dashboards reporting on both real-time patient care gaps and summarized and vetted CQM measure performance trends.

CONCLUSIONS

This study suggests concurrent design of EHR data collection tools and reporting can quickly yield useful EHR structured data for chronic disease registries, and bodes well for efforts to migrate away from manual abstraction. This work also supports the view that in new EHR-based registry development, as in new product development, adopting agile principles and practices can help deliver valued, high-quality features early and often.

Clinical code set engineering for reusing EHR data for research: A review

INTRODUCTION

The construction of reliable, reusable clinical code sets is essential when re-using Electronic Health Record (EHR) data for research. Yet code set definitions are rarely transparent and their sharing is almost non-existent. There is a lack of methodological standards for the management (construction, sharing, revision and reuse) of clinical code sets which needs to be addressed to ensure the reliability and credibility of studies which use code sets.

OBJECTIVE

To review methodological literature on the management of sets of clinical codes used in research on clinical databases and to provide a list of best practice recommendations for future studies and software tools.

METHODS

We performed an exhaustive search for methodological papers about clinical code set engineering for re-using EHR data in research. This was supplemented with papers identified by snowball sampling. In addition, a list of e-phenotyping systems was constructed by merging references from several systematic reviews on this topic, and the processes adopted by those systems for code set management was reviewed.

RESULTS

Thirty methodological papers were reviewed. Common approaches included: creating an initial list of synonyms for the condition of interest (n=20); making use of the hierarchical nature of coding terminologies during searching (n=23); reviewing sets with clinician input (n=20); and reusing and updating an existing code set (n=20). Several open source software tools (n=3) were discovered.

DISCUSSION

There is a need for software tools that enable users to easily and quickly create, revise, extend, review and share code sets and we provide a list of recommendations for their design and implementation.

CONCLUSION

Research re-using EHR data could be improved through the further development, more widespread use and routine reporting of the methods by which clinical codes were selected.

Utilizing Electronic Medical Records to Discover Changing Trends of Medical Behaviors Over Time

Objectives

Medical behaviors are playing significant roles in the delivery of high quality and cost-effective health services. Timely discovery of changing frequencies of medical behaviors is beneficial for the improvement of health services. The main objective of this work is to discover the changing trends of medical behaviors over time.

Methods

This study proposes a two-steps approach to detect essential changing patterns of medical behaviors from Electronic Medical Records (EMRs). In detail, a probabilistic topic model, i.e., Latent Dirichlet allocation (LDA), is firstly applied to disclose yearly treatment patterns in regard to the risk stratification of patients from a large volume of EMRs. After that, the changing trends by comparing essential/critical medical behaviors in a specific time period are detected and analyzed, including changes of significant patient features with their values, and changes of critical treatment interventions with their occurring time stamps.

Results

We verify the effectiveness of the proposed approach on a clinical dataset containing 12,152 patient cases with a time range of 10 years. Totally, 135 patients features and 234 treatment interventions in three treatment patterns were selected to detect their changing trends. In particular, evolving trends of yearly occurring probabilities of the selected medical behaviors were categorized into six content changing patterns (i.e, 112 growing, 123 declining, 43 up-down, 16 down-up, 35 steady, and 40 jumping), using the proposed approach. Besides, changing trends of execution time of treatment interventions were classified into three occurring time changing patterns (i.e., 175 early-implemented, 50 steady-implemented and 9 delay-implemented).

Conclusions

Experimental results show that our approach has an ability to utilize EMRs to discover essential evolving trends of medical behaviors, and thus provide significant potential to be further explored for health services redesign and improvement.

Supervised Machine Learning Algorithms Can Classify Open-Text Feedback of Doctor Performance With Human-Level Accuracy

Background

Machine learning techniques may be an effective and efficient way to classify open-text reports on doctor’s activity for the purposes of quality assurance, safety, and continuing professional development.

Objective

The objective of the study was to evaluate the accuracy of machine learning algorithms trained to classify open-text reports of doctor performance and to assess the potential for classifications to identify significant differences in doctors’ professional performance in the United Kingdom.

Methods

We used 1636 open-text comments (34,283 words) relating to the performance of 548 doctors collected from a survey of clinicians’ colleagues using the General Medical Council Colleague Questionnaire (GMC-CQ). We coded 77.75% (1272/1636) of the comments into 5 global themes (innovation, interpersonal skills, popularity, professionalism, and respect) using a qualitative framework. We trained 8 machine learning algorithms to classify comments and assessed their performance using several training samples. We evaluated doctor performance using the GMC-CQ and compared scores between doctors with different classifications using t tests.

Results

Individual algorithm performance was high (range F score=.68 to .83). Interrater agreement between the algorithms and the human coder was highest for codes relating to “popular” (recall=.97), “innovator” (recall=.98), and “respected” (recall=.87) codes and was lower for the “interpersonal” (recall=.80) and “professional” (recall=.82) codes. A 10-fold cross-validation demonstrated similar performance in each analysis. When combined together into an ensemble of multiple algorithms, mean human-computer interrater agreement was .88. Comments that were classified as “respected,” “professional,” and “interpersonal” related to higher doctor scores on the GMC-CQ compared with comments that were not classified (P<.05). Scores did not vary between doctors who were rated as popular or innovative and those who were not rated at all (P>.05).

Conclusions

Machine learning algorithms can classify open-text feedback of doctor performance into multiple themes derived by human raters with high performance. Colleague open-text comments that signal respect, professionalism, and being interpersonal may be key indicators of doctor’s performance.

Representation of People's Decisions in Health Information Systems.* A Complementary Approach for Understanding Health Care Systems and Population Health

OBJECTIVES

In this study, we aimed: 1) to conceptualize the theoretical challenges facing health information systems (HIS) to represent patients' decisions about health and medical treatments in everyday life; 2) to suggest approaches for modeling these processes.

METHODS

The conceptualization of the theoretical and methodological challenges was discussed in 2015 during a series of interdisciplinary meetings attended by health informatics staff, epidemiologists and health professionals working in quality management and primary and secondary prevention of chronic diseases of the Hospital Italiano de Buenos Aires, together with sociologists, anthropologists and e-health stakeholders.

RESULTS

HIS are facing the need and challenge to represent social human processes based on constructivist and complexity theories, which are the current frameworks of human sciences for understanding human learning and socio-cultural changes. Computer systems based on these theories can model processes of social construction of concrete and subjective entities and the interrelationships between them. These theories could be implemented, among other ways, through the mapping of health assets, analysis of social impact through community trials and modeling of complexity with system simulation tools.

CONCLUSIONS

This analysis suggested the need to complement the traditional linear causal explanations of disease onset (and treatments) that are the bases for models of analysis of HIS with constructivist and complexity frameworks. Both may enlighten the complex interrelationships among patients, health services and the health system. The aim of this strategy is to clarify people's decision making processes to improve the efficiency, quality and equity of the health services and the health system.

Research Strategies for Biomedical and Health Informatics. Some Thought-provoking and Critical Proposals to Encourage Scientific Debate on the Nature of Good Research in Medical Informatics

BACKGROUND

Medical informatics, or biomedical and health informatics (BMHI), has become an established scientific discipline. In all such disciplines there is a certain inertia to persist in focusing on well-established research areas and to hold on to well-known research methodologies rather than adopting new ones, which may be more appropriate.

OBJECTIVES

To search for answers to the following questions: What are research fields in informatics, which are not being currently adequately addressed, and which methodological approaches might be insufficiently used? Do we know about reasons? What could be consequences of change for research and for education?

METHODS

Outstanding informatics scientists were invited to three panel sessions on this topic in leading international conferences (MIE 2015, Medinfo 2015, HEC 2016) in order to get their answers to these questions.

RESULTS

A variety of themes emerged in the set of answers provided by the panellists. Some panellists took the theoretical foundations of the field for granted, while several questioned whether the field was actually grounded in a strong theoretical foundation. Panellists proposed a range of suggestions for new or improved approaches, methodologies, and techniques to enhance the BMHI research agenda.

CONCLUSIONS

The field of BMHI is on the one hand maturing as an academic community and intellectual endeavour. On the other hand vendor-supplied solutions may be too readily and uncritically accepted in health care practice. There is a high chance that BMHI will continue to flourish as an important discipline; its innovative interventions might then reach the original objectives of advancing science and improving health care outcomes.

Some Innovative Approaches for Public Health and Epidemiology Informatics

OBJECTIVES

Summarize excellent current research published in 2015 in the field of Public Health and Epidemiology Informatics.

METHODS

The complete 2015 literature concerning public health and epidemiology informatics has been searched in PubMed and Web of Science, and the returned references were reviewed by the two section editors to select 14 candidate best papers. These papers were then peer-reviewed by external reviewers to allow the editorial team an enlightened selection of the best papers.

RESULTS

Among the 1,272 references retrieved from PubMed and Web of Science, three were finally selected as best papers. The first one presents a language agnostic approach for epidemic event detection in news articles. The second paper describes a system using big health data gathered by a statewide system to forecast emergency department visits. The last paper proposes a rather original approach that uses machine learning to solve the old issue of outbreak detection and prediction.

CONCLUSIONS

The increasing availability of data, now directly from health systems, will probably lead to a boom in public health surveillance systems and in large-scale epidemiologic studies.

The tip of the iceberg: challenges of accessing hospital electronic health record data for biological data mining

Modern cohort studies include self-reported measures on disease, behavior and lifestyle, sensor-based observations from mobile phones and wearables, and rich -omics data. Follow-up is often achieved through electronic health record (EHR) linkages across primary and secondary healthcare providers. Historically however, researchers typically only get to see the tip of the iceberg: coded administrative data relating to healthcare claims which mainly record billable diagnoses and procedures. The rich data generated during the clinical pathway remain submerged and inaccessible. While some institutions and initiatives have made good progress in unlocking such deep phenotypic data within their institutional realms, access at scale still remains challenging. Here we outline and discuss the main technical and social challenges associated with accessing these data for data mining and hauling the entire iceberg.

Geographic Variation and US County Characteristics Associated With Rapid Kidney Function Decline

Introduction

Geographic variation in the prevalence of chronic kidney disease and incidence of end-stage renal disease has been previously reported. However, the geographic epidemiology of rapid estimated glomerular filtration rate (eGFR) decline has not been examined.

Methods

We built a longitudinal cohort of 2,107,570 US veterans to characterize the spatial epidemiology of and examine the associations between US county characteristics and rapid eGFR decline.

Results

There were 169,029 (8.02%) with rapid eGFR decline (defined as eGFR slope < –5 ml/min per 1.73 m²/year). The prevalence of rapid eGFR decline adjusted for age, race, gender, diabetes, and hypertension varied by county from 4.10%–6.72% in the lowest prevalence quintile to 8.41%–22.04% in the highest prevalence quintile (P for heterogeneity < 0.001). Examination of adjusted prevalence showed substantial geographic variation in those with and without diabetes and those with and without hypertension (P for heterogeneity < 0.001). Cohort participants had higher odds of rapid eGFR decline when living in counties with unfavorable characteristics in domains including health outcomes (odds ratio [OR] = 1.15; confidence interval [CI] = 1.09–1.22), health behaviors (OR = 1.08; CI = 1.03–1.13), clinical care (OR = 1.11; CI = 1.06–1.16), socioeconomic conditions (OR = 1.15; CI = 1.09–1.22), and physical environment (OR = 1.15; CI = 1.01–1.20); living in counties with high percentage of minorities and immigrants was associated with rapid eGFR decline (OR = 1.25; CI = 1.20–1.31). Spatial analyses suggest the presence of cluster of counties with high prevalence of rapid eGFR decline.

Discussion

Our findings show substantial geographic variation in rapid eGFR decline among US veterans; the variation persists in analyses stratified by diabetes and hypertension status; results show associations between US county characteristics in domains capturing health, socioeconomic, environmental, and diversity conditions, and rapid eGFR decline.

Data Safe Havens and Trust: Toward a Common Understanding of Trusted Research Platforms for Governing Secure and Ethical Health Research

In parallel with the advances in big data-driven clinical research, the data safe haven concept has evolved over the last decade. It has led to the development of a framework to support the secure handling of health care information used for clinical research that balances compliance with legal and regulatory controls and ethical requirements while engaging with the public as a partner in its governance. We describe the evolution of 4 separately developed clinical research platforms into services throughout the United Kingdom-wide Farr Institute and their common deployment features in practice. The Farr Institute is a case study from which we propose a common definition of data safe havens as trusted platforms for clinical academic research. We use this common definition to discuss the challenges and dilemmas faced by the clinical academic research community, to help promote a consistent understanding of them and how they might best be handled in practice. We conclude by questioning whether the common definition represents a safe and trustworthy model for conducting clinical research that can stand the test of time and ongoing technical advances while paying heed to evolving public and professional concerns.

Discussion of "Combining Health Data Uses to Ignite Health System Learning"

This article is part of a For-Discussion-Section of Methods of Information in Medicine about the paper "Combining Health Data Uses to Ignite Health System Learning" written by John D. Ainsworth and Iain E. Buchan [1]. It is introduced by an editorial. This article contains the combined commentaries invited to independently comment on the paper of Ainsworth and Buchan. In subsequent issues the discussion can continue through letters to the editor. With these comments on the paper "Combining Health Data Uses to Ignite Health System Learning", written by John D. Ainsworth and Iain E. Buchan [1], the journal seeks to stimulate a broad discussion on new ways for combining data sources for the reuse of health data in order to identify new opportunities for health system learning. An international group of experts has been invited by the editor of Methods to comment on this paper. Each of the invited commentaries forms one section of this paper.