Best practices in the real-world data life cycle

Automation of ePROMs in radiation oncology and its impact on patient response and bias

PURPOSE

This study evaluates the impact of integrating a novel, in-house developed electronic Patient-Reported Outcome Measures (ePROMs) tool with a commercial Oncology Information System (OIS) on patient response rates and potential biases in real-world data science applications.

MATERIALS AND METHODS

We designed an ePROMs tool using the NodeJS web application framework, automatically sending e-mail questionnaires to patients based on their treatment schedules in the OIS. The tool is used across various treatment sites to collect PROMs data in a real-world setting. This research examined the effects of increasing automation levels on both recruitment and response rates, as well as potential biases across different patient cohorts. Automation was implemented in three escalating levels, from telephone reminders for missing reports to minimal intervention from study nurses.

RESULTS

From August 2020 to December 2023, 1,944 patients participated in the PROMs study. Our findings indicate that automating the workflows substantially reduced the patient management workload. However, higher levels of automation led to lower response rates, particularly in collecting late-phase symptoms in breast and head-and-neck cancer cohorts. Additionally, email-based PROMs introduced an age bias when recruiting new patients for the ePROMs study. Nevertheless, age was not a significant predictor of early dropout or missing symptom reports among patients participating. Notably, increased automation was significantly correlated with lower response rates in breast (p = 0.026) and head-and-neck cancer patients (p < 0.001).

CONCLUSION

Integrating ePROMs within the OIS can significantly reduce workload and personnel resources. However, this efficiency may compromise patient responses in certain groups. A balance must be achieved between workload, resource allocation, and the sensitivity needed to detect clinically significant effects. This may necessitate customized automation levels tailored to specific cancer groups, highlighting a fundamental trade-off between operational efficiency and data quality.

Validation and clinical discovery demonstration of breast cancer data from a real-world data extraction platform

Objective

To validate and demonstrate the clinical discovery utility of a novel patient-mediated, medical record collection and data extraction platform developed to improve access and utilization of real-world clinical data.

Materials and Methods

Clinical variables were extracted from the medical records of 1011 consented patients with breast cancer. To validate the extracted data, case report forms completed using the structured data output of the platform were compared to manual chart review for 50 randomly-selected patients with metastatic breast cancer. To demonstrate the platform's clinical discovery utility, we identified 194 patients with early-stage clinical data who went on to develop distant metastases and utilized the platform-extracted data to assess associations between time to distant metastasis (TDM) and early-stage tumor histology, molecular type, and germline BRCA status.

Results

The platform-extracted data for the validation cohort had 97.6% precision (91.98%-100% by variable type) and 81.48% recall (58.15%-95.00% by variable type) compared to manual chart review. In our discovery cohort, the shortest TDM was significantly associated with metaplastic (739.0 days) and inflammatory histologies (1005.8 days), HR-/HER2- molecular types (1187.4 days), and positive BRCA status (1042.5 days) as compared to other histologies, molecular types, and negative BRCA status, respectively. Multivariable analyses did not produce statistically significant results.

Discussion

The precision and recall of platform-extracted clinical data are reported, although specificity could not be assessed. The data can generate clinically-relevant insights.

Conclusion

The structured real-world data produced by a novel patient-mediated, medical record-extraction platform are reliable and can power clinical discovery.

Promising algorithms to perilous applications: a systematic review of risk stratification tools for predicting healthcare utilisation

OBJECTIVES

Risk stratification tools that predict healthcare utilisation are extensively integrated into primary care systems worldwide, forming a key component of anticipatory care pathways, where high-risk individuals are targeted by preventative interventions. Existing work broadly focuses on comparing model performance in retrospective cohorts with little attention paid to efficacy in reducing morbidity when deployed in different global contexts. We review the evidence supporting the use of such tools in real-world settings, from retrospective dataset performance to pathway evaluation.

METHODS

A systematic search was undertaken to identify studies reporting the development, validation and deployment of models that predict healthcare utilisation in unselected primary care cohorts, comparable to their current real-world application.

RESULTS

Among 3897 articles screened, 51 studies were identified evaluating 28 risk prediction models. Half underwent external validation yet only two were validated internationally. No association between validation context and model discrimination was observed. The majority of real-world evaluation studies reported no change, or indeed significant increases, in healthcare utilisation within targeted groups, with only one-third of reports demonstrating some benefit.

DISCUSSION

While model discrimination appears satisfactorily robust to application context there is little evidence to suggest that accurate identification of high-risk individuals can be reliably translated to improvements in service delivery or morbidity.

CONCLUSIONS

The evidence does not support further integration of care pathways with costly population-level interventions based on risk prediction in unselected primary care cohorts. There is an urgent need to independently appraise the safety, efficacy and cost-effectiveness of risk prediction systems that are already widely deployed within primary care.

Health-related conditions among long-term cancer survivors diagnosed in adolescence and young adulthood (AYA): results of the SURVAYA study

BACKGROUND

With 5-year survival rates > 85%, gaining insight into the long-term and late health-related conditions of cancer survivors diagnosed in adolescence and young adulthood is of utmost importance to improve their quantity and quality of survival. This study examined the prevalence of and factors associated with, patient-reported health-related conditions and their latency times among long-term adolescent and young adult (AYA) cancer survivors.

METHODS

AYA cancer survivors (5-20 years after diagnosis) were identified by the population-based Netherlands Cancer Registry (NCR), and invited to participate in the SURVAYA questionnaire study. Participants reported the prevalence and date of diagnosis of health-related conditions. Clinical data were retrieved from the NCR.

RESULTS

Three thousand seven hundred seventy-six AYA cancer survivors (response rate 33.4%) were included for analyses. More than half of the AYAs (58.5%) experienced health-related conditions after their cancer diagnosis, of whom 51.4% were diagnosed with two or more conditions. Participants reported conditions related to vision (15.0%), digestive system (15.0%), endocrine system (14.1%), cardiovascular system (11.7%), respiratory system (11.3%), urinary tract system (10.9%), depression (8.6%), hearing (7.4%), arthrosis (6.9%), secondary malignancy (6.4%), speech-, taste and smell (4.5%), and rheumatoid arthritis (2.1%). Time since diagnosis, tumor type, age at diagnosis, and educational level were most frequently associated with a health-related condition.

CONCLUSIONS

A significant proportion of long-term AYA cancer survivors report having one or more health-related conditions.

IMPLICATIONS FOR CANCER SURVIVORS

Future research should focus on better understanding the underlying mechanisms of, and risk factors for, these health-related conditions to support the development and implementation of risk-stratified survivorship care for AYA cancer survivors to further improve their outcomes.

CLINICAL TRIALS REGISTRATION

NCT05379387.

Using routinely collected clinical data for circadian medicine: A review of opportunities and challenges

A wealth of data is available from electronic health records (EHR) that are collected as part of routine clinical care in hospitals worldwide. These rich, longitudinal data offer an attractive object of study for the field of circadian medicine, which aims to translate knowledge of circadian rhythms to improve patient health. This narrative review aims to discuss opportunities for EHR in studies of circadian medicine, highlight the methodological challenges, and provide recommendations for using these data to advance the field. In the existing literature, we find that data collected in real-world clinical settings have the potential to shed light on key questions in circadian medicine, including how 24-hour rhythms in clinical features are associated with-or even predictive of-health outcomes, whether the effect of medication or other clinical activities depend on time of day, and how circadian rhythms in physiology may influence clinical reference ranges or sampling protocols. However, optimal use of EHR to advance circadian medicine requires careful consideration of the limitations and sources of bias that are inherent to these data sources. In particular, time of day influences almost every interaction between a patient and the healthcare system, creating operational 24-hour patterns in the data that have little or nothing to do with biology. Addressing these challenges could help to expand the evidence base for the use of EHR in the field of circadian medicine.

Traceable Research Data Sharing in a German Medical Data Integration Center With FAIR (Findability, Accessibility, Interoperability, and Reusability)-Geared Provenance Implementation: Proof-of-Concept Study

BACKGROUND

Secondary investigations into digital health records, including electronic patient data from German medical data integration centers (DICs), pave the way for enhanced future patient care. However, only limited information is captured regarding the integrity, traceability, and quality of the (sensitive) data elements. This lack of detail diminishes trust in the validity of the collected data. From a technical standpoint, adhering to the widely accepted FAIR (Findability, Accessibility, Interoperability, and Reusability) principles for data stewardship necessitates enriching data with provenance-related metadata. Provenance offers insights into the readiness for the reuse of a data element and serves as a supplier of data governance.

OBJECTIVE

The primary goal of this study is to augment the reusability of clinical routine data within a medical DIC for secondary utilization in clinical research. Our aim is to establish provenance traces that underpin the status of data integrity, reliability, and consequently, trust in electronic health records, thereby enhancing the accountability of the medical DIC. We present the implementation of a proof-of-concept provenance library integrating international standards as an initial step.

METHODS

We adhered to a customized road map for a provenance framework, and examined the data integration steps across the ETL (extract, transform, and load) phases. Following a maturity model, we derived requirements for a provenance library. Using this research approach, we formulated a provenance model with associated metadata and implemented a proof-of-concept provenance class. Furthermore, we seamlessly incorporated the internationally recognized Word Wide Web Consortium (W3C) provenance standard, aligned the resultant provenance records with the interoperable health care standard Fast Healthcare Interoperability Resources, and presented them in various representation formats. Ultimately, we conducted a thorough assessment of provenance trace measurements.

RESULTS

This study marks the inaugural implementation of integrated provenance traces at the data element level within a German medical DIC. We devised and executed a practical method that synergizes the robustness of quality- and health standard-guided (meta)data management practices. Our measurements indicate commendable pipeline execution times, attaining notable levels of accuracy and reliability in processing clinical routine data, thereby ensuring accountability in the medical DIC. These findings should inspire the development of additional tools aimed at providing evidence-based and reliable electronic health record services for secondary use.

CONCLUSIONS

The research method outlined for the proof-of-concept provenance class has been crafted to promote effective and reliable core data management practices. It aims to enhance biomedical data by imbuing it with meaningful provenance, thereby bolstering the benefits for both research and society. Additionally, it facilitates the streamlined reuse of biomedical data. As a result, the system mitigates risks, as data analysis without knowledge of the origin and quality of all data elements is rendered futile. While the approach was initially developed for the medical DIC use case, these principles can be universally applied throughout the scientific domain.

From data strategy to implementation to advance cancer research and cancer care: A French comprehensive cancer center experience

In a comprehensive cancer center, effective data strategies are essential to evaluate practices, and outcome, understanding the disease and prognostic factors, identifying disparities in cancer care, and overall developing better treatments. To achieve these goals, the Center Léon Bérard (CLB) considers various data collection strategies, including electronic medical records (EMRs), clinical trial data, and research projects. Advanced data analysis techniques like natural language processing (NLP) can be used to extract and categorize information from these sources to provide a more complete description of patient data. Data sharing is also crucial for collaboration across comprehensive cancer centers, but it must be done securely and in compliance with regulations like GDPR. To ensure data is shared appropriately, CLB should develop clear data sharing policies and share data in a controlled, standardized format like OSIRIS RWD, OMOP and FHIR. The UNICANCER initiative has launched the CONSORE project to support the development of a structured and standardized repository of patient data to improve cancer research and patient outcomes. Real-world data (RWD) studies are vital in cancer research as they provide a comprehensive and accurate picture of patient outcomes and treatment patterns. By incorporating RWD into data collection, analysis, and sharing strategies, comprehensive cancer centers can take a more comprehensive and patient-centered approach to cancer research. In conclusion, comprehensive cancer centers must take an integrated approach to data collection, analysis, and sharing to enhance their understanding of cancer and improve patient outcomes. Leveraging advanced data analytics techniques and developing effective data sharing policies can help cancer centers effectively harness the power of data to drive progress in cancer research.

Real-World Evidence Studies in Oncology Therapeutics: Hope or Hype?

Randomized controlled trial (RCT) remains a gold standard in evidence-based medicine for assessing the efficacy and safety of cancer therapies. However, due to some inherent methodological limitations of RCT, such as stringent inclusion criteria, highly specific treatment, ethical and scientific compromise in rare cancer, and inability to adequately assess safety, real-world evidence (RWE) has been adjudged as a suitable option to complement data obtained from RCT. Moreover, in the context of cancer therapeutics, few notable merits pertain to developing a novel product for rare cancer subtypes, establishing new indications for already approved drugs, optimization of treatment regimen and sequence, a better description of long-term safety, and supporting the reimbursement-related decision. However, the implementation of RWE for the aforementioned purposes will be limited by various challenges, especially in the context of developing economies such as India. Special attention should be given to the availability of data, maintaining the quality standard, and establishing stringent regulations for privacy and security along with active regulatory engagement with relevant stakeholders. Such activities will be key to facilitating the use of RWE in cancer therapeutics.

Mapping and evaluating national data flows: transparency, privacy, and guiding infrastructural transformation

The importance of big health data is recognised worldwide. Most UK National Health Service (NHS) care interactions are recorded in electronic health records, resulting in an unmatched potential for population-level datasets. However, policy reviews have highlighted challenges from a complex data-sharing landscape relating to transparency, privacy, and analysis capabilities. In response, we used public information sources to map all electronic patient data flows across England, from providers to more than 460 subsequent academic, commercial, and public data consumers. Although NHS data support a global research ecosystem, we found that multistage data flow chains limit transparency and risk public trust, most data interactions do not fulfil recommended best practices for safe data access, and existing infrastructure produces aggregation of duplicate data assets, thus limiting diversity of data and added value to end users. We provide recommendations to support data infrastructure transformation and have produced a website (https://DataInsights.uk) to promote transparency and showcase NHS data assets.

Cardiovascular Care Innovation through Data-Driven Discoveries in the Electronic Health Record

The electronic health record (EHR) represents a rich source of patient information, increasingly being leveraged for cardiovascular research. Although its primary use remains the seamless delivery of health care, the various longitudinally aggregated structured and unstructured data elements for each patient within the EHR can define the computational phenotypes of disease and care signatures and their association with outcomes. Although structured data elements, such as demographic characteristics, laboratory measurements, problem lists, and medications, are easily extracted, unstructured data are underused. The latter include free text in clinical narratives, documentation of procedures, and reports of imaging and pathology. Rapid scaling up of data storage and rapid innovation in natural language processing and computer vision can power insights from unstructured data streams. However, despite an array of opportunities for research using the EHR, specific expertise is necessary to adequately address confidentiality, accuracy, completeness, and heterogeneity challenges in EHR-based research. These often require methodological innovation and best practices to design and conduct successful research studies. Our review discusses these challenges and their proposed solutions. In addition, we highlight the ongoing innovations in federated learning in the EHR through a greater focus on common data models and discuss ongoing work that defines such an approach to large-scale, multicenter, federated studies. Such parallel improvements in technology and research methods enable innovative care and optimization of patient outcomes.

Impact of primary to secondary care data sharing on care quality in NHS England hospitals

Health information exchange (HIE) is seen as a key component of effective care but remains poorly evidenced at a health system level. In the UK National Health Service (NHS), the ability to share primary care data with secondary care clinicians is a focus of continued digital investment. In this study, we report the evolution of interoperable technology across a period of rapid digital transformation in NHS England from 2015 to 2019, and test association of primary to secondary care data-sharing capabilities with clinical care quality indicators across all acute secondary care providers (n = 135 NHS Trusts). In multivariable analyses, data-sharing capabilities are associated with reduction in patients breaching an Accident & Emergency (A&E) 4-h decision time threshold, and better patient-reported experience of acute hospital care quality. Using synthetic control analyses, we estimate mean 2.271% (STD+/-3.371) absolute reduction in A&E 4-h decision time breach, 12 months following introduction of data-sharing capabilities. Our findings support current digital transformation programmes for developing regional HIE networks but highlight the need to focus on implementation factors in addition to technological procurement.

Streams, rivers and data lakes: an introduction to understanding modern electronic healthcare records

As foundation doctors, we have often found ourselves informing patients that a certain aspect of their medical information cannot be immediately found, either because it is on an electronic system we cannot access, or it is in a hospital that is unlinked to our own. Unsurprisingly, this frequently leaves patients flabbergasted and confused. We started to wonder: if patients' data are entered onto an electronic system: where do those data go? If medical data are searched for, where do those data come from? Why are there so many hidden sources of information that clinicians cannot access? In an ever-increasing digital sphere, electronic data will be the future of holistic health and social care planning, impacting every clinician's day-to-day role. From electronic healthcare records to the use of artificial intelligence solutions, this article will serve as an introduction to how data flows in modern healthcare systems.

Contribution of Frailty to Multimorbidity Patterns and Trajectories: Longitudinal Dynamic Cohort Study of Aging People

BACKGROUND

Multimorbidity and frailty are characteristics of aging that need individualized evaluation, and there is a 2-way causal relationship between them. Thus, considering frailty in analyses of multimorbidity is important for tailoring social and health care to the specific needs of older people.

OBJECTIVE

This study aimed to assess how the inclusion of frailty contributes to identifying and characterizing multimorbidity patterns in people aged 65 years or older.

METHODS

Longitudinal data were drawn from electronic health records through the SIDIAP (Sistema d'Informació pel Desenvolupament de la Investigació a l'Atenció Primària) primary care database for the population aged 65 years or older from 2010 to 2019 in Catalonia, Spain. Frailty and multimorbidity were measured annually using validated tools (eFRAGICAP, a cumulative deficit model; and Swedish National Study of Aging and Care in Kungsholmen [SNAC-K], respectively). Two sets of 11 multimorbidity patterns were obtained using fuzzy c-means. Both considered the chronic conditions of the participants. In addition, one set included age, and the other included frailty. Cox models were used to test their associations with death, nursing home admission, and home care need. Trajectories were defined as the evolution of the patterns over the follow-up period.

RESULTS

The study included 1,456,052 unique participants (mean follow-up of 7.0 years). Most patterns were similar in both sets in terms of the most prevalent conditions. However, the patterns that considered frailty were better for identifying the population whose main conditions imposed limitations on daily life, with a higher prevalence of frail individuals in patterns like chronic ulcers &peripheral vascular. This set also included a dementia-specific pattern and showed a better fit with the risk of nursing home admission and home care need. On the other hand, the risk of death had a better fit with the set of patterns that did not include frailty. The change in patterns when considering frailty also led to a change in trajectories. On average, participants were in 1.8 patterns during their follow-up, while 45.1% (656,778/1,456,052) remained in the same pattern.

CONCLUSIONS

Our results suggest that frailty should be considered in addition to chronic diseases when studying multimorbidity patterns in older adults. Multimorbidity patterns and trajectories can help to identify patients with specific needs. The patterns that considered frailty were better for identifying the risk of certain age-related outcomes, such as nursing home admission or home care need, while those considering age were better for identifying the risk of death. Clinical and social intervention guidelines and resource planning can be tailored based on the prevalence of these patterns and trajectories.

Development of a Somatic Variant Registry in a National Cancer Center: towards Molecular Real World Data preparedness

The Biomedical Research field is currently advancing to develop Clinical Trials and translational projects based on Real World Evidence. To make this transition feasible, clinical centers need to work toward Data Accessibility and Interoperability. This task is particularly challenging when applied to Genomics, that entered in routinary screening in the last years via mostly amplicon-based Next-Generation Sequencing panels. Said experiments produce up to hundreds of features per patient, and their summarized results are often stored in static clinical reports, making critical information inaccessible to automated access and Federated Search consortia. In this study, we present a reanalysis of 4620 solid tumor sequencing samples in five different histology settings. Furthermore, we describe all the Bioinformatics and Data Engineering processes that were put in place in order to create a Somatic Variant Registry able to deal with the large biotechnological variability of routinary Genomics Profiling.

Hospital-wide natural language processing summarising the health data of 1 million patients

Electronic health records (EHRs) represent a major repository of real world clinical trajectories, interventions and outcomes. While modern enterprise EHR's try to capture data in structured standardised formats, a significant bulk of the available information captured in the EHR is still recorded only in unstructured text format and can only be transformed into structured codes by manual processes. Recently, Natural Language Processing (NLP) algorithms have reached a level of performance suitable for large scale and accurate information extraction from clinical text. Here we describe the application of open-source named-entity-recognition and linkage (NER+L) methods (CogStack, MedCAT) to the entire text content of a large UK hospital trust (King's College Hospital, London). The resulting dataset contains 157M SNOMED concepts generated from 9.5M documents for 1.07M patients over a period of 9 years. We present a summary of prevalence and disease onset as well as a patient embedding that captures major comorbidity patterns at scale. NLP has the potential to transform the health data lifecycle, through large-scale automation of a traditionally manual task.

Replication of Real-World Evidence in Oncology Using Electronic Health Record Data Extracted by Machine Learning

Meaningful real-world evidence (RWE) generation requires unstructured data found in electronic health records (EHRs) which are often missing from administrative claims; however, obtaining relevant data from unstructured EHR sources is resource-intensive. In response, researchers are using natural language processing (NLP) with machine learning (ML) techniques (i.e., ML extraction) to extract real-world data (RWD) at scale. This study assessed the quality and fitness-for-use of EHR-derived oncology data curated using NLP with ML as compared to the reference standard of expert abstraction. Using a sample of 186,313 patients with lung cancer from a nationwide EHR-derived de-identified database, we performed a series of replication analyses demonstrating some common analyses conducted in retrospective observational research with complex EHR-derived data to generate evidence. Eligible patients were selected into biomarker- and treatment-defined cohorts, first with expert-abstracted then with ML-extracted data. We utilized the biomarker- and treatment-defined cohorts to perform analyses related to biomarker-associated survival and treatment comparative effectiveness, respectively. Across all analyses, the results differed by less than 8% between the data curation methods, and similar conclusions were reached. These results highlight that high-performance ML-extracted variables trained on expert-abstracted data can achieve similar results as when using abstracted data, unlocking the ability to perform oncology research at scale.

A validated artificial intelligence-based pipeline for population-wide primary immunodeficiency screening

BACKGROUND

Identification of patients with underlying inborn errors of immunity and inherent susceptibility to infection remains challenging. The ensuing protracted diagnostic odyssey for such patients often results in greater morbidity and suboptimal outcomes, underscoring a need to develop systematic methods for improving diagnostic rates.

OBJECTIVE

The principal aim of this study is to build and validate a generalizable analytical pipeline for population-wide detection of infection susceptibility and risk of primary immunodeficiency.

METHODS

This prospective, longitudinal cohort study coupled weighted rules with a machine learning classifier for risk stratification. Claims data were analyzed from a diverse population (n = 427,110) iteratively over 30 months. Cohort outcomes were enumerated for new diagnoses, hospitalizations, and acute care visits. This study followed TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) standards.

RESULTS

Cohort members initially identified as high risk were proportionally more likely to receive a diagnosis of primary immunodeficiency compared to those at low-medium risk or those without claims of interest respectively (9% vs 1.5% vs 0.2%; P < .001, chi-square test). Subsequent machine learning stratification enabled an annualized individual snapshot of complexity for triaging referrals. This study's top-performing machine learning model for visit-level prediction used a single dense layer neural network architecture (area under the receiver-operator characteristic curve = 0.98; F1 score = 0.98).

CONCLUSIONS

A 2-step analytical pipeline can facilitate identification of individuals with primary immunodeficiency and accurately quantify clinical risk.

Real-World Data and Paper-Based Disease Registries in the Small Island Developing State of Barbados During the COVID-19 Pandemic

Significant data is being produced on the impact of COVID-19 on aspects of clinical care. However, less is known about the impact on real-world health data. The US Food and Drug Administration defines real-world data as "data relating to patient health status and/or the delivery of health care routinely collected from a variety of sources," including disease registries.1 The methodology used by the Barbados National Registry (BNR)-active pursuit of first-hand clinical data using paper-based charts from multiple sources-makes it an ideal example of real-world data. Real-world data can overcome the barriers to clinical trials often present in small island developing states. This paper reviews the impact of the COVID-19 pandemic on the data of the BNR within the context of the real-world data cycle. Data collected retrospectively for 2016-2018, undergoing traceback during the pandemic, demonstrated a greater reliance on death certificate registration. A 38% reduction in the collection of new cases was noted in the postpandemic period compared to data collected in previous periods. The lack of access to source data delayed cancer registry reporting. We conclude that, given the challenges highlighted during the COVID-19 pandemic, more effort should be placed on providing timely access to real-world data for public health decision-making, particularly in small island developing states.

Contemporary Databases in Real-world Studies Regarding the Diverse Health Care Systems of India, Thailand, and Taiwan: Protocol for a Scoping Review

BACKGROUND

Real-world data (RWD) related to patient health status or health care delivery can be broadly defined as data collected outside of conventional clinical trials, including those from databases, treatment and disease registries, electronic medical records, insurance claims, and information directly contributed by health care professionals or patients. RWD are used to generate real-world evidence (RWE), which is increasingly relevant to policy makers in Asia, who use RWE to support decision-making in several areas, including public health policy, regulatory health technology assessment, and reimbursement; set priorities; or inform clinical practice.

OBJECTIVE

To support the achievement of the benefits of RWE in Asian health care strategies and policies, we sought to identify the linked contemporary databases used in real-world studies from three representative countries-India, Thailand, and Taiwan-and explore variations in results based on these countries' economies and health care reimbursement systems by performing a systematic scoping review. Herein, we describe the protocol and preliminary findings of our scoping review.

METHODS

The PubMed search strategy covered 3 concepts. Concept 1 was designed to identify potential RWE and RWD studies by applying various Medical Subject Headings (MeSH) terms ("Treatment Outcome," "Evidence-Based Medicine," "Retrospective Studies," and "Time Factors") and related keywords (eg, "real-world," "actual life," and "actual practice"). Concept 2 introduced the three countries-India, Taiwan, and Thailand. Concept 3 focused on data types, using a combination of MeSH terms ("Electronic Health Records," "Insurance, Health," "Registries," "Databases, Pharmaceutical," and "Pharmaceutical Services") and related keywords (eg, "electronic medical record," "electronic healthcare record," "EMR," "EHR," "administrative database," and "registry"). These searches were conducted with filters for language (English) and publication date (publications in the last 5 years before the search). The retrieved articles will undergo 2 screening phases (phase 1: review of titles and abstracts; phase 2: review of full texts) to identify relevant and eligible articles for data extraction. The data to be extracted from eligible studies will include the characteristics of databases, the regions covered, and the patient populations.

RESULTS

The literature search was conducted on September 27, 2022. We retrieved 3,172,434, 1,094,125, and 672,794 articles for concepts 1, 2, and 3, respectively. After applying all 3 concepts and the language and publication date filters, 2277 articles were identified. These will be further screened to identify eligible studies. Based on phase 1 screening and our progress to date, approximately 44% (1003/2277) of articles have undergone phase 2 screening to judge their eligibility. Around 800 studies will be used for data extraction.

CONCLUSIONS

Our research will be crucial for nurturing advancement in RWD generation within Asia by identifying linked clinical RWD databases and new avenues for public-private partnerships and multiple collaborations for expanding the scope and spectrum of high-quality, robust RWE generation in Asia.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/43741.

Challenges and recommendations for wearable devices in digital health: Data quality, interoperability, health equity, fairness

Wearable devices are increasingly present in the health context, as tools for biomedical research and clinical care. In this context, wearables are considered key tools for a more digital, personalised, preventive medicine. At the same time, wearables have also been associated with issues and risks, such as those connected to privacy and data sharing. Yet, discussions in the literature have mostly focused on either technical or ethical considerations, framing these as largely separate areas of discussion, and the contribution of wearables to the collection, development, application of biomedical knowledge has only partially been discussed. To fill in these gaps, in this article we provide an epistemic (knowledge-related) overview of the main functions of wearable technology for health: monitoring, screening, detection, and prediction. On this basis, we identify 4 areas of concern in the application of wearables for these functions: data quality, balanced estimations, health equity, and fairness. To move the field forward in an effective and beneficial direction, we present recommendations for the 4 areas: local standards of quality, interoperability, access, and representativity.

Moving towards vertically integrated artificial intelligence development

Substantial interest and investment in clinical artificial intelligence (AI) research has not resulted in widespread translation to deployed AI solutions. Current attention has focused on bias and explainability in AI algorithm development, external validity and model generalisability, and lack of equity and representation in existing data. While of great importance, these considerations also reflect a model-centric approach seen in published clinical AI research, which focuses on optimising architecture and performance of an AI model on best available datasets. However, even robustly built models using state-of-the-art algorithms may fail once tested in realistic environments due to unpredictability of real-world conditions, out-of-dataset scenarios, characteristics of deployment infrastructure, and lack of added value to clinical workflows relative to cost and potential clinical risks. In this perspective, we define a vertically integrated approach to AI development that incorporates early, cross-disciplinary, consideration of impact evaluation, data lifecycles, and AI production, and explore its implementation in two contrasting AI development pipelines: a scalable “AI factory” (Mayo Clinic, Rochester, United States), and an end-to-end cervical cancer screening platform for resource poor settings (Paps AI, Mbarara, Uganda). We provide practical recommendations for implementers, and discuss future challenges and novel approaches (including a decentralised federated architecture being developed in the NHS (AI4VBH, London, UK)). Growth in global clinical AI research continues unabated, and introduction of vertically integrated teams and development practices can increase the translational potential of future clinical AI projects.

Digital Health and Big Data Analytics: Implications of Real-World Evidence for Clinicians and Policymakers

Real world data (RWD) and real-world evidence (RWE) plays an increasingly important role in clinical research since scientific knowledge is obtained during routine clinical large-scale practice and not experimentally as occurs in the highly controlled traditional clinical trials. Particularly, the electronic health records (EHRs) are a relevant source of data. Nevertheless, there are also significant challenges in the correct use and interpretation of EHRs data, such as bias, heterogeneity of the population, and missing or non-standardized data formats. Despite the RWD and RWE recognized difficulties, these are easily outweighed by the benefits of ensuring the efficacy, safety, and cost-effectiveness in complement to the gold standards of the randomized controlled trial (RCT), namely by providing a complete picture regarding factors and variables that can guide robust clinical decisions. Their relevance can be even further evident as healthcare units develop more accurate EHRs always in the respect for the privacy of patient data. This editorial is an overview of the RWD and RWE major aspects of the state of the art and supports the Special Issue on "Digital Health and Big Data Analytics: Implications of Real-World Evidence for Clinicians and Policymakers" aimed to explore all the potential and the utility of RWD and RWE in offering insights on diseases in a broad spectrum.