Artificial Intelligence in Pharmacovigilance: Scoping Points to Consider

Artificial intelligence integration in the drug lifecycle and in regulatory science: policy implications, challenges and opportunities

Artificial intelligence tools promise transformative impacts in drug development. Regulatory agencies face challenges in integrating AI while ensuring reliability and safety in clinical trial approvals, drug marketing authorizations, and post-market surveillance. Incorporating these technologies into the existing regulatory framework and agency practices poses notable challenges, particularly in evaluating the data and models employed for these purposes. Rapid adaptation of regulations and internal processes is essential for agencies to keep pace with innovation, though achieving this requires collective stakeholder collaboration. This article thus delves into the need for adaptations of regulations throughout the drug development lifecycle, as well as the utilization of AI within internal processes of medicine agencies.

Application of machine learning models to animal health pharmacovigilance: A proof-of-concept study

Machine learning (ML) models were applied to pharmacovigilance (PV) data in a two-component proof-of-concept study. PV data were partitioned into Training, Validation, and Holdout datasets for model training and selection. During the first component ML models were challenged to identify factors in individual case safety reports (ICSRs) involving spinosad and neurological and ocular clinical signs. The target feature for the models were these clinical signs that were disproportionately reported for spinosad. The endpoints were normalized coefficient values representing the relationship between the target feature and ICSR free text fields. The deployed model accurately identified the risk factors "demodectic," "demodicosis," and "ivomec." In the second component, the ML models were trained to identify high quality and complete ICSRs free of confounders. The deployed model was presented with an external Test dataset of six ICSRs, one that was complete, of high quality, and devoid of confounders, and five that were not. The endpoints were model-generated probabilities for the ICSRs. The deployed ML model accurately identified the ICSR of interest with a greater than 10-fold higher probability score. Although narrow in scope, the study supports further investigation and potential application of ML models to animal health PV data.

What place for intelligent automation and artificial intelligence to preserve and strengthen vigilance expertise in the face of increasing declarations?

In 2018, the "Ateliers de Giens" (Giens Workshops) devoted a workshop to artificial intelligence (AI) and led its experts to confirm the potential contribution and theoretical benefit of AI in clinical research, pharmacovigilance, and in improving the efficiency of care. The 2022 workshop is a continuation of this reflection on AI and intelligent automation (IA) by focusing on its contribution to pharmacovigilance and the applications and tasks could be optimized to preserve and strengthen medical and pharmacological expertise in pharmacovigilance. The evolution of pharmacovigilance work is characterized by many tasks with low added value, a growing volume of pharmacovigilance reporting of suspected side effects, and a scarcity of medical staff with expertise in clinical pharmacology and pharmacovigilance and human resources to support this growing need. Together, these parameters contribute to an embolization of the pharmacovigilance system at risk of missing its primary mission: to identify and characterize a risk or even a health alert on a drug. The participants of the workshop (representatives of the Regional Pharmacovigilance Centres (CRPV), the French National Agency for Safety of Medicinal Products (ANSM), patients, the pharmaceutical industry, or start-ups working in the development of AI in the field of medicine) shared their experiences, their pilot projects and their expectations on the expected potential, theoretical or proven, AI and IA. This work has made it possible to identify the needs and challenges that AI or IA represent, in the current or future modes of organization of pharmacovigilance activities. This approach led to the development of a SWOT matrix (strengths, weaknesses, opportunities, threats), a basis for reflection to identify critical points and consider four main recommendations: (1) preserve and develop business expertise in pharmacovigilance (including research and development in methods) with the integration of new technologies; (2) improve the quality of pharmacovigilance reports; (3) adapt technical and regulatory means; (4) implement a development strategy for AI and IA tools at the service of expertise.

Industry Perspective on Artificial Intelligence/Machine Learning in Pharmacovigilance

TransCelerate reports on the results of 2019, 2020, and 2021 member company (MC) surveys on the use of intelligent automation in pharmacovigilance processes. MCs increased the number and extent of implementation of intelligent automation solutions throughout Individual Case Safety Report (ICSR) processing, especially with rule-based automations such as robotic process automation, lookups, and workflows, moving from planning to piloting to implementation over the 3 survey years. Companies remain highly interested in other technologies such as machine learning (ML) and artificial intelligence, which can deliver a human-like interpretation of data and decision making rather than just automating tasks. Intelligent automation solutions are usually used in combination with more than one technology being used simultaneously for the same ICSR process step. Challenges to implementing intelligent automation solutions include finding/having appropriate training data for ML models and the need for harmonized regulatory guidance.

Integrating machine learning with electronic health record data to facilitate detection of prolactin level and pharmacovigilance signals in olanzapine-treated patients

BACKGROUND AND AIM

Available evidence suggests elevated serum prolactin (PRL) levels in olanzapine (OLZ)-treated patients with schizophrenia. However, machine learning (ML)-based comprehensive evaluations of the influence of pathophysiological and pharmacological factors on PRL levels in OLZ-treated patients are rare. We aimed to forecast the PRL level in OLZ-treated patients and mine pharmacovigilance information on PRL-related adverse events by integrating ML and electronic health record (EHR) data.

METHODS

Data were extracted from an EHR system to construct an ML dataset in 672×384 matrix format after preprocessing, which was subsequently randomly divided into a derivation cohort for model development and a validation cohort for model validation (8:2). The eXtreme gradient boosting (XGBoost) algorithm was used to build the ML models, the importance of the features and predictive behaviors of which were illustrated by SHapley Additive exPlanations (SHAP)-based analyses. The sequential forward feature selection approach was used to generate the optimal feature subset. The co-administered drugs that might have influenced PRL levels during OLZ treatment as identified by SHAP analyses were then compared with evidence from disproportionality analyses by using OpenVigil FDA.

RESULTS

The 15 features that made the greatest contributions, as ranked by the mean (|SHAP value|), were identified as the optimal feature subset. The features were gender_male, co-administration of risperidone, age, co-administration of aripiprazole, concentration of aripiprazole, concentration of OLZ, progesterone, co-administration of sulpiride, creatine kinase, serum sodium, serum phosphorus, testosterone, platelet distribution width, α-L-fucosidase, and lipoprotein (a). The XGBoost model after feature selection delivered good performance on the validation cohort with a mean absolute error of 0.046, mean squared error of 0.0036, root-mean-squared error of 0.060, and mean relative error of 11%. Risperidone and aripiprazole exhibited the strongest associations with hyperprolactinemia and decreased blood PRL according to the disproportionality analyses, and both were identified as co-administered drugs that influenced PRL levels during OLZ treatment by SHAP analyses.

CONCLUSIONS

Multiple pathophysiological and pharmacological confounders influence PRL levels associated with effective treatment and PRL-related side-effects in OLZ-treated patients. Our study highlights the feasibility of integration of ML and EHR data to facilitate the detection of PRL levels and pharmacovigilance signals in OLZ-treated patients.

Artificial Intelligence-Based Pharmacovigilance in the Setting of Limited Resources

With the rapid development of artificial intelligence (AI) technologies, and the large amount of pharmacovigilance-related data stored in an electronic manner, data-driven automatic methods need to be urgently applied to all aspects of pharmacovigilance to assist healthcare professionals. However, the quantity and quality of data directly affect the performance of AI, and there are particular challenges to implementing AI in limited-resource settings. Analyzing challenges and solutions for AI-based pharmacovigilance in resource-limited settings can improve pharmacovigilance frameworks and capabilities in these settings. In this review, we summarize the challenges into four categories: establishing a database for an AI-based pharmacovigilance system, lack of human resources, weak AI technology and insufficient government support. This study also discusses possible solutions and future perspectives on AI-based pharmacovigilance in resource-limited settings.

Identifying Actionability as a Key Factor for the Adoption of 'Intelligent' Systems for Drug Safety: Lessons Learned from a User-Centred Design Approach

Introduction

Information technology (IT) plays an important role in the healthcare landscape via the increasing digitization of medical data and the use of modern computational paradigms such as machine learning (ML) and knowledge graphs (KGs). These ‘intelligent’ technical paradigms provide a new digital ‘toolkit’ supporting drug safety and healthcare processes, including ‘active pharmacovigilance’. While these technical paradigms are promising, intelligent systems (ISs) are not yet widely adopted by pharmacovigilance (PV) stakeholders, namely the pharma industry, academia/research community, drug safety monitoring organizations, regulatory authorities, and healthcare institutions. The limitations obscuring the integration of ISs into PV activities are multifaceted, involving technical, legal and medical hurdles, and thus require further elucidation.

Objective

We dissect the abovementioned limitations by describing the lessons learned during the design and implementation of the PVClinical platform, a web platform aiming to support the investigation of potential adverse drug reactions (ADRs), emphasizing the use of knowledge engineering (KE) as its main technical paradigm.

Results

To this end, we elaborate on the related ‘business processes’ (i.e. operational processes) and ‘user goals’ identified as part of the PVClinical platform design process based on Design Thinking principles. We also elaborate on key challenges restricting the adoption of such ISs and their integration in the clinical setting and beyond.

Conclusions

We highlight the fact that beyond providing analytics and useful statistics to the end user, ‘actionability’ has emerged as the operational priority identified through the whole process. Furthermore, we focus on the needs for valid, reproducible, explainable and human-interpretable results, stressing the need to emphasize on usability.