Methodological gaps in the assessment of risk minimization interventions: a systematic review

The Reporting Recommendations Intended for Pharmaceutical Risk Minimization Evaluation Studies: Standards for Reporting of Implementation Studies Extension (RIMES-SE)

INTRODUCTION

The Reporting recommendations Intended for pharmaceutical risk Minimization Evaluation Studies (RIMES) was developed to improve the quality of reporting of risk minimization program evaluations. In light of continued inadequacies in study reporting, and high-profile program implementation failures, we updated the RIMES Checklist to incorporate additional concepts from the Standards for Reporting of Implementation studies (StaRI).

METHODS

The development of the updated checklist, the RIMES-StaRI Extension (RIMES-SE), entailed developing a study protocol and drafting an initial pool of items based on a mapping of the RIMES against the StaRI checklist. A modified e-Delphi exercise was then conducted to determine the importance and understandability of items for checklist inclusion. An expert workshop and an online commentary period for additional feedback followed.

RESULTS

The RIMES-SE contains 27 items. It includes two signature features of the StaRI Checklist: 1) a dual strand of items (represented in two columns) describing the risk minimization program (the 'intervention') and the corresponding implementation strategy; and 2) applicable to an array of different research methodologies.

CONCLUSIONS

The RIMES-SE Statement and Checklist extends the reporting guidelines set forth in the original RIMES Checklist via inclusion of key implementation science concepts. It is intended to improve the quality and transparency of reporting of risk minimization evaluation studies so as to advance drug safety science.

Behavioral Science: Enhancing Our Approach to the Development of Effective Additional Risk Minimization Strategies

Additional risk minimization strategies may be required to assure a positive benefit-risk balance for some therapeutic products associated with serious adverse drug reactions/risks of use, without which these products may be otherwise unavailable to patients. The goals of risk minimization strategies are often fundamentally to influence the behavior of healthcare professionals (HCPs) and/or patients and can include appropriate patient selection, provision of education and counselling, appropriate medication use, adverse drug reaction monitoring, and adoption of other elements to assure safe use, such as pregnancy prevention. Current approaches to additional risk minimization strategy development rely heavily on information provision, without full consideration of the contextual factors and multi-level influences on patient and HCP behaviors that impact adoption and long-term adherence to these interventions. Application of evidence-based behavioral science methods are urgently needed to improve the quality and effectiveness of these strategies. Evidence from the fields of adherence, health promotion, and drug utilization research underscores the value and necessity for using established behavioral science frameworks and methods if we are to achieve clinical safety goals for patients. The current paper aims to enhance additional risk minimization strategy development and effectiveness by considering how a behavioral science approach can be applied, drawing from evidence in understanding of engagement with pharmaceutical medicines as well as wider public health interventions for patients and HCPs.

The use of implementation science theories, models, and frameworks in implementation research for medicinal products: A scoping review

BACKGROUND

The uptake, adoption and integration of new medicines and treatment regimens within healthcare delivery can take a decade or more. Increasingly, implementation science (IS) research is being used to bridge this gap between the availability of new therapeutic evidence and its actual application in clinical practice. Little is known, however, about the quality of IS research in this area, including the degree to which theories, models and frameworks (TMFs) are being used. The objective of this study was to conduct a scoping review of the use of TMFs in implementation research involving medicinal products.

METHODS

A search was conducted for English language abstracts and manuscripts describing the application of TMFs in IS studies for medicinal products. Eligible publications were those published between 1 January 1974 and 12 December 2022. All records were screened at the title and abstract stage; included full-text papers were abstracted using data extraction tables designed for the study. Study quality was appraised using the Implementation Research Development Tool.

RESULTS

The initial scoping search identified 2697 publications, of which 9 were ultimately eligible for inclusion in the review. Most studies were published after 2020 and varied in their objectives, design and therapeutic area. Most studies had sample sizes of fewer than 50 participants, and all focused on the post-marketing phase of drug development. The TMF most frequently used was the Consolidated Framework for Implementation Research (CFIR). Although most studies applied all TMF domains, TMF use was limited to instrument development and/or qualitative analysis. Quality appraisals indicated the need for engaging patients and other stakeholders in the implementation research, reporting on the cost of implementation strategies, and evaluating the unintended consequences of implementation efforts.

CONCLUSIONS

We found that few IS studies involving medicinal products reported using TMFs. Those that did encompassed a wide variety of therapeutic indications and medicinal products; all were in the post-marketing phase and involved limited application of the TMFs. Researchers should consider conducting IS in earlier phases of drug development and integrating the TMFs throughout the research process. More consistent and in-depth use of TMFs may help advance research in this area.

Duration of Effectiveness Evaluation of Additional Risk Minimisation Measures for Centrally Authorised Medicinal Products in the EU Between 2012 and 2021

INTRODUCTION

In studies evaluating the effectiveness of additional risk minimisation measures (aRMMs), the need for speed must be properly balanced with the quality of the study. We assessed the duration of aRMM effectiveness evaluations, using additional pharmacovigilance activities, for centrally authorised medicinal products in the European Union.

METHODS

We established a cohort of medicinal products with aRMMs at marketing authorisation (MA) that were centrally authorised from July 2012-December 2021 using the European Public Assessment Reports. Evaluation studies were identified from the Risk Management Plans at the time of MA. Subsequently, we retrieved protocols, final study reports, Pharmacovigilance Risk Assessment Committee (PRAC) assessment reports, and PRAC minutes. We calculated the probability of completing an effectiveness evaluation within 60 months after MA using time-to-event analyses. Besides, we compared the planned final report with the actual final report date.

RESULTS

We identified 134 medicinal products authorised with aRMMs, of which almost half (n = 63, 47.0%) had an effectiveness evaluation study. The probability of an evaluation for a medicinal product being completed within 60 months after MA was 20.7% (95% CI 6.8-32.6). Regarding study design, the probability of completing a study was higher for cross-sectional studies when compared to cohort studies (p = 0.002). Moreover, 81.0% of studies were delayed when compared to their planned final report date.

CONCLUSION

The probability of completing an aRMM effectiveness evaluation at time for renewal of the MA was only one in five. Furthermore, estimates of the duration of studies around MA are too optimistic, with the majority being delayed.

Improving the Safety of Medicines via Digital Technology: An Assessment of the Scope and Quality of Risk Minimization Websites in the United States and United Kingdom

INTRODUCTION

EHealth holds tremendous promise for enhancing drug safety initiatives known as risk minimization programs. Little is known, however, regarding the scope and quality of existing risk minimization websites.

METHODS

Two publicly accessible repositories, REMS@FDA [1] and Electronic Medicines Compendium [2], were reviewed to identify all regulatorily approved risk minimization programs in the United States (US) and United Kingdom (UK) with websites. Website quality was evaluated using the Enlight Quality Assessment tool, a psychometrically validated instrument that addresses seven quality domains.

RESULTS

Ninety-three websites were identified: 59 for healthcare professionals (7 UK/52 US), and 34 for patients (5 UK/29 US). The websites functioned chiefly as archives for electronic copies of educational materials; a subset (31/93) had additional features. Mean quality ratings for Usability (mean 4.70, SD 0.59), Visual Design (mean 4.03, SD 0.87) and Content (mean 4.31, SD 0.82) were good. General Subjective Evaluation was fair (mean 3.15, SD 1.21). Mean scores for Therapeutic Alliance and Therapeutic Persuasiveness were poor (mean 2.62, SD 1.47; and mean 2.50, SD 1.48, respectively); those for User Engagement were very poor (mean 2.25, SD 1.03). No differences were found by target audience but several were identified based on region.

CONCLUSIONS

Risk minimization websites are easy to navigate and well organized. Few, however, incorporate eHealth design elements that facilitate user engagement, build therapeutic alliance and exert therapeutic persuasiveness. Such elements can enhance program uptake and effectiveness. Results highlight opportunities for improving the quality of risk minimization websites and their ability to bridge pharmaceutical and healthcare systems.

Influence of drug safety advisories on drug utilisation: an international interrupted time series and meta-analysis

Objective

To evaluate the association between regulatory drug safety advisories and changes in drug utilisation.

Design

We conducted controlled, interrupted times series analyses with administrative prescription claims data to estimate changes in drug utilisation following advisories. We used random-effects meta-analysis with inverse-variance weighting to estimate the average postadvisory change in drug utilisation across advisories.

Study population

We included advisories issued in Canada, Denmark, the UK and the USA during 2009–2015, mainly concerning drugs in common use in primary care. We excluded advisories related to over-the-counter drugs, drug-drug interactions, vaccines, drugs used primarily in hospital and advisories with co-interventions within ±6 months.

Main outcome measures

Change in drug utilisation, defined as actual versus predicted percentage change in the number of prescriptions (for advisories without dose-related advice), or in the number of defined daily doses (for dose-related advisories), per 100 000 population.

Results

Among advisories without dose-related advice (n=20), the average change in drug utilisation was −5.83% (95% CI −10.93 to –0.73; p=0.03). Advisories with dose-related advice (n=4) were not associated with a statistically significant change in drug utilisation (−1.93%; 95% CI −17.10 to 13.23; p=0.80). In a post hoc subgroup analysis of advisories without dose-related advice, we observed no statistically significant difference between the change in drug utilisation following advisories with explicit prescribing advice, such as a recommendation to consider the risk of a drug when prescribing, and the change in drug utilisation following advisories without such advice.

Conclusions

Among safety advisories issued on a wide range of drugs during 2009–2015 in 4 countries (Canada, Denmark, the UK and the USA), the association of advisories with changes in drug utilisation was variable, and the average association was modest.

Effectiveness of Additional Risk Minimization Measures for Atezolizumab in the European Union

BACKGROUND

A Guide for Healthcare Professionals (HCP Guide) and patient alert card (PAC) for atezolizumab as additional risk minimization measures for physicians were distributed to raise awareness and help in the detection and management of immune-related adverse drug reactions.

OBJECTIVES

The main objective of this study was to assess the receipt, knowledge, and behaviors of physicians regarding the atezolizumab HCP Guide and PAC.

METHODS

A multi-country, one-wave, observational, cross-sectional, web-based, self-reported physician survey was conducted to assess the level of knowledge of key messages related to immune-related adverse drug reactions summarized in the atezolizumab HCP Guide and PAC among physicians (oncologists, pulmonologists, and urologists) prescribing atezolizumab in six European countries (Denmark, Germany, Italy, Spain, Sweden, and the UK). Responses regarding the receipt, understanding and use of the materials, and knowledge and behavior related to the HCP Guide and PAC are presented as percentages and continuous scores scaled out of 100 points, with corresponding 95% confidence intervals (CIs).

RESULTS

Among 313 physicians (255 oncologists, 30 pulmonologists, and 28 urologists), 77.4% received the HCP Guide and 74.2% the PAC. The HCP Guide was read by 71.3% of the 267 physicians who received the materials, and the mean usage score was 69.5 (95% CI 66.0-72.9), and 57.1% of physicians had scores ≥ 70. The HCP Guide was completely understood by 85.4% of physicians who had read it. Mean knowledge scores were 63.9 (95% CI 62.1-65.7) and 39.4% of physicians had correct knowledge scores ≥ 70. Mean knowledge scores were 66.8 (95% CI 64.9-68.7) for receipt of both the HCP Guide and PAC, 59.4 (95% CI 55.5-63.4) for one of the materials, and 60.8 (95% CI 55.4-66.2) for having received none of the materials. Mean behavior scores were 78.9 (95% CI 76.8-81.0), and 74.8% of physicians had behavior scores ≥ 70. The mean behavior score was 79.0 (95% CI 76.5-81.5) for those who received both the HCP Guide and PAC, 76.9 (95% CI 72.2-81.5) for receipt of one of the materials, and 81.5 (95% CI 75.0-88.0) for those who received none of the materials.

CONCLUSIONS

The study assessed the effectiveness of the atezolizumab additional risk minimization educational materials among physicians in six European countries, using process indicators. The educational materials reached over 70% of target physicians, 57.1% of whom reported using them. Knowledge and behavior related to immune-related adverse drug reactions for atezolizumab were no better in those who received the additional risk minimization educational materials. The results support the safe use of atezolizumab by these physician groups and contributed to the European Medicines Agency permitting removal of the HCP Guide.

The Use of Real-World Data to Assess the Impact of Safety-Related Regulatory Interventions

The regulation of medicines seeks to ensure the efficacy, safety, and quality of prescription and non-prescription medicines. Given that the conditions under which a medicine's benefits outweigh its risks are complex, it is essential that communications about the safe and effective use of medicines be clear and actionable. Assessing the impact of interventions to improve the safe and effective use of medicines is a developing area, and one in which real-world data are playing an increasingly important role. Although real-world data are commonly used to assess the impact of regulatory interventions, there are several areas where their use could be improved. Specific areas for improvement include assessing regulatory interventions across a wider range of medicines, rather than concentrating on a relatively few therapeutic areas; assessing more clinically relevant outcomes rather than relying on measures such as changes in the number of prescriptions, which may not always correlate with the desired impact; assessing the potential unintended or negative consequences of regulatory interventions; applying methods to address potential confounders; assessing long-term, rather than just short-term, impacts of an intervention; increasing the use of comparator groups, when feasible; and evaluating the impact of regulatory interventions from multiple dimensions, rather than from a single dimension. Expanded use of real-world data could inform some of these efforts, although data sources beyond administrative claims data will likely be necessary to achieve all these goals.

Effectiveness of drug safety measures for reducing the incidence of adverse drug reactions: Post-hoc analysis of data from all-case surveillance of iguratimod using generalized estimating equations

A post-marketing study was performed on all patients who had started treatment with iguratimod, a conventional synthetic disease-modifying antirheumatic drug approved in Japan. During the study period, various safety measures were implemented to reduce risks. We investigated the frequency of adverse drug reactions before and after implementation of each safety measure to examine the preventive effect of these measures. Post-hoc analysis was performed using data from all-case surveillance of iguratimod. The subjects were all of the patients receiving iguratimod for whom safety information was obtained. To identify the time after starting administration when adverse drug reactions were most likely to occur, a generalized linear mixed-effect model was applied for the period from initiation of administration until occurrence of reactions in each patient. The mean incidence of adverse drug reactions per patient was compared before and after the implementation of safety measures by using generalized estimating equations based on a two-sided test, 95% confidence interval, and 5% significance level. The number of patients treated with iguratimod was not related to changes in the number of patients with adverse drug reactions. After implementing precautions regarding co-administration with warfarin and liver dysfunction, the estimated mean incidence rate of adverse drug reactions (95% confidence interval) decreased significantly to 0.73 (0.59-0.90) and 0.72 (0.55-0.94), respectively. Accordingly, some of the implementation of safety measures significantly reduced adverse drug reactions. The effectiveness of safety measures implemented during the all-case surveillance of iguratimod was evaluated, revealing that early implementation of safety measures decreased the incidence of adverse drug reactions.

Evaluating the Effectiveness of Apixaban Additional Risk Minimisation Measures Using Surveys in Europe

Background

Apixaban (ELIQUIS^®) is a direct oral anticoagulant authorised for multiple indications in the European Economic Area (EEA). Additional risk minimisation measures (aRMMs) to address the risk of bleeding include educational materials comprising a Prescriber Guide and Patient Alert Card.

Objectives

This study evaluated effectiveness of the apixaban Prescriber Guide and Patient Alert Card in terms of healthcare professional (HCP) and patient knowledge of associated bleeding risk, as well as material distribution, utilisation and behaviour.

Methods

This non-interventional, cross-sectional study included online surveys in ten countries that represented a high proportion of apixaban usage in the EEA. The HCP source population was based on HCP lists used for communications about and distribution of the risk minimisation materials. Patient recruitment took place via HCPs. Study participants included HCPs involved in apixaban treatment and patients treated with apixaban (or their caregivers) for multiple indications. Data collection took place over an 18-month period between August 2015 and February 2017.

Results

Survey responses from 385 HCPs and 125 patients/caregivers were analysed. HCP knowledge of bleeding risk included early recognition of symptoms requiring immediate contact with an HCP (96.1%), appropriate dosing (83.6%), contraindications (76.1%) and subpopulations at increased risk of bleeding complications (ranging from 63.5 to 85.9%). Patient knowledge included abnormal bleeding as an important side effect (71.2%), communicating risk factors to HCPs (76.8%) and recognition of potential bleeding symptoms (‘high’ knowledge levels 22.4%, ‘moderate’ knowledge levels 49.6%). Of 226 (58.7%) HCPs who recalled receiving/obtaining the Prescriber Guide, 97.8% read at least part of it and 74.8% had used it to assist patient discussions. Of 74 (59.2%) patients who were aware of the Patient Alert Card, 89.2% recalled receiving/obtaining a copy. When received, 90.9% of patients read the card at least once and 93.9% kept it with them at least some of the time.

Conclusions

HCP and patient respondent knowledge of bleeding risk was satisfactory. Although not optimal, reach of the aRMMs was consistent with other studies. No modifications to aRMM content were required. To increase reach, the Prescriber Guide has been provided in an additional format as a web-based platform whilst the Patient Alert Card was included within product packaging.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40290-021-00380-1.

Risk Management for the 21st Century: Current Status and Future Needs

Global adoption of risk management principles outlined in the International Conference on Harmonisation (ICH) E2E guideline and the Council for International Organizations of Medical Sciences (CIOMS) Working Group VI guidance introduced greater proactivity and consistency into the practice of pharmacovigilance and benefit–risk management throughout the lifecycle of a drug. However, following the release of these guidelines there have been important advances in the science and practice of risk minimisation itself, especially in terms of how risk minimisation measures (RMMs) are designed, implemented, disseminated and evaluated for effectiveness in real-world healthcare settings. In this article, we describe how the field of design, implementation, dissemination and evaluation of RMMs has advanced in recent years while highlighting current areas of challenge and possible solutions. Where possible we cite global examples to demonstrate how evidence-based approaches have informed the development of RMMs. In this context, while taking into consideration local healthcare system policies and national legislations, we conclude with a call for a global effort to harmonise certain areas that focus on, but are not limited to, standardising certain terms and definitions, consistent application of robust methodologies, and outline of best practices for risk minimisation design, implementation, and dissemination.

Introduction or Discontinuation of Additional Risk Minimisation Measures During the Life Cycle of Medicines in Europe

Introduction

Additional risk minimisation measures (aRMMs) may be required to minimise important risks of medicines. aRMMs may be required at the time of authorisation, but may also be introduced or discontinued during the product life cycle as new safety information arises. The aim of this study is to describe post-authorisation introductions of new aRMMs and discontinuations of existing aRMMs for medicines authorised in the European Union (EU).

Methods

We performed a retrospective cohort study that included all new active substances authorised through the EU centralised procedure between January 1st 2006 and December 31st 2017. Data was extracted from European Public Assessment Reports available on the website of the European Medicines Agency (ema.europa.eu). Medicines were followed up from the date of marketing authorisation (MA) until first introduction or discontinuation of aRMMs, excluding Direct Healthcare Professional Communications (DHPCs), withdrawal/suspension/revocation of the MA, or July 1st 2018, when data extraction took place. Descriptive statistics were used to analyse frequency data, and survival analysis was used to calculate 5- and 10-year probability of introduction or discontinuation of aRMMs.

Results

A total of 476 medicines were authorised during the study period. The probability of getting aRMMs after authorisation for products authorised without aRMMs was 3.5% [95% confidence interval (CI) 1.2–5.7] within 5 years after authorisation and 6.9% (95% CI 2.6–11) within 10 years after authorisation. For products authorised with aRMMs, the probability of discontinuation of aRMMs was 0.9% (95% CI 0–2.6) within 5 years and 8.3% (95% CI 0–16.1) within 10 years after authorisation.

Conclusions

We found low probabilities of introduction and discontinuation of aRMMs (excluding DHPCs) during the product life cycle for medicines authorised between 2006 and 2017. The low rate of discontinuation may potentially be due to a lack of robust data on effectiveness of aRMMs. Further research is needed to get more insight into the dynamics of aRMMs during the medicine life cycle.

Evaluation of the Effectiveness of Additional Risk Minimization Measures for Voriconazole in the EU: Findings and Lessons Learned from a Healthcare Professional Survey

BACKGROUND

Voriconazole is an extended-spectrum antifungal agent approved for the treatment and prophylaxis of invasive aspergillosis and other serious fungal infections. In 2014, additional risk minimization measures (aRMM) consisting of a Healthcare Professional (HCP) Question and Answer (Q&A) Brochure, HCP Checklist, and Patient Alert Card were implemented on a rolling basis across the European Union (EU) to mitigate three key risks with voriconazole: phototoxicity, squamous cell carcinoma (SCC) of the skin, and hepatotoxicity. The risks of phototoxicity and hepatotoxicity have been documented in the Summary of Product Characteristics (SmPC) since voriconazole was first approved in the EU in 2002. However, the risk of SCC of the skin was a more recent addition to the SmPC (added in 2010).

OBJECTIVES

We evaluated the effectiveness of the aRMM, as per EU Good Pharmacovigilance Practices Module XVI, via a survey of HCPs.

METHODS

An online survey was conducted among specialty care HCPs in 10 EU countries who had received by mail aRMM tools 12 months previously. Survey questions evaluated HCPs' receipt and utilization of aRMM tools, and knowledge of the three risks.

RESULTS

Of 27,396 HCPs invited to participate, 332 eligible respondents completed the survey (response rate: 447/26,735; 1.7%). In total, 19.6% of respondents recalled receiving the HCP Q&A Brochure, 22.6% the HCP Checklist, and 25.9% the Patient Alert Card. HCPs had a high level of knowledge of phototoxicity and hepatotoxicity; however, knowledge of SCC was lower. Knowledge of the three risks and self-reported risk minimization behavior was slightly improved in those who had read the HCP Q&A Brochure compared with those who had not.

CONCLUSION

The effectiveness of the voriconazole aRMM cannot be meaningfully inferred from the results due to the low survey response rate. The assessment indirectly points to the SmPC or other resources being the main source of risk information for HCPs. Engaging HCPs before designing and implementing an aRMM program is crucial to ensure an effective and focused program. (EU PAS registration number: EUPAS12624).

Pre/post effectiveness evaluation of updated additional risk minimisation measures for an orphan disease: Myozyme (alglucosidase alfa) Safety Information Packet

BACKGROUND

The alglucosidase alfa (Myozyme®) Safety Information Packet ("previous SIP") was updated to improve readability and content ("updated SIP"). We compared the previous and updated SIPs.

METHODS

A two-wave pre-post multicountry survey was conducted among health care professionals (HCPs) who prescribed or monitored patients on alglucosidase alfa in the largest European Union ("EU5") countries and Poland. Wave (W) 2 started 15 months after completion of W1 and the implementation of the updated SIP. Changes between the waves were analysed.

RESULTS

Forty-six HCPs (34 physicians/12 nurses) participated in W1 and 52 in W2 (42 physicians/10 nurses); 22 participated in both waves. Nonsignificant differences were observed between waves 1 and 2 for awareness (75.6% in W1 and 82.4% in W2) and receipt (77.7% in W1 and 74.5% in W2) of the SIP, reading (88.6% in W1 and 89.5% in W2) and usage (88.2% in W1 and 89.5% in W2) among receivers of the SIP, or the overall knowledge about immunological testing (61.1% in W1 vs 55.1% in W2). Frequency of performance of immunological testing was significantly higher in W2 than in W1 (50.3% vs 34.4%; P = .024) with a tendency for increases in the appropriate performance of all types of testing in W2.

CONCLUSIONS

Both versions of the SIP showed relatively high awareness, receipt, reading, and usage, with an overall trend for most measures to improve numerically in W2. The updated SIP did not require further changes.

The effectiveness of direct to healthcare professional communication - A systematic review of communication factor studies

BACKGROUND

Direct to healthcare professional communication (DHPC) is the prevalent regulatory measure to inform about and potentially mitigate newly identified drug risks in EU and USA. According to multiple studies and reviews, however, the effectiveness of DHPC to reduce risk is less than optimal. Prior systematic reviews have indicated that contextual, qualitative knowledge of communication factors related to the clinical setting is needed to further explain and supplement findings in quantitative effectiveness studies.

OBJECTIVES

This article systematically reviews studies of DHPC and, on that basis, describes the communication factors that influence the effectiveness of DHPC in order to discuss future research trajectories.

METHODS

PubMed, Scopus (including Embase) and Web of Science databases were searched for studies on communication about emergent drug risk to healthcare professionals, excluding studies limited to the quantifiable effect of communication. The search results were deductively categorized using the Communication Sequence Model. Then, prevalent themes within categories were identified and described using thematic analysis.

RESULTS

A total of 16 studies published between 1993 and 2017 were included; 12 based on surveys, 2 on document analysis, and 2 primarily on interviews. The prevalent themes included "Health Care Professionals (HCPs) have less trust in communication from industry than authorities and medical associations", "HCPs have diverse preferences for how to receive drug risk information" and "Clinical usability of the presented information is less than optimal."

CONCLUSION

Communication factors in DHPCs are multiple, multi-facetted and are examined primarily by surveys. Future research would benefit from identifying nationally dependent factors and employing methods that better provide knowledge on the qualitative reception and handling of drug risk communication.

Are risk minimization measures for approved drugs in Europe effective? A systematic review

Objectives: The effectiveness of risk minimization measures (RMMs) requires evaluation. This study aims to evaluate the results of cross-sectional surveys assessing the effectiveness of RMMs in Europe (EU RM Surveys) and review the regulatory consequences. Methods: The authors searched for study reports and manuscripts of completed EU RM surveys in the EU PAS Register, MEDLINE, and Google between 01/2011 and 01/2018. Regulatory responses were extracted from Assessment Reports. Random effects models to combine proportions were used. Results: Twenty-four EU RM surveys were identified. Twenty-three studies targeted health-care professionals (HCPs). The pre-specified sample size was reached in 52% of studies. HCP participation was 5% defined as completers/invited and 89% for completers/eligible. Receipt of materials was recalled by 60% of HCPs and 77% of items scored knowledge >60%. Eight studies targeted patients/caregivers. The pre-specified sample size was reached in only two. Participation was 93%, defined as completers/eligible. Materials were received by 50-80% of patients and read by over 90%. Patients only scored knowledge >60% in 38% of items. Further action was requested by regulators in 59% of studies. Conclusion: Surveys are necessary to evaluate many RMMs. Challenges remain in the design, conduct, and reporting of these studies which may benefit from the use of standard definitions and further guidance on reporting. EU PAS Register: http://www.encepp.eu/encepp/viewResource.htm?id=23435.

Study design, process and outcome indicators of post-authorization studies aimed at evaluating the effectiveness of risk minimization measures in the EU PAS Register

Risk minimization measures (RMMs) represent an essential tool for preventing the occurrence of safety-related outcomes. The evaluation of RMMs effectiveness is essential to prove their success and ensure protection of public health. The aim of this qualitative review was to assess the design, process and outcome indicators used for attesting successful implementation of RMMs. We searched the EU Post-Authorization Studies Register up to 30 June 2018 for studies having the scope defined as 'effectiveness evaluation'. Study titles and objectives were screened to select the ones evaluating the effectiveness of RMMs. We described and assessed the extent to which these studies aligned with Good Pharmacovigilance Practices guidelines recommendations. Out of 360 registered studies, we identified 35 studies on evaluation of RMMs effectiveness, 29 being eligible for review. Twenty-six studies evaluated additional RMMs, employed in case routine interventions are considered insufficient. All studies assessed process indicators, five also assessing outcome indicators, thus using a dual-evidence approach as recommended by the guidelines. However, none of the latter used a pre-post design, comparing the frequency of the adverse outcome before and after the implementation of RMMs. Behaviour and knowledge were the most often assessed process indicators. Outcome indicators included occurrence of adverse reactions, pregnancy, off-label use and medication errors. Only four studies had an established threshold, all for process indicators. Stricter adherence to existing recommendations would allow for a more robust design for reaching established endpoints for RMM effectiveness evaluation. It would also infer harmonization, facilitate review and further more detailed guidance on conducting these studies.

Study Design and Evaluation of Risk Minimization Measures: A Review of Studies Submitted to the European Medicines Agency for Cardiovascular, Endocrinology, and Metabolic Drugs

Introduction

Studies measuring the effectiveness of risk minimization measures (RMMs) submitted by pharmaceutical companies to the European Medicines Agency are part of the post-authorization regulatory requirements and represent an important source of data covering a range of medicinal products and safety-related issues. Their objectives, design, and the associated regulatory outcomes were reviewed, and conclusions were drawn that may support future progress in risk minimization evaluation.

Methods

Information was obtained from risk management plans, study protocols, clinical study reports, and assessment reports of 157 medicinal products authorized for cardiovascular, endocrinology, and metabolic indications. We selected observational studies measuring, as outcomes of interest, the relationship between the RMMs in place and (1) implementation measures, such as clinical knowledge or physicians` compliance to recommendations contained in the RMMs; and (2) occurrence or reduced severity of the adverse drug reactions for which the RMMs were required.

Results

Of 59 eligible studies (24 completed, 35 ongoing), 44 assessed implementation measures, whereas only 15 assessed safety outcomes (1 study as a single endpoint and 14 studies with other endpoints). Fifty-one studies used non-experimental designs and 25 studies employed electronic healthcare databases for analysis. Of the 24 completed studies, 17 were considered satisfactory and supported immediate regulatory decision making, 6 were considered inconclusive and required new evaluations, and 1 was terminated early because new safety restrictions were required, thereby necessitating a new evaluation. Compliance with agreed deadlines was considered acceptable in 21 of 24 completed studies; the average time for a submission was 37 months (standard deviation ± 17), with differences observed by type of data source employed.

Conclusions

Three important gaps in the evaluation plans of RMMs were identified: lack of early feedback on implementation, limited evaluation of safety outcomes, and inability to provide information on the effectiveness from an integrated measurement of different elements of a set of risk minimization tools. More robust evidence is needed to advance regulatory science and support more rapid adjustment of risk minimization strategies as needed.

Electronic supplementary material

The online version of this article (doi:10.1007/s40264-017-0604-4) contains supplementary material, which is available to authorized users.

The RIMES Statement: A Checklist to Assess the Quality of Studies Evaluating Risk Minimization Programs for Medicinal Products

INTRODUCTION

Pharmaceutical risk minimization programs involve interventions designed to support safe and appropriate use of medicines. Currently, information regarding the evaluation of these programs is not publicly reported in a standardized and transparent manner. To address this gap, we developed and piloted a quality reporting checklist entitled the Reporting recommendations Intended for pharmaceutical risk Minimization Evaluation Studies (RIMES).

METHODS

Checklist development was guided by three sources: (1) a theoretical framework derived from program theory and process evaluation; (2) public health intervention design and evaluation principles; and (3) a review of existing quality reporting checklists. Two raters independently reviewed 10 recently published (2012-2016) risk minimization program evaluation studies using the proposed checklist. Inter-rater reliability of the checklist was assessed using Cohen's Kappa and Gwet's AC1.

RESULTS

A 43-item checklist was generated. Results indicated substantial inter-rater reliability overall (κ = 0.65, AC1 = 0.65) and for three (key information, design and evaluation) of the four subscales (κ ≥ 0.64, AC1 ≥ 0.64). The fourth subscale (implementation) showed low reliability based on Cohen's Kappa, but substantial reliability based on the AC1 (κ = 0.17, AC1 = 0.61).

CONCLUSIONS

The RIMES statement augments relevant elements from existing quality reporting guidelines with items that address aspects of intervention design, implementation and evaluation specific to pharmaceutical risk minimization programs. Our results show that the RIMES statement reliably measures key dimensions of reporting quality. This tailored checklist is an important first step in improving the reporting quality of risk minimization evaluation studies and may ultimately help to improve the quality of these interventions themselves.

A review of studies evaluating the effectiveness of risk minimisation measures in Europe using the European Union electronic Register of Post-Authorization Studies

PURPOSE

An important element of risk management is the planning and implementation of risk minimisation measures (RMMs) and the evaluation of their effectiveness by process or outcome indicators. The aim of this review is to summarize the characteristics of risk minimisation (RM) effectiveness studies in Europe and provide an overview of RMMs and their effectiveness.

METHODS

This was a qualitative review of RM effectiveness studies in the European Union electronic Register of Post-Authorization Studies (EU PAS Register); data extracted included study design, population, sample size, data sources, drug information, RMMs, study period, indicators, and their reported effectiveness.

RESULTS

Of the 872 records in the EU PAS Register, 19 studies evaluating the effectiveness of RMMs were included. Eleven were cross-sectional surveys and 8 used secondary data sources. Eighty-nine percent (17/19) evaluated additional RMMs (used when routine RMMs are considered insufficient), and 36% (7/19) evaluated changes in routine RMMs (applicable to all medicinal products). A total of 42 effectiveness indicators were identified: 18 process and 24 outcomes. Half of the indicators (21/42) were successful; 2% (1/42) indicators were partially successful; 17% (7/42) indicators were inconclusive. Effectiveness of the remaining 31% (13/42) indicators could not be determined owing to limited information. The United Kingdom was the most frequent country for the conduct of RM effectiveness studies.

CONCLUSIONS

Most of the included studies evaluated additional RMMs. Half of the effectiveness indicators (process and/or outcome) were reported as successful. This review provides evidence to support the development of future guidance on the effectiveness of RM in Europe.

Measuring the impact of medicines regulatory interventions - Systematic review and methodological considerations

AIMS

Evaluating the public health impact of regulatory interventions is important but there is currently no common methodological approach to guide this evaluation. This systematic review provides a descriptive overview of the analytical methods for impact research.

METHODS

We searched MEDLINE and EMBASE for articles with an empirical analysis evaluating the impact of European Union or non-European Union regulatory actions to safeguard public health published until March 2017. References from systematic reviews and articles from other known sources were added. Regulatory interventions, data sources, outcomes of interest, methodology and key findings were extracted.

RESULTS

From 1246 screened articles, 229 were eligible for full-text review and 153 articles in English language were included in the descriptive analysis. Over a third of articles studied analgesics and antidepressants. Interventions most frequently evaluated are regulatory safety communications (28.8%), black box warnings (23.5%) and direct healthcare professional communications (10.5%); 55% of studies measured changes in drug utilization patterns, 27% evaluated health outcomes, and 18% targeted knowledge, behaviour or changes in clinical practice. Unintended consequences like switching therapies or spill-over effects were rarely evaluated. Two-thirds used before-after time series and 15.7% before-after cross-sectional study designs. Various analytical approaches were applied including interrupted time series regression (31.4%), simple descriptive analysis (28.8%) and descriptive analysis with significance tests (23.5%).

CONCLUSION

Whilst impact evaluation of pharmacovigilance and product-specific regulatory interventions is increasing, the marked heterogeneity in study conduct and reporting highlights the need for scientific guidance to ensure robust methodologies are applied and systematic dissemination of results occurs.

Do FDA label changes work? Assessment of the 2010 class label change for proton pump inhibitors using the Sentinel System's analytic tools

PURPOSE

To pilot use of the US Food and Drug Administration's (FDA's) Sentinel System data and analytic tools by a non-FDA stakeholder through the Innovation in Medical Evidence Development and Surveillance system of the Reagan Udall Foundation. We evaluated the US FDA 2010 proton pump inhibitor (PPI) class label change that warned of increased risk of bone fracture, to use PPIs for the lowest dose and shortest duration, and to manage bone status for those at risk for osteoporosis.

METHODS

The cohort consisted of adults aged 18 years or older prescribed PPIs without fracture risk factors. We evaluated incident and prevalent uses of the 8 PPIs noted in the label change. Outcomes evaluated before and after label change were PPI dispensing patterns, incident fractures, and osteoporosis screening or interventions. Consistent with FDA use of descriptive tools, we did not include direct comparisons or statistical testing.

RESULTS

There were 1 488 869 and 2 224 420 incident PPI users in the before [PRE] and after [POST] periods, respectively. Users with 1 year or more of exposure decreased (8.4% vs 7.5%), as did mean days supplied/user (130.4 to 113.7 d among all users and 830.8 to 645.4 d among users with 1 y or more of exposure). Osteoporosis screening and interventions did not appear to increase, but the proportion of patients with fractures decreased (4.4% vs 3.1%). Prevalent user results were similar.

CONCLUSIONS

This analysis demonstrated the ability to use Sentinel tools to assess the effectiveness of a label change and accompanying communication at the population level and suggests an influence on subsequent dispensing behavior.

Evaluation of Risk-Minimization Activities for Cyproterone Acetate 2 mg/Ethinylestradiol 35 µg: A Cross-Sectional Physician Survey

Background

Cyproterone acetate 2 mg/ethinylestradiol 35 µg, an estrogen/progestogen treatment with anti-androgenic properties, shares a thromboembolism risk with combined hormonal contraceptives. Educational materials (i.e., direct healthcare professional communication, patient information card, prescriber checklist) were distributed to physicians to increase risk awareness.

Objective

The objective of this study was to measure physician knowledge of thromboembolism risk of cyproterone acetate 2 mg/ethinylestradiol 35 µg and ascertain whether physicians received the educational materials.

Methods

A cross-sectional web-based physician survey of recent prescribers of cyproterone acetate 2 mg/ethinylestradiol 35 µg in Austria, the Czech Republic, France, the Netherlands, and Spain was conducted. Sampling targets for physician specialty were based on country-specific prescribing patterns. Frequency of correct responses was calculated for 14 knowledge questions.

Results

Among 759 physician respondents (37% of obstetricians/gynecologists, 42% of general practitioners, 20% of dermatologists), 51% received one or more of three educational materials. Knowledge was highest (≥80%) for symptoms of possible deep vein thrombosis, pulmonary embolism, and cerebrovascular accident; most important risk factors for thrombosis; use in smokers; indication for moderate-to-severe acne; and understanding that cyproterone acetate 2 mg/ethinylestradiol 35 µg should not be used for contraception alone. Knowledge varied for contraindications, myocardial infarction symptoms, other risk factors for thrombosis, instructions regarding anticipated prolonged immobilization, and selected concomitant medical conditions. Knowledge was lower regarding prescribing cyproterone acetate 2 mg/ethinylestradiol 35 µg for acne only after failure of topical therapy or systemic antibiotics. Generally, knowledge did not vary by physician specialty, receipt of educational materials, number of patients prescribed cyproterone acetate 2 mg/ethinylestradiol 35 µg in the previous 3 months, and years in practice.

Conclusions

Knowledge was generally high for thromboembolism risk and varied for more complex or infrequent topics.

Electronic supplementary material

The online version of this article (doi:10.1007/s40290-017-0203-9) contains supplementary material, which is available to authorized users.

A multinational, drug utilization study to investigate the use of dexmedetomidine (Dexdor®) in clinical practice in the EU

Aims

Dexmedetomidine (dexdor®) is approved in the European Union (EU) for sedation of adults in the intensive care unit (ICU). The present observational, retrospective study was requested by the European Medicines Agency to investigate dexmedetomidine use in clinical practice, with a particular focus on off‐label use, including the paediatric population.

Methods

Study countries and sites were chosen from those with highest dexmedetomidine use, based on sales. Site selection (blind) was conducted by a multispecialist, independent group. Anonymized data on demographics, treatment indication, dexmedetomidine dosing, concomitant medications and treatment effectiveness were collected retrospectively from records of all dexmedetomidine‐treated patients at the site during the enrolment period. Informed consent was waived, to avoid influencing the prescribing of dexmedetomidine. Recruitment was completed within 18 months of first site initiation.

Results

Data from 2000 patients were collected from 16 hospitals in four EU countries (Finland 750, Poland 505, Germany 470, Austria 275). The median age was 62 years, with more males (70.2%) than females. Dexmedetomidine was primarily used in the adult ICU (86.0%) for ICU sedation (78.6%) and mostly dosed according the product label. The intended sedative effect was obtained in 84.9% of administrations. Paediatric use (5.9% of patients, mostly in Austria and Finland) occurred mainly in the adult or paediatric ICU (75.6%) for sedation (67.2%).

Conclusions

Overall, most patients were treated with dexmedetomidine according to the product labelling. Use in children was limited but significant and similar in scope to that in adults. Administrations not fully according to the product labelling usually occurred in an ICU environment and reflected extensively investigated clinical uses of dexmedetomidine.

Evaluating the effectiveness of risk minimisation measures: the application of a conceptual framework to Danish real-world dabigatran data

PURPOSE

For both marketing authorization holders and regulatory authorities, evaluating the effectiveness of risk minimization measures is now an integral part of pharmacovigilance in the European Union. The overall aim of activities in this area is to assess the performance of risk minimization measures implemented in order to ensure a positive benefit-risk balance in patients treated with a medicinal product.

METHODS

Following a review of the relevant literature, we developed a conceptual framework consisting of four domains (data, knowledge, behaviour and outcomes) intended for the evaluation of risk minimization measures put into practice in the Danish health-care system. For the implementation of the framework, four classes of monitoring variables can be named and defined: patient descriptors, performance-related indicators of knowledge, behaviour and outcomes.

RESULTS

We reviewed the features of the framework when applied to historical, real-world data following the introduction of dabigatran in Denmark for the prophylactic treatment of patients with non-valvular atrial fibrillation.

CONCLUSIONS

The application of the framework provided useful graphical displays and an opportunity for a statistical evaluation (interrupted time series analysis) of a regulatory intervention. © 2017 Commonwealth of Australia. Pharmacoepidemiology & Drug Safety © 2017 John Wiley & Sons, Ltd.

Advancing the field of pharmaceutical risk minimization through application of implementation science best practices

Regulators are increasingly mandating the use of pharmaceutical risk-minimization programs for a variety of medicinal products. To date, however, evaluations of these programs have shown mixed results and relatively little attention has been directed at diagnosing the specific factors contributing to program success or lack thereof. Given the growing use of these programs in many different patient populations, it is imperative to understand how best to design, deliver, disseminate, and assess them. In this paper, we argue that current approaches to designing, implementing, and evaluating risk-minimization programs could be improved by applying evidence- and theory-based ‘best practices’ from implementation science. We highlight commonly encountered challenges and gaps in the design, implementation, and evaluation of pharmaceutical risk-minimization initiatives and propose three key recommendations to address these issues: (1) risk-minimization program design should utilize models and frameworks that guide what should be done to produce successful outcomes and what questions should be addressed to evaluate program success; (2) intervention activities and tools should be theoretically grounded and evidence based; and (3) evaluation plans should incorporate a mixed-methods approach, pragmatic trial designs, and a range of outcomes. Regulators, practitioners, policy makers, and researchers are encouraged to apply these best practices in order to improve the public health impact of this important regulatory tool.

Integrating risk minimization planning throughout the clinical development and commercialization lifecycle: an opinion on how drug development could be improved

Pharmaceutical risk minimization programs are now an established requirement in the regulatory landscape. However, pharmaceutical companies have been slow to recognize and embrace the significant potential these programs offer in terms of enhancing trust with health care professionals and patients, and for providing a mechanism for bringing products to the market that might not otherwise have been approved. Pitfalls of the current drug development process include risk minimization programs that are not data driven; missed opportunities to incorporate pragmatic methods and market-based insights, outmoded tools and data sources, lack of rapid evaluative learning to support timely adaption, lack of systematic approaches for patient engagement, and questions on staffing and organizational infrastructure. We propose better integration of risk minimization with clinical drug development and commercialization work streams throughout the product lifecycle. We articulate a vision and propose broad adoption of organizational models for incorporating risk minimization expertise into the drug development process. Three organizational models are discussed and compared: outsource/external vendor, embedded risk management specialist model, and Center of Excellence.