Recent advances in methodology for clinical trials in small populations: the InSPiRe project

Study design challenges and strategies in clinical trials for rare diseases: Lessons learned from pantothenate kinase-associated neurodegeneration

Substantial challenges in study design and methodology exist during clinical trial development to examine treatment response in patients with a rare disease, especially those with predominant central nervous system involvement and heterogeneity in clinical manifestations and natural history. Here we discuss crucial decisions which may significantly impact success of the study, including patient selection and recruitment, identification and selection of endpoints, determination of the study duration, consideration of control groups including natural history controls, and selection of appropriate statistical analyses. We review strategies for the successful development of a clinical trial to evaluate treatment of a rare disease with a focus on inborn errors of metabolism (IEMs) that present with movement disorders. The strategies presented using pantothenate kinase-associated neurodegeneration (PKAN) as the rare disease example can be applied to other rare diseases, particularly IEMs with movement disorders (e.g., other neurodegeneration with brain iron accumulation disorders, lysosomal storage disorders). The significant challenges associated with designing a clinical trial in rare disease can sometimes be successfully met through strategic engagement with experts in the rare disease, seeking regulatory and biostatistical guidance, and early involvement of patients and families. In addition to these strategies, we discuss the urgent need for a paradigm shift within the regulatory processes to help accelerate medical product development and bring new innovations and advances to patients with rare neurodegenerative diseases who need them earlier in disease progression and prior to clinical manifestations.

New prospectives on treatment opportunities in RASopathies

The RASopathies are a group of clinically defined developmental syndromes caused by germline variants of the RAS/mitogen-activated protein (MAPK) cascade. The prototypic RASopathy is Noonan syndrome, which has phenotypic overlap with related disorders such as cardiofaciocutaneous syndrome, Costello syndrome, Noonan syndrome with multiple lentigines, and others. In this state-of-the-art review, we summarize current knowledge on unmet therapeutic needs in these diseases and novel treatment approaches informed by insights from RAS/MAPK-associated cancer therapies, in particular through inhibition of MEK1/2 and mTOR in patients with severe disease manifestations. We explore the possibilities of integrating a larger arsenal of molecules currently under development into future care plans. Lastly, we describe both medical and ethical challenges and opportunities for future clinical trials in the field.

Identifying obstacles hindering the conduct of academic-sponsored trials for drug repurposing on rare-diseases: an analysis of six use cases

Background

Academic-sponsored trials for rare diseases face many challenges; the present paper identifies hurdles in the set-up of six multinational clinical trials for drug repurposing, as use cases.

Methods

Six academic-sponsored multinational trials aiming to generate knowledge on rare diseases drug repurposing were used as examples to identify problems in their set-up. Coordinating investigators leading these trials provided feedback on hurdles linked to study, country, and site set up, on the basis of pre-identified categories established through the analysis of previous peer-reviewed publications.

Results

Administrative burden and lack of harmonization for trial-site agreements were deemed as a major hurdle. Other main identified obstacles included the following: (1) complexity and restriction on the use of public funding, especially in a multinational set up, (2) drug supply, including procurement tendering rules and country-specific requirements for drug stability, and (3) lack of harmonization on regulatory requirements to get trial approvals.

Conclusion

A better knowledge of the non-commercial clinical research landscape and its challenges and requirements is needed to make drugs—especially those with less commercial gain—accessible to rare diseases patients. Better information about existing resources like research infrastructures, clinical research programs, and counseling mechanisms is needed to support and guide clinicians through the many challenges associated to the set-up of academic-sponsored multinational trials.

Accrual-Monitoring Practices for Various Disease Trials among AACI Member Cancer Centers

Progress in the management of rare diseases, including rare cancers, is dependent upon clinical trials; however, as many as 32% of rare-disease trials go uncompleted or unpublished due to insufficient accrual. Monitoring practices may differ between institutions. We sought to survey the regulatory standards for various trial types among major U.S. cancer centers. A 10-question survey was designed using Qualtrics assessment software. The survey was sent via email to an internal server of member institutions of the Association of American Cancer Institutes (AACI). Of 103 AACI centers, 31% completed the survey (n = 32). Respondents differed in their definitions of a rare disease, minimum expectations for rare tumor studies, and frequency of accrual monitoring by their institutional Protocol Review and Monitoring Committee. Seventy-three percent of respondents did not close trials based on low accrual. Strategies to optimize accrual included investigator incentives for high accrual and penalties for low accrual in 37% and 13% of respondents, respectively.

Current landscape of clinical development and approval of advanced therapies

Advanced therapy medicinal products (ATMPs) are innovative therapies that mainly target orphan diseases and high unmet medical needs. The uncertainty about the product's benefit-risk balance at the time of approval, the limitations of nonclinical development, and the complex quality aspects of those highly individualized advanced therapies are playing a key role in the clinical development, approval, and post-marketing setting for these therapies. This article reviews the current landscape of clinical development of advanced therapies, its challenges, and some of the efforts several stakeholders are conducting to move forward within this field. Progressive iteration of the science, methodologically sound clinical developments, establishing new standards for ATMPs development with the aim to ensure consistency in clinical development, and the reproducibility of knowledge is required, not only to increase the evidence generation for approval but to set principles to achieve translational success in this field.

Methodological Characteristics of Clinical Trials Supporting the Marketing Authorisation of Advanced Therapies in the European Union

Several advanced therapy medicinal products (ATMPs) have been approved in the European Union (EU). The aim of this study is to analyse the methodological features of the clinical trials (CT) that supported the marketing authorization (MA) of the approved ATMPs in the EU. A systematic review of the characteristics of pivotal CT of ATMPs approved in the EU until January 31st, 2021 was carried out. A total of 17 ATMPs were approved and 23 CT were conducted to support the MA (median, 1, range, 1-3). Of those studies, 8 (34.78%) were non-controlled and 7 (30.43%) used historical controls. Only 7 (30.4%) were placebo or active-controlled studies. Among all CT, 21 (91.3%) were open-label and 13 (56.52%) had a single-arm design. To evaluate the primary endpoint, 18 (78.26%) studies used an intermediate and single variable. The median (IQR) number of patients enrolled in the studies was 75 (22-118). To date, ATMPs' approval in the EU is mainly supported by uncontrolled, single-arm pivotal CT. Although there is a trend toward an adaptive or a life cycle approach, a switch to more robust clinical trial designs is expected to better define the benefit and the therapeutic added value of ATMPs.

N-of-1 Trials in Pediatric Oncology: From a Population-Based Approach to Personalized Medicine-A Review

Pediatric oncology is a critical area where the more efficient development of new treatments is urgently needed. The speed of approval of new drugs is still limited by regulatory requirements and a lack of innovative designs appropriate for trials in children. Childhood cancers meet the criteria of rare diseases. Personalized medicine brings it even closer to the horizon of individual cases. Thus, not all the traditional research tools, such as large-scale RCTs, are always suitable or even applicable, mainly due to limited sample sizes. Small samples and traditional versus subject-specific evidence are both distinctive issues in personalized pediatric oncology. Modern analytical approaches and adaptations of the paradigms of evidence are warranted. We have reviewed innovative trial designs and analytical methods developed for small populations, together with individualized approaches, given their applicability to pediatric oncology. We discuss traditional population-based and individualized perspectives of inferences and evidence, and explain the possibilities of using various methods in pediatric personalized oncology. We find that specific derivatives of the original N-of-1 trial design adapted for pediatric personalized oncology may represent an optimal analytical tool for this area of medicine. We conclude that no particular N-of-1 strategy can provide a solution. Rather, a whole range of approaches is needed to satisfy the new inferential and analytical paradigms of modern medicine. We reveal a new view of cancer as continuum model and discuss the "evidence puzzle".

Direct and indirect costs and cost-driving factors in adults with tuberous sclerosis complex: a multicenter cohort study and a review of the literature

Background

Tuberous sclerosis complex (TSC) is a monogenetic, multisystem disorder characterized by benign growths due to TSC1 or TSC2 mutations. This German multicenter study estimated the costs and related cost drivers associated with organ manifestations in adults with TSC.

Methods

A validated, three-month, retrospective questionnaire assessed the sociodemographic and clinical characteristics, organ manifestations, direct, indirect, out-of-pocket (OOP), and nursing care-level costs among adult individuals with TSC throughout Germany from a societal perspective (costing year: 2019).

Results

We enrolled 192 adults with TSC (mean age: 33.4 ± 12.7 years; range: 18–78 years, 51.6% [n = 99] women). Reported TSC disease manifestations included skin (94.8%) and kidney and urinary tract (74%) disorders, epilepsy (72.9%), structural brain defects (67.2%), psychiatric disorders (50.5%), heart and circulatory system disorders (50.5%), and lymphangioleiomyomatosis (11.5%). TSC1 and TSC2 mutations were reported in 16.7% and 25% of respondents, respectively. Mean direct health care costs totaled EUR 6452 (median EUR 1920; 95% confidence interval [CI] EUR 5533–7422) per patient over three months. Medication costs represented the major direct cost category (77% of total direct costs; mean EUR 4953), and mechanistic target of rapamycin (mTOR) inhibitors represented the largest share (68%, EUR 4358). Mean antiseizure drug (ASD) costs were only EUR 415 (6%). Inpatient costs (8%, EUR 518) and outpatient treatment costs (7%; EUR 467) were important further direct cost components. The mean care grade allowance as an approximator of informal nursing care costs was EUR 929 (median EUR 0; 95% CI EUR 780–1083) over three months. Mean indirect costs totaled EUR 3174 (median EUR 0; 95% CI EUR 2503–3840) among working-age individuals (< 67 years in Germany). Multiple regression analyses revealed mTOR inhibitor use and persistent seizures as independent cost-driving factors for total direct costs. Older age and disability were independent cost-driving factors for total indirect costs, whereas epilepsy, psychiatric disease, and disability were independent cost-driving factors for nursing care costs.

Conclusions

This three-month study revealed substantial direct healthcare, indirect healthcare, and medication costs associated with TSC in Germany. This study highlights the spectrum of organ manifestations and their associated treatment needs in the German healthcare setting. Trial registration: DRKS, DRKS00016045. Registered 01 March 2019, http://www.drks.de/DRKS00016045.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13023-021-01838-w.

Spinocerebellar ataxia clinical trials: opportunities and challenges

The spinocerebellar ataxias (SCAs) are a group of dominantly inherited diseases that share the defining feature of progressive cerebellar ataxia. The disease process, however, is not confined to the cerebellum; other areas of the brain, in particular, the brainstem, are also affected, resulting in a high burden of morbidity and mortality. Currently, there are no disease‐modifying treatments for the SCAs, but preclinical research has led to the development of therapeutic agents ripe for testing in patients. Unfortunately, due to the rarity of these diseases and their slow and variable progression, there are substantial hurdles to overcome in conducting clinical trials. While the epidemiological features of the SCAs are immutable, the feasibility of conducting clinical trials is being addressed through a combination of strategies. These include improvements in clinical outcome measures, the identification of imaging and fluid biomarkers, and innovations in clinical trial design. In this review, we highlight current challenges in initiating clinical trials for the SCAs and also discuss pathways for researchers and clinicians to mitigate these challenges and harness opportunities for clinical trial development.

Current Advances in Clinical Trials for Rare Disease Populations: Spotlight on the Patient

Characterized by small, highly heterogeneous patient populations, rare disease trials magnify the challenges often encountered in traditional clinical trials. In recent years, there have been increased efforts by stakeholders to improve drug development in rare diseases through novel approaches to clinical trial designs and statistical analyses. We highlight and discuss some of the current and emerging approaches aimed at overcoming challenges in rare disease clinical trials, with a focus on the ultimate stakeholder, the patient.

Clinical Design and Analysis Strategies for the Development of Gene Therapies: Considerations for Quantitative Drug Development in the Age of Genetic Medicine

Cell and gene therapies have shown enormous promise across a range of diseases in recent years. Numerous adoptive cell therapy modalities as well as systemic and direct-to-target tissue gene transfer administrations are currently in clinical development. The clinical trial design, development, reporting, and analysis of novel cell and gene therapies can differ significantly from established practices for small molecule drugs and biologics. Here, we discuss important quantitative considerations and key competencies for drug developers in preclinical requirements, trial design, and lifecycle planning for gene therapies. We argue that the unique development path of gene therapies requires practicing quantitative drug developers-statisticians, pharmacometricians, pharmacokineticists, epidemiologists, and medical and translational science leads-to exercise active collaboration and cross-functional learning across development stages.

Bayesian Approaches for Confirmatory Trials in Rare Diseases: Opportunities and Challenges

The aim of this narrative review is to introduce the reader to Bayesian methods that, in our opinion, appear to be the most important in the context of rare diseases. A disease is defined as rare depending on the prevalence of the affected patients in the considered population, for example, about 1 in 1500 people in U.S.; about 1 in 2500 people in Japan; and fewer than 1 in 2000 people in Europe. There are between 6000 and 8000 rare diseases and the main issue in drug development is linked to the challenge of achieving robust evidence from clinical trials in small populations. A better use of all available information can help the development process and Bayesian statistics can provide a solid framework at the design stage, during the conduct of the trial, and at the analysis stage. The focus of this manuscript is to provide a review of Bayesian methods for sample size computation or reassessment during phase II or phase III trial, for response adaptive randomization and of for meta-analysis in rare disease. Challenges regarding prior distribution choice, computational burden and dissemination are also discussed.

Bio-behavioural research in a rare disease population: a doctoral student's experience

BACKGROUND

Novice researchers who aspire to contribute to the body of knowledge concerning rare diseases face unique challenges in developing and conducting studies. These include unknown effect sizes in previous research, limitations in recruitment and enrolment, and managing data from a multi-site sample.

AIM

To describe the challenges in researching rare diseases and possible solutions using a doctoral student exemplar from a cross-sectional correlational study of fatigue.

DISCUSSION

The authors discuss the lessons learned from the study, including the challenges in recruitment, communication, collecting biological data and managing data in general. They posit possible solutions, including improving multi-site coordination, feasible methods for exploring sleep and stress, and measures to prevent equipment and data loss.

CONCLUSION

Rare populations, such as young survivors of childhood brain tumours, deserve a voice in building the body of knowledge needed for more precise, personalised healthcare. It is possible with foresight for the novice researcher to make such a contribution.

IMPLICATIONS FOR PRACTICE

Improved knowledge and assessment of symptoms during childhood will improve the detection of health risk factors and enable earlier intervention.

Opportunities and limitations of genetically modified nonhuman primate models for neuroscience research

The recently developed new genome-editing technologies, such as the CRISPR/Cas system, have opened the door for generating genetically modified nonhuman primate (NHP) models for basic neuroscience and brain disorders research. The complex circuit formation and experience-dependent refinement of the human brain are very difficult to model in vitro, and thus require use of in vivo whole-animal models. For many neurodevelopmental and psychiatric disorders, abnormal circuit formation and refinement might be at the center of their pathophysiology. Importantly, many of the critical circuits and regional cell populations implicated in higher human cognitive function and in many psychiatric disorders are not present in lower mammalian brains, while these analogous areas are replicated in NHP brains. Indeed, neuropsychiatric disorders represent a tremendous health and economic burden globally. The emerging field of genetically modified NHP models has the potential to transform our study of higher brain function and dramatically facilitate the development of effective treatment for human brain disorders. In this paper, we discuss the importance of developing such models, the infrastructure and training needed to maximize the impact of such models, and ethical standards required for using these models.

Clinical development of cell therapies for cancer: The regulators' perspective

Novel cell therapies for haematological malignancies and solid tumours address pressing clinical need while offering potentially paradigm shifts in efficacy. However, innovative development risks outflanking information on statutory frameworks, regulatory guidelines and their working application. Meeting this challenge, regulators offer wide-ranging expertise and experience in confidential scientific and regulatory advice. We advocate early incorporation of regulatory perspectives to support strategic development of clinical programmes. We examine critical issues and key advances in clinical oncology trials to highlight practical approaches to optimising the clinical development of cell therapies. We recommend early consideration of collaborative networks, early-access schemes, reducing bias in single-arm trials, adaptive trials, clinical end-points supporting risk/benefit and cost/benefit analyses, companion diagnostics, real-world data and common technical issues. This symbiotic approach between developers and regulators should reduce development risk, safely expedite marketing authorisation, and promote early, wider availability of potentially transformative cell therapies for cancer.

Systematic review of statistical methods for safety data in malaria chemoprevention in pregnancy trials

Background

Drug safety assessments in clinical trials present unique analytical challenges. Some of these include adjusting for individual follow-up time, repeated measurements of multiple outcomes and missing data among others. Furthermore, pre-specifying appropriate analysis becomes difficult as some safety endpoints are unexpected. Although existing guidelines such as CONSORT encourage thorough reporting of adverse events (AEs) in clinical trials, they provide limited details for safety data analysis. The limited guidelines may influence suboptimal analysis by failing to account for some analysis challenges above. A typical example where such challenges exist are trials of anti-malarial drugs for malaria prevention during pregnancy. Lack of proper standardized evaluation of the safety of antimalarial drugs has limited the ability to draw conclusions about safety. Therefore, a systematic review was conducted to establish the current practice in statistical analysis for preventive antimalarial drug safety in pregnancy.

Methods

The search included five databases (PubMed, Embase, Scopus, Malaria in Pregnancy Library and Cochrane Central Register of Controlled Trials) to identify original English articles reporting Phase III randomized controlled trials (RCTs) on anti-malarial drugs for malaria prevention in pregnancy published from January 2010 to July 2019.

Results

Eighteen trials were included in this review that collected multiple longitudinal safety outcomes including AEs. Statistical analysis and reporting of the safety outcomes in all the trials used descriptive statistics; proportions/counts (n = 18, 100%) and mean/median (n = 2, 11.1%). Results presentation included tabular (n = 16, 88.9%) and text description (n = 2, 11.1%). Univariate inferential methods were reported in most trials (n = 16, 88.9%); including Chi square/Fisher’s exact test (n = 12, 66.7%), t test (n = 2, 11.1%) and Mann–Whitney/Wilcoxon test (n = 1, 5.6%). Multivariable methods, including Poisson and negative binomial were reported in few trials (n = 3, 16.7%). Assessment of a potential link between missing efficacy data and safety outcomes was not reported in any of the trials that reported efficacy missing data (n = 7, 38.9%).

Conclusion

The review demonstrated that statistical analysis of safety data in anti-malarial drugs for malarial chemoprevention in pregnancy RCTs is inadequate. The analyses insufficiently account for multiple safety outcomes potential dependence, follow-up time and informative missing data which can compromise anti-malarial drug safety evidence development, based on the available data.

Orphan drug clinical development

Clinical development for orphan drugs is extremely demanding but fascinating. There is no single aspect that is really specific to it but instead it gathers most of the hurdles: design, outcomes, recruitment, ethics, cost, probability and predictability for success. To overcome these difficulties, there has to be a great collaboration between academic centers, small and large pharma companies, patients' representatives as well as health authorities to provide support and innovative approaches. The ultimate goal is to give access to patients with unmet medical needs to drugs with a favorable benefit-risk ratio. We review and discuss here the pillars for a successful clinical development for orphan drugs.

A multicenter, randomized, placebo-controlled, double-blind phase 3 trial with open-arm comparison indicates safety and efficacy of nephroprotective therapy with ramipril in children with Alport's syndrome

Children with Alport syndrome develop renal failure early in life. Since the safety and efficacy of preemptive nephroprotective therapy are uncertain we conducted a randomized, placebo-controlled, double-blind trial in 14 German sites of pediatric patients with ramipril for three to six years plus six months follow-up to determine these parameters. Pretreated children and those whose parents refused randomization became an open-arm control, which were compared to prospective real-world data from untreated children. The co-primary endpoints were safety (adverse drug reactions) and efficacy (time to progression). Out of 66 oligosymptomatic children, 22 were randomized and 44 joined the open-arm comparison. Ramipril therapy showed no safety issues (total of 216.4 patient-years on ramipril; adverse event rate-ratio 1.00; 95% confidence interval 0.66-1.53). Although not significant, our results cautiously showed that ramipril therapy was effective: in the randomized arm, Ramipril decreased the risk of disease progression by almost half (hazard ratio 0.51 (0.12-2.20)), diminished the slope of albuminuria progression and the decline in glomerular filtration. In adjusted analysis, indications of efficacy were supported by prospective data from participants treated open label compared with untreated children, in whom ramipril again seemed to reduce progression by almost half (0.53 (0.22-1.29)). Incorporating these results into the randomized data by Bayesian evidence synthesis resulted in a more precise estimate of the hazard-ratio of 0.52 (0.19-1.39). Thus, our study shows the safety of early initiation of therapy and supports the hope to slow renal failure by many years, emphasizing the value of preemptive therapy. Hence, screening programs for glomerular hematuria in children and young adults could benefit from inclusion of genetic testing for Alport-related gene-variants.

Agreement between results of meta-analyses from case reports and clinical studies, regarding efficacy and safety of idursulfase therapy in patients with mucopolysaccharidosis type II (MPS-II). A new tool for evidence-based medicine in rare diseases

Background

A preliminary exploratory study shows solid agreement between the results of case reports and clinical study meta-analyses in mucopolysaccharidosis Type I (MPS-I) adult patients. The aim of the present study is to confirm previous results in another patient population, suffering from mucopolysaccharidosis Type II (MPS-II).

Methods

A systematic review and meta-analysis of case reports published by April 2018 was conducted for MPS-II patients treated with enzyme replacement therapy (ERT). The study is reported in accordance with PRISMA and MOOSE guidelines (PROSPERO database code CRD42018093408). The assessed population and outcomes were the same as previously analyzed in a meta-analysis of MPS-II clinical studies. The primary endpoint was the percent of clinical cases showing improvement in efficacy outcome, or no harm in safety outcome after ERT initiation. A restrictive procedure to aggregate case reports, by selecting standardized and well-defined outcomes, was proposed. Different sensitivity analyses were able to evaluate the robustness of results.

Results

Every outcome classified as “acceptable evidence group” in our case report meta-analysis had been graded as “moderate strength of evidence” in the aforementioned meta-analysis of clinical studies. Sensitivity, specificity, and positive-negative predictive values for results of both meta-analyses reached 100%, and were deemed equivalent.

Conclusions

Aggregating case reports quantitatively, rather than analyzing them qualitatively, may improve conclusions in rare diseases and personalized medicine. Additionally, we propose some methods to evaluate publication bias and heterogeneity of the included studies in a meta-analysis of case reports.

The patient's view on rare disease trial design - a qualitative study

BACKGROUND

Clinical trials in rare diseases are more challenging than trials in frequent diseases. Small numbers of eligible trial participants, often complicated by heterogeneity among rare disease patients, hamper the design and conduct of a 'classical' Randomized Controlled Trial. Therefore, novel designs are developed by statisticians. However, it is important to be aware of possible design aspects that may jeopardize the feasibility of trial conduct. If the burden of participation is considered out of proportion by patients or parents, recruitment may fail or participants may drop out before trial completion. In order to maximize the chance of success of trials in small populations, it is important to know which aspects of trial design are considered important by patients.

RESULTS

We have interviewed all ten members of the Patient Think Tank (PTT) of the ASTERIX project, a European research consortium on methodology for clinical trials in small populations. The PTT members are rare disease patient representatives who have completed extensive training in clinical trial methodology. We have analyzed the interviews qualitatively according to Grounded Theory using a thematic analysis, and we structured the topics in four chronologically ordered themes: 1. Involvement in trial design; 2. Opinions on trial design; 3. Trial participation; 4. Phase after the trial. Our main findings are that the PTT-members recommend that patients are involved in trial design from an early stage on, and have influence on the outcomes and measurement instruments that are chosen in the trial, the length of the study, the choice of participants, and the information that is sent to potential participants. Also, according to the PTT-members, patient groups should consider setting up disease registries, placebo groups should be minimized, and more education on clinical trials is advised.

CONCLUSIONS

Rare disease patient representatives who have been educated about clinical trial methodology think it is important to involve patient representatives in research at an early stage. They can be of advice in trial design in such a way that the ratio of potential benefit and burden of trial participation as well as the chosen outcome measures and in- and exclusion criteria are optimized.

Orphan drugs: major development challenges at the clinical stage

Biotechnology has provided powerful tools to assist in research and development (R&D) for rare diseases. However, orphan drug development presents several major challenges and obstacles, such as low disease prevalence, disease severity, small and heterogeneous patient populations, difficulties in patient recruitment, and limited knowledge of the natural history of disease, among others. Several strategies can be used to plan for and overcome these clinical and regulatory challenges, namely improved clinical trial design, improved patient recruitment, and closer collaboration with the regulatory authorities and with patient associations. As growth in the orphan drug market is expected over the next few years, improving its relevance in the global pharmaceutical market, further challenges might present themselves in the development of orphan drugs.