Identification and Evaluation of Controlled Trials in Pediatric Cardiology: Crowdsourced Scoping Review and Creation of Accessible Searchable Database

Evaluating registry-based trial economics: Results from the STRESS clinical trial

Background

Registry-based trials have the potential to reduce randomized clinical trial (RCT) costs. However, observed cost differences also may be achieved through pragmatic trial designs. A systematic comparison of trial costs across different designs has not been previously performed.

Methods

We conducted a study to compare the current Steroids to Reduce Systemic inflammation after infant heart surgery (STRESS) registry-based RCT vs. two established designs: pragmatic RCT and explanatory RCT. The primary outcome was total RCT design costs. Secondary outcomes included: RCT duration and personnel hours. Costs were estimated using the Duke Clinical Research Institute's pricing model.

Results

The Registry-Based RCT estimated duration was 31.9 weeks greater than the other designs (259.5 vs. 227.6 weeks). This delay was caused by the Registry-Based design's periodic data harvesting that delayed site closing and statistical reporting. Total personnel hours were greatest for the Explanatory design followed by the Pragmatic design and the Registry-Based design (52,488 vs 29,763 vs. 24,480 h, respectively). Total costs were greatest for the Explanatory design followed by the Pragmatic design and the Registry-Based design ($10,140,263 vs. $4,164,863 vs. $3,268,504, respectively). Thus, Registry-Based total costs were 32 % of the Explanatory and 78 % of the Pragmatic design.

Conclusion

Total costs for the STRESS RCT with a registry-based design were less than those for a pragmatic design and much less than an explanatory design. Cost savings reflect design elements and leveraging of registry resources to improve cost efficiency, but delays to trial completion should be considered.

The paucity of high-level evidence for therapy in pediatric cardiology

Introduction

Clinical practice should be based on the highest quality of evidence available. Therefore, we aimed to classify publications in the field of pediatric cardiology in the year 2021 based on the level of scientific evidence.

Materials and Methods

A PubMed search was performed to identify pediatric cardiology articles published in the calendar year 2021. The abstract or manuscript of each study was reviewed. Each study was categorized as high, medium, or low level of evidence based on the study design. Disease investigated, treatment studied, and country of publication were recorded. Randomized control trials (RCTs) in similar fields of neonatology and adult cardiology were identified for comparison. Descriptive statistics were performed on the level of evidence, type of disease, country of publication, and therapeutic intervention.

Results

In 2021, 731 studies were identified. A decrease in prevalence for the level of evidence as a function of low, medium, and high was found (50.1%, 44.2%, and 5.8%, respectively). A low level of evidence studies was the majority for all types of cardiac disease identified, including acquired heart disease, arrhythmias, congenital heart disease, and heart failure, and for treatment modalities, including circulatory support, defibrillator, percutaneous intervention, medicine, and surgery. In a subgroup analysis, most high-level evidence studies were from the USA (31%), followed by China (26.2%) and India (14.3%). Comparing RCTs, 21 RCTs were identified in pediatric cardiology compared to 178 in neonatology and 413 in adult ischemic heart disease.

Conclusions

There is a great need for the conduct of studies that offer a high level of evidence in the discipline of pediatric cardiology.

Autoresuscitation after circulatory arrest: an updated systematic review

PURPOSE

Current practice in organ donation after death determination by circulatory criteria (DCD) advises a five-minute observation period following circulatory arrest, monitoring for unassisted resumption of spontaneous circulation (i.e., autoresuscitation). In light of newer data, the objective of this updated systematic review was to determine whether a five-minute observation time was still adequate for death determination by circulatory criteria.

SOURCE

We searched four electronic databases from inception to 28 August 2021, for studies evaluating or describing autoresuscitation events after circulatory arrest. Citation screening and data abstraction were conducted independently and in duplicate. We assessed certainty in evidence using the GRADE framework.

PRINCIPAL FINDINGS

Eighteen new studies on autoresuscitation were identified, consisting of 14 case reports and four observational studies. Most studies evaluated adults (n = 15, 83%) and patients with unsuccessful resuscitation following cardiac arrest (n = 11, 61%). Overall, autoresuscitation was reported to occur between one and 20 min after circulatory arrest. Among all eligible studies identified by our reviews (n = 73), seven observational studies were identified. In observational studies of controlled withdrawal of life-sustaining measures with or without DCD (n = 6), 19 autoresuscitation events were reported in 1,049 patients (incidence 1.8%; 95% confidence interval, 1.1 to 2.8). All resumptions occurred within five minutes of circulatory arrest and all patients with autoresuscitation died.

CONCLUSION

A five-minute observation time is sufficient for controlled DCD (moderate certainty). An observation time greater than five minutes may be needed for uncontrolled DCD (low certainty). The findings of this systematic review will be incorporated into a Canadian guideline on death determination.

STUDY REGISTRATION

PROSPERO (CRD42021257827); registered 9 July 2021.

Defining Pediatric Chronic Critical Illness: A Scoping Review

OBJECTIVES

Children with chronic critical illness (CCI) are hypothesized to be a high-risk patient population with persistent multiple organ dysfunction and functional morbidities resulting in recurrent or prolonged critical care; however, it is unclear how CCI should be defined. The aim of this scoping review was to evaluate the existing literature for case definitions of pediatric CCI and case definitions of prolonged PICU admission and to explore the methodologies used to derive these definitions.

DATA SOURCES

Four electronic databases (Ovid Medline, Embase, CINAHL, and Web of Science) from inception to March 3, 2021.

STUDY SELECTION

We included studies that provided a specific case definition for CCI or prolonged PICU admission. Crowdsourcing was used to screen citations independently and in duplicate. A machine-learning algorithm was developed and validated using 6,284 citations assessed in duplicate by trained crowd reviewers. A hybrid of crowdsourcing and machine-learning methods was used to complete the remaining citation screening.

DATA EXTRACTION

We extracted details of case definitions, study demographics, participant characteristics, and outcomes assessed.

DATA SYNTHESIS

Sixty-seven studies were included. Twelve studies (18%) provided a definition for CCI that included concepts of PICU length of stay (n = 12), medical complexity or chronic conditions (n = 9), recurrent admissions (n = 9), technology dependence (n = 5), and uncertain prognosis (n = 1). Definitions were commonly referenced from another source (n = 6) or opinion-based (n = 5). The remaining 55 studies (82%) provided a definition for prolonged PICU admission, most frequently greater than or equal to 14 (n = 11) or greater than or equal to 28 days (n = 10). Most of these definitions were derived by investigator opinion (n = 24) or statistical method (n = 18).

CONCLUSIONS

Pediatric CCI has been variably defined with regard to the concepts of patient complexity and chronicity of critical illness. A consensus definition is needed to advance this emerging and important area of pediatric critical care research.

Pediatric Chronic Critical Illness: Protocol for a Scoping Review

BACKGROUND

Improvements in the delivery of intensive care have increased survival among even the most critically ill children, thereby leading to a growing number of children with chronic complex medical conditions in the pediatric intensive care unit (PICU). Some of these children are at a significant risk of recurrent and prolonged critical illness, with higher morbidity and mortality, making them a unique population described as having chronic critical illness (CCI). To date, pediatric CCI has been understudied and lacks an accepted consensus case definition.

OBJECTIVE

This study aims to describe the protocol and methodology used to perform a scoping review that will describe how pediatric CCI has been defined in the literature, including the concept of prolonged PICU admission and the methodologies used to develop any existing definitions. It also aims to describe patient characteristics and outcomes evaluated in the included studies.

METHODS

We will search four electronic databases for studies that evaluated children admitted to any PICU identified with CCI. We will also search for studies describing prolonged PICU admission, as this concept is related to pediatric CCI. Furthermore, we will develop a hybrid crowdsourcing and machine learning (ML) methodology to complete citation screening. Screening and data abstraction will be performed by 2 reviewers independently and in duplicate. Data abstraction will include the details of population definitions, demographic and clinical characteristics of children with CCI, and evaluated outcomes.

RESULTS

The database search, crowd reviewer recruitment, and ML algorithm development began in March 2021. Citation screening and data abstraction were completed in April 2021. Final data verification is ongoing, with analysis and results anticipated to be completed by fall 2021.

CONCLUSIONS

This scoping review will describe the existing or suggested definitions of pediatric CCI and important demographic and clinical characteristics of patients to whom these definitions have been applied. This review's results will help inform the development of a consensus case definition for pediatric CCI and set a priority agenda for future research. We will use and demonstrate the validity of crowdsourcing and ML methodologies for improving the efficiency of large scoping reviews.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/30582.

Treatment of UTIs in Infants <2 Months: A Living Systematic Review

CONTEXT

Urinary tract infections (UTIs) are the most common bacterial infections in infants <2 months of age. However, there are no clear guidelines on the appropriate duration of antibiotics in this age group.

OBJECTIVE

In this living systematic review, we compared different durations of parenteral antibiotics (≤3 vs >3 days) in neonates and young infants (<2 months) with UTIs. The secondary objective was to compare different durations of total antibiotic courses (≤10 vs >10 days).

DATA SOURCES

MEDLINE, Embase, Cochrane Central Register of Controlled Trials, Web of Science, Literatura Latino-Americana e do Caribe em Ciências da Saúde, Google Scholar, and gray literature, up to March 2, 2021.

STUDY SELECTION

Citations were screened in triplicate by using a crowdsourcing methodology, to identify randomized controlled trials and observational studies.

DATA EXTRACTION

Data were extracted by 2 crowd members and verified by an expert investigator. Outcomes were pooled via random-effects models.

RESULTS

A total of 10 334 citations were screened, and 12 eligible studies were identified. A total of 59 of 3480 (1.7% [95% confidence interval (CI): 1.3% to 2.2%]) infants had a UTI recurrence within 30 days after short parenteral treatment (≤3 days), and 47 of 1971 (2.4% [95% CI: 1.8% to 3.2%]) after longer courses. The pooled adjusted odds ratio for UTI recurrence with a short versus long duration of parenteral antibiotics was 1.02 (95% CI: 0.64 to 1.61; P = .95; n = 5451). A total of 5 studies assessed the risk of recurrence on the basis of the total duration of antibiotics (≤10 vs >10 days) with no significant differences (pooled odds ratio: 1.29 [95% CI: 0.45 to 3.66; P = .63; n = 491).

CONCLUSIONS

On the basis of retrospective studies and Grading of Recommendations, Assessment, Development, and Evaluation level low evidence, short and long duration of parenteral antibiotics were associated with a similar risk of UTI recurrence in infants <2 months.

The evolution of long-term pediatric ventricular assistance devices: a critical review

Introduction: The gap between the number of heart failure patients and the number of potential heart donors has never been larger than today, especially among the pediatric population. The use of mechanical circulatory support is seen as a potential alternative for clinicians to treat more patients. This treatment has proven its efficiency on short-term use. However, in order to replace heart transplant, the techniques should be used over longer periods of time.Areas covered: This review aims at furnishing an engineering vision of the evolution of ventricular assistance devices used in pediatrics. A critical analysis of the clinical complications related to devices generation is made to give an overview of the design improvements made since their inception.Expert opinion: The long-term use of a foreign device in the body is not without consequences, especially among fragile pediatric patients. Moreover, the size of their body parts increases the technical difficulties of such procedure. The balance between the living cells of the body is disturbed by the devices, mostly by the shear stress generated. To provide a safe mechanical circulatory support for long-term use, the devices should be more hemocompatible, preserving blood cells, adapted to the patient's systemic grid and miniaturized for pediatric use.

Unique Challenges of Randomised Controlled Trials in Pediatric Cardiology

Pediatric cardiology has evolved over time with reductions in childhood mortality due to congenital heart disease. Surgical innovation drove early changes in care. Increasingly, the need for more robust evidence provided by randomised controlled trials (RCTs) has been recognised. Although the number of RCTs has increased, there remains a relative paucity of truly impactful trials in the field. However, those trials that have changed practice have demonstrated the potential and importance of this work. Examples include the PRIMACORP trial, which established the safety and efficacy of milrinone after cardiac surgery, and the Single Ventricle Reconstruction trial, which was the first multicentre pediatric cardiac surgical RCT. The successful conduct and important findings emanating from these trials serve as beacons as clinicians strive to improve the evidence base in this field. The establishment of national and international networks such as the Pediatric Heart Network and the Canadian Pediatric Cardiology Research Network provide a strong foundation for future collaborative work. Despite this progress, there remain important challenges to designing and executing RCTs in pediatric cardiology. These include issues of greater disease and patient heterogeneity and increased costs. The use of innovative study designs and analytic methods and the establishment of core outcome measures have the potential to overcome some of the issues related to the smaller patient numbers compared with adult disciplines. As pediatric cardiologists look to the future, it is imperative that we work together to derive the maximum benefit from the considerable efforts directed toward conducting impactful clinical trials in pediatric cardiology.

Creating enriched training sets of eligible studies for large systematic reviews: the utility of PubMed's Best Match algorithm

INTRODUCTION

Solutions like crowd screening and machine learning can assist systematic reviewers with heavy screening burdens but require training sets containing a mix of eligible and ineligible studies. This study explores using PubMed's Best Match algorithm to create small training sets containing at least five relevant studies.

METHODS

Six systematic reviews were examined retrospectively. MEDLINE searches were converted and run in PubMed. The ranking of included studies was studied under both Best Match and Most Recent sort conditions.

RESULTS

Retrieval sizes for the systematic reviews ranged from 151 to 5,406 records and the numbers of relevant records ranged from 8 to 763. The median ranking of relevant records was higher in Best Match for all six reviews, when compared with Most Recent sort. Best Match placed a total of thirty relevant records in the first fifty, at least one for each systematic review. Most Recent sorting placed only ten relevant records in the first fifty. Best Match sorting outperformed Most Recent in all cases and placed five or more relevant records in the first fifty in three of six cases.

DISCUSSION

Using a predetermined set size such as fifty may not provide enough true positives for an effective systematic review training set. However, screening PubMed records ranked by Best Match and continuing until the desired number of true positives are identified is efficient and effective.

CONCLUSIONS

The Best Match sort in PubMed improves the ranking and increases the proportion of relevant records in the first fifty records relative to sorting by recency.