A pediatric virtual care evaluation framework and its evolution using consensus methods

BACKGROUND

The use of virtual care has increased dramatically in response to the COVID-19 pandemic, yet evidence is lacking regarding the impact of virtual care on patient outcomes, particularly in pediatrics. A standardized evaluation approach is required to support the integration of virtual care into pediatric health care delivery programs. The objective of this work was to develop a comprehensive and structured framework for pediatric virtual care evaluation. This framework is intended to engage and guide care providers, health centres, and stakeholders towards the development of a standardized approach to the evaluation of pediatric virtual care.

METHODS

We brought together a diverse multidisciplinary team, including pediatric clinicians, researchers, digital health leads and analysts, program leaders, a human factors engineer, a family advisor and our manager of health equity and diversity. The team reviewed the literature, including published evaluation frameworks, and used a consensus-based method to develop a virtual care evaluation framework applicable to a broad spectrum of pediatric virtual care programs. We used an iterative process to develop framework components, including domains and sub-domains, examples of evaluation questions, measures, and data sources. Team members met repeatedly over seven months to generate and provide feedback on all components of the framework, making revision as needed until consensus was reached. The framework was then applied to an existing virtual care program.

RESULTS

The resulting framework includes four domains (health outcomes, health delivery, individual experience, and program implementation) and 19 sub-domains designed to support the development and evaluation of pediatric virtual care programs. We also developed guidance on how to use the framework and illustrate its utility by applying it to an existing pediatric virtual care program.

CONCLUSIONS

This virtual care evaluation framework expands on previously developed frameworks by providing additional detail and a structure that supports practical application. It can be used to evaluate a wide range of pediatric virtual care programs in a standardized manner. Use of this comprehensive yet easy to use evaluation framework will inform appropriate implementation and integration of virtual care into routine practice and support its sustainability and continuous improvement.

First and second trimester maternal serum markers for prenatal aneuploidy screening: an update on the adjustment factors for race, smoking, and insulin dependent diabetes mellitus

OBJECTIVES

The concentrations of maternal serum markers for aneuploidy screening are influenced by maternal characteristics such as race, smoking, insulin dependent diabetes mellitus (IDDM), and in vitro fertilization (IVF). Accurate risk estimation requires adjustment of initial values for these characteristics. This study aims to update and validate adjustment factors for race, smoking, and IDDM.

METHODS

The study included singleton pregnancies that received multiple marker screening in Ontario, Canada between January 2012, and December 2018, and had their information collected in the Better Outcomes Registry & Network (BORN) Ontario. Serum markers assessed included first trimester pregnancy-associated plasma protein A (PAPP-A), free β and total human chorionic gonadotropin (hCG), placental growth factor (PlGF) and αlpha-fetoprotein (AFP); second trimester AFP, unconjugated estriol (uE3), total hCG and inhibin A. The Mann-Whitney U test was used to assess the differences in the median multiple of the median (MoM) of serum markers between study and reference groups. New adjustment factors were generated by dividing the median MoM of a particular race, individuals who smoke tobacco, or have IDDM by those of the reference groups.

RESULTS

The study included 624,789 pregnancies. There were statistically significant differences in serum marker concentrations among pregnant individuals who were Black, Asian, or First Nations compared to a Caucasian group, those who smoked compared to Non-smoking individuals, and those with IDDM compared to Non-IDDM group. New adjustment factors for race, smoking, and IDDM were validated by comparing median MoM of serum markers corrected using the current adjustment factors and new adjustment factors generated in this study.

CONCLUSION

The adjustment factors generated in this study can adjust the effects of race, smoking, and IDDM on serum markers more accurately.

Genetic and metabolic investigations for neurodevelopmental disorders: position statement of the Canadian College of Medical Geneticists (CCMG)

PURPOSE AND SCOPE

The aim of this position statement is to provide recommendations for clinicians regarding the use of genetic and metabolic investigations for patients with neurodevelopmental disorders (NDDs), specifically, patients with global developmental delay (GDD), intellectual disability (ID) and/or autism spectrum disorder (ASD). This document also provides guidance for primary care and non-genetics specialists caring for these patients while awaiting consultation with a clinical geneticist or metabolic specialist.

METHODS OF STATEMENT DEVELOPMENT

A multidisciplinary group reviewed existing literature and guidelines on the use of genetic and metabolic investigations for the diagnosis of NDDs and synthesised the evidence to make recommendations relevant to the Canadian context. The statement was circulated for comment to the Canadian College of Medical Geneticists (CCMG) membership-at-large and to the Canadian Pediatric Society (Mental Health and Developmental Disabilities Committee); following incorporation of feedback, it was approved by the CCMG Board of Directors on 1 September 2022.

RESULTS AND CONCLUSIONS

Chromosomal microarray is recommended as a first-tier test for patients with GDD, ID or ASD. Fragile X testing should also be done as a first-tier test when there are suggestive clinical features or family history. Metabolic investigations should be done if there are clinical features suggestive of an inherited metabolic disease, while the patient awaits consultation with a metabolic physician. Exome sequencing or a comprehensive gene panel is recommended as a second-tier test for patients with GDD or ID. Genetic testing is not recommended for patients with NDDs in the absence of GDD, ID or ASD, unless accompanied by clinical features suggestive of a syndromic aetiology or inherited metabolic disease.

Cytogenetic outcomes following a failed cell-free DNA screen: a population-based retrospective cohort study of 35,146 singleton pregnancies

BACKGROUND

Cell-free fetal DNA screening is routinely offered to pregnant individuals to screen for aneuploidies. Although cell-free DNA screening is consistently more accurate than multiple-marker screening, it sometimes fails to yield a result. These test failures and their clinical implications are poorly described in the literature. Some studies suggest that a failed cell-free DNA screening result is associated with increased likelihood of cytogenetic abnormalities.

OBJECTIVE

This study aimed to assess the association between a failed cell-free DNA test and common aneuploidies. The objectives were to determine: (1) the proportion of test failures on first and subsequent attempts, and (2) whether a failed cell-free DNA screen on first attempt is associated with increased likelihood of common aneuploidies (trisomies 21, 18, and 13, and sex chromosome aneuploidies).

STUDY DESIGN

This was a population-based retrospective cohort study using data from Ontario's prescribed maternal and child registry, Better Outcomes Registry and Network Ontario. The study included all singleton pregnancies in Ontario with an estimated date of delivery from September 1, 2016 to March 31, 2019 that had a cell-free DNA screening record in the registry. Specific outcomes (trisomies 21, 18, and 13, and sex chromosome aneuploidies) of pregnancies with a failed cell-free DNA screen on first attempt were compared with those of pregnancies with low-risk cell-free DNA-screening results using modified Poisson regression adjusted for funding status (publicly funded vs self-paid), gestational age at screening, method of conception, and maternal age for autosomal aneuploidies.

RESULTS

Our cohort included 35,146 pregnancies that had cell-free DNA screening during the study period. The overall cell-free DNA screening failure rate was 4.8% on first attempt and 2.2% after multiple attempts. An abnormal cytogenetic result for trisomies 21, 18, and 13, or sex chromosome aneuploidies was identified in 19.4% of pregnancies with a failed cell-free DNA screening for which cytogenetic testing was performed. Pregnancies with a failed cell-free DNA screen on first attempt had a relative risk of 130.3 (95% confidence interval, 64.7-262.6) for trisomy 21, trisomy 18, or trisomy 13, and a risk difference of 5.4% (95% confidence interval, 2.6-8.3), compared with pregnancies with a low-risk result. The risk of sex chromosome aneuploidies was not significantly greater in pregnancies with a failed result compared with pregnancies with a low-risk result (relative risk, 2.7; 95% confidence interval, 0.9-7.9; relative difference, 1.2%; 95% confidence interval, -0.9 to 3.2).

CONCLUSION

Cell-free DNA screening test failures are relatively common. Although repeated testing improves the likelihood of an informative result, pregnancies with a failed cell-free DNA screen upon first attempt remain at increased risk for common autosomal aneuploidies, but not sex chromosome aneuploidies.

Care4Rare Canada: Outcomes from a decade of network science for rare disease gene discovery

The past decade has witnessed a rapid evolution in rare disease (RD) research, fueled by the availability of genome-wide (exome and genome) sequencing. In 2011, as this transformative technology was introduced to the research community, the Care4Rare Canada Consortium was launched: initially as FORGE, followed by Care4Rare, and Care4Rare SOLVE. Over what amounted to three eras of diagnosis and discovery, the Care4Rare Consortium used exome sequencing and, more recently, genome and other 'omic technologies to identify the molecular cause of unsolved RDs. We achieved a diagnostic yield of 34% (623/1,806 of participating families), including the discovery of deleterious variants in 121 genes not previously associated with disease, and we continue to study candidate variants in novel genes for 145 families. The Consortium has made significant contributions to RD research, including development of platforms for data collection and sharing and instigating a Canadian network to catalyze functional characterization research of novel genes. The Consortium was instrumental to implementing genome-wide sequencing as a publicly funded test for RD diagnosis in Canada. Despite the successes of the past decade, the challenge of solving all RDs remains enormous, and the work is far from over. We must leverage clinical and 'omic data for secondary use, develop tools and policies to support safe data sharing, continue to explore the utility of new and emerging technologies, and optimize research protocols to delineate complex disease mechanisms. Successful approaches in each of these realms is required to offer diagnostic clarity to all families with RDs.

'Not another safety culture survey': using the Canadian patient safety climate survey (Can-PSCS) to measure provider perceptions of PSC across health settings

Background

The importance of a strong safety culture for enhancing patient safety has been stated for over a decade in healthcare. However, this complex construct continues to face definitional and measurement challenges. Continuing improvements in the measurement of this construct are necessary for enhancing the utility of patient safety climate surveys (PSCS) in research and in practice. This study examines the revised Canadian PSCS (Can-PSCS) for use across a range of care settings.

Methods

Confirmatory factor analytical approaches are used to extensively test the Can-PSCS. Initial and cross-validation samples include 13 126 and 6324 direct care providers from 119 and 35 health settings across Canada, respectively.

Results

Results support a parsimonious model of direct care provider perceptions of patient safety climate (PSC) with 19 items in six dimensions: (1) organisational leadership support for safety; (2) incident follow-up; (3) supervisory leadership for safety; (4) unit learning culture; (5) enabling open communication I: judgement-free environment; (6) enabling open communication II: job repercussions of error. Results also support the validity of the Can-PSCS across a range of care settings.

Conclusions

The Can-PSCS has several advantages: (1) it is a theory-based instrument with a small number of actionable dimensions central to the construct of PSC; (2) it has robust psychometric properties; (3) it is validated for use across a range of care settings, therefore suitable for use in regionalised health delivery systems and can help to raise expectations about acceptable levels of PSC across the system; (4) it has been tested in a publicly funded universal health insurance system and may be suitable for similar international systems.

Exploring informed choice in the context of prenatal testing: findings from a qualitative study

PURPOSE

This study explored whether and how a sample of women made informed choices about prenatal testing for foetal anomalies; its aim was to provide insights for future health policy and service provision.

METHODS

We conducted semi-structured interviews with 38 mothers in Ottawa, Ontario, all of whom had been offered prenatal tests in at least one pregnancy. Using the Multi-dimensional Measure of Informed Choice as a general guide to analysis, we explored themes relevant to informed choice, including values and knowledge, and interactions with health professionals.

RESULTS

Many, but not all, participants seemed to have made informed decisions about prenatal testing. Values and knowledge were interrelated and important components of informed choice, but the way they were discussed differed from the way they have been presented in scientific literature. In particular, 'values' related to expressions of women's moral views or ideas about 'how life should be lived' and 'knowledge' related to the ways in which women prioritized and interpreted factual information, through their own and others' experiences and in 'thinking through' the personal implications of testing. While some women described non-directive discussions with health professionals, others perceived testing as routine or felt pressured to accept it.

CONCLUSIONS

Our findings suggest a need for maternity care providers to be vigilant in promoting active decision making about prenatal testing, particularly around the consideration of personal implications. Further development of measures of informed choice may be necessary to fully evaluate decision support tools and to determine whether prenatal testing programmes are meeting their objectives.