1
|
Regier DA, Loewen R, Chan B, Ehman M, Pollard S, Friedman JM, Stockler-Ipsiroglu S, van Karnebeek C, Race S, Elliott AM, Dragojlovic N, Lynd LD, Weymann D. Real-world diagnostic outcomes and cost-effectiveness of genome-wide sequencing for developmental and seizure disorders: Evidence from Canada. Genet Med 2024; 26:101069. [PMID: 38205742 DOI: 10.1016/j.gim.2024.101069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Revised: 01/03/2024] [Accepted: 01/04/2024] [Indexed: 01/12/2024] Open
Abstract
PURPOSE To determine real-world diagnostic rates, cost trajectories, and cost-effectiveness of exome sequencing (ES) and genome sequencing (GS) for children with developmental and/or seizure disorders in British Columbia, Canada. METHODS Based on medical records review, we estimated real-world costs and outcomes for 491 patients who underwent standard of care (SOC) diagnostic testing at British Columbia Children's Hospital. Results informed a state-transition Markov model examining cost-effectiveness of 3 competing diagnostic strategies: (1) SOC with last-tier access to ES, (2) streamlined ES access, and (3) first-tier GS. RESULTS Through SOC, 49.4% (95% CI: 40.6, 58.2) of patients were diagnosed at an average cost of C$11,683 per patient (95% CI: 9200, 14,166). Compared with SOC, earlier ES or GS access yielded similar or improved diagnostic rates and shorter times to genetic diagnosis, with 94% of simulations demonstrating cost savings for streamlined ES and 60% for first-tier GS. Net benefit from the perspective of the health care system was C$2956 (95% CI: -608, 6519) for streamlined ES compared with SOC. CONCLUSION Using real-world data, we found earlier access to ES may yield more rapid genetic diagnosis of childhood developmental and seizure disorders and cost savings compared with current practice in a Canadian health care system.
Collapse
Affiliation(s)
- Dean A Regier
- School of Population and Public Health, Faculty of Medicine, University of British Columbia, Vancouver, Canada; Cancer Control Research, BC Cancer Research Institute, Vancouver, Canada
| | - Rosalie Loewen
- Cancer Control Research, BC Cancer Research Institute, Vancouver, Canada
| | - Brandon Chan
- Cancer Control Research, BC Cancer Research Institute, Vancouver, Canada
| | - Morgan Ehman
- Cancer Control Research, BC Cancer Research Institute, Vancouver, Canada
| | - Samantha Pollard
- Cancer Control Research, BC Cancer Research Institute, Vancouver, Canada
| | - Jan M Friedman
- Department of Medical Genetics, University of British Columbia, Vancouver, Canada; BC Children's Hospital Research Institute, Vancouver, Canada
| | - Sylvia Stockler-Ipsiroglu
- BC Children's Hospital Research Institute, Vancouver, Canada; Department of Pediatrics, Faculty of Medicine, University of British Columbia, Vancouver, Canada; Division of Biochemical Genetics, BC Children's Hospital, Vancouver, Canada
| | - Clara van Karnebeek
- Department of Pediatrics, Faculty of Medicine, University of British Columbia, Vancouver, Canada; Departments of Pediatrics and Human Genetics, Emma Center for Personalized Medicine, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Simone Race
- Division of Biochemical Genetics, BC Children's Hospital, Vancouver, Canada
| | - Alison M Elliott
- Department of Medical Genetics, University of British Columbia, Vancouver, Canada; BC Children's Hospital Research Institute, Vancouver, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, Canada; Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, Canada
| | - Deirdre Weymann
- Cancer Control Research, BC Cancer Research Institute, Vancouver, Canada.
| |
Collapse
|
2
|
Rodriguez Llorian E, Kopac N, Waliji LA, Borle K, Dragojlovic N, Elliott AM, Lynd LD. A Rapid Review on the Value of Biobanks Containing Genetic Information. Value Health 2023; 26:1286-1295. [PMID: 36921900 DOI: 10.1016/j.jval.2023.02.017] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2022] [Revised: 01/20/2023] [Accepted: 02/24/2023] [Indexed: 06/18/2023]
Abstract
OBJECTIVES Increasing access to health data through biobanks containing genetic information has the potential to expand the knowledge base and thereby improve screening, diagnosis, and treatment options for many diseases. Nevertheless, although privacy concerns and risks surrounding genetic data sharing are well documented, direct evidence in favor of the hypothesized benefits of data integration is scarce, which complicates decision making in this area. Therefore, the objective of this study is to summarize the available evidence on the research and clinical impacts of biobanks containing genetic information, so as to better understand how to quantify the value of expanding genomic data access. METHODS Using a rapid review methodology, we performed a search of MEDLINE/PubMed and Embase databases; and websites of biobanks and genomic initiatives published from 2010 to 2022. We classified findings into 11 indicators including outputs (a direct product of the biobank activities) and outcomes (changes in scientific and clinical capacity). RESULTS Of 8479 abstracts and 101 gray literature sources were reviewed, 96 records were included. Although most records did not report key indicators systematically, the available evidence concentrated on research indicators such as publications and gene-disorder association discoveries (63% of studies), followed by research infrastructure (26%), and clinical indicators (11%) such as supporting the diagnosis of individual patients. CONCLUSIONS Existing evidence on the benefits of biobanks is skewed toward easily quantifiable research outputs. Measuring a comprehensive set of outputs and outcomes inspired by value frameworks is necessary to generate better evidence on the benefits of genomic data sharing.
Collapse
Affiliation(s)
- Elisabet Rodriguez Llorian
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, British Columbia, Canada.
| | - Nicola Kopac
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Louloua Ashikhusein Waliji
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Kennedy Borle
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Alison M Elliott
- Department of Medical Genetics, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, British Columbia, Canada; Centre for Health Evaluation and Outcome Sciences (CHÉOS), St. Paul's Hospital, Vancouver, BC, Canada
| |
Collapse
|
3
|
Borle K, Kopac N, Dragojlovic N, Llorian ER, Lynd LD. Defining Need Amid Exponential Change: Conceptual Challenges in Workforce Planning for Clinical Genetic Services. Clin Ther 2023; 45:695-701. [PMID: 37516568 DOI: 10.1016/j.clinthera.2023.07.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 07/10/2023] [Accepted: 07/10/2023] [Indexed: 07/31/2023]
Abstract
Rapid growth in the volume of referrals to clinical genetics services in many countries during the past 15 years makes workforce planning a critical policy tool in ensuring that the capacity of the clinical genetics workforce is large enough to meet current and future needs. This article explores the distinctive challenges of workforce planning in clinical genetics and provides recommendations for addressing these challenges using a needs-based planning approach. Specifically, at least 3 features complicate efforts to estimate the need for clinical genetic services: the difficulty in linking many clinical genetic services to concrete health outcomes; the rapidly changing nature of genetic medicine, which creates intrinsic uncertainty about the appropriate level of service; and the heightened relevance of patient preferences in this context. Our recommendations call for needs-based planning studies to include an explicit definition of necessary care, to be flexible in considering nonhealth benefits, to err on the side of including services currently funded by health systems even when evidence about outcomes is limited, and to use scenario analysis and expert input to explore the impact of uncertainty about patients' preferences and future technologies on estimates of workforce requirements.
Collapse
Affiliation(s)
- Kennedy Borle
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Nicola Kopac
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Elisabet Rodriguez Llorian
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada; Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, British Columbia, Canada.
| |
Collapse
|
4
|
Dragojlovic N, Borle K, Kopac N, Nisselle A, Nuk J, Jevon M, Friedman JM, Elliott AM, Lynd LD. Workforce Implications of Increased Referrals to Hereditary Cancer Services in Canada: A Scenario-Based Analysis. Curr Oncol 2023; 30:7241-7251. [PMID: 37623006 PMCID: PMC10453026 DOI: 10.3390/curroncol30080525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2023] [Revised: 07/19/2023] [Accepted: 07/27/2023] [Indexed: 08/26/2023] Open
Abstract
Over the last decade, utilization of clinical genetics services has grown rapidly, putting increasing pressure on the workforce available to deliver genetic healthcare. To highlight the policy challenges facing Canadian health systems, a needs-based workforce requirements model was developed to determine the number of Canadian patients in 2030 for whom an assessment of hereditary cancer risk would be indicated according to current standards and the numbers of genetic counsellors, clinical geneticists and other physicians with expertise in genetics needed to provide care under a diverse set of scenarios. Our model projects that by 2030, a total of 90 specialist physicians and 326 genetic counsellors (1.7-fold and 1.6-fold increases from 2020, respectively) will be required to provide Canadians with indicated hereditary cancer services if current growth trends and care models remain unchanged. However, if the expansion in eligibility for hereditary cancer assessment accelerates, the need for healthcare providers with expertise in genetics would increase dramatically unless alternative care models are widely adopted. Increasing capacity through service delivery innovation, as well as mainstreaming of cancer genetics care, will be critical to Canadian health systems' ability to meet this challenge.
Collapse
Affiliation(s)
- Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC V6T 1Z3, Canada; (N.D.)
| | - Kennedy Borle
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC V6T 1Z3, Canada; (N.D.)
| | - Nicola Kopac
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC V6T 1Z3, Canada; (N.D.)
| | - Amy Nisselle
- Australian Genomics Health Alliance, Parkville, VIC 3052, Australia
- Murdoch Children’s Research Institute, Department of Pediatrics, The University of Melbourne, Parkville, VIC 3052, Australia
| | - Jennifer Nuk
- Hereditary Cancer Program, BC Cancer, Vancouver, BC V5Z 1J2, Canada
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC V6H 3N1, Canada
| | - Mandy Jevon
- Hereditary Cancer Program, BC Cancer, Vancouver, BC V5Z 1J2, Canada
| | - Jan M. Friedman
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC V6H 3N1, Canada
- BC Children’s Hospital Research Institute, Vancouver, BC V5Z 4H4, Canada
| | - Alison M. Elliott
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC V6H 3N1, Canada
- BC Children’s Hospital Research Institute, Vancouver, BC V5Z 4H4, Canada
- Women’s Health Research Institute, Vancouver, BC V6H 3N1, Canada
| | - Larry D. Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC V6T 1Z3, Canada; (N.D.)
- Centre for Health Evaluation & Outcome Sciences, Providence Health, Vancouver, BC V6Z IY6, Canada
| |
Collapse
|
5
|
Rodriguez Llorian E, Waliji LA, Dragojlovic N, Michaux KD, Nagase F, Lynd LD. Frameworks for Health Technology Assessment at an Early Stage of Product Development: A Review and Roadmap to Guide Applications. Value Health 2023:S1098-3015(23)00107-9. [PMID: 36990207 DOI: 10.1016/j.jval.2023.03.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 02/18/2023] [Accepted: 03/16/2023] [Indexed: 05/20/2023]
Abstract
OBJECTIVES Early health technology assessment (eHTA) can be used to evaluate and optimize a medical product's value proposition and to inform go/no-go decisions by using health economic modeling, literature scanning, and stakeholder preference studies at an early stage of development. eHTA frameworks offer high-level guidance on conducting this complex, iterative, and multidisciplinary process. The objective of this study was to review and summarize existing eHTA frameworks, understood as systematic approaches to guide early evidence generation and decision making. METHODS Using a rapid review methodology, we identified all relevant studies published in English, French, and Spanish from PubMed/MEDLINE and Embase until February 2022. We only included frameworks relevant to the preclinical and early clinical (phase I) stages of medical product development. RESULTS From 737 reviewed abstracts, 53 publications describing 46 frameworks were selected for inclusion and classified into categories based on their scope: (1) criteria frameworks, which provide an overview of eHTA; (2) process frameworks, which offer stepwise guidance for conducting eHTA, including preferred methods; and (3) methods frameworks, which provide detailed descriptions of specific eHTA methods. Most of the frameworks did not specify their target users or the specific stage of technology development. CONCLUSIONS Despite some variability and gaps found across existing frameworks, the structure provided by this review helps inform eHTA applications. Remaining challenges are the frameworks' limited accessibility to users without a background in health economics, poor distinctions being made among early lifecycle stages and technology types, and the inconsistent terminology used to describe eHTA in different contexts.
Collapse
Affiliation(s)
- Elisabet Rodriguez Llorian
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, BC, Canada
| | - Louloua Ashikhusein Waliji
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, BC, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, BC, Canada
| | - Kristina D Michaux
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, BC, Canada
| | - Fernanda Nagase
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, BC, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, The University of British Columbia, Vancouver, BC, Canada; Centre for Health Evaluation and Outcome Sciences (CHÉOS), St. Paul's Hospital, Vancouver, BC, Canada.
| |
Collapse
|
6
|
Rodriguez Llorian E, Dragojlovic N, Campbell TM, Friedman JM, Osiovich H, Elliott AM, Lynd LD. The effect of rapid exome sequencing on downstream health care utilization for infants with suspected genetic disorders in an intensive care unit. Genet Med 2022; 24:1675-1683. [PMID: 35622065 DOI: 10.1016/j.gim.2022.04.014] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Revised: 04/05/2022] [Accepted: 04/06/2022] [Indexed: 01/12/2023] Open
Abstract
PURPOSE This study aimed to compare downstream utilization of medical services among critically ill infants admitted to intensive care units who received rapid exome sequencing (ES) and those who followed alternative diagnostic testing pathways. METHODS Using propensity score-weighted regression models including sex, age at admission, and severity indicators, we compared a group of 47 infants who underwent rapid ES with a group of 211 infants who did not receive rapid ES. Utilization and cost indicators were compared between cohorts using negative binomial models for utilization and two-part models for costs. RESULTS After controlling for patients' sociodemographic and clinical characteristics, we found no statistically significant difference in outpatient visits, hospitalizations, intensive care unit or total length of stay, or length of stay-associated costs between the cohorts at 12- or 26-month follow-up. Similarly, there was no evidence of higher utilization or costs by the ES group when infants who died were removed from the analysis. CONCLUSION When examining utilization during and beyond the diagnostic trajectory, there is no evidence that ES changes frequency of outpatient visits or use of in-hospital resources in critically ill infants with suspected genetic disorders.
Collapse
Affiliation(s)
- Elisabet Rodriguez Llorian
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Teresa M Campbell
- Department of Medical Genetics, University of British Columbia, Vancouver, British Columbia, Canada
| | - Jan M Friedman
- Department of Medical Genetics, University of British Columbia, Vancouver, British Columbia, Canada
| | - Horacio Osiovich
- Division of Neonatology, Department of Paediatrics, University of British Columbia, Vancouver, British Columbia, Canada
| | | | - Alison M Elliott
- Department of Medical Genetics, University of British Columbia, Vancouver, British Columbia, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada; Centre for Health Evaluation and Outcome Sciences, St. Paul's Hospital, Vancouver, British Columbia, Canada.
| |
Collapse
|
7
|
Borle K, Kopac N, Dragojlovic N, Rodriguez Llorian E, Friedman JM, Elliott AM, Lynd LD. Where is genetic medicine headed? Exploring the perspectives of Canadian genetic professionals on future trends using the Delphi method. Eur J Hum Genet 2022; 30:496-504. [PMID: 35031678 PMCID: PMC9090755 DOI: 10.1038/s41431-021-01017-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Accepted: 11/22/2021] [Indexed: 12/13/2022] Open
Abstract
Driven by technological and scientific advances, the landscape of genetic medicine is rapidly changing, which complicates strategic planning and decision-making in this area. To address this uncertainty, we sought to understand genetic professionals' opinions about the future of clinical genetic and genomic services in Canada. We used the Delphi method to survey Canadian genetic professionals about their perspectives on whether scenarios about changes in service delivery and the use of genomic testing would be broadly implemented in their jurisdiction by 2030. We conducted two survey rounds; the response rates were 32% (27/84) and 67% (18/27), respectively. The most likely scenario was the universal use of noninvasive prenatal screening. The least likely scenarios involved population-based genome-wide sequencing for unaffected individuals. Overall, the scenarios perceived as most likely were those that have existing evidence about their benefit and potential medical necessity, whereas scenarios were seen as unlikely if they involved emerging technologies. Participants expected that the need for genetic healthcare services would increase by 2030 owing to changes in clinical guidelines and increased use of genome-wide sequencing. This study highlights the uncertainty in the future of genetic and genomic service provision and contributes evidence that could be used to inform strategic planning in clinical genetics.
Collapse
Affiliation(s)
- Kennedy Borle
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Nicola Kopac
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Elisabet Rodriguez Llorian
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Jan M Friedman
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | | | - Alison M Elliott
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,BC Children's Hospital Research Institute, Vancouver, BC, Canada.,BC Women's Hospital Research Institute, Vancouver, BC, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada. .,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, BC, Canada.
| |
Collapse
|
8
|
Pollard S, Weymann D, Dunne J, Mayanloo F, Buckell J, Buchanan J, Wordsworth S, Friedman JM, Stockler-Ipsiroglu S, Dragojlovic N, Elliott AM, Harrison M, Lynd LD, Regier DA. Toward the diagnosis of rare childhood genetic diseases: what do parents value most? Eur J Hum Genet 2021; 29:1491-1501. [PMID: 33903739 PMCID: PMC8484431 DOI: 10.1038/s41431-021-00882-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 01/18/2021] [Accepted: 03/23/2021] [Indexed: 02/07/2023] Open
Abstract
Genomic testing is becoming routine for diagnosing rare childhood genetic disease. Evidence underlying sustainable implementation is limited, focusing on short-term endpoints such as diagnostic yield, unable to fully characterize patient and family valued outcomes. Although genomic testing is becoming widely available, evidentiary and outcomes uncertainty persist as key challenges for implementation. We examine whether the current evidence base reflects public tolerance for uncertainty for genomics to diagnose rare childhood genetic disease. We conducted focus groups with general population parents in Vancouver, Canada, and Oxford, United Kingdom, to discuss expectations and concerns related to genomic testing to diagnose rare childhood genetic disease. Applying a purposive sampling technique, recruitment continued until thematic saturation was reached. Transcripts were analysed using thematic analysis. Thirty-three parents participated across four focus groups. Participants valued causal diagnoses alongside management strategies to improve patient health and wellbeing. Further, participants valued expanding the evidence base to reduce evidentiary uncertainty while ensuring security of information. Willingness to pay out of pocket for testing reflected perceived familial health benefit. Diagnostic yield fails to fully capture valued outcomes, and efforts to resolve uncertainty better reflect public priorities. Evaluations of genomic testing that fully integrate valued endpoints are necessary to ensure consistency with best practices and public willingness to accept the uncertain familial benefit.
Collapse
Affiliation(s)
- Samantha Pollard
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, Canada
| | - Deirdre Weymann
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, Canada
| | - Jessica Dunne
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, Canada
| | - Fatemeh Mayanloo
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, Canada
| | - John Buckell
- grid.4991.50000 0004 1936 8948Nuffield Department of Population Health, Health Economics Research Centre, University of Oxford, Oxford, UK
| | - James Buchanan
- grid.4991.50000 0004 1936 8948Nuffield Department of Population Health, Health Economics Research Centre, University of Oxford, Oxford, UK
| | - Sarah Wordsworth
- grid.4991.50000 0004 1936 8948Nuffield Department of Population Health, Health Economics Research Centre, University of Oxford, Oxford, UK
| | - Jan M. Friedman
- grid.17091.3e0000 0001 2288 9830Department of Medical Genetics, University of British Columbia, Vancouver, Canada ,grid.414137.40000 0001 0684 7788BC Children’s Hospital Research Institute, Vancouver, Canada
| | - Sylvia Stockler-Ipsiroglu
- grid.414137.40000 0001 0684 7788BC Children’s Hospital Research Institute, Vancouver, Canada ,grid.17091.3e0000 0001 2288 9830Department of Pediatrics, Faculty of Medicine, University of British Columbia, Vancouver, Canada ,grid.414137.40000 0001 0684 7788Division of Biochemical Genetics, BC Children’s Hospital, Vancouver, Canada
| | - Nick Dragojlovic
- grid.17091.3e0000 0001 2288 9830Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, Canada
| | - Alison M. Elliott
- grid.17091.3e0000 0001 2288 9830Department of Medical Genetics, University of British Columbia, Vancouver, Canada ,grid.414137.40000 0001 0684 7788BC Children’s Hospital Research Institute, Vancouver, Canada
| | - Mark Harrison
- grid.17091.3e0000 0001 2288 9830Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, Canada ,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, Canada
| | - Larry D. Lynd
- grid.17091.3e0000 0001 2288 9830Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, Canada ,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, Canada
| | - Dean A. Regier
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, Canada ,grid.17091.3e0000 0001 2288 9830School of Population and Public Health, University of British Columbia, Vancouver, Canada
| |
Collapse
|
9
|
Enns EA, Wainstein T, Dragojlovic N, Kopac N, Lynd LD, Elliott AM. Far and wide: Exploring provider utilization of remote service provision for genome-wide sequencing in Canada. Mol Genet Genomic Med 2021; 9:e1784. [PMID: 34532994 PMCID: PMC8580085 DOI: 10.1002/mgg3.1784] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Revised: 07/31/2021] [Accepted: 08/12/2021] [Indexed: 11/22/2022] Open
Abstract
Background In Canada, funding for genome‐wide sequencing (GWS; exome and whole genome) is provincially regulated. We characterized the uptake of GWS by genetics health professionals (GHPs) across Canada and describe how they use remote technologies for patient access to GWS and genomic counseling. Methods We distributed a survey to 574 Canadian GHPs addressing: GWS use, remote technologies (e.g., telephone, videoconferencing) for GWS and provider opinions regarding these technologies. Data were summarized using descriptive statistics. Associations between variables were evaluated using Chi‐square and Fisher's Exact tests for categorical data, and t‐tests or Mann–Whitney U tests for continuous data. Results Of 116 GHPs, 50% reported using GWS in the last year and 57% of GWS users reported using remote technologies. Clinical geneticists who did not use GWS reported lack of provincial funding as the principal reason. Remote technologies were most commonly used for informed consent and results, and rarely used for initial consultations. Average wait times for a GWS appointment were shorter for remote appointments (mean 44.2 (SD 40.2) weeks) than for in‐person (mean 58.2 (SD 42.9), p = 0.036). Conclusion The use of GWS varied across Canada, professional designation, and discipline. Funding remains a barrier to GWS access. Remote technologies increase patient access with reduced wait times.
Collapse
Affiliation(s)
- Emily A Enns
- Department of Human Genetics, McGill University, Montreal, Quebec, Canada
| | - Tasha Wainstein
- Department of Medical Genetics, University of British Columbia, Vancouver, British Columbia, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Nicola Kopac
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | | | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada.,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, British Columbia, Canada
| | - Alison M Elliott
- Department of Medical Genetics, University of British Columbia, Vancouver, British Columbia, Canada.,BC Children's Hospital Research Institute, Vancouver, British Columbia, Canada.,Women's Health Research Institute, Vancouver, British Columbia, Canada
| |
Collapse
|
10
|
Ho JK, Borle K, Dragojlovic N, Dhillon M, Kitchin V, Kopac N, Ross C, Lynd LD. Economic Evidence on Potentially Curative Gene Therapy Products: A Systematic Literature Review. Pharmacoeconomics 2021; 39:995-1019. [PMID: 34156648 DOI: 10.1007/s40273-021-01051-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/02/2021] [Indexed: 05/22/2023]
Abstract
OBJECTIVE The aim of this review was to summarize all available evidence on the cost effectiveness of potentially curative gene therapies and identify challenges that economic evaluations face in this area. METHODS We conducted a systematic review of four databases (PubMed/MEDLINE, Embase, CINAHL, EconLit) and grey literature sources. We conducted the search on August 23, 2019 and updated it on November 26, 2020. We included all English, French and Spanish language studies that addressed a gene therapy that had received regulatory approval or had entered a phase III trial, and also reported on costs related to the therapy. Critical appraisal was conducted to assess quality of reporting in included studies. RESULTS Fifty-six studies were identified. Of the 42 full economic evaluations, 71% (n = 30) evaluated chimeric antigen receptor T-cell therapies, most used either a Markov model (n = 17, 40%) and/or a partitioned survival model (n = 17, 40%), and 76% (n = 32) adopted a public or private payer perspective. The model characteristics with the greatest impact on cost effectiveness included assumptions about the efficacy of the treatment and the comparators used. CONCLUSION All gene therapies in this review were shown to be more effective than their comparators, although due to high costs not all were considered cost effective at standard cost-effectiveness thresholds. Despite their high cost, some gene therapies have the potential to dominate the alternatives in conditions with high mortality/disability. The choice of comparator and assumptions regarding long-term effectiveness had substantial impacts on cost-effectiveness estimates and need to be carefully considered. Both the quality of inputs and the quality of reporting were highly variable.
Collapse
Affiliation(s)
- Joseph Khoa Ho
- Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, BC, Canada
| | - Kennedy Borle
- Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, BC, Canada
| | - Nick Dragojlovic
- Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, BC, Canada
| | - Manrubby Dhillon
- Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, BC, Canada
| | - Vanessa Kitchin
- Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Nicola Kopac
- Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, BC, Canada
| | - Colin Ross
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Larry D Lynd
- Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, BC, Canada.
- Centre for Health Evaluation and Outcome Sciences, Providence Health Research Institute, Vancouver, BC, Canada.
| |
Collapse
|
11
|
Pollard S, Weymann D, Dunne J, Mayanloo F, Buckell J, Buchanan J, Wordsworth S, Friedman JM, Stockler-Ipsiroglu S, Dragojlovic N, Elliott AM, Harrison M, Lynd LD, Regier DA. Correction to: Toward the diagnosis of rare childhood genetic diseases: what do parents value most? Eur J Hum Genet 2021; 29:1589. [PMID: 34145384 DOI: 10.1038/s41431-021-00925-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Affiliation(s)
- Samantha Pollard
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, BC, Canada.
| | - Deirdre Weymann
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, BC, Canada
| | - Jessica Dunne
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, BC, Canada
| | - Fatemeh Mayanloo
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, BC, Canada
| | - John Buckell
- Nuffield Department of Population Health, Health Economics Research Centre, University of Oxford, Oxford, UK
| | - James Buchanan
- Nuffield Department of Population Health, Health Economics Research Centre, University of Oxford, Oxford, UK
| | - Sarah Wordsworth
- Nuffield Department of Population Health, Health Economics Research Centre, University of Oxford, Oxford, UK
| | - Jan M Friedman
- Department of Medical Genetics, University of British Columbia, Vancouver, BC, Canada.,BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Sylvia Stockler-Ipsiroglu
- BC Children's Hospital Research Institute, Vancouver, BC, Canada.,Department of Pediatrics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,Division of Biochemical Genetics, BC Children's Hospital, Vancouver, BC, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Alison M Elliott
- Department of Medical Genetics, University of British Columbia, Vancouver, BC, Canada.,BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Mark Harrison
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada.,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, BC, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada.,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, BC, Canada
| | - Dean A Regier
- Canadian Centre for Applied Research in Cancer Control, BC Cancer, Vancouver, BC, Canada.,School of Population and Public Health, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
12
|
Dragojlovic N, Kopac N, Borle K, Tandun R, Salmasi S, Ellis U, Birch P, Adam S, Friedman JM, Elliott AM, Lynd LD. Utilization and uptake of clinical genetics services in high-income countries: A scoping review. Health Policy 2021; 125:877-887. [PMID: 33962789 DOI: 10.1016/j.healthpol.2021.04.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 02/11/2021] [Accepted: 04/14/2021] [Indexed: 12/23/2022]
Abstract
Ongoing rapid growth in the need for genetic services has the potential to severely strain the capacity of the clinical genetics workforce to deliver this care. Unfortunately, assessments of the scale of this health policy challenge and potential solutions are hampered by the lack of a consolidated evidence base on the growth in genetic service utilization. To enable health policy research and strategic planning by health systems in this area, we conducted a scoping review of the literature on the utilization and uptake of clinical genetics services in high-income countries published between 2010 and 2018. One-hundred-and-ninety-five unique studies were included in the review. Most focused on cancer (85/195; 44%) and prenatal care (50/195; 26%), which are consistently the two areas with the greatest volume of genetic service utilization in both the United States and other high-income countries. Utilization and uptake rates varied considerably and were influenced by contextual factors including health system characteristics, provider knowledge, and patient preferences. Moreover, growth in genetic service utilization appears to be driven to a significant degree by technological advances and the integration of new tests into clinical care. Our review highlights both the policy challenge posed by the rapid growth in the utilization of genetic services and the variability in this trend across clinical indications and health systems.
Collapse
Affiliation(s)
- Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, 2405 Wesbrook Mall, Vancouver, BC, V6T 1Z3, Canada
| | - Nicola Kopac
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, 2405 Wesbrook Mall, Vancouver, BC, V6T 1Z3, Canada
| | - Kennedy Borle
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, 2405 Wesbrook Mall, Vancouver, BC, V6T 1Z3, Canada
| | - Rachel Tandun
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, 2405 Wesbrook Mall, Vancouver, BC, V6T 1Z3, Canada
| | - Shahrzad Salmasi
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, 2405 Wesbrook Mall, Vancouver, BC, V6T 1Z3, Canada
| | - Ursula Ellis
- Woodward Library, University of British Columbia, 2198 Health Sciences Mall, Vancouver, BC, V6T 1Z3, Canada
| | - Patricia Birch
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, C201 - 4500 Oak Street, Vancouver, BC, V6H 3N1, Canada; BC Children's Hospital Research Institute, 938 West 28th Avenue, Vancouver, BC, V5Z 4H4, Canada
| | - Shelin Adam
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, C201 - 4500 Oak Street, Vancouver, BC, V6H 3N1, Canada; BC Children's Hospital Research Institute, 938 West 28th Avenue, Vancouver, BC, V5Z 4H4, Canada
| | - Jan M Friedman
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, C201 - 4500 Oak Street, Vancouver, BC, V6H 3N1, Canada; BC Children's Hospital Research Institute, 938 West 28th Avenue, Vancouver, BC, V5Z 4H4, Canada
| | | | - Alison M Elliott
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, C201 - 4500 Oak Street, Vancouver, BC, V6H 3N1, Canada; BC Children's Hospital Research Institute, 938 West 28th Avenue, Vancouver, BC, V5Z 4H4, Canada; BC Women's Hospital Research Institute, H214 - 4500 Oak Street, Vancouver, BC, V6H 3N1, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, 2405 Wesbrook Mall, Vancouver, BC, V6T 1Z3, Canada; Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, 588-1081 Burrard Street, St. Paul's Hospital, Vancouver, BC, V6Z 1Y6.
| |
Collapse
|
13
|
Elliott AM, Dragojlovic N, Campbell T, Adam S, Souich CD, Fryer M, Lehman A, Karnebeek CV, Lynd LD, Friedman JM. Utilization of telehealth in paediatric genome-wide sequencing: Health services implementation issues in the CAUSES Study. J Telemed Telecare 2021; 29:318-327. [PMID: 33470133 DOI: 10.1177/1357633x20982737] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
INTRODUCTION Genome-wide sequencing (exome or whole genome) is transforming the care and management of paediatric patients with a rare disease because of its diagnostic capabilities. Genome-wide sequencing is most effective when both parents and the child are sequenced as a trio. Genetic counselling is recommended for all families considering genome-wide sequencing. Although telehealth is well established in genetic counselling for hereditary cancer and prenatal genetics, its use with genome-wide sequencing has not been well studied. The CAUSES Clinic at BC Children's and Women's Hospitals was a translational paediatric trio-based genome-wide sequencing initiative. Pre-test genetic counselling via telehealth (at a clinical site near the family's residence) was offered to families who had been previously evaluated by a clinical geneticist. We report on the first 300 families seen in the CAUSES clinic and compare health services implementation issues of families seen via telehealth versus on-site. METHODS Demographics, cost to families (travel and time), time to first appointment, complete trio sample accrual and diagnostic rates were studied. RESULTS Of the 300 patients, 58 (19%) were seen via telehealth and 242 (81%) were seen on-site for pre-test counselling. The mean time to completion of accrual of trio samples in the telehealth group was 56.3 (standard deviation ±87.3) days versus 18.9 (standard deviation ±62.4) days in the onsite group (p < 2.2 × 10-16). The mean per-family estimated actual or potential travel/time cost savings were greater in the telehealth group (Can$987; standard deviation = Can$1151) than for those seen on-site (Can$305; standard deviation = Can$589) (p = 0.0004). CONCLUSIONS Telehealth allowed for access to genome-wide sequencing for families in remote communities and for them to avoid significant travel and time costs; however, there was a significant delay to accrual of the complete trio samples in the telehealth group, impacting on time of result reporting and delaying diagnoses for families for whom genome-wide sequencing was diagnostic.
Collapse
Affiliation(s)
- Alison M Elliott
- Department of Medical Genetics, University of British Columbia, Canada.,BC Children's Hospital Research Institute, Canada.,Women's Health Research Institute, Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation (CORE), University of British Columbia, Canada
| | - Teresa Campbell
- Department of Medical Genetics, University of British Columbia, Canada
| | - Shelin Adam
- Department of Medical Genetics, University of British Columbia, Canada.,BC Children's Hospital Research Institute, Canada
| | - Christèle du Souich
- Department of Medical Genetics, University of British Columbia, Canada.,BC Children's Hospital Research Institute, Canada
| | - Michele Fryer
- Office of Virtual Health, Provincial Health Services Authority, Canada
| | - Anna Lehman
- Department of Medical Genetics, University of British Columbia, Canada.,BC Children's Hospital Research Institute, Canada
| | - Clara van Karnebeek
- BC Children's Hospital Research Institute, Canada.,Emma Children's Hospital, University of Amsterdam, The Netherlands
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation (CORE), University of British Columbia, Canada.,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Canada
| | - Jan M Friedman
- Department of Medical Genetics, University of British Columbia, Canada.,BC Children's Hospital Research Institute, Canada
| |
Collapse
|
14
|
Yamoah L, Dragojlovic N, Smith A, Lynd LD, Marra CA. Evaluating New Zealanders' Values for Drug Coverage Decision Making: Trade-Offs between Treatments for Rare and Common Conditions. Pharmacoeconomics 2021; 39:109-119. [PMID: 33150565 DOI: 10.1007/s40273-020-00974-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/24/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND New Zealand's near static healthcare budget limits access to expensive medications including those for rare conditions. As such, it is necessary to know the public's priority for values in the drug funding decision-making process. OBJECTIVES The objectives of this study were to measure the relative societal importance of values of New Zealanders in informing drug funding decisions and to determine how New Zealanders trade off funding in various scenarios between common and rare diseases. METHODS An online survey was conducted between 17 April and 17 May, 2019 on a sample of 500 New Zealanders aged ≥ 18 years. Participants ranked 13 values using an analytical hierarchy process. Participants were then presented with different trade-off scenarios to measure their attitudes towards funding drugs for common and rare diseases. RESULTS The values ranked in the top five by most were potential effect on quality of life (71.8%), ability of the drug to work (57.6%), severity (57.6%), safety (57%), and potential to extend life (56%). Adherence and rarity held the lowest and second lowest ranking. Most believe that resources should be allocated towards drugs that have been proven to work and have the greatest health benefits. In trade-offs between access to an expensive drug therapy for a rare disease with uncertain benefits or receive a fixed cash payment, the overwhelming consensus was to receive the cash payment. CONCLUSIONS New Zealanders ultimately value drug-related factors (e.g. quality of life and efficacy) and disease-related factors (e.g. severity of disease and equity) the most but did not value disease rarity.
Collapse
Affiliation(s)
- Linda Yamoah
- Pharmacy Intern, Wellington, New Zealand
- School of Pharmacy, University of Otago, PO Box 56, Dunedin, 9054, New Zealand
| | - Nick Dragojlovic
- Collaboration for Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Alesha Smith
- School of Pharmacy, University of Otago, PO Box 56, Dunedin, 9054, New Zealand
| | - Larry D Lynd
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Carlo A Marra
- School of Pharmacy, University of Otago, PO Box 56, Dunedin, 9054, New Zealand.
| |
Collapse
|
15
|
Dragojlovic N, Borle K, Kopac N, Ellis U, Birch P, Adam S, Friedman JM, Nisselle A, Elliott AM, Lynd LD. The composition and capacity of the clinical genetics workforce in high-income countries: a scoping review. Genet Med 2020; 22:1437-1449. [PMID: 32576987 DOI: 10.1038/s41436-020-0825-2] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2020] [Revised: 04/24/2020] [Accepted: 04/26/2020] [Indexed: 01/25/2023] Open
Abstract
As genetics becomes increasingly integrated into all areas of health care and the use of complex genetic tests continues to grow, the clinical genetics workforce will likely face greatly increased demand for its services. To inform strategic planning by health-care systems to prepare to meet this future demand, we performed a scoping review of the genetics workforce in high-income countries, summarizing all available evidence on its composition and capacity published between 2010 and 2019. Five databases (MEDLINE, Embase, PAIS, CINAHL, and Web of Science) and gray literature sources were searched, resulting in 162 unique studies being included in the review. The evidence presented includes the composition and size of the workforce, the scope of practice for genetics and nongenetics specialists, the time required to perform genetics-related tasks, case loads of genetics providers, and opportunities to increase efficiency and capacity. Our results indicate that there is currently a shortage of genetics providers and that there is a lack of consensus about the appropriate boundaries between the scopes of practice for genetics and nongenetics providers. Moreover, the results point to strategies that may be used to increase productivity and efficiency, including alternative service delivery models, streamlining processes, and the automation of tasks.
Collapse
Affiliation(s)
- Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Kennedy Borle
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Nicola Kopac
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Ursula Ellis
- Woodward Library, University of British Columbia, Vancouver, BC, Canada
| | - Patricia Birch
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Shelin Adam
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Jan M Friedman
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Amy Nisselle
- Australian Genomics Health Alliance, Melbourne, VIC, Australia.,Murdoch Children's Research Institute, Melbourne, VIC, Australia.,Department of Paediatrics, University of Melbourne, Melbourne, VIC, Australia
| | | | - Alison M Elliott
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,BC Children's Hospital Research Institute, Vancouver, BC, Canada.,BC Women's Hospital Research Institute, Vancouver, BC, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada. .,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, BC, Canada.
| |
Collapse
|
16
|
Rizzardo S, Bansback N, Dragojlovic N, Douglas C, Li KH, Mitton C, Marra C, Blanis L, Lynd LD. Evaluating Canadians' Values for Drug Coverage Decision Making. Value Health 2019; 22:362-369. [PMID: 30832975 DOI: 10.1016/j.jval.2018.08.008] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2018] [Revised: 08/14/2018] [Accepted: 08/15/2018] [Indexed: 05/28/2023]
Abstract
BACKGROUND Decision makers are facing growing challenges in prioritizing drugs for reimbursement because of soaring drug costs and increasing pressures on financial resources. In addition to cost and effectiveness, payers are using other values to dictate which drugs are prioritized for funding, yet there are limited data on the Canadian public's priorities. OBJECTIVES To measure the relative societal importance of values considered most relevant in informing drug reimbursement decisions in a representative sample of Canadians. METHODS An online survey of 2539 Canadians aged 19 years and older was performed in which 13 values used in drug funding prioritization were ranked and then weighted using an analytic hierarchy process. RESULTS Canadians value safe and efficacious drugs that have certainty of evidence. The values ranked in the top 5 by most of our subjects were potential effect on quality of life (65.4%), severity of the disease (62.6%), ability of drug to work (61.1%), safety (60.5%), and potential to extend life (49.4%). Values related to patient or disease characteristics such as rarity, socioeconomic status, and health and lifestyle choices held the lowest rankings and weights. CONCLUSIONS Canadians value, above all, treatment-related factors (eg, efficacy and safety) and disease-related factors (eg, severity and equity). Decision makers are currently using additional justifications to prioritize drugs for reimbursement, such as rarity and unmet need, which were not found to be highly valued by Canadians. Decision makers should integrate the public's values into a Canadian reimbursement framework for prioritization of drugs competing for limited funds.
Collapse
Affiliation(s)
- Shirin Rizzardo
- Pharmaceutical Services Division, British Columbia Ministry of Health, Victoria, BC, Canada
| | - Nick Bansback
- Faculty of Medicine, School of Population and Public Health, University of British Columbia, Vancouver, BC, Canada; Centre for Health Evaluation and Outcome Sciences, Providence Health Care Research Institute, Vancouver, BC, Canada
| | - Nick Dragojlovic
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Conor Douglas
- Department of Science and Technology Studies, York University, Toronto, ON, Canada
| | - Kathy H Li
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Craig Mitton
- Faculty of Medicine, School of Population and Public Health, University of British Columbia, Vancouver, BC, Canada; Centre for Clinical Epidemiology and Evaluation, Vancouver Coastal Health Research Institute, Vancouver, BC, Canada
| | - Carlo Marra
- National School of Pharmacy, University of Otago, Dunedin, New Zealand
| | - Litsa Blanis
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Larry D Lynd
- Centre for Health Evaluation and Outcome Sciences, Providence Health Care Research Institute, Vancouver, BC, Canada; Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada.
| |
Collapse
|
17
|
Smith EE, du Souich C, Dragojlovic N, Elliott AM. Genetic counseling considerations with rapid genome-wide sequencing in a neonatal intensive care unit. J Genet Couns 2018; 28:263-272. [DOI: 10.1002/jgc4.1074] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Revised: 11/05/2018] [Accepted: 11/07/2018] [Indexed: 01/03/2023]
Affiliation(s)
- Emma E. Smith
- Department of Medical Genetics; University of British Columbia; Vancouver BC Canada
| | - Christèle du Souich
- Department of Medical Genetics; University of British Columbia; Vancouver BC Canada
- BC Children’s Hospital Research Institute; Vancouver BC Canada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation, Faculty of Pharmaceutical Sciences; University of British Columbia; Vancouver BC Canada
| | - Alison M. Elliott
- Department of Medical Genetics; University of British Columbia; Vancouver BC Canada
- BC Children’s Hospital Research Institute; Vancouver BC Canada
- BC Women’s Health Research Institute; Vancouver BC Canada
| | | | | |
Collapse
|
18
|
Elliott AM, du Souich C, Adam S, Dragojlovic N, van Karnebeek C, Nelson TN, Lehman A, Lynd LD, Friedman JM. The Genomic Consultation Service: A clinical service designed to improve patient selection for genome-wide sequencing in British Columbia. Mol Genet Genomic Med 2018; 6:592-600. [PMID: 29851296 PMCID: PMC6081221 DOI: 10.1002/mgg3.410] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2018] [Revised: 04/01/2018] [Accepted: 04/06/2018] [Indexed: 12/03/2022] Open
Abstract
BACKGROUND Access to clinical diagnostic genome-wide sequencing (GWS; exome or whole genome sequencing) is limited in British Columbia. The establishment of a translational research initiative (CAUSES) to provide diagnostic genome-wide sequencing for 500 children necessitated the development of a genomic consultation service, a clinical service established to provide consultation for physicians considering GWS for their pediatric patients throughout British Columbia. The Genomic Consultation Service provides patient-specific genomic advice that may include: GWS, multi-gene panel, single gene test, referral to medical genetics for clinical evaluation, or no genetic testing. Here, we describe and evaluate this service. METHODS We analyzed referral patterns, patient demographics, clinical indications, and genomic advice provided during the first year of this service. Comparison of outcomes from the first 6 months versus the last 6 months was performed. RESULTS A total of 407 referrals (238 males and 169 females [p = .0006]) were processed in the first year. Only children were eligible for referral and average patient age was 8 years. Medical genetics was the most frequent referring discipline, followed by biochemical disease and pediatric neurology, respectively. Most patients (68%) had syndromic intellectual disability. There was a significant difference in the frequency of referrals not appropriate for GWS in the first versus the second 6 months of the service (75/220 vs. 42/187; p = .01) suggesting increasing awareness of testing criteria by referring physicians. CONCLUSION This triage service is utilized throughout the province and appears to be an important factor in the high diagnostic rate (>40%) achieved in our GWS program.
Collapse
Affiliation(s)
- Alison M. Elliott
- Department of Medical GeneticsFaculty of MedicineUniversity of British ColumbiaVancouverBCCanada
- BC Children's Hospital Research InstituteVancouverBCCanada
| | - Christèle du Souich
- Department of Medical GeneticsFaculty of MedicineUniversity of British ColumbiaVancouverBCCanada
- BC Children's Hospital Research InstituteVancouverBCCanada
| | - Shelin Adam
- Department of Medical GeneticsFaculty of MedicineUniversity of British ColumbiaVancouverBCCanada
| | - Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation (CORE)Department of Pharmaceutical SciencesUniversity of British ColumbiaVancouverBCCanada
| | - Clara van Karnebeek
- Department of PediatricsCentre for Molecular Medicine and TherapeuticsVancouverBCCanada
- Department of PediatricsDepartment of Clinical GeneticsAcademic Medical CentreAmsterdamThe Netherlands
| | - Tanya N. Nelson
- BC Children's Hospital Research InstituteVancouverBCCanada
- Department of Pathology and Laboratory MedicineFaculty of MedicineUniversity of British ColumbiaVancouverBCCanada
- Department of Pathology and Laboratory MedicineBC Children's HospitalVancouverBCCanada
| | - Anna Lehman
- Department of Medical GeneticsFaculty of MedicineUniversity of British ColumbiaVancouverBCCanada
- BC Children's Hospital Research InstituteVancouverBCCanada
| | | | - Larry D. Lynd
- Collaboration for Outcomes Research and Evaluation (CORE)Department of Pharmaceutical SciencesUniversity of British ColumbiaVancouverBCCanada
- CHEOS – Centre for Health Evaluation and Outcomes SciencesProvidence Health Research InstituteVancouverBCCanada
| | - Jan M. Friedman
- Department of Medical GeneticsFaculty of MedicineUniversity of British ColumbiaVancouverBCCanada
- BC Children's Hospital Research InstituteVancouverBCCanada
| |
Collapse
|
19
|
Dragojlovic N, Kim E, Elliott AM, Friedman JM, Lynd LD. Evaluating the use of parental reports to estimate health care resource utilization in children with suspected genetic disorders. J Eval Clin Pract 2018; 24:416-422. [PMID: 29603523 DOI: 10.1111/jep.12876] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/08/2017] [Revised: 12/08/2017] [Accepted: 12/12/2017] [Indexed: 11/29/2022]
Abstract
OBJECTIVE A key step in evaluating the cost-effectiveness of diagnostic genome-wide sequencing (GWS) services is to measure the cost of prior and subsequent diagnosis-related health care resource utilization by patients. The majority of patients using diagnostic GWS services are children, and parental surveys are often used to complement utilization data abstracted from medical records. The objective of this study was to evaluate the validity of parental reports for children with very high levels of resource utilization. METHOD Primary caregivers of children enrolled in the CAUSES Research Clinic, a diagnostic GWS programme at B.C. Children's Hospital, completed an online survey. Parent-reported health care encounters for the 6-month period prior to survey completion were compared to utilization data abstracted from electronic medical records (EMR). The association between demographic characteristics and the probability of survey completion was tested using logistic regression. Agreement between parent-reported and EMR data was evaluated using Cohen's kappa, prevalence- and bias-adjusted kappa (PABAK), and the intraclass correlation coefficient (ICC). RESULTS There were no major differences in demographic characteristics or resource utilization levels between families that completed the survey and those who did not. Agreement between parental reports and EMR data was high for hospitalizations (κ = 0.71; PABAK = 0.89; ICC = 0.77) but lower for outpatient physician visits (κ = 0.21; PABAK = 0.48; ICC = 0.27). CONCLUSIONS Parental surveys are a valuable tool for estimating health care resource utilization during a 6-month recall period for children with suspected genetic disorders but are best used to complement utilization data collected from other sources.
Collapse
Affiliation(s)
- Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Ellen Kim
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Alison M Elliott
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,British Columbia Children's Hospital Research Institute, Vancouver, BC, Canada
| | -
- British Columbia Children's and Women's Hospitals, Vancouver, BC, Canada
| | - Jan M Friedman
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada.,British Columbia Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, BC, Canada.,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, BC, Canada
| |
Collapse
|
20
|
Dragojlovic N, Elliott AM, Adam S, van Karnebeek C, Lehman A, Mwenifumbo JC, Nelson TN, du Souich C, Friedman JM, Lynd LD. The cost and diagnostic yield of exome sequencing for children with suspected genetic disorders: a benchmarking study. Genet Med 2018; 20:1013-1021. [PMID: 29300375 DOI: 10.1038/gim.2017.226] [Citation(s) in RCA: 63] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2017] [Accepted: 11/03/2017] [Indexed: 12/12/2022] Open
Abstract
PURPOSE This study aimed to generate benchmark estimates for the cost, diagnostic yield, and cost per positive diagnosis of diagnostic exome sequencing (ES) in heterogeneous pediatric patient populations and to illustrate how the design of an ES service can influence its cost and yield. METHODS A literature review and Monte Carlo simulations were used to generate benchmark estimates for singleton and trio ES. A cost model for the Clinical Assessment of the Utility of Sequencing and Evaluation as a Service (CAUSES) study, which is testing a proposed delivery model for diagnostic ES in British Columbia, is used to illustrate the potential effects of changing the service design. RESULTS The benchmark diagnostic yield was 34.3% (95% confidence interval (CI): 23.2-46.5) for trio ES and 26.5% (95% CI: 12.9-42.9) for singleton ES. The benchmark cost of delivery was C$6,437 (95% CI: $5,305-$7,704) in 2016 Canadian dollars (US$4,859; 4,391€) for trio ES and C$2,576 (95% CI: $1,993-$3,270) (US$1,944; 1,757€) for singleton ES. Scenario models for CAUSES suggest that alternative service designs could reduce costs but might lead to a higher cost per diagnosis due to lower yields. CONCLUSION Broad conclusions about the cost-effectiveness of ES should be drawn with caution when relying on studies that use cost or yield assumptions that lie at the extremes of the benchmark ranges.
Collapse
Affiliation(s)
- Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada
| | - Alison M Elliott
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.,BC Children's Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Shelin Adam
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.,BC Children's Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Clara van Karnebeek
- Department of Pediatrics, Centre for Molecular Medicine and Therapeutics, University of British Columbia, Vancouver, British Columbia, Canada.,Emma Children's Hospital, Academic Medical Centre, University of Amsterdam, Amsterdam, The Netherlands
| | - Anna Lehman
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.,BC Children's Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Jill C Mwenifumbo
- BC Children's Hospital Research Institute, Vancouver, British Columbia, Canada.,Centre for Molecular Medicine and Therapeutics, University of British Columbia, Vancouver, British Columbia, Canada
| | - Tanya N Nelson
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.,BC Children's Hospital Research Institute, Vancouver, British Columbia, Canada.,Department of Pathology and Laboratory Medicine, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.,Department of Pathology and Laboratory Medicine, BC Children's Hospital, Vancouver, British Columbia, Canada
| | - Christèle du Souich
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.,BC Children's Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Jan M Friedman
- Department of Medical Genetics, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada.,BC Children's Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia, Canada. .,Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, Vancouver, British Columbia, Canada.
| |
Collapse
|
21
|
Dragojlovic N, Lynd LD. What will the crowd fund? Preferences of prospective donors for drug development fundraising campaigns. Drug Discov Today 2016; 21:1863-1868. [PMID: 27422268 DOI: 10.1016/j.drudis.2016.07.002] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2016] [Revised: 07/01/2016] [Accepted: 07/05/2016] [Indexed: 10/21/2022]
Abstract
Biomedical researchers are increasingly turning to project-based online fundraising (i.e., crowdfunding) as a complementary source of research funding. To help inform the fundraising strategies adopted by researchers who take this approach, we conducted an online survey of prospective donors in North America. Respondents indicated not only an overwhelming preference for donating to projects conducted by nonprofit research organizations, but also an openness to donating to companies that have a 'for-benefit' corporate structure. They also showed a strong preference for projects that have alternate sources of funding, that have the potential to yield a curative therapy, and that focus on common and pediatric diseases.
Collapse
Affiliation(s)
- Nick Dragojlovic
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, University of British Columbia, 2405 Wesbrook Mall, Vancouver, BC V6 T 1Z3, Canada
| | - Larry D Lynd
- Collaboration for Outcomes Research and Evaluation (CORE), Faculty of Pharmaceutical Sciences, University of British Columbia, 2405 Wesbrook Mall, Vancouver, BC V6 T 1Z3, Canada; Centre for Health Evaluation and Outcomes Sciences, Providence Health Research Institute, 588 - 1081 Burrard Street, St Paul's Hospital, Vancouver, BC V6Z 1Y6, Canada.
| |
Collapse
|
22
|
Dragojlovic N, Lynd LD. Crowdfunding drug development: the state of play in oncology and rare diseases. Drug Discov Today 2014; 19:1775-1780. [DOI: 10.1016/j.drudis.2014.06.019] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2014] [Revised: 05/02/2014] [Accepted: 06/19/2014] [Indexed: 10/25/2022]
|
23
|
Dragojlovic N. Canadians' support for radical life extension resulting from advances in regenerative medicine. J Aging Stud 2013; 27:151-8. [DOI: 10.1016/j.jaging.2012.12.008] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2012] [Revised: 12/07/2012] [Accepted: 12/28/2012] [Indexed: 11/29/2022]
|