1
|
Dulude C, Sutherland S, Vanderhout S, King WJ, Zuijdwijk C, Major N, Audcent T, Howley H, Cloutier P, Buba M, Jain R, Litwinska J, Findlay L, Malic C, Macaulay K, Parker K, Kouri C, Goldbloom EB. A pediatric virtual care evaluation framework and its evolution using consensus methods. BMC Pediatr 2023; 23:402. [PMID: 37592246 PMCID: PMC10433580 DOI: 10.1186/s12887-023-04229-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 08/02/2023] [Indexed: 08/19/2023] Open
Abstract
BACKGROUND The use of virtual care has increased dramatically in response to the COVID-19 pandemic, yet evidence is lacking regarding the impact of virtual care on patient outcomes, particularly in pediatrics. A standardized evaluation approach is required to support the integration of virtual care into pediatric health care delivery programs. The objective of this work was to develop a comprehensive and structured framework for pediatric virtual care evaluation. This framework is intended to engage and guide care providers, health centres, and stakeholders towards the development of a standardized approach to the evaluation of pediatric virtual care. METHODS We brought together a diverse multidisciplinary team, including pediatric clinicians, researchers, digital health leads and analysts, program leaders, a human factors engineer, a family advisor and our manager of health equity and diversity. The team reviewed the literature, including published evaluation frameworks, and used a consensus-based method to develop a virtual care evaluation framework applicable to a broad spectrum of pediatric virtual care programs. We used an iterative process to develop framework components, including domains and sub-domains, examples of evaluation questions, measures, and data sources. Team members met repeatedly over seven months to generate and provide feedback on all components of the framework, making revision as needed until consensus was reached. The framework was then applied to an existing virtual care program. RESULTS The resulting framework includes four domains (health outcomes, health delivery, individual experience, and program implementation) and 19 sub-domains designed to support the development and evaluation of pediatric virtual care programs. We also developed guidance on how to use the framework and illustrate its utility by applying it to an existing pediatric virtual care program. CONCLUSIONS This virtual care evaluation framework expands on previously developed frameworks by providing additional detail and a structure that supports practical application. It can be used to evaluate a wide range of pediatric virtual care programs in a standardized manner. Use of this comprehensive yet easy to use evaluation framework will inform appropriate implementation and integration of virtual care into routine practice and support its sustainability and continuous improvement.
Collapse
Affiliation(s)
- Catherine Dulude
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
| | - Stephanie Sutherland
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
| | - Shelley Vanderhout
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
- School of Epidemiology and Public Health, University of Ottawa, 600 Peter Morand Crescent, Room 101, Ottawa, ON, Canada
| | - W James King
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
- Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada
| | - Caroline Zuijdwijk
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
- Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada
| | - Nathalie Major
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
- Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada
| | - Tobey Audcent
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
- Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada
| | - Heather Howley
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
| | - Paula Cloutier
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
| | - Melanie Buba
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
- Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada
- Children's Hospital of Eastern Ontario Research Institute Family Leader Program, 401 Smyth Rd, Ottawa, ON, Canada
| | - Raagini Jain
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada
| | - Justyna Litwinska
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
| | - Leanne Findlay
- Children's Hospital of Eastern Ontario Research Institute Family Leader Program, 401 Smyth Rd, Ottawa, ON, Canada
| | - Claudia Malic
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada
- Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada
| | - Karen Macaulay
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
| | - Kasey Parker
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
| | - Christine Kouri
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada
| | - Ellen B Goldbloom
- Children's Hospital of Eastern Ontario, 401 Smyth Rd, Ottawa, ON, K1H 8L1, Canada.
- Children's Hospital of Eastern Ontario Research Institute, 401 Smyth Rd, Ottawa, ON, Canada.
- Faculty of Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada.
| |
Collapse
|