1
|
Doolub G, Khurshid S, Theriault-Lauzier P, Nolin Lapalme A, Tastet O, So D, Langlais EL, Cobin D, Avram R. Revolutionizing Acute Cardiac Care with Artificial Intelligence: Opportunities and Challenges. Can J Cardiol 2024:S0828-282X(24)00443-4. [PMID: 38901544 DOI: 10.1016/j.cjca.2024.06.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Revised: 05/29/2024] [Accepted: 06/12/2024] [Indexed: 06/22/2024] Open
Abstract
This manuscript reviews the application of artificial intelligence (AI) in acute cardiac care, highlighting its potential to transform patient outcomes in the face of the global burden of cardiovascular diseases. It explores how AI algorithms can rapidly and accurately process data for the prediction and diagnosis of acute cardiac conditions. The paper examines AI's impact on patient health across various diagnostic tools such as echocardiography, electrocardiography, coronary angiography, cardiac CT, and MRI and discusses the regulatory landscape for AI in healthcare, categorizes AI algorithms by their risk levels. Furthermore, it addresses the challenges of data quality, generalizability, bias, transparency, and regulatory considerations, underscoring the necessity for inclusive data and robust validation processes. The review concludes with future perspectives on integrating AI into clinical workflows and the ongoing need for research, regulation, and innovation to harness AI's full potential in improving acute cardiac care.
Collapse
Affiliation(s)
- Gemina Doolub
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal,Canada
| | - Shaan Khurshid
- Cardiovascular Disease Initiative, The Broad Institute of MIT and Harvard, Cambridge, MA, USA; Demoulas Center for Cardiac Arrhythmias, Massachusetts General Hospital, Boston, MA, USA
| | | | - Alexis Nolin Lapalme
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal,Canada; Heartwise (heartwise.ai), Montreal Heart Institute, Montreal, Canada; Mila - Québec Ai Institute, Montréal, Canada
| | - Olivier Tastet
- Heartwise (heartwise.ai), Montreal Heart Institute, Montreal, Canada
| | - Derek So
- University of Ottawa, Heart Institute, Ottawa, Canada
| | | | - Denis Cobin
- Heartwise (heartwise.ai), Montreal Heart Institute, Montreal, Canada
| | - Robert Avram
- Department of Medicine, Montreal Heart Institute, Université de Montréal, Montreal,Canada; Heartwise (heartwise.ai), Montreal Heart Institute, Montreal, Canada.
| |
Collapse
|
2
|
Vervoort D, Sallam A, Fremes SE, Wijeysundera HC, Tam DY. Centering Equity in Cardiovascular Health Technology Assessment. Can J Cardiol 2024; 40:1168-1171. [PMID: 38253126 DOI: 10.1016/j.cjca.2024.01.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 01/14/2024] [Accepted: 01/17/2024] [Indexed: 01/24/2024] Open
Affiliation(s)
- Dominique Vervoort
- Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Aminah Sallam
- Department of Cardiac Surgery, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, California, USA; National Clinician Scholars Program, David Geffen School of Medicine at UCLA, Los Angeles, California, USA
| | - Stephen E Fremes
- Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada; Schulich Heart Centre, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada
| | - Harindra C Wijeysundera
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada; Schulich Heart Centre, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada
| | - Derrick Y Tam
- Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada; Department of Cardiac Surgery, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, California, USA; Schulich Heart Centre, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, Ontario, Canada.
| |
Collapse
|
3
|
Vervoort D, Afzal AM, Ruiz GZL, Mutema C, Wijeysundera HC, Ouzounian M, Fremes SE. Barriers to Access to Cardiac Surgery: Canadian Situation and Global Context. Can J Cardiol 2024; 40:1110-1122. [PMID: 37977275 DOI: 10.1016/j.cjca.2023.11.011] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Revised: 11/09/2023] [Accepted: 11/10/2023] [Indexed: 11/19/2023] Open
Abstract
Cardiovascular disease is the leading cause of morbidity and mortality worldwide. Cardiovascular care spans primary, secondary, and tertiary prevention and care, whereby tertiary care is particularly prone to disparities in care. Challenges in access to care especially affect low- and middle-income countries (LMICs), however, multiple barriers also exist and persist across high-income countries. Canada is lauded for its universal health coverage but is faced with health care system challenges and substantial geographic barriers. Canada possesses 203 active cardiac surgeons, or 5.02 per million population, ranging from 3.70 per million in Newfoundland and Labrador to 7.48 in Nova Scotia. As such, Canada possesses fewer cardiac surgeons per million population than the average among high-income countries (7.15 per million), albeit more than the global average (1.64 per million) and far higher than the low-income country average (0.04 per million). In Canada, adult cardiac surgeons are active across 32 cardiac centres, representing 0.79 cardiac centres per million population, which is just above the global average (0.73 per million). In addition to centre and workforce variations, barriers to care exist in the form of waiting times, sociodemographic characteristics, insufficient virtual care infrastructure and electronic health record interoperability, and health care governance fragmentation. Meanwhile, Canada has highly favourable surgical outcomes, well established postacute cardiac care infrastructure, considerable spending on health, robust health administrative data, and effective health technology assessment agencies, which provides a foundation for continued improvements in care. In this narrative review, we describe successes and challenges surrounding access to cardiac surgery in Canada and globally.
Collapse
Affiliation(s)
- Dominique Vervoort
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada; Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada.
| | - Abdul Muqtader Afzal
- Schulich School of Medicine and Dentistry, University of Western Ontario, London, Ontario, Canada
| | - Gabriela Zamunaro Lopes Ruiz
- Division of Cardiovascular Surgery, Hospital das Clínicas da Universidade Federal de Minas Gerais, Belo Horizonte, Minas Gerais, Brazil
| | - Chileshe Mutema
- Division of Cardiothoracic Surgery, National Heart Hospital, Lusaka, Zambia
| | - Harindra C Wijeysundera
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada; Schulich Heart Centre, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
| | - Maral Ouzounian
- Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada; Division of Cardiovascular Surgery, Peter Munk Cardiac Centre, Toronto General Hospital, Toronto, Ontario, Canada
| | - Stephen E Fremes
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada; Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada; Schulich Heart Centre, Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
| |
Collapse
|
4
|
Khan ZA, Kidholm K, Pedersen SA, Haga SM, Drozd F, Sundrehagen T, Olavesen E, Halsteinli V. Developing a Program Costs Checklist of Digital Health Interventions: A Scoping Review and Empirical Case Study. PHARMACOECONOMICS 2024; 42:663-678. [PMID: 38530596 PMCID: PMC11126496 DOI: 10.1007/s40273-024-01366-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 02/22/2024] [Indexed: 03/28/2024]
Abstract
INTRODUCTION The rate of development and complexity of digital health interventions (DHIs) in recent years has to some extent outpaced the methodological development in economic evaluation and costing. Particularly, the choice of cost components included in intervention or program costs of DHIs have received scant attention. The aim of this study was to build a literature-informed checklist of program cost components of DHIs. The checklist was next tested by applying it to an empirical case, Mamma Mia, a DHI developed to prevent perinatal depression. METHOD A scoping review with a structured literature search identified peer-reviewed literature from 2010 to 2022 that offers guidance on program costs of DHIs. Relevant guidance was summarized and extracted elements were organized into categories of main cost components and their associated activities following the standard three-step approach, that is, activities, resource use and unit costs. RESULTS Of the 3448 records reviewed, 12 studies met the criteria for data extraction. The main cost categories identified were development, research, maintenance, implementation and health personnel involvement (HPI). Costs are largely considered to be context-specific, may decrease as the DHI matures and vary with number of users. The five categories and their associated activities constitute the checklist. This was applied to estimate program costs per user for Mamma Mia Self-Guided and Blended, the latter including additional guidance from public health nurses during standard maternal check-ups. Excluding research, the program cost per mother was more than double for Blended compared with Self-Guided (€140.5 versus €56.6, 2022 Euros) due to increased implementation and HPI costs. Including research increased the program costs to €190.8 and €106.9, respectively. One-way sensitivity analyses showed sensitivity to changes in number of users, lifespan of the app, salaries and license fee. CONCLUSION The checklist can help increase transparency of cost calculation and improve future comparison across studies.
Collapse
Affiliation(s)
- Zareen Abbas Khan
- Center for Health Care Improvement, St. Olav Hospital, Trondheim University Hospital, 3250, Torgarden, 7006, Trondheim, Norway.
- Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway.
| | - Kristian Kidholm
- Center for Innovative Medical Technology, University of Southern Denmark, Odense, Denmark
| | - Sindre Andre Pedersen
- Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Trondheim, Norway
| | - Silje Marie Haga
- Regional Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
| | - Filip Drozd
- Regional Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
| | - Thea Sundrehagen
- Regional Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
| | - Ellen Olavesen
- Regional Centre for Child and Adolescent Mental Health, Eastern and Southern Norway, Oslo, Norway
| | - Vidar Halsteinli
- Center for Health Care Improvement, St. Olav Hospital, Trondheim University Hospital, 3250, Torgarden, 7006, Trondheim, Norway
| |
Collapse
|
5
|
Kostick-Quenet K, Estep J, Blumenthal-Barby J. Ethical Concerns for Remote Computer Perception in Cardiology: New Stages for Digital Health Technologies, Artificial Intelligence, and Machine Learning. Circ Cardiovasc Qual Outcomes 2024; 17:e010717. [PMID: 38771912 PMCID: PMC11115370 DOI: 10.1161/circoutcomes.123.010717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/23/2024]
Affiliation(s)
| | - Jerry Estep
- Department of Cardiovascular Medicine, Cleveland Clinic Florida, Weston Hospital
| | | |
Collapse
|
6
|
Reason T, Rawlinson W, Langham J, Gimblett A, Malcolm B, Klijn S. Artificial Intelligence to Automate Health Economic Modelling: A Case Study to Evaluate the Potential Application of Large Language Models. PHARMACOECONOMICS - OPEN 2024; 8:191-203. [PMID: 38340276 PMCID: PMC10884386 DOI: 10.1007/s41669-024-00477-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 02/01/2024] [Indexed: 02/12/2024]
Abstract
BACKGROUND Current generation large language models (LLMs) such as Generative Pre-Trained Transformer 4 (GPT-4) have achieved human-level performance on many tasks including the generation of computer code based on textual input. This study aimed to assess whether GPT-4 could be used to automatically programme two published health economic analyses. METHODS The two analyses were partitioned survival models evaluating interventions in non-small cell lung cancer (NSCLC) and renal cell carcinoma (RCC). We developed prompts which instructed GPT-4 to programme the NSCLC and RCC models in R, and which provided descriptions of each model's methods, assumptions and parameter values. The results of the generated scripts were compared to the published values from the original, human-programmed models. The models were replicated 15 times to capture variability in GPT-4's output. RESULTS GPT-4 fully replicated the NSCLC model with high accuracy: 100% (15/15) of the artificial intelligence (AI)-generated NSCLC models were error-free or contained a single minor error, and 93% (14/15) were completely error-free. GPT-4 closely replicated the RCC model, although human intervention was required to simplify an element of the model design (one of the model's fifteen input calculations) because it used too many sequential steps to be implemented in a single prompt. With this simplification, 87% (13/15) of the AI-generated RCC models were error-free or contained a single minor error, and 60% (9/15) were completely error-free. Error-free model scripts replicated the published incremental cost-effectiveness ratios to within 1%. CONCLUSION This study provides a promising indication that GPT-4 can have practical applications in the automation of health economic model construction. Potential benefits include accelerated model development timelines and reduced costs of development. Further research is necessary to explore the generalisability of LLM-based automation across a larger sample of models.
Collapse
Affiliation(s)
- Tim Reason
- Estima Scientific, Mediaworks, 191 Wood Ln, London, W12 7FP, UK.
| | | | - Julia Langham
- Estima Scientific, Mediaworks, 191 Wood Ln, London, W12 7FP, UK
| | - Andy Gimblett
- Estima Scientific, Mediaworks, 191 Wood Ln, London, W12 7FP, UK
| | | | - Sven Klijn
- Bristol Myers Squibb, Princeton, NJ, USA
| |
Collapse
|
7
|
Nedadur R, Vervoort D. Commentary: Optimizing transfusion and hemostasis practices in cardiac surgery: Human versus machine or human and machine? J Thorac Cardiovasc Surg 2023:S0022-5223(23)01124-8. [PMID: 38056767 DOI: 10.1016/j.jtcvs.2023.11.048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 11/30/2023] [Indexed: 12/08/2023]
Affiliation(s)
- Rashmi Nedadur
- Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Dominique Vervoort
- Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.
| |
Collapse
|
8
|
Vervoort D, Jin H, Edwin F, Kumar RK, Malik M, Tapaua N, Verstappen A, Hasan BS. Global Access to Comprehensive Care for Paediatric and Congenital Heart Disease. CJC PEDIATRIC AND CONGENITAL HEART DISEASE 2023; 2:453-463. [PMID: 38205434 PMCID: PMC10777200 DOI: 10.1016/j.cjcpc.2023.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Accepted: 10/05/2023] [Indexed: 01/12/2024]
Abstract
Paediatric and congenital heart disease (PCHD) is common but remains forgotten on the global health agenda. Congenital heart disease is the most frequent major congenital anomaly, affecting approximately 1 in every 100 live births. In high-income countries, most children now live into adulthood, whereas in low- and middle-income countries, over 90% of patients do not get the care they need. Rheumatic heart disease is the most common acquired cardiovascular disease in children and adolescents. While almost completely eradicated in high-income countries, over 30-40 million people live with rheumatic heart disease in low- and middle-income countries. Challenges exist in the care for PCHD and, increasingly, adult congenital heart disease (ACHD) worldwide. In this review, we summarize the current status of PCHD and ACHD care through the health systems lens of workforce, infrastructure, financing, service delivery, information management and technology, and governance. We further highlight gaps in knowledge and opportunities moving forward to improve access to care for all those living with PCHD or ACHD worldwide.
Collapse
Affiliation(s)
- Dominique Vervoort
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
- Division of Cardiac Surgery, University of Toronto, Toronto, Ontario, Canada
| | - Hyerang Jin
- Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Frank Edwin
- School of Medicine, University of Health and Allied Sciences, Ho, Ghana
- National Cardiothoracic Center, Accra, Ghana
| | - Raman Krishna Kumar
- Department of Pediatric Cardiology, Amrita Institute of Medical Sciences, Amrita Vishwa Vidyapeetham, Kochi, Kerala, India
| | - Mahim Malik
- Department of Cardiac Surgery, Rawalpindi Institute of Cardiology, Rawalpindi, Punjab, Pakistan
| | - Noah Tapaua
- Department of Surgery, University of Papua New Guinea, Port Moresby, Papua New Guinea
| | - Amy Verstappen
- Global Alliance for Rheumatic and Congenital Hearts, Philadelphia, Pennsylvania, USA
| | - Babar S. Hasan
- Division of Cardiothoracic Sciences, Sindh Institute of Urology and Transplantation, Karachi, Pakistan
| |
Collapse
|
9
|
Mezei F, Horváth K, Pálfi M, Lovas K, Ádám I, Túri G. International practices in health technology assessment and public financing of digital health technologies: recommendations for Hungary. Front Public Health 2023; 11:1197949. [PMID: 37719722 PMCID: PMC10501404 DOI: 10.3389/fpubh.2023.1197949] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 08/18/2023] [Indexed: 09/19/2023] Open
Abstract
Background Evaluating and integrating digital health technologies is a critical component of a national healthcare ecosystem in the 2020s and is expected to even increase in significance. Design The paper gives an overview of international practices on public financing and health technology assessment of digital health technologies (DHTs) in five European Union (EU) countries and outlines recommendations for country-level action that relevant stakeholders can consider in order to support uptake of digital health solutions in Hungary. A scoping review was carried out to identify and gather country-specific classifications and international practices on the financing DHTs in five pioneering EU countries: Germany, France, Belgium, the United Kingdom and Finland. Results Several frameworks have been developed for DHTs, however there is no single, unified framework or method for classification, evaluation, and financing of digital health technologies in European context. European countries apply different taxonomy, use different assessment domains and regulations for the reimbursement of DHTs. The Working Group of the Hungarian Health Economic Society recommends eight specific points for stakeholders, importantly taking active role in shaping common clinical evidence standards and technical quality criteria across in order for common standards to be developed in the European Union single market. Conclusion Specificities of national healthcare contexts must be taken into account in decisions to allocate public funds to certain therapies rather than others.
Collapse
Affiliation(s)
- Fruzsina Mezei
- Data-Driven Health Division of National Laboratory for Health Security, Health Services Management Training Centre, Semmelweis University, Budapest, Hungary
- EIT Health France, Paris, France
| | - Krisztián Horváth
- Department of Public Health, Semmelweis University, Budapest, Hungary
| | - Máté Pálfi
- Center for Health Technology Assessment, Semmelweis University, Budapest, Hungary
| | - Kornélia Lovas
- CE Certiso Ltd, Budakeszi, Hungary
- Department of Clinical Pharmacy, University of Szeged, Szeged, Hungary
| | - Ildikó Ádám
- Center for Health Technology Assessment, Semmelweis University, Budapest, Hungary
| | - Gergő Túri
- Epidemiology and Surveillance Centre, Semmelweis University, Budapest, Hungary
- Synthesis Health Research Foundation, Budapest, Hungary
| |
Collapse
|
10
|
Vandenberk B, Chew DS, Prasana D, Gupta S, Exner DV. Successes and challenges of artificial intelligence in cardiology. Front Digit Health 2023; 5:1201392. [PMID: 37448836 PMCID: PMC10336354 DOI: 10.3389/fdgth.2023.1201392] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 06/19/2023] [Indexed: 07/15/2023] Open
Abstract
In the past decades there has been a substantial evolution in data management and data processing techniques. New data architectures made analysis of big data feasible, healthcare is orienting towards personalized medicine with digital health initiatives, and artificial intelligence (AI) is becoming of increasing importance. Despite being a trendy research topic, only very few applications reach the stage where they are implemented in clinical practice. This review provides an overview of current methodologies and identifies clinical and organizational challenges for AI in healthcare.
Collapse
Affiliation(s)
- Bert Vandenberk
- Department of Cardiac Sciences, Libin Cardiovascular Institute, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- Department of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
| | - Derek S. Chew
- Department of Cardiac Sciences, Libin Cardiovascular Institute, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | - Dinesh Prasana
- Intelense Inc., Markham, ON, Canada
- IOT/AI- Caliber Interconnect Pvt Ltd., Coimbatore, India
| | | | - Derek V. Exner
- Department of Cardiac Sciences, Libin Cardiovascular Institute, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
11
|
Donovan T, Abell B, Fernando M, McPhail SM, Carter HE. Implementation costs of hospital-based computerised decision support systems: a systematic review. Implement Sci 2023; 18:7. [PMID: 36829247 PMCID: PMC9960445 DOI: 10.1186/s13012-023-01261-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Accepted: 01/17/2023] [Indexed: 02/26/2023] Open
Abstract
BACKGROUND The importance of accurately costing implementation strategies is increasingly recognised within the field of implementation science. However, there is a lack of methodological guidance for costing implementation, particularly within digital health settings. This study reports on a systematic review of costing analyses conducted alongside implementation of hospital-based computerised decision support systems. METHODS PubMed, Embase, Scopus and CINAHL databases were searched between January 2010 and August 2021. Two reviewers independently screened and selected original research studies that were conducted in a hospital setting, examined the implementation of a computerised decision support systems and reported implementation costs. The Expert Recommendations for Implementing Change Framework was used to identify and categorise implementation strategies into clusters. A previously published costing framework was applied to describe the methods used to measure and value implementation costs. The reporting quality of included studies was assessed using the Consolidated Health Economic Evaluation Reporting Standards checklist. RESULTS Titles and abstracts of 1836 articles were screened, with nine articles eligible for inclusion in the review. Implementation costs were most frequently reported under the 'evaluative and iterative strategies' cluster, followed by 'provide interactive assistance'. Labour was the largest implementation-related cost in the included papers, irrespective of implementation strategy. Other reported costs included consumables, durable assets and physical space, which was mostly associated with stakeholder training. The methods used to cost implementation were often unclear. There was variation across studies in the overall quality of reporting. CONCLUSIONS A relatively small number of papers have described computerised decision support systems implementation costs, and the methods used to measure and value these costs were not well reported. Priorities for future research should include establishing consistent terminology and appropriate methods for estimating and reporting on implementation costs. TRIAL REGISTRATION The review protocol is registered with PROSPERO (ID: CRD42021272948).
Collapse
Affiliation(s)
- Thomasina Donovan
- Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD, Australia.
| | - Bridget Abell
- grid.1024.70000000089150953Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD Australia
| | - Manasha Fernando
- grid.1024.70000000089150953Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD Australia
| | - Steven M. McPhail
- grid.1024.70000000089150953Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD Australia ,grid.474142.0Digital Health and Informatics, Metro South Health, Brisbane, QLD Australia
| | - Hannah E. Carter
- grid.1024.70000000089150953Australian Centre for Health Services Innovation and Centre for Healthcare Transformation, School of Public Health and Social Work, Faculty of Health, Queensland University of Technology, Brisbane, QLD Australia
| |
Collapse
|
12
|
Zemplényi A, Tachkov K, Balkanyi L, Németh B, Petykó ZI, Petrova G, Czech M, Dawoud D, Goettsch W, Gutierrez Ibarluzea I, Hren R, Knies S, Lorenzovici L, Maravic Z, Piniazhko O, Savova A, Manova M, Tesar T, Zerovnik S, Kaló Z. Recommendations to overcome barriers to the use of artificial intelligence-driven evidence in health technology assessment. Front Public Health 2023; 11:1088121. [PMID: 37181704 PMCID: PMC10171457 DOI: 10.3389/fpubh.2023.1088121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 04/03/2023] [Indexed: 05/16/2023] Open
Abstract
Background Artificial intelligence (AI) has attracted much attention because of its enormous potential in healthcare, but uptake has been slow. There are substantial barriers that challenge health technology assessment (HTA) professionals to use AI-generated evidence for decision-making from large real-world databases (e.g., based on claims data). As part of the European Commission-funded HTx H2020 (Next Generation Health Technology Assessment) project, we aimed to put forward recommendations to support healthcare decision-makers in integrating AI into the HTA processes. The barriers, addressed by the paper, are particularly focusing on Central and Eastern European (CEE) countries, where the implementation of HTA and access to health databases lag behind Western European countries. Methods We constructed a survey to rank the barriers to using AI for HTA purposes, completed by respondents from CEE jurisdictions with expertise in HTA. Using the results, two members of the HTx consortium from CEE developed recommendations on the most critical barriers. Then these recommendations were discussed in a workshop by a wider group of experts, including HTA and reimbursement decision-makers from both CEE countries and Western European countries, and summarized in a consensus report. Results Recommendations have been developed to address the top 15 barriers in areas of (1) human factor-related barriers, focusing on educating HTA doers and users, establishing collaborations and best practice sharing; (2) regulatory and policy-related barriers, proposing increasing awareness and political commitment and improving the management of sensitive information for AI use; (3) data-related barriers, suggesting enhancing standardization and collaboration with data networks, managing missing and unstructured data, using analytical and statistical approaches to address bias, using quality assessment tools and quality standards, improving reporting, and developing better conditions for the use of data; and (4) technological barriers, suggesting sustainable development of AI infrastructure. Conclusion In the field of HTA, the great potential of AI to support evidence generation and evaluation has not yet been sufficiently explored and realized. Raising awareness of the intended and unintended consequences of AI-based methods and encouraging political commitment from policymakers is necessary to upgrade the regulatory and infrastructural environment and knowledge base required to integrate AI into HTA-based decision-making processes better.
Collapse
Affiliation(s)
- Antal Zemplényi
- Center for Health Technology Assessment and Pharmacoeconomics Research, Faculty of Pharmacy, University of Pécs, Pécs, Hungary
- Syreon Research Institute, Budapest, Hungary
- *Correspondence: Antal Zemplényi,
| | - Konstantin Tachkov
- Department of Organization and Economics of Pharmacy, Faculty of Pharmacy, Medical University of Sofia, Sofia, Bulgaria
| | - Laszlo Balkanyi
- Medical Informatics R&D Center, Pannon University, Veszprém, Hungary
| | | | | | - Guenka Petrova
- Department of Organization and Economics of Pharmacy, Faculty of Pharmacy, Medical University of Sofia, Sofia, Bulgaria
| | - Marcin Czech
- Department of Pharmacoeconomics, Institute of Mother and Child, Warsaw, Poland
| | - Dalia Dawoud
- Science Policy and Research Programme, Science Evidence and Analytics Directorate, National Institute for Health and Care Excellence (NICE), London, United Kingdom
- Cairo University, Faculty of Pharmacy, Cairo, Egypt
| | - Wim Goettsch
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht University, Utrecht, Netherlands
- National Health Care Institute, Diemen, Netherlands
| | | | - Rok Hren
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
| | - Saskia Knies
- National Health Care Institute, Diemen, Netherlands
| | - László Lorenzovici
- Syreon Research Romania, Tirgu Mures, Romania
- G. E. Palade University of Medicine, Pharmacy, Science and Technology, Tirgu Mures, Romania
| | | | - Oresta Piniazhko
- HTA Department of State Expert Centre of the Ministry of Health of Ukraine, Kyiv, Ukraine
| | - Alexandra Savova
- Department of Organization and Economics of Pharmacy, Faculty of Pharmacy, Medical University of Sofia, Sofia, Bulgaria
- National Council of Prices and Reimbursement of Medicinal Products, Sofia, Bulgaria
| | - Manoela Manova
- Department of Organization and Economics of Pharmacy, Faculty of Pharmacy, Medical University of Sofia, Sofia, Bulgaria
- National Council of Prices and Reimbursement of Medicinal Products, Sofia, Bulgaria
| | - Tomas Tesar
- Department of Organisation and Management of Pharmacy, Faculty of Pharmacy, Comenius University in Bratislava, Bratislava, Slovakia
| | | | - Zoltán Kaló
- Syreon Research Institute, Budapest, Hungary
- Centre for Health Technology Assessment, Semmelweis University, Budapest, Hungary
| |
Collapse
|
13
|
Nattel S. Digital Technologies: Revolutionizing Cardiovascular Medicine and Reshaping the World. Can J Cardiol 2021; 38:142-144. [PMID: 34954008 DOI: 10.1016/j.cjca.2021.12.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Accepted: 12/19/2021] [Indexed: 11/26/2022] Open
Affiliation(s)
- Stanley Nattel
- Department of Medicine and Research Center, Montreal Heart Institute and Université de Montréal, Montreal, Quebec, Canada; Institute of Pharmacology, West German Heart and Vascular Center, University Duisburg-Essen, Germany; IHU LIRYC and Fondation Bordeaux Université, Bordeaux, France.
| |
Collapse
|