1
|
Fernandez V, Pinaya WHL, Borges P, Graham MS, Tudosiu PD, Vercauteren T, Cardoso MJ. Generating multi-pathological and multi-modal images and labels for brain MRI. Med Image Anal 2024; 97:103278. [PMID: 39059240 DOI: 10.1016/j.media.2024.103278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 07/04/2024] [Accepted: 07/15/2024] [Indexed: 07/28/2024]
Abstract
The last few years have seen a boom in using generative models to augment real datasets, as synthetic data can effectively model real data distributions and provide privacy-preserving, shareable datasets that can be used to train deep learning models. However, most of these methods are 2D and provide synthetic datasets that come, at most, with categorical annotations. The generation of paired images and segmentation samples that can be used in downstream, supervised segmentation tasks remains fairly uncharted territory. This work proposes a two-stage generative model capable of producing 2D and 3D semantic label maps and corresponding multi-modal images. We use a latent diffusion model for label synthesis and a VAE-GAN for semantic image synthesis. Synthetic datasets provided by this model are shown to work in a wide variety of segmentation tasks, supporting small, real datasets or fully replacing them while maintaining good performance. We also demonstrate its ability to improve downstream performance on out-of-distribution data.
Collapse
Affiliation(s)
- Virginia Fernandez
- Department of Biomedical Engineering and Imaging Sciences, King's College London, Strand, London, WC2R 2LS, United Kingdom.
| | - Walter Hugo Lopez Pinaya
- Department of Biomedical Engineering and Imaging Sciences, King's College London, Strand, London, WC2R 2LS, United Kingdom
| | - Pedro Borges
- Department of Biomedical Engineering and Imaging Sciences, King's College London, Strand, London, WC2R 2LS, United Kingdom
| | - Mark S Graham
- Department of Biomedical Engineering and Imaging Sciences, King's College London, Strand, London, WC2R 2LS, United Kingdom
| | - Petru-Daniel Tudosiu
- Department of Biomedical Engineering and Imaging Sciences, King's College London, Strand, London, WC2R 2LS, United Kingdom
| | - Tom Vercauteren
- Department of Biomedical Engineering and Imaging Sciences, King's College London, Strand, London, WC2R 2LS, United Kingdom
| | - M Jorge Cardoso
- Department of Biomedical Engineering and Imaging Sciences, King's College London, Strand, London, WC2R 2LS, United Kingdom
| |
Collapse
|
2
|
Mehari M, Sibih Y, Dada A, Chang SM, Wen PY, Molinaro AM, Chukwueke UN, Budhu JA, Jackson S, McFaline-Figueroa JR, Porter A, Hervey-Jumper SL. Enhancing neuro-oncology care through equity-driven applications of artificial intelligence. Neuro Oncol 2024:noae127. [PMID: 39159285 DOI: 10.1093/neuonc/noae127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/21/2024] Open
Abstract
The disease course and clinical outcome for brain tumor patients depend not only on the molecular and histological features of the tumor but also on the patient's demographics and social determinants of health. While current investigations in neuro-oncology have broadly utilized artificial intelligence (AI) to enrich tumor diagnosis and more accurately predict treatment response, postoperative complications, and survival, equity-driven applications of AI have been limited. However, AI applications to advance health equity in the broader medical field have the potential to serve as practical blueprints to address known disparities in neuro-oncologic care. In this consensus review, we will describe current applications of AI in neuro-oncology, postulate viable AI solutions for the most pressing inequities in neuro-oncology based on broader literature, propose a framework for the effective integration of equity into AI-based neuro-oncology research, and close with the limitations of AI.
Collapse
Affiliation(s)
- Mulki Mehari
- Department of Neurosurgery, University of California, San Francisco, San Francisco, California, USA
| | - Youssef Sibih
- Department of Neurosurgery, University of California, San Francisco, San Francisco, California, USA
| | - Abraham Dada
- Department of Neurosurgery, University of California, San Francisco, San Francisco, California, USA
| | - Susan M Chang
- Division of Neuro-Oncology, University of California San Francisco and Weill Institute for Neurosciences, San Francisco, California, USA
| | - Patrick Y Wen
- Center for Neuro-Oncology, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts, USA
| | - Annette M Molinaro
- Department of Neurosurgery, University of California, San Francisco, San Francisco, California, USA
| | - Ugonma N Chukwueke
- Center for Neuro-Oncology, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts, USA
| | - Joshua A Budhu
- Department of Neurology, Memorial Sloan Kettering Cancer Center, Department of Neurology, Weill Cornell Medicine, Joan & Sanford I. Weill Medical College of Cornell University, New York, New York, USA
| | - Sadhana Jackson
- Surgical Neurology Branch, National Institute of Neurological Disorders and Stroke, Pediatric Oncology Branch, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | - J Ricardo McFaline-Figueroa
- Center for Neuro-Oncology, Department of Medical Oncology, Dana-Farber Cancer Institute, Harvard Medical School, Boston, Massachusetts, USA
| | - Alyx Porter
- Division of Neuro-Oncology, Department of Neurology, Mayo Clinic, Phoenix, Arizona, USA
| | - Shawn L Hervey-Jumper
- Department of Neurosurgery, University of California, San Francisco, San Francisco, California, USA
| |
Collapse
|
3
|
Kargilis DC, Xu W, Reddy S, Ramesh SSK, Wang S, Le AD, Rajapakse CS. Deep learning segmentation of mandible with lower dentition from cone beam CT. Oral Radiol 2024:10.1007/s11282-024-00770-6. [PMID: 39141154 DOI: 10.1007/s11282-024-00770-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Accepted: 08/08/2024] [Indexed: 08/15/2024]
Abstract
OBJECTIVES This study aimed to train a 3D U-Net convolutional neural network (CNN) for mandible and lower dentition segmentation from cone-beam computed tomography (CBCT) scans. METHODS In an ambispective cross-sectional design, CBCT scans from two hospitals (2009-2019 and 2021-2022) constituted an internal dataset and external validation set, respectively. Manual segmentation informed CNN training, and evaluations employed Dice similarity coefficient (DSC) for volumetric accuracy. A blinded oral maxillofacial surgeon performed qualitative grading of CBCT scans and object meshes. Statistical analyses included independent t-tests and ANOVA tests to compare DSC across patient subgroups of gender, race, body mass index (BMI), test dataset used, age, and degree of metal artifact. Tests were powered for a minimum detectable difference in DSC of 0.025, with alpha of 0.05 and power level of 0.8. RESULTS 648 CBCT scans from 490 patients were included in the study. The CNN achieved high accuracy (average DSC: 0.945 internal, 0.940 external). No DSC differences were observed between test set used, gender, BMI, and race. Significant differences in DSC were identified based on age group and the degree of metal artifact. The majority (80%) of object meshes produced by both manual and automatic segmentation were rated as acceptable or higher quality. CONCLUSION We developed a model for automatic mandible and lower dentition segmentation from CBCT scans in a demographically diverse cohort including a high degree of metal artifacts. The model demonstrated good accuracy on internal and external test sets, with majority acceptable quality from a clinical grader.
Collapse
Affiliation(s)
- Daniel C Kargilis
- University of Pennsylvania, 1 Founders Pavilion, 3400 Spruce Street, Philadelphia, PA, 19104-4283, USA.
- Johns Hopkins University, Baltimore, USA.
| | - Winnie Xu
- University of Pennsylvania, 1 Founders Pavilion, 3400 Spruce Street, Philadelphia, PA, 19104-4283, USA
| | - Samir Reddy
- University of Pennsylvania, 1 Founders Pavilion, 3400 Spruce Street, Philadelphia, PA, 19104-4283, USA
| | | | - Steven Wang
- University of Pennsylvania, 1 Founders Pavilion, 3400 Spruce Street, Philadelphia, PA, 19104-4283, USA
| | - Anh D Le
- University of Pennsylvania, 1 Founders Pavilion, 3400 Spruce Street, Philadelphia, PA, 19104-4283, USA
| | - Chamith S Rajapakse
- University of Pennsylvania, 1 Founders Pavilion, 3400 Spruce Street, Philadelphia, PA, 19104-4283, USA
| |
Collapse
|
4
|
Federico CA, Trotsyuk AA. Biomedical Data Science, Artificial Intelligence, and Ethics: Navigating Challenges in the Face of Explosive Growth. Annu Rev Biomed Data Sci 2024; 7:1-14. [PMID: 38598860 DOI: 10.1146/annurev-biodatasci-102623-104553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/12/2024]
Abstract
Advances in biomedical data science and artificial intelligence (AI) are profoundly changing the landscape of healthcare. This article reviews the ethical issues that arise with the development of AI technologies, including threats to privacy, data security, consent, and justice, as they relate to donors of tissue and data. It also considers broader societal obligations, including the importance of assessing the unintended consequences of AI research in biomedicine. In addition, this article highlights the challenge of rapid AI development against the backdrop of disparate regulatory frameworks, calling for a global approach to address concerns around data misuse, unintended surveillance, and the equitable distribution of AI's benefits and burdens. Finally, a number of potential solutions to these ethical quandaries are offered. Namely, the merits of advocating for a collaborative, informed, and flexible regulatory approach that balances innovation with individual rights and public welfare, fostering a trustworthy AI-driven healthcare ecosystem, are discussed.
Collapse
Affiliation(s)
- Carole A Federico
- Center for Biomedical Ethics, Stanford University School of Medicine, Stanford, California, USA; ,
| | - Artem A Trotsyuk
- Center for Biomedical Ethics, Stanford University School of Medicine, Stanford, California, USA; ,
| |
Collapse
|
5
|
Siddiqui IA, Littlefield N, Carlson LA, Gong M, Chhabra A, Menezes Z, Mastorakos GM, Thakar SM, Abedian M, Lohse I, Weiss KR, Plate JF, Moradi H, Amirian S, Tafti AP. Fair AI-powered orthopedic image segmentation: addressing bias and promoting equitable healthcare. Sci Rep 2024; 14:16105. [PMID: 38997335 PMCID: PMC11245517 DOI: 10.1038/s41598-024-66873-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 07/04/2024] [Indexed: 07/14/2024] Open
Abstract
AI-powered segmentation of hip and knee bony anatomy has revolutionized orthopedics, transforming pre-operative planning and post-operative assessment. Despite the remarkable advancements in AI algorithms for medical imaging, the potential for biases inherent within these models remains largely unexplored. This study tackles these concerns by thoroughly re-examining AI-driven segmentation for hip and knee bony anatomy. While advanced imaging modalities like CT and MRI offer comprehensive views, plain radiographs (X-rays) predominate the standard initial clinical assessment due to their widespread availability, low cost, and rapid acquisition. Hence, we focused on plain radiographs to ensure the utilization of our contribution in diverse healthcare settings, including those with limited access to advanced imaging technologies. This work provides insights into the underlying causes of biases in AI-based knee and hip image segmentation through an extensive evaluation, presenting targeted mitigation strategies to alleviate biases related to sex, race, and age, using an automatic segmentation that is fair, impartial, and safe in the context of AI. Our contribution can enhance inclusivity, ethical practices, equity, and an unbiased healthcare environment with advanced clinical outcomes, aiding decision-making and osteoarthritis research. Furthermore, we have made all the codes and datasets publicly and freely accessible to promote open scientific research.
Collapse
Affiliation(s)
- Ismaeel A Siddiqui
- Department of Health Information Management, University of Pittsburgh, Pittsburgh, 15620, USA
| | | | - Luke A Carlson
- Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, 15213, USA
| | - Matthew Gong
- Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, 15213, USA
| | - Avani Chhabra
- Department of Health Information Management, University of Pittsburgh, Pittsburgh, 15620, USA
| | - Zoe Menezes
- Department of Health Information Management, University of Pittsburgh, Pittsburgh, 15620, USA
| | | | - Sakshi Mehul Thakar
- Department of Health Information Management, University of Pittsburgh, Pittsburgh, 15620, USA
| | - Mehrnaz Abedian
- Department of Health Information Management, University of Pittsburgh, Pittsburgh, 15620, USA
| | - Ines Lohse
- Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, 15213, USA
| | - Kurt R Weiss
- Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, 15213, USA
| | - Johannes F Plate
- Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, 15213, USA.
| | - Hamidreza Moradi
- Department of Computer Science, North Carolina Agricultural and Technical State University, Greensboro, 27411, USA.
| | - Soheyla Amirian
- Seidenberg School of Computer Science and Information Systems, Pace University, New York, 10038, USA.
| | - Ahmad P Tafti
- Department of Health Information Management, University of Pittsburgh, Pittsburgh, 15620, USA.
- Intelligent Systems Program, University of Pittsburgh, Pittsburgh, 5620, USA.
| |
Collapse
|
6
|
Chen F, Wang L, Hong J, Jiang J, Zhou L. Unmasking bias in artificial intelligence: a systematic review of bias detection and mitigation strategies in electronic health record-based models. ARXIV 2024:arXiv:2310.19917v3. [PMID: 39010875 PMCID: PMC11247915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 07/17/2024]
Abstract
Objectives Leveraging artificial intelligence (AI) in conjunction with electronic health records (EHRs) holds transformative potential to improve healthcare. However, addressing bias in AI, which risks worsening healthcare disparities, cannot be overlooked. This study reviews methods to handle various biases in AI models developed using EHR data. Materials and Methods We conducted a systematic review following the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines, analyzing articles from PubMed, Web of Science, and IEEE published between January 01, 2010 and December 17, 2023. The review identified key biases, outlined strategies for detecting and mitigating bias throughout the AI model development, and analyzed metrics for bias assessment. Results Of the 450 articles retrieved, 20 met our criteria, revealing 6 major bias types: algorithmic, confounding, implicit, measurement, selection, and temporal. The AI models were primarily developed for predictive tasks, yet none have been deployed in real-world healthcare settings. Five studies concentrated on the detection of implicit and algorithmic biases employing fairness metrics like statistical parity, equal opportunity, and predictive equity. Fifteen studies proposed strategies for mitigating biases, especially targeting implicit and selection biases. These strategies, evaluated through both performance and fairness metrics, predominantly involved data collection and preprocessing techniques like resampling and reweighting. Discussion This review highlights evolving strategies to mitigate bias in EHR-based AI models, emphasizing the urgent need for both standardized and detailed reporting of the methodologies and systematic real-world testing and evaluation. Such measures are essential for gauging models' practical impact and fostering ethical AI that ensures fairness and equity in healthcare.
Collapse
Affiliation(s)
- Feng Chen
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States
- Department of Biomedical Informatics and Health Education, University of Washington, Seattle, WA 98105, United States
| | - Liqin Wang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States
- Division of General Internal Medicine and Primary Care, Brigham and Women’s Hospital, Boston, MA 02115, United States
| | - Julie Hong
- Wellesley High School, Wellesley, MA 02481, United States
| | - Jiaqi Jiang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States
| | - Li Zhou
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States
- Division of General Internal Medicine and Primary Care, Brigham and Women’s Hospital, Boston, MA 02115, United States
| |
Collapse
|
7
|
Carrillo-Larco RM. Recognition of Patient Gender: A Machine Learning Preliminary Analysis Using Heart Sounds from Children and Adolescents. Pediatr Cardiol 2024:10.1007/s00246-024-03561-2. [PMID: 38937337 DOI: 10.1007/s00246-024-03561-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/15/2024] [Accepted: 06/19/2024] [Indexed: 06/29/2024]
Abstract
Research has shown that X-rays and fundus images can classify gender, age group, and race, raising concerns about bias and fairness in medical AI applications. However, the potential for physiological sounds to classify sociodemographic traits has not been investigated. Exploring this gap is crucial for understanding the implications and ensuring fairness in the field of medical sound analysis. We aimed to develop classifiers to determine gender (men/women) based on heart sound recordings and using machine learning (ML). Data-driven ML analysis. We utilized the open-access CirCor DigiScope Phonocardiogram Dataset obtained from cardiac screening programs in Brazil. Volunteers < 21 years of age. Each participant completed a questionnaire and underwent a clinical examination, including electronic auscultation at four cardiac points: aortic (AV), mitral (MV), pulmonary (PV), and tricuspid (TV). We used Mel-frequency cepstral coefficients (MFCCs) to develop the ML classifiers. From each patient and from each auscultation sound recording, we extracted 10 MFCCs. In sensitivity analysis, we additionally extracted 20, 30, 40, and 50 MFCCs. The most effective gender classifier was developed using PV recordings (AUC ROC = 70.3%). The second best came from MV recordings (AUC ROC = 58.8%). AV and TV recordings produced classifiers with an AUC ROC of 56.4% and 56.1%, respectively. Using more MFCCs did not substantially improve the classifiers. It is possible to classify between males and females using phonocardiogram data. As health-related audio recordings become more prominent in ML applications, research is required to explore if these recordings contain signals that could distinguish sociodemographic features.
Collapse
Affiliation(s)
- Rodrigo M Carrillo-Larco
- Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, GA, USA.
| |
Collapse
|
8
|
Wen D, Soltan A, Trucco E, Matin RN. From data to diagnosis: skin cancer image datasets for artificial intelligence. Clin Exp Dermatol 2024; 49:675-685. [PMID: 38549552 DOI: 10.1093/ced/llae112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Revised: 02/11/2024] [Accepted: 03/25/2024] [Indexed: 06/26/2024]
Abstract
Artificial intelligence (AI) solutions for skin cancer diagnosis continue to gain momentum, edging closer towards broad clinical use. These AI models, particularly deep-learning architectures, require large digital image datasets for development. This review provides an overview of the datasets used to develop AI algorithms and highlights the importance of dataset transparency for the evaluation of algorithm generalizability across varying populations and settings. Current challenges for curation of clinically valuable datasets are detailed, which include dataset shifts arising from demographic variations and differences in data collection methodologies, along with inconsistencies in labelling. These shifts can lead to differential algorithm performance, compromise of clinical utility, and the propagation of discriminatory biases when developed algorithms are implemented in mismatched populations. Limited representation of rare skin cancers and minoritized groups in existing datasets are highlighted, which can further skew algorithm performance. Strategies to address these challenges are presented, which include improving transparency, representation and interoperability. Federated learning and generative methods, which may improve dataset size and diversity without compromising privacy, are also examined. Lastly, we discuss model-level techniques that may address biases entrained through the use of datasets derived from routine clinical care. As the role of AI in skin cancer diagnosis becomes more prominent, ensuring the robustness of underlying datasets is increasingly important.
Collapse
Affiliation(s)
- David Wen
- Department of Dermatology, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
- Oxford University Clinical Academic Graduate School, University of Oxford, Oxford, UK
| | - Andrew Soltan
- Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK
- Oxford Cancer and Haematology Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
- Department of Oncology, University of Oxford, Oxford, UK
| | - Emanuele Trucco
- VAMPIRE Project, Computing, School of Science and Engineering, University of Dundee, Dundee, UK
| | - Rubeta N Matin
- Department of Dermatology, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
- Artificial Intelligence Working Party Group, British Association of Dermatologists, London, UK
| |
Collapse
|
9
|
Tan W, Wei Q, Xing Z, Fu H, Kong H, Lu Y, Yan B, Zhao C. Fairer AI in ophthalmology via implicit fairness learning for mitigating sexism and ageism. Nat Commun 2024; 15:4750. [PMID: 38834557 DOI: 10.1038/s41467-024-48972-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2023] [Accepted: 05/21/2024] [Indexed: 06/06/2024] Open
Abstract
The transformative role of artificial intelligence (AI) in various fields highlights the need for it to be both accurate and fair. Biased medical AI systems pose significant potential risks to achieving fair and equitable healthcare. Here, we show an implicit fairness learning approach to build a fairer ophthalmology AI (called FairerOPTH) that mitigates sex (biological attribute) and age biases in AI diagnosis of eye diseases. Specifically, FairerOPTH incorporates the causal relationship between fundus features and eye diseases, which is relatively independent of sensitive attributes such as race, sex, and age. We demonstrate on a large and diverse collected dataset that FairerOPTH significantly outperforms several state-of-the-art approaches in terms of diagnostic accuracy and fairness for 38 eye diseases in ultra-widefield imaging and 16 eye diseases in narrow-angle imaging. This work demonstrates the significant potential of implicit fairness learning in promoting equitable treatment for patients regardless of their sex or age.
Collapse
Affiliation(s)
- Weimin Tan
- School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Qiaoling Wei
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
| | - Zhen Xing
- School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Hao Fu
- School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Hongyu Kong
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China
| | - Yi Lu
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China.
| | - Bo Yan
- School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai, China.
| | - Chen Zhao
- Eye Institute and Department of Ophthalmology, Eye & ENT Hospital, Fudan University, Shanghai, China.
| |
Collapse
|
10
|
Yang Y, Lin M, Zhao H, Peng Y, Huang F, Lu Z. A survey of recent methods for addressing AI fairness and bias in biomedicine. J Biomed Inform 2024; 154:104646. [PMID: 38677633 PMCID: PMC11129918 DOI: 10.1016/j.jbi.2024.104646] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Accepted: 04/17/2024] [Indexed: 04/29/2024]
Abstract
OBJECTIVES Artificial intelligence (AI) systems have the potential to revolutionize clinical practices, including improving diagnostic accuracy and surgical decision-making, while also reducing costs and manpower. However, it is important to recognize that these systems may perpetuate social inequities or demonstrate biases, such as those based on race or gender. Such biases can occur before, during, or after the development of AI models, making it critical to understand and address potential biases to enable the accurate and reliable application of AI models in clinical settings. To mitigate bias concerns during model development, we surveyed recent publications on different debiasing methods in the fields of biomedical natural language processing (NLP) or computer vision (CV). Then we discussed the methods, such as data perturbation and adversarial learning, that have been applied in the biomedical domain to address bias. METHODS We performed our literature search on PubMed, ACM digital library, and IEEE Xplore of relevant articles published between January 2018 and December 2023 using multiple combinations of keywords. We then filtered the result of 10,041 articles automatically with loose constraints, and manually inspected the abstracts of the remaining 890 articles to identify the 55 articles included in this review. Additional articles in the references are also included in this review. We discuss each method and compare its strengths and weaknesses. Finally, we review other potential methods from the general domain that could be applied to biomedicine to address bias and improve fairness. RESULTS The bias of AIs in biomedicine can originate from multiple sources such as insufficient data, sampling bias and the use of health-irrelevant features or race-adjusted algorithms. Existing debiasing methods that focus on algorithms can be categorized into distributional or algorithmic. Distributional methods include data augmentation, data perturbation, data reweighting methods, and federated learning. Algorithmic approaches include unsupervised representation learning, adversarial learning, disentangled representation learning, loss-based methods and causality-based methods.
Collapse
Affiliation(s)
- Yifan Yang
- National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA; Department of Computer Science, University of Maryland, College Park, USA
| | - Mingquan Lin
- Department of Population Health Sciences, Weill Cornell Medicine, NY, USA
| | - Han Zhao
- Department of Computer Science, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - Yifan Peng
- Department of Population Health Sciences, Weill Cornell Medicine, NY, USA
| | - Furong Huang
- Department of Computer Science, University of Maryland, College Park, USA
| | - Zhiyong Lu
- National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
| |
Collapse
|
11
|
Baeßler B, Engelhardt S, Hekalo A, Hennemuth A, Hüllebrand M, Laube A, Scherer C, Tölle M, Wech T. Perfect Match: Radiomics and Artificial Intelligence in Cardiac Imaging. Circ Cardiovasc Imaging 2024; 17:e015490. [PMID: 38889216 DOI: 10.1161/circimaging.123.015490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/20/2024]
Abstract
Cardiovascular diseases remain a significant health burden, with imaging modalities like echocardiography, cardiac computed tomography, and cardiac magnetic resonance imaging playing a crucial role in diagnosis and prognosis. However, the inherent heterogeneity of these diseases poses challenges, necessitating advanced analytical methods like radiomics and artificial intelligence. Radiomics extracts quantitative features from medical images, capturing intricate patterns and subtle variations that may elude visual inspection. Artificial intelligence techniques, including deep learning, can analyze these features to generate knowledge, define novel imaging biomarkers, and support diagnostic decision-making and outcome prediction. Radiomics and artificial intelligence thus hold promise for significantly enhancing diagnostic and prognostic capabilities in cardiac imaging, paving the way for more personalized and effective patient care. This review explores the synergies between radiomics and artificial intelligence in cardiac imaging, following the radiomics workflow and introducing concepts from both domains. Potential clinical applications, challenges, and limitations are discussed, along with solutions to overcome them.
Collapse
Affiliation(s)
- Bettina Baeßler
- Department of Diagnostic and Interventional Radiology, University Hospital Würzburg, Germany (B.B., A. Hekalo, T.W.)
| | - Sandy Engelhardt
- Department of Internal Medicine III, Heidelberg University Hospital, Germany (S.E., M.T.)
- DZHK (German Centre for Cardiovascular Research), partner site Heidelberg/Mannheim (S.E., M.T.)
| | - Amar Hekalo
- Department of Diagnostic and Interventional Radiology, University Hospital Würzburg, Germany (B.B., A. Hekalo, T.W.)
| | - Anja Hennemuth
- Deutsches Herzzentrum der Charité, Institute of Computer-assisted Cardiovascular Medicine, Berlin, Germany (A. Hennemuth, M.H., A.L.)
- Charité - Universitätsmedizin Berlin, Freie Universität Berlin and Humboldt Universität zu Berlin, Germany (A. Hennemuth, M.H., A.L.)
- Fraunhofer Institute for Digital Medicine MEVIS, Berlin, Germany (A. Hennemuth, M.H.)
- DZHK (German Centre for Cardiovascular Research), partner site Berlin (A. Hennemuth, M.H., A.L.)
- Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf, Germany (A. Hennemuth)
| | - Markus Hüllebrand
- Deutsches Herzzentrum der Charité, Institute of Computer-assisted Cardiovascular Medicine, Berlin, Germany (A. Hennemuth, M.H., A.L.)
- Charité - Universitätsmedizin Berlin, Freie Universität Berlin and Humboldt Universität zu Berlin, Germany (A. Hennemuth, M.H., A.L.)
- Fraunhofer Institute for Digital Medicine MEVIS, Berlin, Germany (A. Hennemuth, M.H.)
- DZHK (German Centre for Cardiovascular Research), partner site Berlin (A. Hennemuth, M.H., A.L.)
| | - Ann Laube
- Deutsches Herzzentrum der Charité, Institute of Computer-assisted Cardiovascular Medicine, Berlin, Germany (A. Hennemuth, M.H., A.L.)
- Charité - Universitätsmedizin Berlin, Freie Universität Berlin and Humboldt Universität zu Berlin, Germany (A. Hennemuth, M.H., A.L.)
- DZHK (German Centre for Cardiovascular Research), partner site Berlin (A. Hennemuth, M.H., A.L.)
| | - Clemens Scherer
- Department of Medicine I, LMU University Hospital, LMU Munich, Germany (C.S.)
- Munich Heart Alliance, German Center for Cardiovascular Research (DZHK), Germany (C.S.)
| | - Malte Tölle
- Department of Internal Medicine III, Heidelberg University Hospital, Germany (S.E., M.T.)
- DZHK (German Centre for Cardiovascular Research), partner site Heidelberg/Mannheim (S.E., M.T.)
| | - Tobias Wech
- Department of Diagnostic and Interventional Radiology, University Hospital Würzburg, Germany (B.B., A. Hekalo, T.W.)
- Comprehensive Heart Failure Center (CHFC), University Hospital Würzburg, Germany (T.W.)
| |
Collapse
|
12
|
Gaggion N, Mosquera C, Mansilla L, Saidman JM, Aineseder M, Milone DH, Ferrante E. CheXmask: a large-scale dataset of anatomical segmentation masks for multi-center chest x-ray images. Sci Data 2024; 11:511. [PMID: 38760409 PMCID: PMC11101488 DOI: 10.1038/s41597-024-03358-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Accepted: 05/08/2024] [Indexed: 05/19/2024] Open
Abstract
The development of successful artificial intelligence models for chest X-ray analysis relies on large, diverse datasets with high-quality annotations. While several databases of chest X-ray images have been released, most include disease diagnosis labels but lack detailed pixel-level anatomical segmentation labels. To address this gap, we introduce an extensive chest X-ray multi-center segmentation dataset with uniform and fine-grain anatomical annotations for images coming from five well-known publicly available databases: ChestX-ray8, CheXpert, MIMIC-CXR-JPG, Padchest, and VinDr-CXR, resulting in 657,566 segmentation masks. Our methodology utilizes the HybridGNet model to ensure consistent and high-quality segmentations across all datasets. Rigorous validation, including expert physician evaluation and automatic quality control, was conducted to validate the resulting masks. Additionally, we provide individualized quality indices per mask and an overall quality estimation per dataset. This dataset serves as a valuable resource for the broader scientific community, streamlining the development and assessment of innovative methodologies in chest X-ray analysis.
Collapse
Affiliation(s)
- Nicolás Gaggion
- Institute for Signals, Systems and Computational Intelligence, sinc(i) CONICET-UNL, Santa Fe, CP 3002, Argentina
| | - Candelaria Mosquera
- Health Informatics Department at Hospital Italiano de Buenos Aires, Buenos Aires, CP 1199, Argentina
- Universidad Tecnológica Nacional, Buenos Aires, CP 1179, Argentina
| | - Lucas Mansilla
- Institute for Signals, Systems and Computational Intelligence, sinc(i) CONICET-UNL, Santa Fe, CP 3002, Argentina
| | - Julia Mariel Saidman
- Radiology Department, Hospital Italiano de Buenos Aires, Buenos Aires, CP 1199, Argentina
| | - Martina Aineseder
- Radiology Department, Hospital Italiano de Buenos Aires, Buenos Aires, CP 1199, Argentina
| | - Diego H Milone
- Institute for Signals, Systems and Computational Intelligence, sinc(i) CONICET-UNL, Santa Fe, CP 3002, Argentina
| | - Enzo Ferrante
- Institute for Signals, Systems and Computational Intelligence, sinc(i) CONICET-UNL, Santa Fe, CP 3002, Argentina.
| |
Collapse
|
13
|
Liu RW, Ong W, Makmur A, Kumar N, Low XZ, Shuliang G, Liang TY, Ting DFK, Tan JH, Hallinan JTPD. Application of Artificial Intelligence Methods on Osteoporosis Classification with Radiographs-A Systematic Review. Bioengineering (Basel) 2024; 11:484. [PMID: 38790351 PMCID: PMC11117497 DOI: 10.3390/bioengineering11050484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Revised: 04/24/2024] [Accepted: 05/07/2024] [Indexed: 05/26/2024] Open
Abstract
Osteoporosis is a complex endocrine disease characterized by a decline in bone mass and microstructural integrity. It constitutes a major global health problem. Recent progress in the field of artificial intelligence (AI) has opened new avenues for the effective diagnosis of osteoporosis via radiographs. This review investigates the application of AI classification of osteoporosis in radiographs. A comprehensive exploration of electronic repositories (ClinicalTrials.gov, Web of Science, PubMed, MEDLINE) was carried out in adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 statement (PRISMA). A collection of 31 articles was extracted from these repositories and their significant outcomes were consolidated and outlined. This encompassed insights into anatomical regions, the specific machine learning methods employed, the effectiveness in predicting BMD, and categorizing osteoporosis. Through analyzing the respective studies, we evaluated the effectiveness and limitations of AI osteoporosis classification in radiographs. The pooled reported accuracy, sensitivity, and specificity of osteoporosis classification ranges from 66.1% to 97.9%, 67.4% to 100.0%, and 60.0% to 97.5% respectively. This review underscores the potential of AI osteoporosis classification and offers valuable insights for future research endeavors, which should focus on addressing the challenges in technical and clinical integration to facilitate practical implementation of this technology.
Collapse
Affiliation(s)
- Ren Wei Liu
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore (D.F.K.T.)
| | - Wilson Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore (D.F.K.T.)
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore (D.F.K.T.)
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Naresh Kumar
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - Xi Zhen Low
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore (D.F.K.T.)
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Ge Shuliang
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore (D.F.K.T.)
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Tan Yi Liang
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore (D.F.K.T.)
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Dominic Fong Kuan Ting
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore (D.F.K.T.)
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| | - Jiong Hao Tan
- University Spine Centre, Department of Orthopaedic Surgery, National University Health System, 1E, Lower Kent Ridge Road, Singapore 119228, Singapore
| | - James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Road, Singapore 119074, Singapore (D.F.K.T.)
- Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, 10 Medical Drive, Singapore 117597, Singapore
| |
Collapse
|
14
|
Girach Z, Sarian A, Maldonado-García C, Ravikumar N, Sergouniotis PI, Rothwell PM, Frangi AF, Julian TH. Retinal imaging for the assessment of stroke risk: a systematic review. J Neurol 2024; 271:2285-2297. [PMID: 38430271 PMCID: PMC11055692 DOI: 10.1007/s00415-023-12171-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2023] [Revised: 12/21/2023] [Accepted: 12/23/2023] [Indexed: 03/03/2024]
Abstract
BACKGROUND Stroke is a leading cause of morbidity and mortality. Retinal imaging allows non-invasive assessment of the microvasculature. Consequently, retinal imaging is a technology which is garnering increasing attention as a means of assessing cardiovascular health and stroke risk. METHODS A biomedical literature search was performed to identify prospective studies that assess the role of retinal imaging derived biomarkers as indicators of stroke risk. RESULTS Twenty-four studies were included in this systematic review. The available evidence suggests that wider retinal venules, lower fractal dimension, increased arteriolar tortuosity, presence of retinopathy, and presence of retinal emboli are associated with increased likelihood of stroke. There is weaker evidence to suggest that narrower arterioles and the presence of individual retinopathy traits such as microaneurysms and arteriovenous nicking indicate increased stroke risk. Our review identified three models utilizing artificial intelligence algorithms for the analysis of retinal images to predict stroke. Two of these focused on fundus photographs, whilst one also utilized optical coherence tomography (OCT) technology images. The constructed models performed similarly to conventional risk scores but did not significantly exceed their performance. Only two studies identified in this review used OCT imaging, despite the higher dimensionality of this data. CONCLUSION Whilst there is strong evidence that retinal imaging features can be used to indicate stroke risk, there is currently no predictive model which significantly outperforms conventional risk scores. To develop clinically useful tools, future research should focus on utilization of deep learning algorithms, validation in external cohorts, and analysis of OCT images.
Collapse
Affiliation(s)
- Zain Girach
- Sheffield Medical School, University of Sheffield, Beech Hill Rd, Broomhall, Sheffield, UK
| | - Arni Sarian
- Manchester Royal Infirmary, Manchester University NHS Foundation Trust, Oxford Rd, Manchester, UK
| | - Cynthia Maldonado-García
- Centre for Computational Imaging and Simulation Technologies in Biomedicine, School of Computing, University of Leeds, Leeds, UK
| | - Nishant Ravikumar
- Centre for Computational Imaging and Simulation Technologies in Biomedicine, School of Computing, University of Leeds, Leeds, UK
| | - Panagiotis I Sergouniotis
- Division of Evolution, Infection and Genomics, School of Biological Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK
- European Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI), Wellcome Genome Campus, Hinxton, UK
- Manchester Centre for Genomic Medicine, Saint Mary's Hospital, Manchester University NHS Foundation Trust, Manchester, UK
- Manchester Royal Eye Hospital, Manchester University NHS Foundation Trust, Oxford Rd, Manchester, UK
| | - Peter M Rothwell
- Wolfson Centre for the Prevention of Stroke and Dementia, University of Oxford, Oxford, UK
| | - Alejandro F Frangi
- Division of Informatics, Imaging and Data Sciences, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK
- School of Computer Science, Faculty of Science and Engineering, University of Manchester, Kilburn Building, Manchester, UK
- Christabel Pankhurst Institute, The University of Manchester, Manchester, UK
| | - Thomas H Julian
- Division of Evolution, Infection and Genomics, School of Biological Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK.
- European Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI), Wellcome Genome Campus, Hinxton, UK.
- Manchester Centre for Genomic Medicine, Saint Mary's Hospital, Manchester University NHS Foundation Trust, Manchester, UK.
- Manchester Royal Eye Hospital, Manchester University NHS Foundation Trust, Oxford Rd, Manchester, UK.
| |
Collapse
|
15
|
Chen F, Wang L, Hong J, Jiang J, Zhou L. Unmasking bias in artificial intelligence: a systematic review of bias detection and mitigation strategies in electronic health record-based models. J Am Med Inform Assoc 2024; 31:1172-1183. [PMID: 38520723 PMCID: PMC11031231 DOI: 10.1093/jamia/ocae060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Revised: 02/26/2024] [Accepted: 03/05/2024] [Indexed: 03/25/2024] Open
Abstract
OBJECTIVES Leveraging artificial intelligence (AI) in conjunction with electronic health records (EHRs) holds transformative potential to improve healthcare. However, addressing bias in AI, which risks worsening healthcare disparities, cannot be overlooked. This study reviews methods to handle various biases in AI models developed using EHR data. MATERIALS AND METHODS We conducted a systematic review following the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines, analyzing articles from PubMed, Web of Science, and IEEE published between January 01, 2010 and December 17, 2023. The review identified key biases, outlined strategies for detecting and mitigating bias throughout the AI model development, and analyzed metrics for bias assessment. RESULTS Of the 450 articles retrieved, 20 met our criteria, revealing 6 major bias types: algorithmic, confounding, implicit, measurement, selection, and temporal. The AI models were primarily developed for predictive tasks, yet none have been deployed in real-world healthcare settings. Five studies concentrated on the detection of implicit and algorithmic biases employing fairness metrics like statistical parity, equal opportunity, and predictive equity. Fifteen studies proposed strategies for mitigating biases, especially targeting implicit and selection biases. These strategies, evaluated through both performance and fairness metrics, predominantly involved data collection and preprocessing techniques like resampling and reweighting. DISCUSSION This review highlights evolving strategies to mitigate bias in EHR-based AI models, emphasizing the urgent need for both standardized and detailed reporting of the methodologies and systematic real-world testing and evaluation. Such measures are essential for gauging models' practical impact and fostering ethical AI that ensures fairness and equity in healthcare.
Collapse
Affiliation(s)
- Feng Chen
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States
- Department of Biomedical Informatics and Health Education, University of Washington, Seattle, WA 98105, United States
| | - Liqin Wang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States
- Division of General Internal Medicine and Primary Care, Brigham and Women’s Hospital, Boston, MA 02115, United States
| | - Julie Hong
- Wellesley High School, Wellesley, MA 02481, United States
| | - Jiaqi Jiang
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States
| | - Li Zhou
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, United States
- Division of General Internal Medicine and Primary Care, Brigham and Women’s Hospital, Boston, MA 02115, United States
| |
Collapse
|
16
|
Ktena I, Wiles O, Albuquerque I, Rebuffi SA, Tanno R, Roy AG, Azizi S, Belgrave D, Kohli P, Cemgil T, Karthikesalingam A, Gowal S. Generative models improve fairness of medical classifiers under distribution shifts. Nat Med 2024; 30:1166-1173. [PMID: 38600282 PMCID: PMC11031395 DOI: 10.1038/s41591-024-02838-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 01/26/2024] [Indexed: 04/12/2024]
Abstract
Domain generalization is a ubiquitous challenge for machine learning in healthcare. Model performance in real-world conditions might be lower than expected because of discrepancies between the data encountered during deployment and development. Underrepresentation of some groups or conditions during model development is a common cause of this phenomenon. This challenge is often not readily addressed by targeted data acquisition and 'labeling' by expert clinicians, which can be prohibitively expensive or practically impossible because of the rarity of conditions or the available clinical expertise. We hypothesize that advances in generative artificial intelligence can help mitigate this unmet need in a steerable fashion, enriching our training dataset with synthetic examples that address shortfalls of underrepresented conditions or subgroups. We show that diffusion models can automatically learn realistic augmentations from data in a label-efficient manner. We demonstrate that learned augmentations make models more robust and statistically fair in-distribution and out of distribution. To evaluate the generality of our approach, we studied three distinct medical imaging contexts of varying difficulty: (1) histopathology, (2) chest X-ray and (3) dermatology images. Complementing real samples with synthetic ones improved the robustness of models in all three medical tasks and increased fairness by improving the accuracy of clinical diagnosis within underrepresented groups, especially out of distribution.
Collapse
|
17
|
Wang R, Kuo PC, Chen LC, Seastedt KP, Gichoya JW, Celi LA. Drop the shortcuts: image augmentation improves fairness and decreases AI detection of race and other demographics from medical images. EBioMedicine 2024; 102:105047. [PMID: 38471396 PMCID: PMC10945176 DOI: 10.1016/j.ebiom.2024.105047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 02/15/2024] [Accepted: 02/21/2024] [Indexed: 03/14/2024] Open
Abstract
BACKGROUND It has been shown that AI models can learn race on medical images, leading to algorithmic bias. Our aim in this study was to enhance the fairness of medical image models by eliminating bias related to race, age, and sex. We hypothesise models may be learning demographics via shortcut learning and combat this using image augmentation. METHODS This study included 44,953 patients who identified as Asian, Black, or White (mean age, 60.68 years ±18.21; 23,499 women) for a total of 194,359 chest X-rays (CXRs) from MIMIC-CXR database. The included CheXpert images comprised 45,095 patients (mean age 63.10 years ±18.14; 20,437 women) for a total of 134,300 CXRs were used for external validation. We also collected 1195 3D brain magnetic resonance imaging (MRI) data from the ADNI database, which included 273 participants with an average age of 76.97 years ±14.22, and 142 females. DL models were trained on either non-augmented or augmented images and assessed using disparity metrics. The features learned by the models were analysed using task transfer experiments and model visualisation techniques. FINDINGS In the detection of radiological findings, training a model using augmented CXR images was shown to reduce disparities in error rate among racial groups (-5.45%), age groups (-13.94%), and sex (-22.22%). For AD detection, the model trained with augmented MRI images was shown 53.11% and 31.01% reduction of disparities in error rate among age and sex groups, respectively. Image augmentation led to a reduction in the model's ability to identify demographic attributes and resulted in the model trained for clinical purposes incorporating fewer demographic features. INTERPRETATION The model trained using the augmented images was less likely to be influenced by demographic information in detecting image labels. These results demonstrate that the proposed augmentation scheme could enhance the fairness of interpretations by DL models when dealing with data from patients with different demographic backgrounds. FUNDING National Science and Technology Council (Taiwan), National Institutes of Health.
Collapse
Affiliation(s)
- Ryan Wang
- Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan
| | - Po-Chih Kuo
- Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan.
| | - Li-Ching Chen
- Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan
| | - Kenneth Patrick Seastedt
- Department of Surgery, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA; Department of Thoracic Surgery, Roswell Park Comprehensive Cancer Center, Buffalo, NY, USA
| | | | - Leo Anthony Celi
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, USA; Division of Pulmonary Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA; Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| |
Collapse
|
18
|
Yao S, Dai F, Sun P, Zhang W, Qian B, Lu H. Enhancing the fairness of AI prediction models by Quasi-Pareto improvement among heterogeneous thyroid nodule population. Nat Commun 2024; 15:1958. [PMID: 38438371 PMCID: PMC10912763 DOI: 10.1038/s41467-024-44906-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 01/09/2024] [Indexed: 03/06/2024] Open
Abstract
Artificial Intelligence (AI) models for medical diagnosis often face challenges of generalizability and fairness. We highlighted the algorithmic unfairness in a large thyroid ultrasound dataset with significant diagnostic performance disparities across subgroups linked causally to sample size imbalances. To address this, we introduced the Quasi-Pareto Improvement (QPI) approach and a deep learning implementation (QP-Net) combining multi-task learning and domain adaptation to improve model performance among disadvantaged subgroups without compromising overall population performance. On the thyroid ultrasound dataset, our method significantly mitigated the area under curve (AUC) disparity for three less-prevalent subgroups by 0.213, 0.112, and 0.173 while maintaining the AUC for dominant subgroups; we also further confirmed the generalizability of our approach on two public datasets: the ISIC2019 skin disease dataset and the CheXpert chest radiograph dataset. Here we show the QPI approach to be widely applicable in promoting AI for equitable healthcare outcomes.
Collapse
Affiliation(s)
- Siqiong Yao
- State Key Laboratory of Microbial Metabolism, Joint International Research Laboratory of Metabolic and Developmental Sciences, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, 200240, PR China
- SJTU-Yale Joint Center of Biostatistics and Data Science, National Center for Translational Medicine, MoE Key Lab of Artificial Intelligence, AI Institute Shanghai Jiao Tong University, Shanghai, 200240, PR China
| | - Fang Dai
- State Key Laboratory of Microbial Metabolism, Joint International Research Laboratory of Metabolic and Developmental Sciences, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, 200240, PR China
| | - Peng Sun
- State Key Laboratory of Microbial Metabolism, Joint International Research Laboratory of Metabolic and Developmental Sciences, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, 200240, PR China
| | - Weituo Zhang
- Hongqiao International Institute of Medicine, Shanghai Tong Ren Hospital and School of Public Health, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, PR China.
| | - Biyun Qian
- Hongqiao International Institute of Medicine, Shanghai Tong Ren Hospital and School of Public Health, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, PR China.
| | - Hui Lu
- State Key Laboratory of Microbial Metabolism, Joint International Research Laboratory of Metabolic and Developmental Sciences, School of Life Sciences and Biotechnology, Shanghai Jiao Tong University, Shanghai, 200240, PR China.
- SJTU-Yale Joint Center of Biostatistics and Data Science, National Center for Translational Medicine, MoE Key Lab of Artificial Intelligence, AI Institute Shanghai Jiao Tong University, Shanghai, 200240, PR China.
- Shanghai Engineering Research Center for Big Data in Pediatric Precision Medicine, NHC Key Laboratory of Medical Embryogenesis and Developmental Molecular Biology & Shanghai Key Laboratory of Embryo and Reproduction Engineering, Shanghai, 200020, PR China.
| |
Collapse
|
19
|
Vrudhula A, Kwan AC, Ouyang D, Cheng S. Machine Learning and Bias in Medical Imaging: Opportunities and Challenges. Circ Cardiovasc Imaging 2024; 17:e015495. [PMID: 38377237 PMCID: PMC10883605 DOI: 10.1161/circimaging.123.015495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Abstract
Bias in health care has been well documented and results in disparate and worsened outcomes for at-risk groups. Medical imaging plays a critical role in facilitating patient diagnoses but involves multiple sources of bias including factors related to access to imaging modalities, acquisition of images, and assessment (ie, interpretation) of imaging data. Machine learning (ML) applied to diagnostic imaging has demonstrated the potential to improve the quality of imaging-based diagnosis and the precision of measuring imaging-based traits. Algorithms can leverage subtle information not visible to the human eye to detect underdiagnosed conditions or derive new disease phenotypes by linking imaging features with clinical outcomes, all while mitigating cognitive bias in interpretation. Importantly, however, the application of ML to diagnostic imaging has the potential to either reduce or propagate bias. Understanding the potential gain as well as the potential risks requires an understanding of how and what ML models learn. Common risks of propagating bias can arise from unbalanced training, suboptimal architecture design or selection, and uneven application of models. Notwithstanding these risks, ML may yet be applied to improve gain from imaging across all 3A's (access, acquisition, and assessment) for all patients. In this review, we present a framework for understanding the balance of opportunities and challenges for minimizing bias in medical imaging, how ML may improve current approaches to imaging, and what specific design considerations should be made as part of efforts to maximize the quality of health care for all.
Collapse
Affiliation(s)
- Amey Vrudhula
- Icahn School of Medicine at Mount Sinai, New York
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| | - Alan C Kwan
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| | - David Ouyang
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
- Division of Artificial Intelligence in Medicine, Department of Medicine, Cedars-Sinai Medical Center
| | - Susan Cheng
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center
| |
Collapse
|
20
|
Sorber R, Weaver ML. Who Looks Like a Surgeon?-Evaluating Reflections From a Digital Mirror. JAMA Surg 2024; 159:95. [PMID: 37966833 DOI: 10.1001/jamasurg.2023.5705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2023]
Affiliation(s)
- Rebecca Sorber
- Division of Vascular Surgery, University of Washington, Seattle
| | - M Libby Weaver
- Division of Vascular and Endovascular Surgery, University of Virginia, Charlottesville
| |
Collapse
|
21
|
Ueda D, Kakinuma T, Fujita S, Kamagata K, Fushimi Y, Ito R, Matsui Y, Nozaki T, Nakaura T, Fujima N, Tatsugami F, Yanagawa M, Hirata K, Yamada A, Tsuboyama T, Kawamura M, Fujioka T, Naganawa S. Fairness of artificial intelligence in healthcare: review and recommendations. Jpn J Radiol 2024; 42:3-15. [PMID: 37540463 PMCID: PMC10764412 DOI: 10.1007/s11604-023-01474-3] [Citation(s) in RCA: 25] [Impact Index Per Article: 25.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Accepted: 07/17/2023] [Indexed: 08/05/2023]
Abstract
In this review, we address the issue of fairness in the clinical integration of artificial intelligence (AI) in the medical field. As the clinical adoption of deep learning algorithms, a subfield of AI, progresses, concerns have arisen regarding the impact of AI biases and discrimination on patient health. This review aims to provide a comprehensive overview of concerns associated with AI fairness; discuss strategies to mitigate AI biases; and emphasize the need for cooperation among physicians, AI researchers, AI developers, policymakers, and patients to ensure equitable AI integration. First, we define and introduce the concept of fairness in AI applications in healthcare and radiology, emphasizing the benefits and challenges of incorporating AI into clinical practice. Next, we delve into concerns regarding fairness in healthcare, addressing the various causes of biases in AI and potential concerns such as misdiagnosis, unequal access to treatment, and ethical considerations. We then outline strategies for addressing fairness, such as the importance of diverse and representative data and algorithm audits. Additionally, we discuss ethical and legal considerations such as data privacy, responsibility, accountability, transparency, and explainability in AI. Finally, we present the Fairness of Artificial Intelligence Recommendations in healthcare (FAIR) statement to offer best practices. Through these efforts, we aim to provide a foundation for discussing the responsible and equitable implementation and deployment of AI in healthcare.
Collapse
Affiliation(s)
- Daiju Ueda
- Department of Diagnostic and Interventional Radiology, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3 Asahi-Machi, Abeno-ku, Osaka, 545-8585, Japan.
| | | | - Shohei Fujita
- Department of Radiology, University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Koji Kamagata
- Department of Radiology, Juntendo University Graduate School of Medicine, Bunkyo-ku, Tokyo, Japan
| | - Yasutaka Fushimi
- Department of Diagnostic Imaging and Nuclear Medicine, Kyoto University Graduate School of Medicine, Sakyoku, Kyoto, Japan
| | - Rintaro Ito
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Yusuke Matsui
- Department of Radiology, Faculty of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, Kita-ku, Okayama, Japan
| | - Taiki Nozaki
- Department of Radiology, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan
| | - Takeshi Nakaura
- Department of Diagnostic Radiology, Kumamoto University Graduate School of Medicine, Chuo-ku, Kumamoto, Japan
| | - Noriyuki Fujima
- Department of Diagnostic and Interventional Radiology, Hokkaido University Hospital, Sapporo, Japan
| | - Fuminari Tatsugami
- Department of Diagnostic Radiology, Hiroshima University, Minami-ku, Hiroshima, Japan
| | - Masahiro Yanagawa
- Department of Radiology, Osaka University Graduate School of Medicine, Suita City, Osaka, Japan
| | - Kenji Hirata
- Department of Diagnostic Imaging, Graduate School of Medicine, Hokkaido University, Kita-ku, Sapporo, Hokkaido, Japan
| | - Akira Yamada
- Department of Radiology, Shinshu University School of Medicine, Matsumoto, Nagano, Japan
| | - Takahiro Tsuboyama
- Department of Radiology, Osaka University Graduate School of Medicine, Suita City, Osaka, Japan
| | - Mariko Kawamura
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| | - Tomoyuki Fujioka
- Department of Diagnostic Radiology, Tokyo Medical and Dental University, Bunkyo-ku, Tokyo, Japan
| | - Shinji Naganawa
- Department of Radiology, Nagoya University Graduate School of Medicine, Nagoya, Aichi, Japan
| |
Collapse
|
22
|
Banja J, Gichoya JW, Martinez-Martin N, Waller LA, Clifford GD. Fairness as an afterthought: An American perspective on fairness in model developer-clinician user collaborations. PLOS DIGITAL HEALTH 2023; 2:e0000386. [PMID: 37983258 PMCID: PMC10659157 DOI: 10.1371/journal.pdig.0000386] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
Numerous ethics guidelines have been handed down over the last few years on the ethical applications of machine learning models. Virtually every one of them mentions the importance of "fairness" in the development and use of these models. Unfortunately, though, these ethics documents omit providing a consensually adopted definition or characterization of fairness. As one group of authors observed, these documents treat fairness as an "afterthought" whose importance is undeniable but whose essence seems strikingly elusive. In this essay, which offers a distinctly American treatment of "fairness," we comment on a number of fairness formulations and on qualitative or statistical methods that have been encouraged to achieve fairness. We argue that none of them, at least from an American moral perspective, provides a one-size-fits-all definition of or methodology for securing fairness that could inform or standardize fairness over the universe of use cases witnessing machine learning applications. Instead, we argue that because fairness comprehensions and applications reflect a vast range of use contexts, model developers and clinician users will need to engage in thoughtful collaborations that examine how fairness should be conceived and operationalized in the use case at issue. Part II of this paper illustrates key moments in these collaborations, especially when inter and intra disagreement occurs among model developer and clinician user groups over whether a model is fair or unfair. We conclude by noting that these collaborations will likely occur over the lifetime of a model if its claim to fairness is to advance beyond "afterthought" status.
Collapse
Affiliation(s)
- John Banja
- Center for Ethics, Emory University, Atlanta, Georgia, United States of America
| | - Judy Wawira Gichoya
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Atlanta, Georgia, United States of America
| | - Nicole Martinez-Martin
- Stanford University Center for Biomedical Ethics, Stanford University, Stanford, California, United States of America
| | - Lance A. Waller
- Department of Biostatistics and Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America
| | - Gari D. Clifford
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, Georgia, United States of America
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, Georgia, United States of America
| |
Collapse
|
23
|
Whitney HM, Baughan N, Myers KJ, Drukker K, Gichoya J, Bower B, Chen W, Gruszauskas N, Kalpathy-Cramer J, Koyejo S, Sá RC, Sahiner B, Zhang Z, Giger ML. Longitudinal assessment of demographic representativeness in the Medical Imaging and Data Resource Center open data commons. J Med Imaging (Bellingham) 2023; 10:61105. [PMID: 37469387 PMCID: PMC10353566 DOI: 10.1117/1.jmi.10.6.061105] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 06/21/2023] [Accepted: 06/23/2023] [Indexed: 07/21/2023] Open
Abstract
Purpose The Medical Imaging and Data Resource Center (MIDRC) open data commons was launched to accelerate the development of artificial intelligence (AI) algorithms to help address the COVID-19 pandemic. The purpose of this study was to quantify longitudinal representativeness of the demographic characteristics of the primary MIDRC dataset compared to the United States general population (US Census) and COVID-19 positive case counts from the Centers for Disease Control and Prevention (CDC). Approach The Jensen-Shannon distance (JSD), a measure of similarity of two distributions, was used to longitudinally measure the representativeness of the distribution of (1) all unique patients in the MIDRC data to the 2020 US Census and (2) all unique COVID-19 positive patients in the MIDRC data to the case counts reported by the CDC. The distributions were evaluated in the demographic categories of age at index, sex, race, ethnicity, and the combination of race and ethnicity. Results Representativeness of the MIDRC data by ethnicity and the combination of race and ethnicity was impacted by the percentage of CDC case counts for which this was not reported. The distributions by sex and race have retained their level of representativeness over time. Conclusion The representativeness of the open medical imaging datasets in the curated public data commons at MIDRC has evolved over time as the number of contributing institutions and overall number of subjects have grown. The use of metrics, such as the JSD support measurement of representativeness, is one step needed for fair and generalizable AI algorithm development.
Collapse
Affiliation(s)
- Heather M. Whitney
- University of Chicago, Chicago, Illinois, United States
- The Medical Imaging and Data Resource Center (midrc.org)
| | - Natalie Baughan
- University of Chicago, Chicago, Illinois, United States
- The Medical Imaging and Data Resource Center (midrc.org)
| | - Kyle J. Myers
- The Medical Imaging and Data Resource Center (midrc.org)
- Puente Solutions LLC, Phoenix, Arizona, United States
| | - Karen Drukker
- University of Chicago, Chicago, Illinois, United States
- The Medical Imaging and Data Resource Center (midrc.org)
| | - Judy Gichoya
- The Medical Imaging and Data Resource Center (midrc.org)
- Emory University, Atlanta, Georgia, United States
| | - Brad Bower
- The Medical Imaging and Data Resource Center (midrc.org)
- National Institutes of Health, Bethesda, Maryland, United States
| | - Weijie Chen
- The Medical Imaging and Data Resource Center (midrc.org)
- United States Food and Drug Administration, Silver Spring, Maryland, United States
| | - Nicholas Gruszauskas
- University of Chicago, Chicago, Illinois, United States
- The Medical Imaging and Data Resource Center (midrc.org)
| | - Jayashree Kalpathy-Cramer
- The Medical Imaging and Data Resource Center (midrc.org)
- University of Colorado Anschutz Medical Campus, Aurora, Colorado, United States
| | - Sanmi Koyejo
- The Medical Imaging and Data Resource Center (midrc.org)
- Stanford University, Stanford, California, United States
| | - Rui C. Sá
- The Medical Imaging and Data Resource Center (midrc.org)
- National Institutes of Health, Bethesda, Maryland, United States
- University of California, San Diego, La Jolla, California, United States
| | - Berkman Sahiner
- The Medical Imaging and Data Resource Center (midrc.org)
- United States Food and Drug Administration, Silver Spring, Maryland, United States
| | - Zi Zhang
- The Medical Imaging and Data Resource Center (midrc.org)
- Jefferson Health, Philadelphia, Pennsylvania, United States
| | - Maryellen L. Giger
- University of Chicago, Chicago, Illinois, United States
- The Medical Imaging and Data Resource Center (midrc.org)
| |
Collapse
|
24
|
Burns JL, Zaiman Z, Vanschaik J, Luo G, Peng L, Price B, Mathias G, Mittal V, Sagane A, Tignanelli C, Chakraborty S, Gichoya JW, Purkayastha S. Ability of artificial intelligence to identify self-reported race in chest x-ray using pixel intensity counts. J Med Imaging (Bellingham) 2023; 10:061106. [PMID: 37545750 PMCID: PMC10400898 DOI: 10.1117/1.jmi.10.6.061106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 05/15/2023] [Accepted: 07/18/2023] [Indexed: 08/08/2023] Open
Abstract
Purpose Prior studies show convolutional neural networks predicting self-reported race using x-rays of chest, hand and spine, chest computed tomography, and mammogram. We seek an understanding of the mechanism that reveals race within x-ray images, investigating the possibility that race is not predicted using the physical structure in x-ray images but is embedded in the grayscale pixel intensities. Approach Retrospective full year 2021, 298,827 AP/PA chest x-ray images from 3 academic health centers across the United States and MIMIC-CXR, labeled by self-reported race, were used in this study. The image structure is removed by summing the number of each grayscale value and scaling to percent per image (PPI). The resulting data are tested using multivariate analysis of variance (MANOVA) with Bonferroni multiple-comparison adjustment and class-balanced MANOVA. Machine learning (ML) feed-forward networks (FFN) and decision trees were built to predict race (binary Black or White and binary Black or other) using only grayscale value counts. Stratified analysis by body mass index, age, sex, gender, patient type, make/model of scanner, exposure, and kilovoltage peak setting was run to study the impact of these factors on race prediction following the same methodology. Results MANOVA rejects the null hypothesis that classes are the same with 95% confidence (F 7.38, P < 0.0001 ) and balanced MANOVA (F 2.02, P < 0.0001 ). The best FFN performance is limited [area under the receiver operating characteristic (AUROC) of 69.18%]. Gradient boosted trees predict self-reported race using grayscale PPI (AUROC 77.24%). Conclusions Within chest x-rays, pixel intensity value counts alone are statistically significant indicators and enough for ML classification tasks of patient self-reported race.
Collapse
Affiliation(s)
- John Lee Burns
- Indiana University, School of Informatics, Indianapolis, Indiana, United States
| | - Zachary Zaiman
- Emory University, School of Medicine, Department of Radiology, Atlanta, Georgia, United States
| | - Jack Vanschaik
- Indiana University, School of Informatics, Indianapolis, Indiana, United States
| | - Gaoxiang Luo
- University of Minnesota Twin Cities, Medical School, Minneapolis, Minnesota, United States
| | - Le Peng
- University of Minnesota Twin Cities, Medical School, Minneapolis, Minnesota, United States
| | - Brandon Price
- University of Florida College of Medicine, College of Medicine, Gainesville, Florida, United States
| | - Garric Mathias
- Indiana University, School of Informatics, Indianapolis, Indiana, United States
| | - Vijay Mittal
- Indiana University, School of Informatics, Indianapolis, Indiana, United States
| | - Akshay Sagane
- Indiana University, School of Informatics, Indianapolis, Indiana, United States
| | - Christopher Tignanelli
- University of Minnesota Twin Cities, Medical School, Minneapolis, Minnesota, United States
| | | | - Judy Wawira Gichoya
- Emory University, School of Medicine, Department of Radiology, Atlanta, Georgia, United States
| | | |
Collapse
|
25
|
Cho SI, Navarrete-Dechent C, Daneshjou R, Cho HS, Chang SE, Kim SH, Na JI, Han SS. Generation of a Melanoma and Nevus Data Set From Unstandardized Clinical Photographs on the Internet. JAMA Dermatol 2023; 159:1223-1231. [PMID: 37792351 PMCID: PMC10551819 DOI: 10.1001/jamadermatol.2023.3521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2023] [Accepted: 06/16/2023] [Indexed: 10/05/2023]
Abstract
Importance Artificial intelligence (AI) training for diagnosing dermatologic images requires large amounts of clean data. Dermatologic images have different compositions, and many are inaccessible due to privacy concerns, which hinder the development of AI. Objective To build a training data set for discriminative and generative AI from unstandardized internet images of melanoma and nevus. Design, Setting, and Participants In this diagnostic study, a total of 5619 (CAN5600 data set) and 2006 (CAN2000 data set; a manually revised subset of CAN5600) cropped lesion images of either melanoma or nevus were semiautomatically annotated from approximately 500 000 photographs on the internet using convolutional neural networks (CNNs), region-based CNNs, and large mask inpainting. For unsupervised pretraining, 132 673 possible lesions (LESION130k data set) were also created with diversity by collecting images from 18 482 websites in approximately 80 countries. A total of 5000 synthetic images (GAN5000 data set) were generated using the generative adversarial network (StyleGAN2-ADA; training, CAN2000 data set; pretraining, LESION130k data set). Main Outcomes and Measures The area under the receiver operating characteristic curve (AUROC) for determining malignant neoplasms was analyzed. In each test, 1 of the 7 preexisting public data sets (total of 2312 images; including Edinburgh, an SNU subset, Asan test, Waterloo, 7-point criteria evaluation, PAD-UFES-20, and MED-NODE) was used as the test data set. Subsequently, a comparative study was conducted between the performance of the EfficientNet Lite0 CNN on the proposed data set and that trained on the remaining 6 preexisting data sets. Results The EfficientNet Lite0 CNN trained on the annotated or synthetic images achieved higher or equivalent mean (SD) AUROCs to the EfficientNet Lite0 trained using the pathologically confirmed public data sets, including CAN5600 (0.874 [0.042]; P = .02), CAN2000 (0.848 [0.027]; P = .08), and GAN5000 (0.838 [0.040]; P = .31 [Wilcoxon signed rank test]) and the preexisting data sets combined (0.809 [0.063]) by the benefits of increased size of the training data set. Conclusions and Relevance The synthetic data set in this diagnostic study was created using various AI technologies from internet images. A neural network trained on the created data set (CAN5600) performed better than the same network trained on preexisting data sets combined. Both the annotated (CAN5600 and LESION130k) and synthetic (GAN5000) data sets could be shared for AI training and consensus between physicians.
Collapse
Affiliation(s)
| | | | - Roxana Daneshjou
- Department of Dermatology, Stanford University, Stanford, California
| | - Hye Soo Cho
- Department of Dermatology, Asan Medical Center, Ulsan University College of Medicine, Seoul, Korea
| | - Sung Eun Chang
- Department of Dermatology, Asan Medical Center, Ulsan University College of Medicine, Seoul, Korea
| | - Seong Hwan Kim
- Department of Plastic and Reconstructive Surgery, Kangnam Sacred Heart Hospital, Hallym University College of Medicine, Seoul, Korea
| | - Jung-Im Na
- Department of Dermatology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seoul, Korea
| | - Seung Seog Han
- Department of Dermatology, I Dermatology Clinic, Seoul, Korea
- IDerma Inc, Seoul, Korea
| |
Collapse
|
26
|
Cobo M, Menéndez Fernández-Miranda P, Bastarrika G, Lloret Iglesias L. Enhancing radiomics and Deep Learning systems through the standardization of medical imaging workflows. Sci Data 2023; 10:732. [PMID: 37865635 PMCID: PMC10590396 DOI: 10.1038/s41597-023-02641-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 10/12/2023] [Indexed: 10/23/2023] Open
Affiliation(s)
- Miriam Cobo
- Advanced Computing and e-Science Group, Institute of Physics of Cantabria (IFCA), CSIC - UC, Santander, Spain.
| | | | - Gorka Bastarrika
- Clínica Universidad de Navarra, Department of Radiology, Pamplona, Spain
| | - Lara Lloret Iglesias
- Advanced Computing and e-Science Group, Institute of Physics of Cantabria (IFCA), CSIC - UC, Santander, Spain
| |
Collapse
|
27
|
Ricci Lara MA, Rodríguez Kowalczuk MV, Lisa Eliceche M, Ferraresso MG, Luna DR, Benitez SE, Mazzuoccolo LD. A dataset of skin lesion images collected in Argentina for the evaluation of AI tools in this population. Sci Data 2023; 10:712. [PMID: 37853053 PMCID: PMC10584927 DOI: 10.1038/s41597-023-02630-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Accepted: 10/11/2023] [Indexed: 10/20/2023] Open
Abstract
In recent years, numerous dermatological image databases have been published to make possible the development and validation of artificial intelligence-based technologies to support healthcare professionals in the diagnosis of skin diseases. However, the generation of these datasets confined to certain countries as well as the lack of demographic information accompanying the images, prevents having a real knowledge of in which populations these models could be used. Consequently, this hinders the translation of the models to the clinical setting. This has led the scientific community to encourage the detailed and transparent reporting of the databases used for artificial intelligence developments, as well as to promote the formation of genuinely international databases that can be representative of the world population. Through this work, we seek to provide details of the processing stages of the first public database of dermoscopy and clinical images created in a hospital in Argentina. The dataset comprises 1,616 images corresponding to 1,246 unique lesions collected from 623 patients.
Collapse
Affiliation(s)
- María Agustina Ricci Lara
- Departamento de Informática en Salud, Hospital Italiano de Buenos Aires, Tte. Gral. Juan Domingo Perón 4190, 1199, Ciudad Autónoma de, Buenos Aires, Argentina.
- Universidad Tecnológica Nacional, Av. Medrano 951, 1179, Ciudad Autónoma de, Buenos Aires, Argentina.
| | - María Victoria Rodríguez Kowalczuk
- Servicio de Dermatología, Hospital Italiano de Buenos Aires, Tte. Gral. Juan Domingo Perón 4190, 1199, Ciudad Autónoma de, Buenos Aires, Argentina
| | - Maite Lisa Eliceche
- Servicio de Dermatología, Hospital Italiano de Buenos Aires, Tte. Gral. Juan Domingo Perón 4190, 1199, Ciudad Autónoma de, Buenos Aires, Argentina
| | - María Guillermina Ferraresso
- Servicio de Dermatología, Hospital Italiano de Buenos Aires, Tte. Gral. Juan Domingo Perón 4190, 1199, Ciudad Autónoma de, Buenos Aires, Argentina
| | - Daniel Roberto Luna
- Departamento de Informática en Salud, Hospital Italiano de Buenos Aires, Tte. Gral. Juan Domingo Perón 4190, 1199, Ciudad Autónoma de, Buenos Aires, Argentina
- Instituto de Medicina Traslacional e Ingeniería Biomédica (IMTIB), UE de triple dependencia CONICET- Instituto Universitario del Hospital Italiano (IUHI) - Hospital ITaliano (HIBA), Tte. Gral. Juan Domingo Perón 4190, 1199, Ciudad Autónoma de, Buenos Aires, Argentina
| | - Sonia Elizabeth Benitez
- Departamento de Informática en Salud, Hospital Italiano de Buenos Aires, Tte. Gral. Juan Domingo Perón 4190, 1199, Ciudad Autónoma de, Buenos Aires, Argentina
- Instituto Universitario del Hospital Italiano, Potosí 4265, 1199, Ciudad Autónoma de, Buenos Aires, Argentina
| | - Luis Daniel Mazzuoccolo
- Servicio de Dermatología, Hospital Italiano de Buenos Aires, Tte. Gral. Juan Domingo Perón 4190, 1199, Ciudad Autónoma de, Buenos Aires, Argentina
| |
Collapse
|
28
|
Bak M. AI Can Show You the World. THE AMERICAN JOURNAL OF BIOETHICS : AJOB 2023; 23:107-110. [PMID: 37812112 DOI: 10.1080/15265161.2023.2250312] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/10/2023]
Affiliation(s)
- Marieke Bak
- Amsterdam UMC, University of Amsterdam
- Technical University of Munich
| |
Collapse
|
29
|
Li B, Shi X, Gao H, Jiang X, Zhang K, Harmanci AO, Malin B. Enhancing Fairness in Disease Prediction by Optimizing Multiple Domain Adversarial Networks. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.04.551906. [PMID: 37609241 PMCID: PMC10441334 DOI: 10.1101/2023.08.04.551906] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/24/2023]
Abstract
Predictive models in biomedicine need to ensure equitable and reliable outcomes for the populations they are applied to. Unfortunately, biases in medical predictions can lead to unfair treatment and widening disparities, underscoring the need for effective techniques to address these issues. To enhance fairness, we introduce a framework based on a Multiple Domain Adversarial Neural Network (MDANN), which incorporates multiple adversarial components. In an MDANN, an adversarial module is applied to learn a fair pattern by negative gradients back-propagating across multiple sensitive features (i.e., characteristics of individuals that should not be used to discriminate unfairly between individuals when making predictions or decisions.) We leverage loss functions based on the Area Under the Receiver Operating Characteristic Curve (AUC) to address the class imbalance, promoting equitable classification performance for minority groups (e.g., a subset of the population that is underrepresented or disadvantaged.) Moreover, we utilize pre-trained convolutional autoencoders (CAEs) to extract deep representations of data, aiming to enhance prediction accuracy and fairness. Combining these mechanisms, we alleviate biases and disparities to provide reliable and equitable disease prediction. We empirically demonstrate that the MDANN approach leads to better accuracy and fairness in predicting disease progression using brain imaging data for Alzheimer's Disease and Autism populations than state-of-the-art techniques.
Collapse
Affiliation(s)
- Bin Li
- Computer and Information Sciences, Temple University, Philadelphia, Pennsylvania, 19122, USA
| | - Xinghua Shi
- Computer and Information Sciences, Temple University, Philadelphia, Pennsylvania, 19122, USA
| | - Hongchang Gao
- Computer and Information Sciences, Temple University, Philadelphia, Pennsylvania, 19122, USA
| | - Xiaoqian Jiang
- School of Biomedical Informatics, UTHealth Houston, Houston, Texas, 77030, USA
| | - Kai Zhang
- School of Biomedical Informatics, UTHealth Houston, Houston, Texas, 77030, USA
| | - Arif O Harmanci
- School of Biomedical Informatics, UTHealth Houston, Houston, Texas, 77030, USA
| | - Bradley Malin
- Department of Biomedical Informatics, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
30
|
Nakayama LF, Mitchell WG, Ribeiro LZ, Dychiao RG, Phanphruk W, Celi LA, Kalua K, Santiago APD, Regatieri CVS, Moraes NSB. Fairness and generalisability in deep learning of retinopathy of prematurity screening algorithms: a literature review. BMJ Open Ophthalmol 2023; 8:e001216. [PMID: 37558406 PMCID: PMC10414056 DOI: 10.1136/bmjophth-2022-001216] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Accepted: 07/04/2023] [Indexed: 08/11/2023] Open
Abstract
BACKGROUND Retinopathy of prematurity (ROP) is a vasoproliferative disease responsible for more than 30 000 blind children worldwide. Its diagnosis and treatment are challenging due to the lack of specialists, divergent diagnostic concordance and variation in classification standards. While artificial intelligence (AI) can address the shortage of professionals and provide more cost-effective management, its development needs fairness, generalisability and bias controls prior to deployment to avoid producing harmful unpredictable results. This review aims to compare AI and ROP study's characteristics, fairness and generalisability efforts. METHODS Our review yielded 220 articles, of which 18 were included after full-text assessment. The articles were classified into ROP severity grading, plus detection, detecting treatment requiring, ROP prediction and detection of retinal zones. RESULTS All the article's authors and included patients are from middle-income and high-income countries, with no low-income countries, South America, Australia and Africa Continents representation.Code is available in two articles and in one on request, while data are not available in any article. 88.9% of the studies use the same retinal camera. In two articles, patients' sex was described, but none applied a bias control in their models. CONCLUSION The reviewed articles included 180 228 images and reported good metrics, but fairness, generalisability and bias control remained limited. Reproducibility is also a critical limitation, with few articles sharing codes and none sharing data. Fair and generalisable ROP and AI studies are needed that include diverse datasets, data and code sharing, collaborative research, and bias control to avoid unpredictable and harmful deployments.
Collapse
Affiliation(s)
- Luis Filipe Nakayama
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
- Department of Ophthalmology, Sao Paulo Federal University, Sao Paulo, Brazil
| | - William Greig Mitchell
- Department of Ophthalmology, The Royal Victorian Eye and Ear Hospital, East Melbourne, Victoria, Australia
| | - Lucas Zago Ribeiro
- Department of Ophthalmology, Sao Paulo Federal University, Sao Paulo, Brazil
| | - Robyn Gayle Dychiao
- University of the Philippines Manila College of Medicine, Manila, Philippines
| | | | - Leo Anthony Celi
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
- Department of Biostatistics, Harvard University T H Chan School of Public Health, Boston, Massachusetts, USA
| | - Khumbo Kalua
- Department of Ophthalmology, Blantyre Institute for Community Ophthalmology, BICO, Blantyre, Malawi
| | | | | | | |
Collapse
|
31
|
Garcia Santa Cruz B, Husch A, Hertel F. Machine learning models for diagnosis and prognosis of Parkinson's disease using brain imaging: general overview, main challenges, and future directions. Front Aging Neurosci 2023; 15:1216163. [PMID: 37539346 PMCID: PMC10394631 DOI: 10.3389/fnagi.2023.1216163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 06/28/2023] [Indexed: 08/05/2023] Open
Abstract
Parkinson's disease (PD) is a progressive and complex neurodegenerative disorder associated with age that affects motor and cognitive functions. As there is currently no cure, early diagnosis and accurate prognosis are essential to increase the effectiveness of treatment and control its symptoms. Medical imaging, specifically magnetic resonance imaging (MRI), has emerged as a valuable tool for developing support systems to assist in diagnosis and prognosis. The current literature aims to improve understanding of the disease's structural and functional manifestations in the brain. By applying artificial intelligence to neuroimaging, such as deep learning (DL) and other machine learning (ML) techniques, previously unknown relationships and patterns can be revealed in this high-dimensional data. However, several issues must be addressed before these solutions can be safely integrated into clinical practice. This review provides a comprehensive overview of recent ML techniques analyzed for the automatic diagnosis and prognosis of PD in brain MRI. The main challenges in applying ML to medical diagnosis and its implications for PD are also addressed, including current limitations for safe translation into hospitals. These challenges are analyzed at three levels: disease-specific, task-specific, and technology-specific. Finally, potential future directions for each challenge and future perspectives are discussed.
Collapse
Affiliation(s)
| | - Andreas Husch
- Imaging AI Group, Luxembourg Centre for Systems Biomedicine, University of Luxembourg, Esch-sur-Alzette, Luxembourg
| | - Frank Hertel
- National Department of Neurosurgery, Centre Hospitalier de Luxembourg, Luxembourg, Luxembourg
| |
Collapse
|
32
|
Petersen E, Holm S, Ganz M, Feragen A. The path toward equal performance in medical machine learning. PATTERNS (NEW YORK, N.Y.) 2023; 4:100790. [PMID: 37521051 PMCID: PMC10382979 DOI: 10.1016/j.patter.2023.100790] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 08/01/2023]
Abstract
To ensure equitable quality of care, differences in machine learning model performance between patient groups must be addressed. Here, we argue that two separate mechanisms can cause performance differences between groups. First, model performance may be worse than theoretically achievable in a given group. This can occur due to a combination of group underrepresentation, modeling choices, and the characteristics of the prediction task at hand. We examine scenarios in which underrepresentation leads to underperformance, scenarios in which it does not, and the differences between them. Second, the optimal achievable performance may also differ between groups due to differences in the intrinsic difficulty of the prediction task. We discuss several possible causes of such differences in task difficulty. In addition, challenges such as label biases and selection biases may confound both learning and performance evaluation. We highlight consequences for the path toward equal performance, and we emphasize that leveling up model performance may require gathering not only more data from underperforming groups but also better data. Throughout, we ground our discussion in real-world medical phenomena and case studies while also referencing relevant statistical theory.
Collapse
Affiliation(s)
- Eike Petersen
- DTU Compute, Technical University of Denmark, Richard Pedersens Plads, 2800 Kgs. Lyngby, Denmark
- Pioneer Centre for AI, Øster Voldgade 3, 1350 Copenhagen, Denmark
| | - Sune Holm
- Pioneer Centre for AI, Øster Voldgade 3, 1350 Copenhagen, Denmark
- Department of Food and Resource Economics, University of Copenhagen, Rolighedsvej 23, 1958 Frederiksberg C., Denmark
| | - Melanie Ganz
- Pioneer Centre for AI, Øster Voldgade 3, 1350 Copenhagen, Denmark
- Department of Computer Science, University of Copenhagen, Universitetsparken 1, 2100 Copenhagen, Denmark
- Neurobiology Research Unit, Rigshospitalet, Inge Lehmanns Vej 6–8, 2100 Copenhagen, Denmark
| | - Aasa Feragen
- DTU Compute, Technical University of Denmark, Richard Pedersens Plads, 2800 Kgs. Lyngby, Denmark
- Pioneer Centre for AI, Øster Voldgade 3, 1350 Copenhagen, Denmark
| |
Collapse
|
33
|
Walsh G, Stogiannos N, van de Venter R, Rainey C, Tam W, McFadden S, McNulty JP, Mekis N, Lewis S, O'Regan T, Kumar A, Huisman M, Bisdas S, Kotter E, Pinto dos Santos D, Sá dos Reis C, van Ooijen P, Brady AP, Malamateniou C. Responsible AI practice and AI education are central to AI implementation: a rapid review for all medical imaging professionals in Europe. BJR Open 2023; 5:20230033. [PMID: 37953871 PMCID: PMC10636340 DOI: 10.1259/bjro.20230033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 05/27/2023] [Accepted: 05/30/2023] [Indexed: 11/14/2023] Open
Abstract
Artificial intelligence (AI) has transitioned from the lab to the bedside, and it is increasingly being used in healthcare. Radiology and Radiography are on the frontline of AI implementation, because of the use of big data for medical imaging and diagnosis for different patient groups. Safe and effective AI implementation requires that responsible and ethical practices are upheld by all key stakeholders, that there is harmonious collaboration between different professional groups, and customised educational provisions for all involved. This paper outlines key principles of ethical and responsible AI, highlights recent educational initiatives for clinical practitioners and discusses the synergies between all medical imaging professionals as they prepare for the digital future in Europe. Responsible and ethical AI is vital to enhance a culture of safety and trust for healthcare professionals and patients alike. Educational and training provisions for medical imaging professionals on AI is central to the understanding of basic AI principles and applications and there are many offerings currently in Europe. Education can facilitate the transparency of AI tools, but more formalised, university-led training is needed to ensure the academic scrutiny, appropriate pedagogy, multidisciplinarity and customisation to the learners' unique needs are being adhered to. As radiographers and radiologists work together and with other professionals to understand and harness the benefits of AI in medical imaging, it becomes clear that they are faced with the same challenges and that they have the same needs. The digital future belongs to multidisciplinary teams that work seamlessly together, learn together, manage risk collectively and collaborate for the benefit of the patients they serve.
Collapse
Affiliation(s)
- Gemma Walsh
- Division of Midwifery & Radiography, City University of London, London, United Kingdom
| | | | | | - Clare Rainey
- School of Health Sciences, Ulster University, Derry~Londonderry, Northern Ireland
| | - Winnie Tam
- Division of Midwifery & Radiography, City University of London, London, United Kingdom
| | - Sonyia McFadden
- School of Health Sciences, Ulster University, Coleraine, United Kingdom
| | | | - Nejc Mekis
- Medical Imaging and Radiotherapy Department, University of Ljubljana, Faculty of Health Sciences, Ljubljana, Slovenia
| | - Sarah Lewis
- Discipline of Medical Imaging Science, Sydney School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Sydney, Australia
| | - Tracy O'Regan
- The Society and College of Radiographers, London, United Kingdom
| | - Amrita Kumar
- Frimley Health NHS Foundation Trust, Frimley, United Kingdom
| | - Merel Huisman
- Department of Radiology, University Medical Center Utrecht, Utrecht, Netherlands
| | | | | | | | - Cláudia Sá dos Reis
- School of Health Sciences (HESAV), University of Applied Sciences and Arts Western Switzerland (HES-SO), Lausanne, Switzerland
| | | | | | | |
Collapse
|
34
|
Tan TF, Teo ZL, Ting DSW. Artificial Intelligence Bias and Ethics in Retinal Imaging. JAMA Ophthalmol 2023; 141:552-553. [PMID: 37140916 DOI: 10.1001/jamaophthalmol.2023.1490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Affiliation(s)
- Ting Fang Tan
- Singapore National Eye Center, Singapore Eye Research Institute, Singapore, Singapore
| | - Zhen Ling Teo
- Singapore National Eye Center, Singapore Eye Research Institute, Singapore, Singapore
| | - Daniel Shu Wei Ting
- Singapore National Eye Center, Singapore Eye Research Institute, Singapore, Singapore
- Duke-NUS Medical School, National University of Singapore, Singapore, Singapore
| |
Collapse
|
35
|
Paudyal R, Shah AD, Akin O, Do RKG, Konar AS, Hatzoglou V, Mahmood U, Lee N, Wong RJ, Banerjee S, Shin J, Veeraraghavan H, Shukla-Dave A. Artificial Intelligence in CT and MR Imaging for Oncological Applications. Cancers (Basel) 2023; 15:cancers15092573. [PMID: 37174039 PMCID: PMC10177423 DOI: 10.3390/cancers15092573] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 04/13/2023] [Accepted: 04/17/2023] [Indexed: 05/15/2023] Open
Abstract
Cancer care increasingly relies on imaging for patient management. The two most common cross-sectional imaging modalities in oncology are computed tomography (CT) and magnetic resonance imaging (MRI), which provide high-resolution anatomic and physiological imaging. Herewith is a summary of recent applications of rapidly advancing artificial intelligence (AI) in CT and MRI oncological imaging that addresses the benefits and challenges of the resultant opportunities with examples. Major challenges remain, such as how best to integrate AI developments into clinical radiology practice, the vigorous assessment of quantitative CT and MR imaging data accuracy, and reliability for clinical utility and research integrity in oncology. Such challenges necessitate an evaluation of the robustness of imaging biomarkers to be included in AI developments, a culture of data sharing, and the cooperation of knowledgeable academics with vendor scientists and companies operating in radiology and oncology fields. Herein, we will illustrate a few challenges and solutions of these efforts using novel methods for synthesizing different contrast modality images, auto-segmentation, and image reconstruction with examples from lung CT as well as abdome, pelvis, and head and neck MRI. The imaging community must embrace the need for quantitative CT and MRI metrics beyond lesion size measurement. AI methods for the extraction and longitudinal tracking of imaging metrics from registered lesions and understanding the tumor environment will be invaluable for interpreting disease status and treatment efficacy. This is an exciting time to work together to move the imaging field forward with narrow AI-specific tasks. New AI developments using CT and MRI datasets will be used to improve the personalized management of cancer patients.
Collapse
Affiliation(s)
- Ramesh Paudyal
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Akash D Shah
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Oguz Akin
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Richard K G Do
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Amaresha Shridhar Konar
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Vaios Hatzoglou
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Usman Mahmood
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Nancy Lee
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Richard J Wong
- Head and Neck Service, Department of Surgery, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | | | | | - Harini Veeraraghavan
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| | - Amita Shukla-Dave
- Department of Medical Physics, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
- Department of Radiology, Memorial Sloan Kettering Cancer Center, New York City, NY 10065, USA
| |
Collapse
|
36
|
Kiyasseh D, Laca J, Haque TF, Otiato M, Miles BJ, Wagner C, Donoho DA, Trinh QD, Anandkumar A, Hung AJ. Human visual explanations mitigate bias in AI-based assessment of surgeon skills. NPJ Digit Med 2023; 6:54. [PMID: 36997642 PMCID: PMC10063676 DOI: 10.1038/s41746-023-00766-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 01/21/2023] [Indexed: 04/03/2023] Open
Abstract
Artificial intelligence (AI) systems can now reliably assess surgeon skills through videos of intraoperative surgical activity. With such systems informing future high-stakes decisions such as whether to credential surgeons and grant them the privilege to operate on patients, it is critical that they treat all surgeons fairly. However, it remains an open question whether surgical AI systems exhibit bias against surgeon sub-cohorts, and, if so, whether such bias can be mitigated. Here, we examine and mitigate the bias exhibited by a family of surgical AI systems-SAIS-deployed on videos of robotic surgeries from three geographically-diverse hospitals (USA and EU). We show that SAIS exhibits an underskilling bias, erroneously downgrading surgical performance, and an overskilling bias, erroneously upgrading surgical performance, at different rates across surgeon sub-cohorts. To mitigate such bias, we leverage a strategy -TWIX-which teaches an AI system to provide a visual explanation for its skill assessment that otherwise would have been provided by human experts. We show that whereas baseline strategies inconsistently mitigate algorithmic bias, TWIX can effectively mitigate the underskilling and overskilling bias while simultaneously improving the performance of these AI systems across hospitals. We discovered that these findings carry over to the training environment where we assess medical students' skills today. Our study is a critical prerequisite to the eventual implementation of AI-augmented global surgeon credentialing programs, ensuring that all surgeons are treated fairly.
Collapse
Affiliation(s)
- Dani Kiyasseh
- Department of Computing and Mathematical Sciences, California Institute of Technology, California, CA, USA.
| | - Jasper Laca
- Center for Robotic Simulation and Education, Catherine & Joseph Aresty Department of Urology, University of Southern California, California, CA, USA
| | - Taseen F Haque
- Center for Robotic Simulation and Education, Catherine & Joseph Aresty Department of Urology, University of Southern California, California, CA, USA
| | - Maxwell Otiato
- Center for Robotic Simulation and Education, Catherine & Joseph Aresty Department of Urology, University of Southern California, California, CA, USA
| | - Brian J Miles
- Department of Urology, Houston Methodist Hospital, Texas, TX, USA
| | - Christian Wagner
- Department of Urology, Pediatric Urology and Uro-Oncology, Prostate Center Northwest, St. Antonius-Hospital, Gronau, Germany
| | - Daniel A Donoho
- Division of Neurosurgery, Center for Neuroscience, Children's National Hospital, Washington DC, WA, USA
| | - Quoc-Dien Trinh
- Center for Surgery & Public Health, Department of Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Animashree Anandkumar
- Department of Computing and Mathematical Sciences, California Institute of Technology, California, CA, USA
| | - Andrew J Hung
- Center for Robotic Simulation and Education, Catherine & Joseph Aresty Department of Urology, University of Southern California, California, CA, USA.
| |
Collapse
|
37
|
Sex-based differences in nuclear medicine imaging and therapy. Eur J Nucl Med Mol Imaging 2023; 50:971-974. [PMID: 36633615 DOI: 10.1007/s00259-023-06113-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Accepted: 01/08/2023] [Indexed: 01/13/2023]
|
38
|
Predicting gene mutation status via artificial intelligence technologies based on multimodal integration (MMI) to advance precision oncology. Semin Cancer Biol 2023; 91:1-15. [PMID: 36801447 DOI: 10.1016/j.semcancer.2023.02.006] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 01/30/2023] [Accepted: 02/15/2023] [Indexed: 02/21/2023]
Abstract
Personalized treatment strategies for cancer frequently rely on the detection of genetic alterations which are determined by molecular biology assays. Historically, these processes typically required single-gene sequencing, next-generation sequencing, or visual inspection of histopathology slides by experienced pathologists in a clinical context. In the past decade, advances in artificial intelligence (AI) technologies have demonstrated remarkable potential in assisting physicians with accurate diagnosis of oncology image-recognition tasks. Meanwhile, AI techniques make it possible to integrate multimodal data such as radiology, histology, and genomics, providing critical guidance for the stratification of patients in the context of precision therapy. Given that the mutation detection is unaffordable and time-consuming for a considerable number of patients, predicting gene mutations based on routine clinical radiological scans or whole-slide images of tissue with AI-based methods has become a hot issue in actual clinical practice. In this review, we synthesized the general framework of multimodal integration (MMI) for molecular intelligent diagnostics beyond standard techniques. Then we summarized the emerging applications of AI in the prediction of mutational and molecular profiles of common cancers (lung, brain, breast, and other tumor types) pertaining to radiology and histology imaging. Furthermore, we concluded that there truly exist multiple challenges of AI techniques in the way of its real-world application in the medical field, including data curation, feature fusion, model interpretability, and practice regulations. Despite these challenges, we still prospect the clinical implementation of AI as a highly potential decision-support tool to aid oncologists in future cancer treatment management.
Collapse
|
39
|
Al-Ani MA, Bai C, Hashky A, Parker AM, Vilaro JR, Aranda JM, Shickel B, Rashidi P, Bihorac A, Ahmed MM, Mardini MT. Artificial intelligence guidance of advanced heart failure therapies: A systematic scoping review. Front Cardiovasc Med 2023; 10:1127716. [PMID: 36910520 PMCID: PMC9999024 DOI: 10.3389/fcvm.2023.1127716] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Accepted: 02/07/2023] [Indexed: 03/14/2023] Open
Abstract
Introduction Artificial intelligence can recognize complex patterns in large datasets. It is a promising technology to advance heart failure practice, as many decisions rely on expert opinions in the absence of high-quality data-driven evidence. Methods We searched Embase, Web of Science, and PubMed databases for articles containing "artificial intelligence," "machine learning," or "deep learning" and any of the phrases "heart transplantation," "ventricular assist device," or "cardiogenic shock" from inception until August 2022. We only included original research addressing post heart transplantation (HTx) or mechanical circulatory support (MCS) clinical care. Review and data extraction were performed in accordance with PRISMA-Scr guidelines. Results Of 584 unique publications detected, 31 met the inclusion criteria. The majority focused on outcome prediction post HTx (n = 13) and post durable MCS (n = 7), as well as post HTx and MCS management (n = 7, n = 3, respectively). One study addressed temporary mechanical circulatory support. Most studies advocated for rapid integration of AI into clinical practice, acknowledging potential improvements in management guidance and reliability of outcomes prediction. There was a notable paucity of external data validation and integration of multiple data modalities. Conclusion Our review showed mounting innovation in AI application in management of MCS and HTx, with the largest evidence showing improved mortality outcome prediction.
Collapse
Affiliation(s)
- Mohammad A Al-Ani
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Chen Bai
- Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, FL, United States
| | - Amal Hashky
- Department of Computer and Information Science and Engineering, University of Florida, Gainesville, FL, United States
| | - Alex M Parker
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Juan R Vilaro
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Juan M Aranda
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Benjamin Shickel
- Department of Medicine, University of Florida, Gainesville, FL, United States.,Intelligent Critical Care Center (IC3), University of Florida, Gainesville, FL, United States
| | - Parisa Rashidi
- Intelligent Critical Care Center (IC3), University of Florida, Gainesville, FL, United States.,Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
| | - Azra Bihorac
- Department of Medicine, University of Florida, Gainesville, FL, United States.,Intelligent Critical Care Center (IC3), University of Florida, Gainesville, FL, United States
| | - Mustafa M Ahmed
- Division of Cardiovascular Medicine, University of Florida, Gainesville, FL, United States
| | - Mamoun T Mardini
- Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, FL, United States
| |
Collapse
|
40
|
Germani E, Fromont E, Maumet C. On the benefits of self-taught learning for brain decoding. Gigascience 2022; 12:giad029. [PMID: 37132522 PMCID: PMC10155221 DOI: 10.1093/gigascience/giad029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 01/24/2023] [Accepted: 04/14/2023] [Indexed: 05/04/2023] Open
Abstract
CONTEXT We study the benefits of using a large public neuroimaging database composed of functional magnetic resonance imaging (fMRI) statistic maps, in a self-taught learning framework, for improving brain decoding on new tasks. First, we leverage the NeuroVault database to train, on a selection of relevant statistic maps, a convolutional autoencoder to reconstruct these maps. Then, we use this trained encoder to initialize a supervised convolutional neural network to classify tasks or cognitive processes of unseen statistic maps from large collections of the NeuroVault database. RESULTS We show that such a self-taught learning process always improves the performance of the classifiers, but the magnitude of the benefits strongly depends on the number of samples available both for pretraining and fine-tuning the models and on the complexity of the targeted downstream task. CONCLUSION The pretrained model improves the classification performance and displays more generalizable features, less sensitive to individual differences.
Collapse
Affiliation(s)
- Elodie Germani
- Univ Rennes, Inria, CNRS, Inserm, IRISA UMR 6074, Empenn ERL U 1228, 35000 Rennes, France
| | - Elisa Fromont
- Univ Rennes, IUF, Inria, CNRS, IRISA UMR 6074, 35000 Rennes, France
| | - Camille Maumet
- Univ Rennes, Inria, CNRS, Inserm, IRISA UMR 6074, Empenn ERL U 1228, 35000 Rennes, France
| |
Collapse
|
41
|
Awad CS, Deng Y, Kwagyan J, Roche-Lima A, Tchounwou PB, Wang Q, Idris MY. Summary of Year-One Effort of the RCMI Consortium to Enhance Research Capacity and Diversity with Data Science. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 20:279. [PMID: 36612607 PMCID: PMC9819075 DOI: 10.3390/ijerph20010279] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 11/22/2022] [Accepted: 12/02/2022] [Indexed: 05/23/2023]
Abstract
Despite being disproportionately impacted by health disparities, Black, Hispanic, Indigenous, and other underrepresented populations account for a significant minority of graduates in biomedical data science-related disciplines. Given their commitment to educating underrepresented students and trainees, minority serving institutions (MSIs) can play a significant role in enhancing diversity in the biomedical data science workforce. Little has been published about the reach, curricular breadth, and best practices for delivering these data science training programs. The purpose of this paper is to summarize six Research Centers in Minority Institutions (RCMIs) awarded funding from the National Institute of Minority Health Disparities (NIMHD) to develop new data science training programs. A cross-sectional survey was conducted to better understand the demographics of learners served, curricular topics covered, methods of instruction and assessment, challenges, and recommendations by program directors. Programs demonstrated overall success in reach and curricular diversity, serving a broad range of students and faculty, while also covering a broad range of topics. The main challenges highlighted were a lack of resources and infrastructure and teaching learners with varying levels of experience and knowledge. Further investments in MSIs are needed to sustain training efforts and develop pathways for diversifying the biomedical data science workforce.
Collapse
Affiliation(s)
- Christopher S. Awad
- Department of Medicine, Emory University School of Medicine, 100 Woodruff Circle, Atlanta, GA 30322, USA
- Department of Medicine, Clinical Research Center, Morehouse School of Medicine, 720 Westview Dr SW, Atlanta, GA 30310, USA
| | - Youping Deng
- Department of Quantitative Health Sciences, John A. Burns School of Medicine, University of Hawaii at Manoa, Honolulu, HI 96813, USA
| | - John Kwagyan
- Department of Community Health and Family Medicine, Howard University College of Medicine, 520 W St, Washington, DC 20059, USA
| | - Abiel Roche-Lima
- Department of Bioinformatics, Medical Science Campus, University of Puerto Rico, CCHRD-RCMI, P.O. Box 365067, San Juan, PR 00936, USA
| | - Paul B. Tchounwou
- Department of Biology, Jackson State University, 1400 J R Lynch Street, Jackson, MS 39217, USA
| | - Qingguo Wang
- Department of Computer Science & Data Science, School of Applied Computational Sciences, Meharry Medical College, 1005 Dr. D.B. Todd Jr. Blvd., Nashville, TN 37208, USA
| | - Muhammed Y. Idris
- Department of Medicine, Clinical Research Center, Morehouse School of Medicine, 720 Westview Dr SW, Atlanta, GA 30310, USA
| |
Collapse
|
42
|
FAN BE, CHEN DTY, PONNUDURAI K, WINKLER S. Artificial intelligence for malaria: Bridging the gap for real world usage. THE LANCET REGIONAL HEALTH. SOUTHEAST ASIA 2022; 5:100073. [PMID: 37383664 PMCID: PMC10306021 DOI: 10.1016/j.lansea.2022.100073] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 06/30/2023]
Affiliation(s)
- Bingwen Eugene FAN
- Department of Haematology, Tan Tock Seng Hospital, Singapore
- Department of Laboratory Medicine, Khoo Teck Puat Hospital, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | | | - Kuperan PONNUDURAI
- Department of Haematology, Tan Tock Seng Hospital, Singapore
- Department of Laboratory Medicine, Khoo Teck Puat Hospital, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Stefan WINKLER
- ASUS Intelligent Cloud Services (AICS), Singapore
- School of Computing, National University of Singapore, Singapore
| |
Collapse
|