1
|
Benčević M, Habijan M, Galić I, Babin D, Pižurica A. Understanding skin color bias in deep learning-based skin lesion segmentation. Comput Methods Programs Biomed 2024; 245:108044. [PMID: 38290289 DOI: 10.1016/j.cmpb.2024.108044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 01/17/2024] [Accepted: 01/21/2024] [Indexed: 02/01/2024]
Abstract
BACKGROUND The field of dermatological image analysis using deep neural networks includes the semantic segmentation of skin lesions, pivotal for lesion analysis, pathology inference, and diagnoses. While biases in neural network-based dermatoscopic image classification against darker skin tones due to dataset imbalance and contrast disparities are acknowledged, a comprehensive exploration of skin color bias in lesion segmentation models is lacking. It is imperative to address and understand the biases in these models. METHODS Our study comprehensively evaluates skin tone bias within prevalent neural networks for skin lesion segmentation. Since no information about skin color exists in widely used datasets, to quantify the bias we use three distinct skin color estimation methods: Fitzpatrick skin type estimation, Individual Typology Angle estimation as well as manual grouping of images by skin color. We assess bias across common models by training a variety of U-Net-based models on three widely-used datasets with 1758 different dermoscopic and clinical images. We also evaluate commonly suggested methods to mitigate bias. RESULTS Our findings expose a significant and large correlation between segmentation performance and skin color, revealing consistent challenges in segmenting lesions for darker skin tones across diverse datasets. Using various methods of skin color quantification, we have found significant bias in skin lesion segmentation against darker-skinned individuals when evaluated both in and out-of-sample. We also find that commonly used methods for bias mitigation do not result in any significant reduction in bias. CONCLUSIONS Our findings suggest a pervasive bias in most published lesion segmentation methods, given our use of commonly employed neural network architectures and publicly available datasets. In light of our findings, we propose recommendations for unbiased dataset collection, labeling, and model development. This presents the first comprehensive evaluation of fairness in skin lesion segmentation.
Collapse
Affiliation(s)
- Marin Benčević
- J. J. Strossmayer University of Osijek, Faculty of Electrical Engineering, Computer Science and Information Technology Osijek, Kneza Trpimira 2B, Osijek, 31000, Croatia; Ghent University, Department of Telecommunications and Information Processing, TELIN-GAIM, St-Pietersnieuwstraat 41, Ghent, 9000, Belgium.
| | - Marija Habijan
- J. J. Strossmayer University of Osijek, Faculty of Electrical Engineering, Computer Science and Information Technology Osijek, Kneza Trpimira 2B, Osijek, 31000, Croatia
| | - Irena Galić
- J. J. Strossmayer University of Osijek, Faculty of Electrical Engineering, Computer Science and Information Technology Osijek, Kneza Trpimira 2B, Osijek, 31000, Croatia
| | - Danilo Babin
- Ghent University, Department of Telecommunications and Information Processing, imec-TELIN-IPI, St-Pietersnieuwstraat 41, Ghent, 9000, Belgium
| | - Aleksandra Pižurica
- Ghent University, Department of Telecommunications and Information Processing, TELIN-GAIM, St-Pietersnieuwstraat 41, Ghent, 9000, Belgium
| |
Collapse
|
2
|
Vodanović M, Subašić M, Milošević DP, Galić I, Brkić H. Artificial intelligence in forensic medicine and forensic dentistry. J Forensic Odontostomatol 2023; 41:30-41. [PMID: 37634174 PMCID: PMC10473456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 08/29/2023]
Abstract
This review article aims to highlight the current possibilities for applying Artificial Intelligence in modern forensic medicine and forensic dentistry and present the advantages and disadvantages of its use. For this purpose, the relevant academic literature was searched using PubMed, Web of Science and Scopus. The application of Artificial Intelligence in forensic medicine and forensic dentistry is still in its early stages. However, the possibilities are great, and the future will show what is applicable in daily practice. Artificial Intelligence will improve the accuracy and efficiency of work in forensic medicine and forensic dentistry; it can automate some tasks; and enhance the quality of evidence. Disadvantages of the application of Artificial Intelligence may be related to discrimination, transparency, accountability, privacy, security, ethics and others. Artificial Intelligence systems should be used as a support tool, not as a replacement for forensic experts.
Collapse
Affiliation(s)
- M Vodanović
- Department of Dental Anthropology, School of Dental Medicine, University of Zagreb, Croatia
| | - M Subašić
- Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia
| | - D P Milošević
- Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia
| | - I Galić
- School of Medicine, University of Split, Croatia
| | - H Brkić
- Department of Dental Anthropology, School of Dental Medicine, University of Zagreb, Croatia
| |
Collapse
|
3
|
Benčević M, Qiu Y, Galić I, Pižurica A. Segment-then-Segment: Context-Preserving Crop-Based Segmentation for Large Biomedical Images. Sensors (Basel) 2023; 23:633. [PMID: 36679429 PMCID: PMC9866819 DOI: 10.3390/s23020633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Revised: 12/23/2022] [Accepted: 01/04/2023] [Indexed: 06/17/2023]
Abstract
Medical images are often of huge size, which presents a challenge in terms of memory requirements when training machine learning models. Commonly, the images are downsampled to overcome this challenge, but this leads to a loss of information. We present a general approach for training semantic segmentation neural networks on much smaller input sizes called Segment-then-Segment. To reduce the input size, we use image crops instead of downscaling. One neural network performs the initial segmentation on a downscaled image. This segmentation is then used to take the most salient crops of the full-resolution image with the surrounding context. Each crop is segmented using a second specially trained neural network. The segmentation masks of each crop are joined to form the final output image. We evaluate our approach on multiple medical image modalities (microscopy, colonoscopy, and CT) and show that this approach greatly improves segmentation performance with small network input sizes when compared to baseline models trained on downscaled images, especially in terms of pixel-wise recall.
Collapse
Affiliation(s)
- Marin Benčević
- Faculty of Electrical Engineering, Computer Science and Information Technology, J. J. Strossmayer University, 31000 Osijek, Croatia
- TELIN-GAIM, Faculty of Engineering and Architecture, Ghent University, 9000 Ghent, Belgium
| | - Yuming Qiu
- TELIN-GAIM, Faculty of Engineering and Architecture, Ghent University, 9000 Ghent, Belgium
- Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China
| | - Irena Galić
- Faculty of Electrical Engineering, Computer Science and Information Technology, J. J. Strossmayer University, 31000 Osijek, Croatia
| | - Aleksandra Pižurica
- TELIN-GAIM, Faculty of Engineering and Architecture, Ghent University, 9000 Ghent, Belgium
| |
Collapse
|
4
|
Angelakopoulos N, Galić I, Balla SB, Kiş HC, Gómez Jiménez L, Zolotenkova G, Mohd Yusof MYP, Hadzić Selmanagić A, Pandey H, Palmela Pereira C, Nóbrega JBM, Hettiarachchi K, Mieke SM, Kumagai A, Gulsahi A, Zelić K, Marinković N, Kelmendi J, Bianchi I, Soriano Vázquez I, Spinas E, Velezmoro-Montes YW, Oliveira-Santos I, De Luca S, Arrais Ribeiro IL, Moukarzel M, Cameriere R. Comparison of the third molar maturity index (I 3M) between left and right lower third molars to assess the age of majority: a multi-ethnic study sample. Int J Legal Med 2021; 135:2423-2436. [PMID: 34228192 DOI: 10.1007/s00414-021-02656-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Accepted: 06/27/2021] [Indexed: 11/26/2022]
Abstract
The diagnostic accuracy of the I3M to assess the legal age of 18 years has already been tested in several specific-population samples. The left lower third molar has been extensively used for discriminating between minors and adults. This research aimed to compare the usefulness of lower third molar maturity indexes, from both left and right side (I3ML and I3MR), in samples originating from four distinct continents in order to examine possible differences in their accuracy values. For this purpose, a sample of 10,181 orthopantomograms (OPGs), from Europe, Africa, Asia and America, was analysed and previously scored in other studies. The samples included healthy subjects with no systemic disorders with both third molars and clear depicted root apices. Wilcoxon Signed Rank test for left and right asymmetry did not show any significant differences. Data about sensitivity, specificity, predictive values, likelihood ratio and accuracy were pooled together and showed similar results for I3ML and I3MR, respectively. In addition, all these quantities were high when only the I3MR was considered to discriminate between adults and minors. The present referable database was the first to pool third molar measurements using panoramic radiographs of subjects coming from different continents. The results highlighted that both I3ML and I3MR are reliable indicators for assessing the legal age of 18 years old in those jurisdictions where this legal threshold has been set as the age of majority.
Collapse
Affiliation(s)
- N Angelakopoulos
- Department of Orthodontics and Dentofacial Orthopaedics, University of Bern, Bern, Switzerland
- AgEstimation Project, Macerata, Italy
| | - I Galić
- AgEstimation Project, Macerata, Italy
- Department of Oral Surgery, School of Medicine, University of Split, Split, Croatia
| | - S B Balla
- AgEstimation Project, Macerata, Italy
- Department of Forensic Odontology, Panineeya Institute of Dental Sciences and Research Center, Hyderabad, Telangana, India
| | - H C Kiş
- Faculty of Dentistry, Oral and Maxillofacial Radiology, Nuh Naci Yazgan University, Kocasinan, Kayseri, Turkey
| | - L Gómez Jiménez
- Instituto Nacional de Patología Dr. Sergio Sarita Valdez, Santo Domingo, República Dominicana
| | - G Zolotenkova
- Department of Forensic Medicine, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
- Design Information Technologies Centre, Russian Academy of Sciences (DITC RAS), Moscow, Russia
| | - M Y P Mohd Yusof
- Centre for Oral & Maxillofacial Diagnostics and Medicine Studies, Faculty of Dentistry, Universiti Teknologi MARA, Sungai Buloh Campus, Selangor, Malaysia
- Institute of Pathology, Laboratory and Forensic Medicine (I-PPerForM), Universiti Teknologi MARA, Sungai Buloh Campus, Selangor, Malaysia
| | - A Hadzić Selmanagić
- Department of Dental Morphology With Dental Anthropology and Forensics Faculty of Dentistry, University of Sarajevo, Sarajevo, Bosnia and Herzegovina
| | - H Pandey
- Department of Forensic Medicine and Toxicology, Seth GS Medical College and KEM Hospital, Mumbai, India
| | - C Palmela Pereira
- Facultade de Medicina Dentária da Universidade de Lisboa, Lisboa, Portugal
| | - J B M Nóbrega
- Postgraduate Program in Dentistry, Universidade Federal da Paraíba, João Pessoa, Paraíba, Brasil
| | - K Hettiarachchi
- Department of Oral Medicine and Periodontology, Faculty of Dental Sciences, University of Peradeniya, Kandy, Central Province, Sri Lanka
| | - S M Mieke
- Department of Forensic Odontology, Faculty of Dental Medicine, Universitas Airlangga, Surabaya, Indonesia
| | - A Kumagai
- Division of Forensic Odontology and Disaster Oral Medicine, Department of Forensic Science, Iwate Medical University, Iwate, Japan
| | - A Gulsahi
- AgEstimation Project, Macerata, Italy
- Faculty of Dentistry, Dentomaxillofacial Radiology Department, Baskent University, Ankara, Turkey
| | - K Zelić
- Laboratory of Anthropology, Institute of Anatomy, School of Medicine, University of Belgrade, Belgrade, Serbia
- School of Dental Medicine, University of Belgrade, Belgrade, Serbia
| | - N Marinković
- Clinic for Orthodontics, School of Dental Medicine, University of Belgrade, Belgrade, Serbia
| | - J Kelmendi
- Department of Orthodontics, Faculty of Medicine Alma Mater Europaea, University of Prishtina, Campus Rezonanca, Prishtina, Kosovo
| | - I Bianchi
- Department of Law, Institute of Legal Medicine, University of Macerata, Macerata, Italy
| | | | - E Spinas
- Department of Surgical Sciences, Section of Dentistry, University of Cagliari , Cagliari, Italy
| | | | - I Oliveira-Santos
- Centre for Functional Ecology, Laboratory of Forensic Anthropology, Department of Life Sciences, University of Coimbra, Coimbra, Portugal
| | - Stefano De Luca
- AgEstimation Project, Macerata, Italy.
- Área de Identificación Forense, Unidad de Derechos Humanos, Servicio Médico Legal, Santiago de Chile, Chile.
| | - I L Arrais Ribeiro
- Postgraduate Program in Dentistry, Universidade Federal da Paraíba, João Pessoa, Paraíba, Brasil
| | | | - R Cameriere
- AgEstimation Project, Macerata, Italy
- Department of Forensic Medicine, I.M. Sechenov First Moscow State Medical University, Moscow, Russia
| |
Collapse
|
5
|
Habijan M, Babin D, Galić I, Leventić H, Romić K, Velicki L, Pižurica A. Overview of the Whole Heart and Heart Chamber Segmentation Methods. Cardiovasc Eng Technol 2020; 11:725-747. [DOI: 10.1007/s13239-020-00494-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Accepted: 10/06/2020] [Indexed: 12/13/2022]
|
6
|
Angelakopoulos N, Galić I, De Luca S, Campobasso C, Martino F, De Micco F, Coccia E, Cameriere R. Skeletal age assessment by measuring planar projections of carpals and distal epiphyses of ulna and radius bones in a sample of South African subadults. AUST J FORENSIC SCI 2020. [DOI: 10.1080/00450618.2020.1766111] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Affiliation(s)
- N. Angelakopoulos
- Department of Orthodontics and Dentofacial Orthopedics, University of Bern, Bern, Switzerland
| | - I. Galić
- Department of Research in Biomedicine and Health, School of Medicine, University of Split, Split, Croatia
| | - S. De Luca
- Área de Identificación Forense, Unidad de Derechos Humanos, Servicio Médico Legal, Santiago de Chile, Chile
- AgEstimation Project, University of Macerata, Macerata, Italy
| | - C.P. Campobasso
- Department of Experimental Medicine, University of Campania “Luigi Vanvitelli”, Napoli, Italy
| | - F. Martino
- Department of Experimental Medicine, University of Campania “Luigi Vanvitelli”, Napoli, Italy
| | - F. De Micco
- Department of Medicine and Health Sciences “Vincenzo Tiberio”, University of Molise, Campobasso, Italy
| | - E. Coccia
- Department of Odontostomatology and Specialized Clinical Sciences (DISCO), Polytechnic University of Marche, Ancona, Italy
| | - R. Cameriere
- AgEstimation Project, University of Macerata, Macerata, Italy
| |
Collapse
|
7
|
Leventić H, Babin D, Velicki L, Devos D, Galić I, Zlokolica V, Romić K, Pižurica A. Left atrial appendage segmentation from 3D CCTA images for occluder placement procedure. Comput Biol Med 2019; 104:163-174. [DOI: 10.1016/j.compbiomed.2018.11.006] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2018] [Revised: 10/29/2018] [Accepted: 11/07/2018] [Indexed: 11/29/2022]
|
8
|
Azevedo A, Michel-Crosato E, Biazevic M, Galić I, Merelli V, De Luca S, Cameriere R. Accuracy and reliability of pulp/tooth area ratio in upper canines by peri-apical X-rays. Leg Med (Tokyo) 2014; 16:337-43. [DOI: 10.1016/j.legalmed.2014.07.002] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2013] [Revised: 06/05/2014] [Accepted: 07/04/2014] [Indexed: 10/25/2022]
|
9
|
Vodanović M, Zukanović A, Galić I, Harvey L, Savić Pavičin I, Dumančić J, Bedić Ž, Njemirovskij V, Šlaus M, Brkić H. Carabelli's trait in Croatian populations over 1800 years. Homo 2013; 64:273-85. [PMID: 23664021 DOI: 10.1016/j.jchb.2013.04.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/23/2012] [Accepted: 04/06/2013] [Indexed: 10/26/2022]
Abstract
Examination and comparison of the morphological features of tooth crown in archaeological and recent samples can be difficult due to the different levels of tooth wear seen both within and between populations. These differences make the comparison of frequency data for Carabelli trait problematic. The aim of the present study is to detect the frequency and degree of expression of Carabelli's trait in Croatian populations from late antiquity to recent times and to use these data as supplementary evidence of complex population migration. A total of 1287 individuals from the late antiquity, medieval, early modern and modern periods were examined. Correlation between the presence of Carabelli's trait and tooth crown size was tested. The results of our analyses show that the frequency of Carabelli's trait is significantly greater in the early modern period (51.3%) and in the 21st century (43.1%) than in the late antiquity (20.4%) and medieval periods (23.4%). These results are consistent with historical evidence of migration and population change in the territory of present-day Croatia throughout the almost 1800 years covered by this study. The results also provide additional evidence for the complex nature of population change in the transition from the late antiquity to the early medieval period.
Collapse
Affiliation(s)
- M Vodanović
- Department of Dental Anthropology, School of Dental Medicine, University of Zagreb, Gundulićeva 5, Zagreb 10000, Croatia.
| | | | | | | | | | | | | | | | | | | |
Collapse
|
10
|
Vodanović M, Dumančić J, Galić I, Savić Pavičin I, Petrovečki M, Cameriere R, Brkić H. Age estimation in archaeological skeletal remains: evaluation of four non-destructive age calculation methods. J Forensic Odontostomatol 2011; 29:14-21. [PMID: 22717909 PMCID: PMC5734850] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Estimation of age at death is an essential part of reconstructing information from skeletal material. The aim of the investigation was to reconstruct the chronological age of an archaeological sample from Croatia using cranial skeletal remains as well as to make an evaluation of the methods used for age estimation. For this purpose, four age calculation methods were used: palatal suture closure, occlusal tooth wear, tooth root translucency and pulp/tooth area ratio. Cramer's V test was used to test the association between the age calculation methods. Cramer's V test showed high association (0.677) between age determination results using palatal suture closure and occlusal tooth wear, and low association (0.177) between age determination results using palatal suture closure and pulp/tooth area ratio. Simple methods like palatal suture closure can provide data about age at death for large number of individuals, but with less accuracy. More complex methods which require qualified and trained personnel can provide data about age for a smaller number of individuals, but with more accuracy. Using different (both simple and complex) age calculation methods in archaeological samples can raise the level of confidence and percentage of success in determining age.
Collapse
Affiliation(s)
- M Vodanović
- Department of Dental Anthropology, School of Dental Medicine, University of Zagreb, Croatia.
| | | | | | | | | | | | | |
Collapse
|