1
|
Lysukhin D, Varlamov A, Yakimov B, Porubayeva E, Pachuashvili N, Kovaleva E, Vanushko V, Platonova N, Shirshin E, Mokrysheva N, Urusova L. Multiple-Instance Learning for thyroid gland disease classification: A hands-on experience. Comput Biol Med 2025; 184:109424. [PMID: 39612828 DOI: 10.1016/j.compbiomed.2024.109424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2024] [Revised: 10/29/2024] [Accepted: 11/10/2024] [Indexed: 12/01/2024]
Abstract
The morphological diagnosis of thyroid gland neoplasms presents a dual challenge: it requires the expertise of highly trained specialists and considerable time, particularly when evaluating multiple whole slide images (WSIs) from a single patient. The integration of artificial intelligence (AI) techniques into the diagnostic workflow is a hot area of research. However, most studies rely on meticulously curated datasets, the preparation of which is both costly and fraught with complexities. This paper investigates the development of machine learning models using weakly-annotated "real-world" data, devoid of the selective preprocessing typical in common research datasets. Our study demonstrates that a Multiple-Instance Learning (MIL) model, trained on a weak patient-level annotations of 1102 patients encompassing 5104 WSIs, successfully discriminates between benign and malignant conditions at the patient level, achieving an average test set F1-Score of 0.85 with a standard deviation of 0.05. This study is, to our knowledge, the first to report findings from an AI model trained on patient-level data without prior labeling refinement. Additionally, we identify potential pitfalls in data quality that could induce model overfitting, such as the inadvertent inclusion of dye used to highlight resection margins, which correlates with the target variable. We also assessed the impact of detailed slide-level versus coarse patient-level annotations on classification accuracy using a smaller, more precisely annotated dataset of 36 laboratory cases (91 WSIs). The results indicate that detailed annotations substantially enhance classification performance in smaller datasets.
Collapse
Affiliation(s)
| | | | - Boris Yakimov
- Department of Physics, M.V. Lomonosov Moscow State University, Moscow, Russia
| | | | | | | | | | | | - Evgeny Shirshin
- Endocrinology Research Centre, Moscow, Russia; Department of Physics, M.V. Lomonosov Moscow State University, Moscow, Russia
| | | | | |
Collapse
|
2
|
Timakova A, Ananev V, Fayzullin A, Zemnuhov E, Rumyantsev E, Zharov A, Zharkov N, Zotova V, Shchelokova E, Demura T, Timashev P, Makarov V. LVI-PathNet: Segmentation-classification pipeline for detection of lymphovascular invasion in whole slide images of lung adenocarcinoma. J Pathol Inform 2024; 15:100395. [PMID: 39328468 PMCID: PMC11426154 DOI: 10.1016/j.jpi.2024.100395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Revised: 08/20/2024] [Accepted: 08/27/2024] [Indexed: 09/28/2024] Open
Abstract
Lymphovascular invasion (LVI) in lung cancer is a significant prognostic factor that influences treatment and outcomes, yet its reliable detection is challenging due to interobserver variability. This study aims to develop a deep learning model for LVI detection using whole slide images (WSIs) and evaluate its effectiveness within a pathologist's information system. Experienced pathologists annotated blood vessels and invading tumor cells in 162 WSIs of non-mucinous lung adenocarcinoma sourced from two external and one internal datasets. Two models were trained to segment vessels and identify images with LVI features. DeepLabV3+ model achieved an Intersection-over-Union of 0.8840 and an area under the receiver operating characteristic curve (AUC-ROC) of 0.9869 in vessel segmentation. For LVI classification, the ensemble model achieved a F1-score of 0.9683 and an AUC-ROC of 0.9987. The model demonstrated robustness and was unaffected by variations in staining and image quality. The pilot study showed that pathologists' evaluation time for LVI detecting decreased by an average of 16.95%, and by 21.5% in "hard cases". The model facilitated consistent diagnostic assessments, suggesting potential for broader applications in detecting pathological changes in blood vessels and other lung pathologies.
Collapse
Affiliation(s)
- Anna Timakova
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Vladislav Ananev
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| | - Alexey Fayzullin
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Egor Zemnuhov
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| | - Egor Rumyantsev
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| | - Andrey Zharov
- Helmholtz National Medical Research Center for Eye Diseases, 14/19 Sadovaya- Chernogryazskaya, Moscow 105062, Russia
| | - Nicolay Zharkov
- Institute for Morphology and Digital Pathology, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Varvara Zotova
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| | - Elena Shchelokova
- Institute for Morphology and Digital Pathology, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Tatiana Demura
- Institute for Morphology and Digital Pathology, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Peter Timashev
- Institute for Regenerative Medicine, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
- World-Class Research Center “Digital Biodesign and Personalized Healthcare”, Sechenov First Moscow State Medical University (Sechenov University), 8-2 Trubetskaya st., Moscow 119991, Russia
| | - Vladimir Makarov
- Medical Informatics Laboratory, Yaroslav-the-Wise Novgorod State University, 41 B. St. Petersburgskaya, Veliky Novgorod 173003, Russia
| |
Collapse
|
3
|
Guryleva A, Machikhin A, Orlova E, Kulikova E, Volkov M, Gabrielian G, Smirnova L, Sekacheva M, Olisova O, Rudenko E, Lobanova O, Smolyannikova V, Demura T. Photoplethysmography-Based Angiography of Skin Tumors in Arbitrary Areas of Human Body. JOURNAL OF BIOPHOTONICS 2024:e202400242. [PMID: 39327652 DOI: 10.1002/jbio.202400242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Revised: 09/05/2024] [Accepted: 09/06/2024] [Indexed: 09/28/2024]
Abstract
Noninvasive, rapid, and robust diagnostic techniques for clinical screening of tumors located in arbitrary areas of the human body are in demand. To address this challenge, we analyzed the feasibility of photoplethysmography-based angiography for assessing vascular structures within malignant and benign tumors. The proposed hardware and software were approved in a clinical study involving 30 patients with tumors located in the legs, torso, arms, and head. High-contrast and detailed vessel maps within both benign and malignant tumors were obtained. We demonstrated that capillary maps are consistent and can be interpreted using well-established dermoscopic criteria for vascular morphology. Vessel mapping provides valuable details, which may not be available in dermoscopic images and can aid in determining whether a tumor is benign or malignant. We believe that the proposed approach may become a valuable tool in the preliminary cancer diagnosis and is suitable for large-scale screening.
Collapse
Affiliation(s)
- Anastasia Guryleva
- Scientific and Technological Centre of Unique Instrumentation of Russian Academy of Sciences, Moscow, Russia
| | - Alexander Machikhin
- Scientific and Technological Centre of Unique Instrumentation of Russian Academy of Sciences, Moscow, Russia
| | - Ekaterina Orlova
- V.A. Rakhmanov Department of Dermatology and Venereology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Evgeniya Kulikova
- Scientific and Technological Centre of Unique Instrumentation of Russian Academy of Sciences, Moscow, Russia
| | - Michail Volkov
- Scientific and Technological Centre of Unique Instrumentation of Russian Academy of Sciences, Moscow, Russia
| | - Gaiane Gabrielian
- World-Class Research Center "Digital Biodesign and Personalized Healthcare", I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Ludmila Smirnova
- V.A. Rakhmanov Department of Dermatology and Venereology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Marina Sekacheva
- World-Class Research Center "Digital Biodesign and Personalized Healthcare", I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Olga Olisova
- V.A. Rakhmanov Department of Dermatology and Venereology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Ekaterina Rudenko
- Institute of Clinical Morphology and Digital Pathology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Olga Lobanova
- Institute of Clinical Morphology and Digital Pathology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Vera Smolyannikova
- Institute of Clinical Morphology and Digital Pathology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Tatiana Demura
- Institute of Clinical Morphology and Digital Pathology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| |
Collapse
|
4
|
Danilov VV, Laptev VV, Klyshnikov KY, Stepanov AD, Bogdanov LA, Antonova LV, Krivkina EO, Kutikhin AG, Ovcharenko EA. ML-driven segmentation of microvascular features during histological examination of tissue-engineered vascular grafts. Front Bioeng Biotechnol 2024; 12:1411680. [PMID: 38988863 PMCID: PMC11233802 DOI: 10.3389/fbioe.2024.1411680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Accepted: 05/21/2024] [Indexed: 07/12/2024] Open
Abstract
Introduction The development of next-generation tissue-engineered medical devices such as tissue-engineered vascular grafts (TEVGs) is a leading trend in translational medicine. Microscopic examination is an indispensable part of animal experimentation, and histopathological analysis of regenerated tissue is crucial for assessing the outcomes of implanted medical devices. However, the objective quantification of regenerated tissues can be challenging due to their unusual and complex architecture. To address these challenges, research and development of advanced ML-driven tools for performing adequate histological analysis appears to be an extremely promising direction. Methods We compiled a dataset of 104 representative whole slide images (WSIs) of TEVGs which were collected after a 6-month implantation into the sheep carotid artery. The histological examination aimed to analyze the patterns of vascular tissue regeneration in TEVGs in situ. Having performed an automated slicing of these WSIs by the Entropy Masker algorithm, we filtered and then manually annotated 1,401 patches to identify 9 histological features: arteriole lumen, arteriole media, arteriole adventitia, venule lumen, venule wall, capillary lumen, capillary wall, immune cells, and nerve trunks. To segment and quantify these features, we rigorously tuned and evaluated the performance of six deep learning models (U-Net, LinkNet, FPN, PSPNet, DeepLabV3, and MA-Net). Results After rigorous hyperparameter optimization, all six deep learning models achieved mean Dice Similarity Coefficients (DSC) exceeding 0.823. Notably, FPN and PSPNet exhibited the fastest convergence rates. MA-Net stood out with the highest mean DSC of 0.875, demonstrating superior performance in arteriole segmentation. DeepLabV3 performed well in segmenting venous and capillary structures, while FPN exhibited proficiency in identifying immune cells and nerve trunks. An ensemble of these three models attained an average DSC of 0.889, surpassing their individual performances. Conclusion This study showcases the potential of ML-driven segmentation in the analysis of histological images of tissue-engineered vascular grafts. Through the creation of a unique dataset and the optimization of deep neural network hyperparameters, we developed and validated an ensemble model, establishing an effective tool for detecting key histological features essential for understanding vascular tissue regeneration. These advances herald a significant improvement in ML-assisted workflows for tissue engineering research and development.
Collapse
Affiliation(s)
| | - Vladislav V Laptev
- Siberian State Medical University, Tomsk, Russia
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | - Kirill Yu Klyshnikov
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | - Alexander D Stepanov
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | - Leo A Bogdanov
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | - Larisa V Antonova
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | - Evgenia O Krivkina
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | - Anton G Kutikhin
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | - Evgeny A Ovcharenko
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| |
Collapse
|
5
|
Magnusson MMM, Schüpbach-Regula G, Rieger J, Plendl J, Marin I, Drews B, Kaessmeyer S. Application of an artificial intelligence for quantitative analysis of endothelial capillary beds in vitro. Clin Hemorheol Microcirc 2024; 88:43-58. [PMID: 38640146 DOI: 10.3233/ch-242157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/21/2024]
Abstract
BACKGROUND The use of endothelial cell cultures has become fundamental to study angiogenesis. Recent advances in artificial intelligences (AI) offer opportunities to develop automated assessment methods in medical research, analyzing larger datasets. OBJECTIVE The aim of this study was to compare the application of AI with a manual method to morphometrically quantify in vitro angiogenesis. METHODS Co-cultures of human microvascular endothelial cells and fibroblasts were incubated mimicking endothelial capillary-beds. An AI-software was trained for segmentation of endothelial capillaries on anti-CD31-labeled light microscope crops. Number of capillaries and branches and average capillary diameter were measured by the AI and manually on 115 crops. RESULTS The crops were analyzed faster by the AI than manually (3 minutes vs 1 hour per crop). Using the AI, systematically more capillaries (mean 48/mm2 vs 27/mm2) and branches (mean 23/mm2 vs 11/mm2) were counted than manually. Both methods had a strong linear relationship in counting capillaries and branches (r-capillaries = 0.88, r-branches = 0.89). No correlation was found for measurements of the diameter (r-diameter = 0.15). CONCLUSIONS The present AI reduces the time required for quantitative analysis of angiogenesis on large datasets, and correlates well with manual analysis.
Collapse
Affiliation(s)
- Marine M M Magnusson
- Vetsuisse Faculty, Division of Veterinary Anatomy, University of Bern, Bern, Switzerland
| | | | - Juliane Rieger
- Department of Human Medicine, Institute of Translational Medicine for Health Care Systems
| | - Johanna Plendl
- Department of Veterinary Medicine, Institute of Veterinary Anatomy, Freie Universität Berlin, Berlin, Germany
| | - Ilka Marin
- Department of Veterinary Medicine, Institute of Veterinary Anatomy, Freie Universität Berlin, Berlin, Germany
| | - Barbara Drews
- Vetsuisse Faculty, Division of Veterinary Anatomy, University of Bern, Bern, Switzerland
| | - Sabine Kaessmeyer
- Vetsuisse Faculty, Division of Veterinary Anatomy, University of Bern, Bern, Switzerland
| |
Collapse
|
6
|
Pereira M, Pinto J, Arteaga B, Guerra A, Jorge RN, Monteiro FJ, Salgado CL. A Comprehensive Look at In Vitro Angiogenesis Image Analysis Software. Int J Mol Sci 2023; 24:17625. [PMID: 38139453 PMCID: PMC10743557 DOI: 10.3390/ijms242417625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 12/11/2023] [Accepted: 12/14/2023] [Indexed: 12/24/2023] Open
Abstract
One of the complex challenges faced presently by tissue engineering (TE) is the development of vascularized constructs that accurately mimic the extracellular matrix (ECM) of native tissue in which they are inserted to promote vessel growth and, consequently, wound healing and tissue regeneration. TE technique is characterized by several stages, starting from the choice of cell culture and the more appropriate scaffold material that can adequately support and supply them with the necessary biological cues for microvessel development. The next step is to analyze the attained microvasculature, which is reliant on the available labeling and microscopy techniques to visualize the network, as well as metrics employed to characterize it. These are usually attained with the use of software, which has been cited in several works, although no clear standard procedure has been observed to promote the reproduction of the cell response analysis. The present review analyzes not only the various steps previously described in terms of the current standards for evaluation, but also surveys some of the available metrics and software used to quantify networks, along with the detection of analysis limitations and future improvements that could lead to considerable progress for angiogenesis evaluation and application in TE research.
Collapse
Affiliation(s)
- Mariana Pereira
- i3S—Instituto de Investigação e Inovação em Saúde, Universidade do Porto, 4200-135 Porto, Portugal; (M.P.); (J.P.); (B.A.); (F.J.M.)
- INEB—Instituto de Engenharia Biomédica, Universidade do Porto, 4200-135 Porto, Portugal
| | - Jéssica Pinto
- i3S—Instituto de Investigação e Inovação em Saúde, Universidade do Porto, 4200-135 Porto, Portugal; (M.P.); (J.P.); (B.A.); (F.J.M.)
- INEB—Instituto de Engenharia Biomédica, Universidade do Porto, 4200-135 Porto, Portugal
| | - Belén Arteaga
- i3S—Instituto de Investigação e Inovação em Saúde, Universidade do Porto, 4200-135 Porto, Portugal; (M.P.); (J.P.); (B.A.); (F.J.M.)
- INEB—Instituto de Engenharia Biomédica, Universidade do Porto, 4200-135 Porto, Portugal
- Faculty of Medicine, University of Granada, Parque Tecnológico de la Salud, Av. de la Investigación 11, 18016 Granada, Spain
| | - Ana Guerra
- INEGI—Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, 4200-465 Porto, Portugal; (A.G.); (R.N.J.)
| | - Renato Natal Jorge
- INEGI—Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, 4200-465 Porto, Portugal; (A.G.); (R.N.J.)
- LAETA—Laboratório Associado de Energia, Transportes e Aeronáutica, Universidade do Porto, 4200-165 Porto, Portugal
- FEUP—Faculdade de Engenharia, Departamento de Engenharia Metalúrgica e de Materiais, Universidade do Porto, 4200-165 Porto, Portugal
| | - Fernando Jorge Monteiro
- i3S—Instituto de Investigação e Inovação em Saúde, Universidade do Porto, 4200-135 Porto, Portugal; (M.P.); (J.P.); (B.A.); (F.J.M.)
- INEB—Instituto de Engenharia Biomédica, Universidade do Porto, 4200-135 Porto, Portugal
- FEUP—Faculdade de Engenharia, Departamento de Engenharia Metalúrgica e de Materiais, Universidade do Porto, 4200-165 Porto, Portugal
- PCCC—Porto Comprehensive Cancer Center, 4200-072 Porto, Portugal
| | - Christiane Laranjo Salgado
- i3S—Instituto de Investigação e Inovação em Saúde, Universidade do Porto, 4200-135 Porto, Portugal; (M.P.); (J.P.); (B.A.); (F.J.M.)
- INEB—Instituto de Engenharia Biomédica, Universidade do Porto, 4200-135 Porto, Portugal
| |
Collapse
|