1
|
Martín-Pérez A, Martinez de Ternero A, Lagares A, Juarez E, Sanz C. Spectral analysis comparison of pushbroom and snapshot hyperspectral cameras for in vivo brain tissues and chromophore identification. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:093510. [PMID: 39318966 PMCID: PMC11420787 DOI: 10.1117/1.jbo.29.9.093510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Revised: 08/27/2024] [Accepted: 08/28/2024] [Indexed: 09/26/2024]
Abstract
Significance Hyperspectral imaging sensors have rapidly advanced, aiding in tumor diagnostics for in vivo brain tumors. Linescan cameras effectively distinguish between pathological and healthy tissue, whereas snapshot cameras offer a potential alternative to reduce acquisition time. Aim Our research compares linescan and snapshot hyperspectral cameras for in vivo brain tissues and chromophore identification. Approach We compared a linescan pushbroom camera and a snapshot camera using images from 10 patients with various pathologies. Objective comparisons were made using unnormalized and normalized data for healthy and pathological tissues. We utilized the interquartile range (IQR) for the spectral angle mapping (SAM), the goodness-of-fit coefficient (GFC), and the root mean square error (RMSE) within the 659.95 to 951.42 nm range. In addition, we assessed the ability of both cameras to capture tissue chromophores by analyzing absorbance from reflectance information. Results The SAM metric indicates reduced dispersion and high similarity between cameras for pathological samples, with a 9.68% IQR for normalized data compared with 2.38% for unnormalized data. This pattern is consistent across GFC and RMSE metrics, regardless of tissue type. Moreover, both cameras could identify absorption peaks of certain chromophores. For instance, using the absorbance measurements of the linescan camera, we obtained SAM values below 0.235 for four peaks, regardless of the tissue and type of data under inspection. These peaks are one for cytochrome b in its oxidized form at λ = 422 nm , two forHbO 2 at λ = 542 nm and λ = 576 nm , and one for water at λ = 976 nm . Conclusion The spectral signatures of the cameras show more similarity with unnormalized data, likely due to snapshot sensor noise, resulting in noisier signatures post-normalization. Comparisons in this study suggest that snapshot cameras might be viable alternatives to linescan cameras for real-time brain tissue identification.
Collapse
Affiliation(s)
- Alberto Martín-Pérez
- Universidad Politécnica de Madrid, Research Center on Software Technologies and Multimedia Systems, Madrid, Spain
| | | | - Alfonso Lagares
- Hospital Universitario 12 de Octubre, Neurosurgery Department, Madrid, Spain
- Universidad Complutense de Madrid, Surgery Department, Medicine Faculty, Madrid, Spain
- Instituto de Investigación Sanitaria Hospital 12 de Octubre (imas12), Madrid, Spain
| | - Eduardo Juarez
- Universidad Politécnica de Madrid, Research Center on Software Technologies and Multimedia Systems, Madrid, Spain
| | - César Sanz
- Universidad Politécnica de Madrid, Research Center on Software Technologies and Multimedia Systems, Madrid, Spain
| |
Collapse
|
2
|
Leung JH, Karmakar R, Mukundan A, Lin WS, Anwar F, Wang HC. Technological Frontiers in Brain Cancer: A Systematic Review and Meta-Analysis of Hyperspectral Imaging in Computer-Aided Diagnosis Systems. Diagnostics (Basel) 2024; 14:1888. [PMID: 39272675 PMCID: PMC11394276 DOI: 10.3390/diagnostics14171888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2024] [Revised: 08/19/2024] [Accepted: 08/23/2024] [Indexed: 09/15/2024] Open
Abstract
Brain cancer is a substantial factor in the mortality associated with cancer, presenting difficulties in the timely identification of the disease. The precision of diagnoses is significantly dependent on the proficiency of radiologists and neurologists. Although there is potential for early detection with computer-aided diagnosis (CAD) algorithms, the majority of current research is hindered by its modest sample sizes. This meta-analysis aims to comprehensively assess the diagnostic test accuracy (DTA) of computer-aided design (CAD) models specifically designed for the detection of brain cancer utilizing hyperspectral (HSI) technology. We employ Quadas-2 criteria to choose seven papers and classify the proposed methodologies according to the artificial intelligence method, cancer type, and publication year. In order to evaluate heterogeneity and diagnostic performance, we utilize Deeks' funnel plot, the forest plot, and accuracy charts. The results of our research suggest that there is no notable variation among the investigations. The CAD techniques that have been examined exhibit a notable level of precision in the automated detection of brain cancer. However, the absence of external validation hinders their potential implementation in real-time clinical settings. This highlights the necessity for additional studies in order to authenticate the CAD models for wider clinical applicability.
Collapse
Affiliation(s)
- Joseph-Hang Leung
- Department of Radiology, Ditmanson Medical Foundation Chia-yi Christian Hospital, Chia Yi 60002, Taiwan
| | - Riya Karmakar
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi 62102, Taiwan
| | - Arvind Mukundan
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi 62102, Taiwan
| | - Wen-Shou Lin
- Neurology Division, Department of Internal Medicine, Kaohsiung Armed Forces General Hospital, 2, Zhongzheng 1st. Rd., Lingya District, Kaohsiung City 80284, Taiwan
| | - Fathima Anwar
- Faculty of Allied Health Sciences, The University of Lahore, 1-Km Defense Road, Lahore 54590, Punjab, Pakistan
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi 62102, Taiwan
- Department of Medical Research, Dalin Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, No. 2, Minsheng Road, Dalin, Chia Yi 62247, Taiwan
- Department of Technology Development, Hitspectra Intelligent Technology Co., Ltd., 8F.11-1, No. 25, Chenggong 2nd Rd., Qianzhen Dist., Kaohsiung City 80661, Taiwan
| |
Collapse
|
3
|
Black D, Liquet B, Di Ieva A, Stummer W, Suero Molina E. Spectral library and method for sparse unmixing of hyperspectral images in fluorescence guided resection of brain tumors. BIOMEDICAL OPTICS EXPRESS 2024; 15:4406-4424. [PMID: 39346979 PMCID: PMC11427211 DOI: 10.1364/boe.528535] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Revised: 06/06/2024] [Accepted: 06/06/2024] [Indexed: 10/01/2024]
Abstract
Through spectral unmixing, hyperspectral imaging (HSI) in fluorescence-guided brain tumor surgery has enabled the detection and classification of tumor regions invisible to the human eye. Prior unmixing work has focused on determining a minimal set of viable fluorophore spectra known to be present in the brain and effectively reconstructing human data without overfitting. With these endmembers, non-negative least squares regression (NNLS) was commonly used to compute the abundances. However, HSI images are heterogeneous, so one small set of endmember spectra may not fit all pixels well. Additionally, NNLS is the maximum likelihood estimator only if the measurement is normally distributed, and it does not enforce sparsity, which leads to overfitting and unphysical results. In this paper, we analyzed 555666 HSI fluorescence spectra from 891 ex vivo measurements of patients with various brain tumors to show that a Poisson distribution indeed models the measured data 82% better than a Gaussian in terms of the Kullback-Leibler divergence, and that the endmember abundance vectors are sparse. With this knowledge, we introduce (1) a library of 9 endmember spectra, including PpIX (620 nm and 634 nm photostates), NADH, FAD, flavins, lipofuscin, melanin, elastin, and collagen, (2) a sparse, non-negative Poisson regression algorithm to perform physics-informed unmixing with this library without overfitting, and (3) a highly realistic spectral measurement simulation with known endmember abundances. The new unmixing method was then tested on the human and simulated data and compared to four other candidate methods. It outperforms previous methods with 25% lower error in the computed abundances on the simulated data than NNLS, lower reconstruction error on human data, better sparsity, and 31 times faster runtime than state-of-the-art Poisson regression. This method and library of endmember spectra can enable more accurate spectral unmixing to aid the surgeon better during brain tumor resection.
Collapse
Affiliation(s)
- David Black
- Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC, Canada
| | - Benoit Liquet
- School of Mathematical and Physical Sciences, Macquarie University, Sydney, Australia
- Laboratoire de Mathématiques et de ses Applications, E2S-UPPA, Université de Pau & Pays de L'Adour, France
- Computational NeuroSurgery (CNS) Lab, Macquarie University, Sydney, Australia
| | - Antonio Di Ieva
- Computational NeuroSurgery (CNS) Lab, Macquarie University, Sydney, Australia
- Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| | - Walter Stummer
- Department of Neurosurgery, University Hospital of Münster, Münster, Germany
| | - Eric Suero Molina
- Computational NeuroSurgery (CNS) Lab, Macquarie University, Sydney, Australia
- Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
- Department of Neurosurgery, University Hospital of Münster, Münster, Germany
| |
Collapse
|
4
|
Ghasemkhani B, Balbal KF, Birant KU, Birant D. A Novel Classification Method: Neighborhood-Based Positive Unlabeled Learning Using Decision Tree (NPULUD). ENTROPY (BASEL, SWITZERLAND) 2024; 26:403. [PMID: 38785652 PMCID: PMC11120015 DOI: 10.3390/e26050403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2024] [Revised: 04/29/2024] [Accepted: 05/02/2024] [Indexed: 05/25/2024]
Abstract
In a standard binary supervised classification task, the existence of both negative and positive samples in the training dataset are required to construct a classification model. However, this condition is not met in certain applications where only one class of samples is obtainable. To overcome this problem, a different classification method, which learns from positive and unlabeled (PU) data, must be incorporated. In this study, a novel method is presented: neighborhood-based positive unlabeled learning using decision tree (NPULUD). First, NPULUD uses the nearest neighborhood approach for the PU strategy and then employs a decision tree algorithm for the classification task by utilizing the entropy measure. Entropy played a pivotal role in assessing the level of uncertainty in the training dataset, as a decision tree was developed with the purpose of classification. Through experiments, we validated our method over 24 real-world datasets. The proposed method attained an average accuracy of 87.24%, while the traditional supervised learning approach obtained an average accuracy of 83.99% on the datasets. Additionally, it is also demonstrated that our method obtained a statistically notable enhancement (7.74%), with respect to state-of-the-art peers, on average.
Collapse
Affiliation(s)
- Bita Ghasemkhani
- Graduate School of Natural and Applied Sciences, Dokuz Eylul University, Izmir 35390, Turkey;
| | | | - Kokten Ulas Birant
- Information Technologies Research and Application Center (DEBTAM), Dokuz Eylul University, Izmir 35390, Turkey;
- Department of Computer Engineering, Dokuz Eylul University, Izmir 35390, Turkey
| | - Derya Birant
- Department of Computer Engineering, Dokuz Eylul University, Izmir 35390, Turkey
| |
Collapse
|
5
|
Burström G, Amini M, El-Hajj VG, Arfan A, Gharios M, Buwaider A, Losch MS, Manni F, Edström E, Elmi-Terander A. Optical Methods for Brain Tumor Detection: A Systematic Review. J Clin Med 2024; 13:2676. [PMID: 38731204 PMCID: PMC11084501 DOI: 10.3390/jcm13092676] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Revised: 04/28/2024] [Accepted: 04/30/2024] [Indexed: 05/13/2024] Open
Abstract
Background: In brain tumor surgery, maximal tumor resection is typically desired. This is complicated by infiltrative tumor cells which cannot be visually distinguished from healthy brain tissue. Optical methods are an emerging field that can potentially revolutionize brain tumor surgery through intraoperative differentiation between healthy and tumor tissues. Methods: This study aimed to systematically explore and summarize the existing literature on the use of Raman Spectroscopy (RS), Hyperspectral Imaging (HSI), Optical Coherence Tomography (OCT), and Diffuse Reflectance Spectroscopy (DRS) for brain tumor detection. MEDLINE, Embase, and Web of Science were searched for studies evaluating the accuracy of these systems for brain tumor detection. Outcome measures included accuracy, sensitivity, and specificity. Results: In total, 44 studies were included, covering a range of tumor types and technologies. Accuracy metrics in the studies ranged between 54 and 100% for RS, 69 and 99% for HSI, 82 and 99% for OCT, and 42 and 100% for DRS. Conclusions: This review provides insightful evidence on the use of optical methods in distinguishing tumor from healthy brain tissue.
Collapse
Affiliation(s)
- Gustav Burström
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Misha Amini
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Victor Gabriel El-Hajj
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Arooj Arfan
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Maria Gharios
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Ali Buwaider
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
| | - Merle S. Losch
- Department of Biomechanical Engineering, Faculty of Mechanical Engineering, Delft University of Technology, 2627 Delft, The Netherlands
| | - Francesca Manni
- Department of Electrical Engineering, Eindhoven University of Technology (TU/e), 5612 Eindhoven, The Netherlands;
| | - Erik Edström
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
- Capio Spine Center Stockholm, Löwenströmska Hospital, 194 80 Upplands-Väsby, Sweden
- Department of Medical Sciences, Örebro University, 701 85 Örebro, Sweden
| | - Adrian Elmi-Terander
- Department of Clinical Neuroscience, Karolinska Institute, 171 77 Stockholm, Sweden; (G.B.); (M.A.); (A.A.); (M.G.); (A.B.); (E.E.)
- Capio Spine Center Stockholm, Löwenströmska Hospital, 194 80 Upplands-Väsby, Sweden
- Department of Medical Sciences, Örebro University, 701 85 Örebro, Sweden
- Department of Surgical Sciences, Uppsala University, 751 35 Uppsala, Sweden
| |
Collapse
|
6
|
Anichini G, Leiloglou M, Hu Z, O'Neill K, Daniel Elson. Hyperspectral and multispectral imaging in neurosurgery: a systematic literature review and meta-analysis. EUROPEAN JOURNAL OF SURGICAL ONCOLOGY 2024:108293. [PMID: 38658267 DOI: 10.1016/j.ejso.2024.108293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Revised: 01/21/2024] [Accepted: 03/20/2024] [Indexed: 04/26/2024]
Abstract
INTRODUCTION The neuro-surgical community is witnessing a rising interest for surgical application of multispectral/hyperspectral imaging. Several potential technical applications of this optical imaging are reported, but the set-up is variable and so are the processing methods. We present a systematic review of the relevant literature on the topic. MATERIALS AND METHODS A literature search based on the PRISMA principles was performed on PubMed, SCOPUS, and Web of Science, using MESH terms and Boolean operators. Papers regarding intra-operative in-vivo application of multispectral and/or hyperspectral imaging in humans during neurosurgical procedures were included. Papers reporting technologies related to radiological applications were excluded. A meta-analysis on the performance metrics was also conducted. RESULTS Our search string retrieved 20 papers. The main applications of optical imaging during neurosurgery concern tumour detection and improvement of the extent of resection (15 papers) or visualization of perfusion changes during neuro-oncology or neuro-vascular surgery (5 papers). All the retrieved articles were pilot studies, proof of concepts, or case reports, with limited number of patients recruited. Sensitivity, specificity, and accuracy were promising in most of the reports, but the metanalysis showed heterogeneous approaches and results among studies. CONCLUSIONS The present review shows that several approaches are currently being tested to integrate hyperspectral imaging in neurosurgery, but most of the studies reported a limited pool of patients, with different approaches to data collection and analysis. Further studies on larger cohorts of patients are therefore desirable to fully explore the potential of this imaging technique.
Collapse
Affiliation(s)
- Giulio Anichini
- Department of Brain Sciences, Imperial College of London, United Kingdom; Department of Neurosurgery, Neuroscience, Imperial College Healthcare NHS Trust, United Kingdom.
| | - Maria Leiloglou
- Department of Surgery and Cancer, Imperial College of London, United Kingdom; The Hamlyn Centre, Imperial College of London, United Kingdom
| | - Zepeng Hu
- Department of Surgery and Cancer, Imperial College of London, United Kingdom; The Hamlyn Centre, Imperial College of London, United Kingdom
| | - Kevin O'Neill
- Department of Brain Sciences, Imperial College of London, United Kingdom; Department of Neurosurgery, Neuroscience, Imperial College Healthcare NHS Trust, United Kingdom
| | - Daniel Elson
- Department of Surgery and Cancer, Imperial College of London, United Kingdom; The Hamlyn Centre, Imperial College of London, United Kingdom
| |
Collapse
|
7
|
Myslicka M, Kawala-Sterniuk A, Bryniarska A, Sudol A, Podpora M, Gasz R, Martinek R, Kahankova Vilimkova R, Vilimek D, Pelc M, Mikolajewski D. Review of the application of the most current sophisticated image processing methods for the skin cancer diagnostics purposes. Arch Dermatol Res 2024; 316:99. [PMID: 38446274 DOI: 10.1007/s00403-024-02828-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Revised: 12/28/2023] [Accepted: 01/25/2024] [Indexed: 03/07/2024]
Abstract
This paper presents the most current and innovative solutions applying modern digital image processing methods for the purpose of skin cancer diagnostics. Skin cancer is one of the most common types of cancers. It is said that in the USA only, one in five people will develop skin cancer and this trend is constantly increasing. Implementation of new, non-invasive methods plays a crucial role in both identification and prevention of skin cancer occurrence. Early diagnosis and treatment are needed in order to decrease the number of deaths due to this disease. This paper also contains some information regarding the most common skin cancer types, mortality and epidemiological data for Poland, Europe, Canada and the USA. It also covers the most efficient and modern image recognition methods based on the artificial intelligence applied currently for diagnostics purposes. In this work, both professional, sophisticated as well as inexpensive solutions were presented. This paper is a review paper and covers the period of 2017 and 2022 when it comes to solutions and statistics. The authors decided to focus on the latest data, mostly due to the rapid technology development and increased number of new methods, which positively affects diagnosis and prognosis.
Collapse
Affiliation(s)
- Maria Myslicka
- Faculty of Medicine, Wroclaw Medical University, J. Mikulicza-Radeckiego 5, 50-345, Wroclaw, Poland.
| | - Aleksandra Kawala-Sterniuk
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland.
| | - Anna Bryniarska
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
| | - Adam Sudol
- Faculty of Natural Sciences and Technology, University of Opole, Dmowskiego 7-9, 45-368, Opole, Poland
| | - Michal Podpora
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
| | - Rafal Gasz
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
| | - Radek Martinek
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
- Department of Cybernetics and Biomedical Engineering, VSB-Technical University of Ostrava, 17. Listopadu 2172/15, Ostrava, 70800, Czech Republic
| | - Radana Kahankova Vilimkova
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
- Department of Cybernetics and Biomedical Engineering, VSB-Technical University of Ostrava, 17. Listopadu 2172/15, Ostrava, 70800, Czech Republic
| | - Dominik Vilimek
- Department of Cybernetics and Biomedical Engineering, VSB-Technical University of Ostrava, 17. Listopadu 2172/15, Ostrava, 70800, Czech Republic
| | - Mariusz Pelc
- Institute of Computer Science, University of Opole, Oleska 48, 45-052, Opole, Poland
- School of Computing and Mathematical Sciences, University of Greenwich, Old Royal Naval College, Park Row, SE10 9LS, London, UK
| | - Dariusz Mikolajewski
- Institute of Computer Science, Kazimierz Wielki University in Bydgoszcz, ul. Kopernika 1, 85-074, Bydgoszcz, Poland
- Neuropsychological Research Unit, 2nd Clinic of the Psychiatry and Psychiatric Rehabilitation, Medical University in Lublin, Gluska 1, 20-439, Lublin, Poland
| |
Collapse
|
8
|
Mun NE, Tran TKC, Park DH, Im JH, Park JI, Le TD, Moon YJ, Kwon SY, Yoo SW. Endoscopic Hyperspectral Imaging System to Discriminate Tissue Characteristics in Tissue Phantom and Orthotopic Mouse Pancreatic Tumor Model. Bioengineering (Basel) 2024; 11:208. [PMID: 38534482 DOI: 10.3390/bioengineering11030208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Revised: 02/15/2024] [Accepted: 02/21/2024] [Indexed: 03/28/2024] Open
Abstract
In this study, we developed an endoscopic hyperspectral imaging (eHSI) system and evaluated its performance in analyzing tissues within tissue phantoms and orthotopic mouse pancreatic tumor models. Our custom-built eHSI system incorporated a liquid crystal tunable filter. To assess its tissue discrimination capabilities, we acquired images of tissue phantoms, distinguishing between fat and muscle regions. The system underwent supervised training using labeled samples, and this classification model was then applied to other tissue phantom images for evaluation. In the tissue phantom experiment, the eHSI effectively differentiated muscle from fat and background tissues. The precision scores regarding fat tissue classification were 98.3% for the support vector machine, 97.7% for the neural network, and 96.0% with a light gradient-boosting machine algorithm, respectively. Furthermore, we applied the eHSI system to identify tumors within an orthotopic mouse pancreatic tumor model. The F-score of each pancreatic tumor-bearing model reached 73.1% for the KPC tumor model and 63.1% for the Pan02 tumor models. The refined imaging conditions and optimization of the fine-tuning of classification algorithms enhance the versatility and diagnostic efficacy of eHSI in biomedical applications.
Collapse
Affiliation(s)
- Na Eun Mun
- Department of Nuclear Medicine, Chonnam National University Medical School and Hwasun Hospital, Hwasun-gun 58128, Republic of Korea
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
| | - Thi Kim Chi Tran
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
- Biomedical Science Graduate Program, Chonnam National University, Hwasun-gun 58128, Republic of Korea
| | - Dong Hui Park
- Department of Nuclear Medicine, Chonnam National University Medical School and Hwasun Hospital, Hwasun-gun 58128, Republic of Korea
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
| | - Jin Hee Im
- Department of Nuclear Medicine, Chonnam National University Medical School and Hwasun Hospital, Hwasun-gun 58128, Republic of Korea
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
| | - Jae Il Park
- Department of Nuclear Medicine, Chonnam National University Medical School and Hwasun Hospital, Hwasun-gun 58128, Republic of Korea
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
| | - Thanh Dat Le
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
- Department of Artificial Intelligence Convergence, Chonnam National University, Gwangju 61186, Republic of Korea
| | - Young Jin Moon
- Department of Nuclear Medicine, Chonnam National University Medical School and Hwasun Hospital, Hwasun-gun 58128, Republic of Korea
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
| | - Seong-Young Kwon
- Department of Nuclear Medicine, Chonnam National University Medical School and Hwasun Hospital, Hwasun-gun 58128, Republic of Korea
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
| | - Su Woong Yoo
- Department of Nuclear Medicine, Chonnam National University Medical School and Hwasun Hospital, Hwasun-gun 58128, Republic of Korea
- Institute for Molecular Imaging and Theranostics, Chonnam National University Medical School, Hwasun-gun 58128, Republic of Korea
| |
Collapse
|
9
|
Cekic E, Pinar E, Pinar M, Dagcinar A. Deep Learning-Assisted Segmentation and Classification of Brain Tumor Types on Magnetic Resonance and Surgical Microscope Images. World Neurosurg 2024; 182:e196-e204. [PMID: 38030068 DOI: 10.1016/j.wneu.2023.11.073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Revised: 11/15/2023] [Accepted: 11/16/2023] [Indexed: 12/01/2023]
Abstract
OBJECTIVE The primary aim of this research was to harness the capabilities of deep learning to enhance neurosurgical procedures, focusing on accurate tumor boundary delineation and classification. Through advanced diagnostic tools, we aimed to offer surgeons a more insightful perspective during surgeries, improving surgical outcomes and patient care. METHODS The study deployed the Mask R-convolutional neural network (CNN) architecture, leveraging its sophisticated features to process and analyze data from surgical microscope videos and preoperative magnetic resonance images. Resnet101 and Resnet50 backbone networks are used in the Mask R-CNN method, and experimental results are given. We subsequently tested its performance across various metrics, such as accuracy, precision, recall, dice coefficient (DICE), and Jaccard index. Deep learning models were trained from magnetic resonance imaging and surgical microscope images, and the classification result obtained for each patient was combined with the weighted average. RESULTS The algorithm exhibited remarkable capabilities in distinguishing among meningiomas, metastases, and high-grade glial tumors. Specifically, for the Mask R-CNN Resnet 101 architecture, precision, recall, DICE, and Jaccard index values were recorded as 96%, 93%, 91%, and 84%, respectively. Conversely, for the Mask R-CNN Resnet 50 architecture, these values stood at 94%, 89%, 89%, and 82%. Additionally, the model achieved an impressive DICE score range of 94%-95% and an accuracy of 98% in pathology estimation. CONCLUSIONS As illustrated in our study, the confluence of deep learning with neurosurgical procedures marks a transformative phase in medical science. The results are promising but underscore diverse data sets' significance for training and refining these deep learning models.
Collapse
Affiliation(s)
- Efecan Cekic
- Department of Neurosurgery, Polatli Duatepe State Hospital, Ankara, Turkey.
| | - Ertugrul Pinar
- Department of Neurosurgery, Private Pendik Yuzyil Hospital, İstanbul, Turkey
| | - Merve Pinar
- Department of Computer Engineering, Marmara University, İstanbul, Turkey
| | - Adnan Dagcinar
- Department of Neurosurgery, Marmara University, İstanbul, Turkey
| |
Collapse
|
10
|
Yang Z, Zhang M, Li X, Xu Z, Chen Y, Xu X, Chen D, Meng L, Si X, Wang J. Fluorescence spectroscopic profiling of urine samples for predicting kidney transplant rejection. Photodiagnosis Photodyn Ther 2024; 45:103984. [PMID: 38244654 DOI: 10.1016/j.pdpdt.2024.103984] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2023] [Revised: 01/08/2024] [Accepted: 01/17/2024] [Indexed: 01/22/2024]
Abstract
Rejection is the primary factor affecting the functionality of a kidney post-transplant, where its prompt prediction of risk significantly influences therapeutic strategies and clinical outcomes. Current graft health assessment methods, including serum creatinine measurements and transplant kidney puncture biopsies, possess considerable limitations. In contrast, urine serves as a direct indicator of the graft's degenerative stage and provides a more accurate measure than peripheral blood analysis, given its non-invasive collection of kidney-specific metabolite. This research entailed collecting fluorescent fingerprint data from 120 urine samples of post-renal transplant patients using hyperspectral imaging, followed by the development of a learning model to detect various forms of immunological rejection. The model successfully identified multiple rejection types with an average diagnostic accuracy of 95.56 %.Beyond proposing an innovative approach for predicting the risk of complications post-kidney transplantation, this study heralds the potential introduction of a non-invasive, rapid, and accurate supplementary method for risk assessment in clinical practice.
Collapse
Affiliation(s)
- Zhe Yang
- Department of Urology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China
| | - Minrui Zhang
- Department of Urology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China
| | - Xianduo Li
- Department of Urology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China
| | - Zhipeng Xu
- Department of Urology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China
| | - Yi Chen
- Shandong Medical College, Jinan 250000, China
| | - Xiaoyu Xu
- Department of Urology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China
| | - Dongdong Chen
- Department of Urology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China
| | - Lingquan Meng
- Department of Urology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China
| | - Xiaoqing Si
- Department of dermatology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China.
| | - Jianning Wang
- Department of Urology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital, Jinan 250014, China.
| |
Collapse
|
11
|
Puustinen S, Hyttinen J, Elomaa AP, Vrzáková H. Hyperspectral placenta dataset: Hyperspectral image acquisition, annotations, and processing of biological tissues in microsurgical training. Data Brief 2023; 50:109526. [PMID: 37691737 PMCID: PMC10482730 DOI: 10.1016/j.dib.2023.109526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 08/21/2023] [Accepted: 08/22/2023] [Indexed: 09/12/2023] Open
Abstract
The dataset consists of 101 hyperspectral images of four human placentas and six hyperspectral images of contrast dyes (i.e., indocyanine green and red and blue food colorant) that were captured in the range 515-900 nm, step = 5 nm. The hyperspectral images were manually annotated, delineating the key anatomical structures: arteries, veins, stroma, and the umbilical cord. Standard reference materials were used for flat-field correction. The dataset is instrumental for advancing machine-learning algorithms and automated classification of anatomical structures, particularly the classification of superficial and deep vessels and transparent tissue layers.
Collapse
Affiliation(s)
- Sami Puustinen
- Microsurgery Center of Eastern Finland, Kuopio University Hospital, Puijonlaaksontie 2, Kuopio 70210, Finland
| | - Joni Hyttinen
- Faculty of Science, Forestry and Technology, University of Eastern Finland, Yliopistokatu 2, Joensuu 80100, Finland
| | - Antti-Pekka Elomaa
- Department of Neurosurgery, Kuopio University Hospital, Puijonlaaksontie 2, Kuopio 70210, Finland
| | - Hana Vrzáková
- Faculty of Science, Forestry and Technology, University of Eastern Finland, Yliopistokatu 2, Joensuu 80100, Finland
| |
Collapse
|
12
|
Policastro P, Mesin L. Processing Ultrasound Scans of the Inferior Vena Cava: Techniques and Applications. Bioengineering (Basel) 2023; 10:1076. [PMID: 37760178 PMCID: PMC10525913 DOI: 10.3390/bioengineering10091076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Revised: 09/08/2023] [Accepted: 09/09/2023] [Indexed: 09/29/2023] Open
Abstract
The inferior vena cava (IVC) is the largest vein in the body. It returns deoxygenated blood to the heart from the tissues placed under the diaphragm. The size and dynamics of the IVC depend on the blood volume and right atrial pressure, which are important indicators of a patient's hydration and reflect possible pathological conditions. Ultrasound (US) assessment of the IVC is a promising technique for evaluating these conditions, because it is fast, non-invasive, inexpensive, and without side effects. However, the standard M-mode approach for measuring IVC diameter is prone to errors due to the vein movements during respiration. B-mode US produces two-dimensional images that better capture the IVC shape and size. In this review, we discuss the pros and cons of current IVC segmentation techniques for B-mode longitudinal and transverse views. We also explored several scenarios where automated IVC segmentation could improve medical diagnosis and prognosis.
Collapse
Affiliation(s)
| | - Luca Mesin
- Mathematical Biology and Physiology, Department Electronics and Telecommunications, Politecnico di Torino, 10129 Turin, Italy;
| |
Collapse
|
13
|
Raghavendra U, Gudigar A, Paul A, Goutham TS, Inamdar MA, Hegde A, Devi A, Ooi CP, Deo RC, Barua PD, Molinari F, Ciaccio EJ, Acharya UR. Brain tumor detection and screening using artificial intelligence techniques: Current trends and future perspectives. Comput Biol Med 2023; 163:107063. [PMID: 37329621 DOI: 10.1016/j.compbiomed.2023.107063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Revised: 05/16/2023] [Accepted: 05/19/2023] [Indexed: 06/19/2023]
Abstract
A brain tumor is an abnormal mass of tissue located inside the skull. In addition to putting pressure on the healthy parts of the brain, it can lead to significant health problems. Depending on the region of the brain tumor, it can cause a wide range of health issues. As malignant brain tumors grow rapidly, the mortality rate of individuals with this cancer can increase substantially with each passing week. Hence it is vital to detect these tumors early so that preventive measures can be taken at the initial stages. Computer-aided diagnostic (CAD) systems, in coordination with artificial intelligence (AI) techniques, have a vital role in the early detection of this disorder. In this review, we studied 124 research articles published from 2000 to 2022. Here, the challenges faced by CAD systems based on different modalities are highlighted along with the current requirements of this domain and future prospects in this area of research.
Collapse
Affiliation(s)
- U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India.
| | - Aritra Paul
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - T S Goutham
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Mahesh Anil Inamdar
- Department of Mechatronics, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, 576104, India
| | - Ajay Hegde
- Consultant Neurosurgeon Manipal Hospitals, Sarjapur Road, Bangalore, India
| | - Aruna Devi
- School of Education and Tertiary Access, University of the Sunshine Coast, Caboolture Campus, Australia
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore, 599494, Singapore
| | - Ravinesh C Deo
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, QLD, 4300, Australia
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW, 2010, Australia; School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD, 4350, Australia; Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, 2007, Australia
| | - Filippo Molinari
- Department of Electronics and Telecommunications, Politecnico di Torino, 10129, Torino, Italy
| | - Edward J Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY, 10032, USA
| | - U Rajendra Acharya
- School of Mathematics, Physics, and Computing, University of Southern Queensland, Springfield, QLD, 4300, Australia; International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto, 860-8555, Japan
| |
Collapse
|
14
|
Schulz T, Nuwayhid R, Houschyar KS, Langer S, Kohler L. Diagnostical accuracy of hyperspectral imaging after free flap surgery. J Plast Surg Hand Surg 2023; 58:48-55. [PMID: 37614177 DOI: 10.2340/jphs.v58.7140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 05/25/2023] [Indexed: 08/25/2023]
Abstract
Microsurgical free-tissue transfer has been a safe option for tissue reconstruction. This study aimed to analyze the diagnostic accuracy of hyperspectral imaging (HSI) after free-tissue transfer surgery. From January 2017 to October 2019, 42 consecutive free-flap surgeries were performed, and their outcomes were analyzed via HSI. Clinical examination of free-flap perfusion was initially performed. Clinical examination findings were subsequently compared with those of HSI. Potential venous congestion with subsequent necrosis was defined as a tissue hemoglobin index of ≥53%. Student's t-test was used to compare the results of the analysis. The evaluation of sensitivity and specificity for flap failure detection was time dependent using the Fisher's exact test. A p-value of ≤0.05 was considered statistically significant. Microsurgical tissue transfer success rate was 84%. Seven patients presented with venous congestion that caused total flap necrosis. Overall, 124 assessments were made. HSI accurately identified 12 out of 19 pathological images: four as false positive and seven as false negative. The sensitivity and specificity of HSI were 57 and 94%, respectively, compared to those of clinical examination that were 28 and 100%, respectively, within 24 h following tissue transfer. The sensitivity and specificity of HSI were 63 and 96%, respectively, compared to those of clinical examination that were 63 and 100%, respectively, within the first 72 h. A tissue hemoglobin index of ≥53% could predict venous congestion after free-flap surgery. HSI demonstrated higher sensitivity than clinical examination within the first 24 h; however, it was not superior compared to clinical findings within 72 h.
Collapse
Affiliation(s)
- Torsten Schulz
- Department of Orthopedic, Trauma and Plastic Surgery, University Hospital Leipzig, Leipzig, Germany.
| | - Rima Nuwayhid
- Department of Orthopedic, Trauma and Plastic Surgery, University Hospital Leipzig, Leipzig, Germany
| | | | - Stefan Langer
- Department of Orthopedic, Trauma and Plastic Surgery, University Hospital Leipzig, Leipzig, Germany
| | - Lukas Kohler
- Department of Orthopedic, Trauma and Plastic Surgery, University Hospital Leipzig, Leipzig, Germany; Division of Hand-, Plastic- and Aesthetic Surgery, University Hospital Munich, Munich, Germany
| |
Collapse
|
15
|
Hossain R, Ibrahim RB, Hashim HB. Automated Brain Tumor Detection Using Machine Learning: A Bibliometric Review. World Neurosurg 2023; 175:57-68. [PMID: 37019303 DOI: 10.1016/j.wneu.2023.03.115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Revised: 03/25/2023] [Accepted: 03/27/2023] [Indexed: 04/05/2023]
Abstract
To develop a research overview of brain tumor classification using machine learning, we conducted a systematic review with a bibliometric analysis. Our systematic review and bibliometric analysis included 1747 studies of automated brain tumor detection using machine learning reported in the previous 5 years (2019-2023) from 679 different sources and authored by 6632 investigators. Bibliographic data were collected from the Scopus database, and a comprehensive bibliometric analysis was conducted using Biblioshiny and the R platform. The most productive and collaborative institutes, reports, journals, and countries were determined using citation analysis. In addition, various collaboration metrics were determined at the institute, country, and author level. Lotka's law was tested using the authors' performance. Analysis showed that the authors' publication trends followed Lotka's inverse square law. An annual publication analysis showed that 36.46% of the studies had been reported in 2022, with steady growth from previous years. Most of the cited authors had focused on multiclass classification and novel convolutional neural network models that are efficient for small training sets. A keyword analysis showed that "deep learning," "magnetic resonance imaging," "nuclear magnetic resonance imaging," and "glioma" appeared most often, proving that of the several brain tumor types, most studies had focused on glioma. India, China, and the United States were among the highest collaborative countries in terms of both authors and institutes. The University of Toronto and Harvard Medical School had the highest number of affiliations with 132 and 87 publications, respectively.
Collapse
Affiliation(s)
- Rajan Hossain
- Department of Computing, University of Technology Malaysia, Selangor, Malaysia.
| | | | | |
Collapse
|
16
|
Puustinen S, Vrzáková H, Hyttinen J, Rauramaa T, Fält P, Hauta-Kasari M, Bednarik R, Koivisto T, Rantala S, von Und Zu Fraunberg M, Jääskeläinen JE, Elomaa AP. Hyperspectral Imaging in Brain Tumor Surgery-Evidence of Machine Learning-Based Performance. World Neurosurg 2023; 175:e614-e635. [PMID: 37030483 DOI: 10.1016/j.wneu.2023.03.149] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Accepted: 03/31/2023] [Indexed: 04/10/2023]
Abstract
BACKGROUND Hyperspectral imaging (HSI) has the potential to enhance surgical tissue detection and diagnostics. Definite utilization of intraoperative HSI guidance demands validated machine learning and public datasets that currently do not exist. Moreover, current imaging conventions are dispersed, and evidence-based paradigms for neurosurgical HSI have not been declared. METHODS We presented the rationale and a detailed clinical paradigm for establishing microneurosurgical HSI guidance. In addition, a systematic literature review was conducted to summarize the current indications and performance of neurosurgical HSI systems, with an emphasis on machine learning-based methods. RESULTS The published data comprised a few case series or case reports aiming to classify tissues during glioma operations. For a multitissue classification problem, the highest overall accuracy of 80% was obtained using deep learning. Our HSI system was capable of intraoperative data acquisition and visualization with minimal disturbance to glioma surgery. CONCLUSIONS In a limited number of publications, neurosurgical HSI has demonstrated unique capabilities in contrast to the established imaging techniques. Multidisciplinary work is required to establish communicable HSI standards and clinical impact. Our HSI paradigm endorses systematic intraoperative HSI data collection, which aims to facilitate the related standards, medical device regulations, and value-based medical imaging systems.
Collapse
Affiliation(s)
- Sami Puustinen
- University of Eastern Finland, Faculty of Health Sciences, School of Medicine, Kuopio, Finland; Kuopio University Hospital, Eastern Finland Microsurgery Center, Kuopio, Finland.
| | - Hana Vrzáková
- Kuopio University Hospital, Eastern Finland Microsurgery Center, Kuopio, Finland; University of Eastern Finland, Faculty of Science and Forestry, School of Computing, Joensuu, Finland
| | - Joni Hyttinen
- University of Eastern Finland, Faculty of Science and Forestry, School of Computing, Joensuu, Finland
| | - Tuomas Rauramaa
- Kuopio University Hospital, Department of Clinical Pathology, Kuopio, Finland
| | - Pauli Fält
- University of Eastern Finland, Faculty of Science and Forestry, School of Computing, Joensuu, Finland
| | - Markku Hauta-Kasari
- University of Eastern Finland, Faculty of Science and Forestry, School of Computing, Joensuu, Finland
| | - Roman Bednarik
- University of Eastern Finland, Faculty of Science and Forestry, School of Computing, Joensuu, Finland
| | - Timo Koivisto
- Kuopio University Hospital, Department of Neurosurgery, Kuopio, Finland
| | - Susanna Rantala
- Kuopio University Hospital, Department of Neurosurgery, Kuopio, Finland
| | - Mikael von Und Zu Fraunberg
- Oulu University Hospital, Department of Neurosurgery, Oulu, Finland; University of Oulu, Faculty of Medicine, Research Unit of Clinical Medicine, Oulu, Finland
| | | | - Antti-Pekka Elomaa
- University of Eastern Finland, Faculty of Health Sciences, School of Medicine, Kuopio, Finland; Kuopio University Hospital, Eastern Finland Microsurgery Center, Kuopio, Finland; Kuopio University Hospital, Department of Neurosurgery, Kuopio, Finland
| |
Collapse
|
17
|
Studier-Fischer A, Seidlitz S, Sellner J, Bressan M, Özdemir B, Ayala L, Odenthal J, Knoedler S, Kowalewski KF, Haney CM, Salg G, Dietrich M, Kenngott H, Gockel I, Hackert T, Müller-Stich BP, Maier-Hein L, Nickel F. HeiPorSPECTRAL - the Heidelberg Porcine HyperSPECTRAL Imaging Dataset of 20 Physiological Organs. Sci Data 2023; 10:414. [PMID: 37355750 PMCID: PMC10290660 DOI: 10.1038/s41597-023-02315-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 06/15/2023] [Indexed: 06/26/2023] Open
Abstract
Hyperspectral Imaging (HSI) is a relatively new medical imaging modality that exploits an area of diagnostic potential formerly untouched. Although exploratory translational and clinical studies exist, no surgical HSI datasets are openly accessible to the general scientific community. To address this bottleneck, this publication releases HeiPorSPECTRAL ( https://www.heiporspectral.org ; https://doi.org/10.5281/zenodo.7737674 ), the first annotated high-quality standardized surgical HSI dataset. It comprises 5,758 spectral images acquired with the TIVITA® Tissue and annotated with 20 physiological porcine organs from 8 pigs per organ distributed over a total number of 11 pigs. Each HSI image features a resolution of 480 × 640 pixels acquired over the 500-1000 nm wavelength range. The acquisition protocol has been designed such that the variability of organ spectra as a function of several parameters including the camera angle and the individual can be assessed. A comprehensive technical validation confirmed both the quality of the raw data and the annotations. We envision potential reuse within this dataset, but also its reuse as baseline data for future research questions outside this dataset. Measurement(s) Spectral Reflectance Technology Type(s) Hyperspectral Imaging Sample Characteristic - Organism Sus scrofa.
Collapse
Affiliation(s)
- Alexander Studier-Fischer
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Silvia Seidlitz
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany
- National Center for Tumor Diseases (NCT) Heidelberg, a partnership between DKFZ and Heidelberg University Hospital, Heidelberg, Germany
| | - Jan Sellner
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany
| | - Marc Bressan
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Berkin Özdemir
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Leonardo Ayala
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Medical Faculty, Heidelberg University, Heidelberg, Germany
| | - Jan Odenthal
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Samuel Knoedler
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
- Division of Plastic Surgery, Department of Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Karl-Friedrich Kowalewski
- Department of Urology, Medical Faculty of Mannheim at the University of Heidelberg, Mannheim, Germany
| | - Caelan Max Haney
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Gabriel Salg
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Maximilian Dietrich
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Hannes Kenngott
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Ines Gockel
- Department of Visceral, Transplant, Thoracic and Vascular Surgery, Leipzig University Hospital, Leipzig, Germany
| | - Thilo Hackert
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
- Department of General, Visceral, and Thoracic Surgery, University Hospital Hamburg-Eppendorf, Hamburg, Germany
| | - Beat Peter Müller-Stich
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany
| | - Lena Maier-Hein
- Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ), Heidelberg, Germany
- Faculty of Mathematics and Computer Science, Heidelberg University, Heidelberg, Germany
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany
- National Center for Tumor Diseases (NCT) Heidelberg, a partnership between DKFZ and Heidelberg University Hospital, Heidelberg, Germany
| | - Felix Nickel
- Department of General, Visceral, and Transplantation Surgery, Heidelberg University Hospital, Heidelberg, Germany.
- HIDSS4Health - Helmholtz Information and Data Science School for Health, Karlsruhe, Heidelberg, Germany.
- Department of General, Visceral, and Thoracic Surgery, University Hospital Hamburg-Eppendorf, Hamburg, Germany.
| |
Collapse
|
18
|
Vitorino R, Barros AS, Guedes S, Caixeta DC, Sabino-Silva R. Diagnostic and monitoring applications using Near infrared (NIR) Spectroscopy in cancer and other diseases. Photodiagnosis Photodyn Ther 2023:103633. [PMID: 37245681 DOI: 10.1016/j.pdpdt.2023.103633] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Revised: 05/19/2023] [Accepted: 05/23/2023] [Indexed: 05/30/2023]
Abstract
Early cancer diagnosis plays a critical role in improving treatment outcomes and increasing survival rates for certain cancers. NIR spectroscopy offers a rapid and cost-effective approach to evaluate the optical properties of tissues at the microvessel level and provides valuable molecular insights. The integration of NIR spectroscopy with advanced data-driven algorithms in portable instruments has made it a cutting-edge technology for medical applications. NIR spectroscopy is a simple, non-invasive and affordable analytical tool that complements expensive imaging modalities such as functional magnetic resonance imaging, positron emission tomography and computed tomography. By examining tissue absorption, scattering, and concentrations of oxygen, water, and lipids, NIR spectroscopy can reveal inherent differences between tumor and normal tissue, often revealing specific patterns that help stratify disease. In addition, the ability of NIR spectroscopy to assess tumor blood flow, oxygenation, and oxygen metabolism provides a key paradigm for its application in cancer diagnosis. This review evaluates the effectiveness of NIR spectroscopy in the detection and characterization of disease, particularly in cancer, with or without the incorporation of chemometrics and machine learning algorithms. The report highlights the potential of NIR spectroscopy technology to significantly improve discrimination between benign and malignant tumors and accurately predict treatment outcomes. In addition, as more medical applications are studied in large patient cohorts, consistent advances in clinical implementation can be expected, making NIR spectroscopy a valuable adjunct technology for cancer therapy management. Ultimately, the integration of NIR spectroscopy into cancer diagnostics promises to improve prognosis by providing critical new insights into cancer patterns and physiology.
Collapse
Affiliation(s)
- Rui Vitorino
- Institute of Biomedicine-iBiMED, Department of Medical Sciences, University of Aveiro, 3810-193 Aveiro, Portugal; UnIC@RISE, Department of Surgery and Physiology, Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-319 Porto, Portugal; LAQV-REQUIMTE, Department of Chemistry, University of Aveiro, 3810-193 Aveiro, Portugal.
| | - António S Barros
- UnIC@RISE, Department of Surgery and Physiology, Faculty of Medicine of the University of Porto, Alameda Professor Hernâni Monteiro, 4200-319 Porto, Portugal
| | - Sofia Guedes
- LAQV-REQUIMTE, Department of Chemistry, University of Aveiro, 3810-193 Aveiro, Portugal
| | - Douglas C Caixeta
- Innovation Center in Salivary Diagnostics and Nanobiotechnology, Department of Physiology, Institute of Biomedical Sciences, Federal University of Uberlandia, Minas Gerais, Brazil
| | - Robinson Sabino-Silva
- Innovation Center in Salivary Diagnostics and Nanobiotechnology, Department of Physiology, Institute of Biomedical Sciences, Federal University of Uberlandia, Minas Gerais, Brazil
| |
Collapse
|
19
|
Tomanic T, Rogelj L, Stergar J, Markelc B, Bozic T, Brezar SK, Sersa G, Milanic M. Estimating quantitative physiological and morphological tissue parameters of murine tumor models using hyperspectral imaging and optical profilometry. JOURNAL OF BIOPHOTONICS 2023; 16:e202200181. [PMID: 36054067 DOI: 10.1002/jbio.202200181] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Revised: 07/27/2022] [Accepted: 08/05/2022] [Indexed: 06/15/2023]
Abstract
Understanding tumors and their microenvironment are essential for successful and accurate disease diagnosis. Tissue physiology and morphology are altered in tumors compared to healthy tissues, and there is a need to monitor tumors and their surrounding tissues, including blood vessels, non-invasively. This preliminary study utilizes a multimodal optical imaging system combining hyperspectral imaging (HSI) and three-dimensional (3D) optical profilometry (OP) to capture hyperspectral images and surface shapes of subcutaneously grown murine tumor models. Hyperspectral images are corrected with 3D OP data and analyzed using the inverse-adding doubling (IAD) method to extract tissue properties such as melanin volume fraction and oxygenation. Blood vessels are segmented using the B-COSFIRE algorithm from oxygenation maps. From 3D OP data, tumor volumes are calculated and compared to manual measurements using a vernier caliper. Results show that tumors can be distinguished from healthy tissue based on most extracted tissue parameters ( p < 0.05 ). Furthermore, blood oxygenation is 50% higher within the blood vessels than in the surrounding tissue, and tumor volumes calculated using 3D OP agree within 26% with manual measurements using a vernier caliper. Results suggest that combining HSI and OP could provide relevant quantitative information about tumors and improve the disease diagnosis.
Collapse
Affiliation(s)
- Tadej Tomanic
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
| | - Luka Rogelj
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
| | - Jost Stergar
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
- Jozef Stefan Institute, Ljubljana, Slovenia
| | - Bostjan Markelc
- Department of Experimental Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia
- Faculty of Health Sciences, University of Ljubljana, Ljubljana, Slovenia
| | - Tim Bozic
- Department of Experimental Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia
- Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia
| | - Simona Kranjc Brezar
- Department of Experimental Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia
- Faculty of Medicine, University of Ljubljana, Ljubljana, Slovenia
| | - Gregor Sersa
- Department of Experimental Oncology, Institute of Oncology Ljubljana, Ljubljana, Slovenia
- Faculty of Health Sciences, University of Ljubljana, Ljubljana, Slovenia
| | - Matija Milanic
- Faculty of Mathematics and Physics, University of Ljubljana, Ljubljana, Slovenia
- Jozef Stefan Institute, Ljubljana, Slovenia
| |
Collapse
|
20
|
Cui R, Yu H, Xu T, Xing X, Cao X, Yan K, Chen J. Deep Learning in Medical Hyperspectral Images: A Review. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22249790. [PMID: 36560157 PMCID: PMC9784550 DOI: 10.3390/s22249790] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Revised: 12/11/2022] [Accepted: 12/12/2022] [Indexed: 06/13/2023]
Abstract
With the continuous progress of development, deep learning has made good progress in the analysis and recognition of images, which has also triggered some researchers to explore the area of combining deep learning with hyperspectral medical images and achieve some progress. This paper introduces the principles and techniques of hyperspectral imaging systems, summarizes the common medical hyperspectral imaging systems, and summarizes the progress of some emerging spectral imaging systems through analyzing the literature. In particular, this article introduces the more frequently used medical hyperspectral images and the pre-processing techniques of the spectra, and in other sections, it discusses the main developments of medical hyperspectral combined with deep learning for disease diagnosis. On the basis of the previous review, tne limited factors in the study on the application of deep learning to hyperspectral medical images are outlined, promising research directions are summarized, and the future research prospects are provided for subsequent scholars.
Collapse
Affiliation(s)
- Rong Cui
- College of Electronic and Information Engineering, Changchun University, Changchun 130022, China
| | - He Yu
- College of Electronic and Information Engineering, Changchun University, Changchun 130022, China
- Jilin Provincial Key Laboratory of Human Health Status Identification and Function Enhancement, Changchun University, Changchun 130022, China
| | - Tingfa Xu
- Image Engineering & Video Technology Lab, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
- Beijing Institute of Technology Chongqing Innovation Center, Chongqing 401120, China
| | - Xiaoxue Xing
- College of Electronic and Information Engineering, Changchun University, Changchun 130022, China
- Jilin Provincial Key Laboratory of Human Health Status Identification and Function Enhancement, Changchun University, Changchun 130022, China
| | - Xiaorui Cao
- College of Electronic and Information Engineering, Changchun University, Changchun 130022, China
| | - Kang Yan
- College of Electronic and Information Engineering, Changchun University, Changchun 130022, China
| | - Jiexi Chen
- College of Electronic and Information Engineering, Changchun University, Changchun 130022, China
| |
Collapse
|
21
|
Van Hese L, De Vleeschouwer S, Theys T, Rex S, Heeren RMA, Cuypers E. The diagnostic accuracy of intraoperative differentiation and delineation techniques in brain tumours. Discov Oncol 2022; 13:123. [PMID: 36355227 PMCID: PMC9649524 DOI: 10.1007/s12672-022-00585-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Accepted: 10/22/2022] [Indexed: 11/11/2022] Open
Abstract
Brain tumour identification and delineation in a timeframe of seconds would significantly guide and support surgical decisions. Here, treatment is often complicated by the infiltration of gliomas in the surrounding brain parenchyma. Accurate delineation of the invasive margins is essential to increase the extent of resection and to avoid postoperative neurological deficits. Currently, histopathological annotation of brain biopsies and genetic phenotyping still define the first line treatment, where results become only available after surgery. Furthermore, adjuvant techniques to improve intraoperative visualisation of the tumour tissue have been developed and validated. In this review, we focused on the sensitivity and specificity of conventional techniques to characterise the tumour type and margin, specifically fluorescent-guided surgery, neuronavigation and intraoperative imaging as well as on more experimental techniques such as mass spectrometry-based diagnostics, Raman spectrometry and hyperspectral imaging. Based on our findings, all investigated methods had their advantages and limitations, guiding researchers towards the combined use of intraoperative imaging techniques. This can lead to an improved outcome in terms of extent of tumour resection and progression free survival while preserving neurological outcome of the patients.
Collapse
Affiliation(s)
- Laura Van Hese
- Division of Mass Spectrometry Imaging, Maastricht MultiModal Molecular Imaging (M4I) Institute, Maastricht University, Universiteitssingel 50, 6229 ER, Maastricht, The Netherlands
- Department of Anaesthesiology, University Hospitals Leuven, 3000, Leuven, Belgium
- Department of Cardiovascular Sciences, KU Leuven, 3000, Leuven, Belgium
| | - Steven De Vleeschouwer
- Neurosurgery Department, University Hospitals Leuven, 3000, Leuven, Belgium
- Laboratory for Experimental Neurosurgery and Neuroanatomy, Department of Neurosciences, Leuven Brain Institute (LBI), 3000, Leuven, Belgium
| | - Tom Theys
- Neurosurgery Department, University Hospitals Leuven, 3000, Leuven, Belgium
- Laboratory for Experimental Neurosurgery and Neuroanatomy, Department of Neurosciences, Leuven Brain Institute (LBI), 3000, Leuven, Belgium
| | - Steffen Rex
- Department of Anaesthesiology, University Hospitals Leuven, 3000, Leuven, Belgium
- Department of Cardiovascular Sciences, KU Leuven, 3000, Leuven, Belgium
| | - Ron M A Heeren
- Division of Mass Spectrometry Imaging, Maastricht MultiModal Molecular Imaging (M4I) Institute, Maastricht University, Universiteitssingel 50, 6229 ER, Maastricht, The Netherlands
| | - Eva Cuypers
- Division of Mass Spectrometry Imaging, Maastricht MultiModal Molecular Imaging (M4I) Institute, Maastricht University, Universiteitssingel 50, 6229 ER, Maastricht, The Netherlands.
| |
Collapse
|
22
|
Zhang L, Huang D, Chen X, Zhu L, Chen X, Xie Z, Huang G, Gao J, Shi W, Cui G. Visible near-infrared hyperspectral imaging and supervised classification for the detection of small intestinal necrosis tissue in vivo. BIOMEDICAL OPTICS EXPRESS 2022; 13:6061-6080. [PMID: 36733734 PMCID: PMC9872898 DOI: 10.1364/boe.470202] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 09/23/2022] [Accepted: 09/26/2022] [Indexed: 06/18/2023]
Abstract
Complete recognition of necrotic areas during small bowel tissue resection remains challenging due to the lack of optimal intraoperative aid identification techniques. This research utilizes hyperspectral imaging techniques to automatically distinguish normal and necrotic areas of small intestinal tissue. Sample data were obtained from the animal model of small intestinal tissue of eight Japanese large-eared white rabbits developed by experienced physicians. A spectral library of normal and necrotic regions of small intestinal tissue was created and processed using six different supervised classification algorithms. The results show that hyperspectral imaging combined with supervised classification algorithms can be a suitable technique to automatically distinguish between normal and necrotic areas of small intestinal tissue. This new technique could aid physicians in objectively identify normal and necrotic areas of small intestinal tissue.
Collapse
Affiliation(s)
- LeChao Zhang
- College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun, Jilin, 130000, China
- Zhongshan Research Institute, Changchun University of Science and Technology, Zhongshan, Guangdong, 528400, China
| | - DanFei Huang
- College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun, Jilin, 130000, China
- Zhongshan Research Institute, Changchun University of Science and Technology, Zhongshan, Guangdong, 528400, China
| | - XiaoJing Chen
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| | - LiBin Zhu
- Pediatric General Surgery, The Second Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China
| | - XiaoQing Chen
- Pediatric General Surgery, The Second Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China
| | - ZhongHao Xie
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| | - GuangZao Huang
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| | - JunZhao Gao
- College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun, Jilin, 130000, China
- Zhongshan Research Institute, Changchun University of Science and Technology, Zhongshan, Guangdong, 528400, China
| | - Wen Shi
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| | - GuiHua Cui
- College of Electrical and Electronic Engineering, Wenzhou University, Wenzhou, Zhejiang, 325000, China
| |
Collapse
|
23
|
Massalimova A, Timmermans M, Esfandiari H, Carrillo F, Laux CJ, Farshad M, Denis K, Fürnstahl P. Intraoperative tissue classification methods in orthopedic and neurological surgeries: A systematic review. Front Surg 2022; 9:952539. [PMID: 35990097 PMCID: PMC9381957 DOI: 10.3389/fsurg.2022.952539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Accepted: 07/19/2022] [Indexed: 11/13/2022] Open
Abstract
Accurate tissue differentiation during orthopedic and neurological surgeries is critical, given that such surgeries involve operations on or in the vicinity of vital neurovascular structures and erroneous surgical maneuvers can lead to surgical complications. By now, the number of emerging technologies tackling the problem of intraoperative tissue classification methods is increasing. Therefore, this systematic review paper intends to give a general overview of existing technologies. The review was done based on the PRISMA principle and two databases: PubMed and IEEE Xplore. The screening process resulted in 60 full-text papers. The general characteristics of the methodology from extracted papers included data processing pipeline, machine learning methods if applicable, types of tissues that can be identified with them, phantom used to conduct the experiment, and evaluation results. This paper can be useful in identifying the problems in the current status of the state-of-the-art intraoperative tissue classification methods and designing new enhanced techniques.
Collapse
Affiliation(s)
- Aidana Massalimova
- Research in Orthopedic Computer Science (ROCS), Balgrist Campus, University of Zurich, Zurich, Switzerland
- Correspondence: Aidana Massalimova
| | - Maikel Timmermans
- KU Leuven, Campus Group T, BioMechanics (BMe), Smart Instrumentation Group, Leuven, Belgium
| | - Hooman Esfandiari
- Research in Orthopedic Computer Science (ROCS), Balgrist Campus, University of Zurich, Zurich, Switzerland
| | - Fabio Carrillo
- Research in Orthopedic Computer Science (ROCS), Balgrist Campus, University of Zurich, Zurich, Switzerland
| | - Christoph J. Laux
- Department of Orthopaedics, Balgrist University Hospital, University of Zurich, Zurich, Switzerland
| | - Mazda Farshad
- Department of Orthopaedics, Balgrist University Hospital, University of Zurich, Zurich, Switzerland
| | - Kathleen Denis
- KU Leuven, Campus Group T, BioMechanics (BMe), Smart Instrumentation Group, Leuven, Belgium
| | - Philipp Fürnstahl
- Research in Orthopedic Computer Science (ROCS), Balgrist Campus, University of Zurich, Zurich, Switzerland
| |
Collapse
|
24
|
Xu J, Meng Y, Qiu K, Topatana W, Li S, Wei C, Chen T, Chen M, Ding Z, Niu G. Applications of Artificial Intelligence Based on Medical Imaging in Glioma: Current State and Future Challenges. Front Oncol 2022; 12:892056. [PMID: 35965542 PMCID: PMC9363668 DOI: 10.3389/fonc.2022.892056] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Accepted: 06/22/2022] [Indexed: 12/24/2022] Open
Abstract
Glioma is one of the most fatal primary brain tumors, and it is well-known for its difficulty in diagnosis and management. Medical imaging techniques such as magnetic resonance imaging (MRI), positron emission tomography (PET), and spectral imaging can efficiently aid physicians in diagnosing, treating, and evaluating patients with gliomas. With the increasing clinical records and digital images, the application of artificial intelligence (AI) based on medical imaging has reduced the burden on physicians treating gliomas even further. This review will classify AI technologies and procedures used in medical imaging analysis. Additionally, we will discuss the applications of AI in glioma, including tumor segmentation and classification, prediction of genetic markers, and prediction of treatment response and prognosis, using MRI, PET, and spectral imaging. Despite the benefits of AI in clinical applications, several issues such as data management, incomprehension, safety, clinical efficacy evaluation, and ethical or legal considerations, remain to be solved. In the future, doctors and researchers should collaborate to solve these issues, with a particular emphasis on interdisciplinary teamwork.
Collapse
Affiliation(s)
- Jiaona Xu
- Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Yuting Meng
- Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Kefan Qiu
- Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Win Topatana
- Department of General Surgery, Sir Run-Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Shijie Li
- Department of General Surgery, Sir Run-Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Chao Wei
- Department of Neurology, Affiliated Ningbo First Hospital, Ningbo, China
| | - Tianwen Chen
- Department of Neurology, Affiliated Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Mingyu Chen
- Department of General Surgery, Sir Run-Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, China
- *Correspondence: Mingyu Chen, ; Zhongxiang Ding, ; Guozhong Niu,
| | - Zhongxiang Ding
- Department of Radiology, Affiliated Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
- *Correspondence: Mingyu Chen, ; Zhongxiang Ding, ; Guozhong Niu,
| | - Guozhong Niu
- Department of Neurology, Affiliated Hangzhou First People’s Hospital, Zhejiang University School of Medicine, Hangzhou, China
- *Correspondence: Mingyu Chen, ; Zhongxiang Ding, ; Guozhong Niu,
| |
Collapse
|
25
|
Wu Y, Xu Z, Yang W, Ning Z, Dong H. Review on the Application of Hyperspectral Imaging Technology of the Exposed Cortex in Cerebral Surgery. Front Bioeng Biotechnol 2022; 10:906728. [PMID: 35711634 PMCID: PMC9196632 DOI: 10.3389/fbioe.2022.906728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 05/09/2022] [Indexed: 11/13/2022] Open
Abstract
The study of brain science is vital to human health. The application of hyperspectral imaging in biomedical fields has grown dramatically in recent years due to their unique optical imaging method and multidimensional information acquisition. Hyperspectral imaging technology can acquire two-dimensional spatial information and one-dimensional spectral information of biological samples simultaneously, covering the ultraviolet, visible and infrared spectral ranges with high spectral resolution, which can provide diagnostic information about the physiological, morphological and biochemical components of tissues and organs. This technology also presents finer spectral features for brain imaging studies, and further provides more auxiliary information for cerebral disease research. This paper reviews the recent advance of hyperspectral imaging in cerebral diagnosis. Firstly, the experimental setup, image acquisition and pre-processing, and analysis methods of hyperspectral technology were introduced. Secondly, the latest research progress and applications of hyperspectral imaging in brain tissue metabolism, hemodynamics, and brain cancer diagnosis in recent years were summarized briefly. Finally, the limitations of the application of hyperspectral imaging in cerebral disease diagnosis field were analyzed, and the future development direction was proposed.
Collapse
Affiliation(s)
- Yue Wu
- Research Center for Intelligent Sensing Systems, Zhejiang Lab, Hangzhou, China
| | - Zhongyuan Xu
- Research Center for Intelligent Sensing Systems, Zhejiang Lab, Hangzhou, China
| | - Wenjian Yang
- Research Center for Intelligent Sensing Systems, Zhejiang Lab, Hangzhou, China
| | - Zhiqiang Ning
- Anhui Institute of Optics and Fine Mechanics, Chinese Academy of Sciences (CAS), Hefei, China.,Science Island Branch, Graduate School of USTC, Hefei, China
| | - Hao Dong
- Research Center for Sensing Materials and Devices, Zhejiang Lab, Hangzhou, China
| |
Collapse
|
26
|
Soni A, Dixit Y, Reis MM, Brightwell G. Hyperspectral imaging and machine learning in food microbiology: Developments and challenges in detection of bacterial, fungal, and viral contaminants. Compr Rev Food Sci Food Saf 2022; 21:3717-3745. [PMID: 35686478 DOI: 10.1111/1541-4337.12983] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 04/28/2022] [Accepted: 05/02/2022] [Indexed: 02/03/2023]
Abstract
Hyperspectral imaging (HSI) is a robust and nondestructive method that can detect foreign particles such as microbial, chemical, and physical contamination in food. This review summarizes the work done in the last two decades in this field with a highlight on challenges, risks, and research gaps. Considering the challenges of using HSI on complex matrices like food (e.g., the confounding and masking effects of background signals), application of machine learning and modeling approaches that have been successful in achieving better accuracy as well as increasing the detection limit have also been discussed here. Foodborne microbial contaminants such as bacteria, fungi, viruses, yeast, and protozoa are of interest and concern to food manufacturers due to the potential risk of either food poisoning or food spoilage. Detection of these contaminants using fast and efficient methods would not only prevent outbreaks and recalls but will also increase consumer acceptance and demand for shelf-stable food products. The conventional culture-based methods for microbial detection are time and labor-intensive, whereas hyperspectral imaging (HSI) is robust, nondestructive with minimum sample preparation, and has gained significant attention due to its rapid approach to detection of microbial contaminants. This review is a comprehensive summary of the detection of bacterial, viral, and fungal contaminants in food with detailed emphasis on the specific modeling and datamining approaches used to overcome the specific challenges associated with background and data complexity.
Collapse
Affiliation(s)
- Aswathi Soni
- Food System Integrity, Consumer Food Interface, AgResearch Ltd, Palmerston North, New Zealand
| | - Yash Dixit
- Food Informatics, Smart Foods, AgResearch Ltd, Palmerston North, New Zealand
| | - Marlon M Reis
- Food Informatics, Smart Foods, AgResearch Ltd, Palmerston North, New Zealand
| | - Gale Brightwell
- Food System Integrity, Consumer Food Interface, AgResearch Ltd, Palmerston North, New Zealand.,New Zealand Food Safety Science Research Centre, Palmerston North, New Zealand
| |
Collapse
|
27
|
Painuli D, Bhardwaj S, Köse U. Recent advancement in cancer diagnosis using machine learning and deep learning techniques: A comprehensive review. Comput Biol Med 2022; 146:105580. [PMID: 35551012 DOI: 10.1016/j.compbiomed.2022.105580] [Citation(s) in RCA: 41] [Impact Index Per Article: 20.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Revised: 04/14/2022] [Accepted: 04/30/2022] [Indexed: 02/07/2023]
Abstract
Being a second most cause of mortality worldwide, cancer has been identified as a perilous disease for human beings, where advance stage diagnosis may not help much in safeguarding patients from mortality. Thus, efforts to provide a sustainable architecture with proven cancer prevention estimate and provision for early diagnosis of cancer is the need of hours. Advent of machine learning methods enriched cancer diagnosis area with its overwhelmed efficiency & low error-rate then humans. A significant revolution has been witnessed in the development of machine learning & deep learning assisted system for segmentation & classification of various cancers during past decade. This research paper includes a review of various types of cancer detection via different data modalities using machine learning & deep learning-based methods along with different feature extraction techniques and benchmark datasets utilized in the recent six years studies. The focus of this study is to review, analyse, classify, and address the recent development in cancer detection and diagnosis of six types of cancers i.e., breast, lung, liver, skin, brain and pancreatic cancer, using machine learning & deep learning techniques. Various state-of-the-art technique are clustered into same group and results are examined through key performance indicators like accuracy, area under the curve, precision, sensitivity, dice score on benchmark datasets and concluded with future research work challenges.
Collapse
Affiliation(s)
- Deepak Painuli
- Department of Computer Science and Engineering, Gurukula Kangri Vishwavidyalaya, Haridwar, India.
| | - Suyash Bhardwaj
- Department of Computer Science and Engineering, Gurukula Kangri Vishwavidyalaya, Haridwar, India
| | - Utku Köse
- Department of Computer Engineering, Suleyman Demirel University, Isparta, Turkey
| |
Collapse
|
28
|
Williams S, Layard Horsfall H, Funnell JP, Hanrahan JG, Khan DZ, Muirhead W, Stoyanov D, Marcus HJ. Artificial Intelligence in Brain Tumour Surgery-An Emerging Paradigm. Cancers (Basel) 2021; 13:cancers13195010. [PMID: 34638495 PMCID: PMC8508169 DOI: 10.3390/cancers13195010] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Revised: 10/02/2021] [Accepted: 10/03/2021] [Indexed: 01/01/2023] Open
Abstract
Artificial intelligence (AI) platforms have the potential to cause a paradigm shift in brain tumour surgery. Brain tumour surgery augmented with AI can result in safer and more effective treatment. In this review article, we explore the current and future role of AI in patients undergoing brain tumour surgery, including aiding diagnosis, optimising the surgical plan, providing support during the operation, and better predicting the prognosis. Finally, we discuss barriers to the successful clinical implementation, the ethical concerns, and we provide our perspective on how the field could be advanced.
Collapse
Affiliation(s)
- Simon Williams
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
- Correspondence:
| | - Hugo Layard Horsfall
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Jonathan P. Funnell
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - John G. Hanrahan
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Danyal Z. Khan
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - William Muirhead
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Danail Stoyanov
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| | - Hani J. Marcus
- Department of Neurosurgery, National Hospital for Neurology and Neurosurgery, London WC1N 3BG, UK; (H.L.H.); (J.P.F.); (J.G.H.); (D.Z.K.); (W.M.); (H.J.M.)
- Wellcome/Engineering and Physical Sciences Research Council (EPSRC) Centre for Interventional and Surgical Sciences (WEISS), London W1W 7TY, UK;
| |
Collapse
|