1
|
Guryleva A, Machikhin A, Orlova E, Kulikova E, Volkov M, Gabrielian G, Smirnova L, Sekacheva M, Olisova O, Rudenko E, Lobanova O, Smolyannikova V, Demura T. Photoplethysmography-Based Angiography of Skin Tumors in Arbitrary Areas of Human Body. JOURNAL OF BIOPHOTONICS 2024:e202400242. [PMID: 39327652 DOI: 10.1002/jbio.202400242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Revised: 09/05/2024] [Accepted: 09/06/2024] [Indexed: 09/28/2024]
Abstract
Noninvasive, rapid, and robust diagnostic techniques for clinical screening of tumors located in arbitrary areas of the human body are in demand. To address this challenge, we analyzed the feasibility of photoplethysmography-based angiography for assessing vascular structures within malignant and benign tumors. The proposed hardware and software were approved in a clinical study involving 30 patients with tumors located in the legs, torso, arms, and head. High-contrast and detailed vessel maps within both benign and malignant tumors were obtained. We demonstrated that capillary maps are consistent and can be interpreted using well-established dermoscopic criteria for vascular morphology. Vessel mapping provides valuable details, which may not be available in dermoscopic images and can aid in determining whether a tumor is benign or malignant. We believe that the proposed approach may become a valuable tool in the preliminary cancer diagnosis and is suitable for large-scale screening.
Collapse
Affiliation(s)
- Anastasia Guryleva
- Scientific and Technological Centre of Unique Instrumentation of Russian Academy of Sciences, Moscow, Russia
| | - Alexander Machikhin
- Scientific and Technological Centre of Unique Instrumentation of Russian Academy of Sciences, Moscow, Russia
| | - Ekaterina Orlova
- V.A. Rakhmanov Department of Dermatology and Venereology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Evgeniya Kulikova
- Scientific and Technological Centre of Unique Instrumentation of Russian Academy of Sciences, Moscow, Russia
| | - Michail Volkov
- Scientific and Technological Centre of Unique Instrumentation of Russian Academy of Sciences, Moscow, Russia
| | - Gaiane Gabrielian
- World-Class Research Center "Digital Biodesign and Personalized Healthcare", I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Ludmila Smirnova
- V.A. Rakhmanov Department of Dermatology and Venereology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Marina Sekacheva
- World-Class Research Center "Digital Biodesign and Personalized Healthcare", I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Olga Olisova
- V.A. Rakhmanov Department of Dermatology and Venereology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Ekaterina Rudenko
- Institute of Clinical Morphology and Digital Pathology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Olga Lobanova
- Institute of Clinical Morphology and Digital Pathology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Vera Smolyannikova
- Institute of Clinical Morphology and Digital Pathology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| | - Tatiana Demura
- Institute of Clinical Morphology and Digital Pathology, I.M. Sechenov First Moscow State Medical University of the Ministry of Health of the Russian Federation (Sechenov University), Moscow, Russia
| |
Collapse
|
2
|
Zhang Q, Pandit A, Liu Z, Guo Z, Muddu S, Wei Y, Pereg D, Nazemifard N, Papageorgiou C, Yang Y, Tang W, Braatz RD, Myerson AS, Barbastathis G. Non-invasive estimation of the powder size distribution from a single speckle image. LIGHT, SCIENCE & APPLICATIONS 2024; 13:200. [PMID: 39168972 PMCID: PMC11339358 DOI: 10.1038/s41377-024-01563-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/12/2024] [Revised: 07/28/2024] [Accepted: 08/02/2024] [Indexed: 08/23/2024]
Abstract
Non-invasive characterization of powders may take one of two approaches: imaging and counting individual particles; or relying on scattered light to estimate the particle size distribution (PSD) of the ensemble. The former approach runs into practical difficulties, as the system must conform to the working distance and other restrictions of the imaging optics. The latter approach requires an inverse map from the speckle autocorrelation to the particle sizes. The principle relies on the pupil function determining the basic sidelobe shape, whereas the particle size spread modulates the sidelobe intensity. We recently showed that it is feasible to invert the speckle autocorrelation and obtain the PSD using a neural network, trained efficiently through a physics-informed semi-generative approach. In this work, we eliminate one of the most time-consuming steps of our previous method by engineering the pupil function. By judiciously blocking portions of the pupil, we sacrifice some photons but in return we achieve much enhanced sidelobes and, hence, higher sensitivity to the change of the size distribution. The result is a 60 × reduction in total acquisition and processing time, or 0.25 seconds per frame in our implementation. Almost real-time operation in our system is not only more appealing toward rapid industrial adoption, it also paves the way for quantitative characterization of complex spatial or temporal dynamics in drying, blending, and other chemical and pharmaceutical manufacturing processes.
Collapse
Affiliation(s)
- Qihang Zhang
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
- Singapore-MIT Alliance for Research and Technology (SMART) Centre, Singapore, 117543, Singapore
- Department of Precision Instruments, Tsinghua University, Beijing, 100084, China
| | - Ajinkya Pandit
- Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Zhiguang Liu
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Zhen Guo
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Shashank Muddu
- Process Chemistry Development, Takeda Pharmaceuticals International Co, 40 Landsdowne St, Cambridge, MA, 02139, USA
| | - Yi Wei
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Deborah Pereg
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Neda Nazemifard
- Process Chemistry Development, Takeda Pharmaceuticals International Co, 40 Landsdowne St, Cambridge, MA, 02139, USA
| | - Charles Papageorgiou
- Process Chemistry Development, Takeda Pharmaceuticals International Co, 40 Landsdowne St, Cambridge, MA, 02139, USA
| | - Yihui Yang
- Process Chemistry Development, Takeda Pharmaceuticals International Co, 40 Landsdowne St, Cambridge, MA, 02139, USA
| | - Wenlong Tang
- ShinrAI Center for AI/ML, Data Sciences Institutes, Takeda Pharmaceuticals International Co, 650 E Kendall St, Cambridge, MA, 02142, USA
| | - Richard D Braatz
- Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Allan S Myerson
- Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - George Barbastathis
- Singapore-MIT Alliance for Research and Technology (SMART) Centre, Singapore, 117543, Singapore.
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
| |
Collapse
|
3
|
Goessinger EV, Dittrich PG, Nöcker P, Notni G, Weber S, Cerminara S, Mühleisen B, Navarini AA, Maul LV. Classification of melanocytic lesions using direct illumination multispectral imaging. Sci Rep 2024; 14:19036. [PMID: 39152181 PMCID: PMC11329730 DOI: 10.1038/s41598-024-69773-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2024] [Accepted: 08/08/2024] [Indexed: 08/19/2024] Open
Abstract
With rising melanoma incidence and mortality, early detection and surgical removal of primary lesions is essential. Multispectral imaging is a new, non-invasive technique that can facilitate skin cancer detection by measuring the reflectance spectra of biological tissues. Currently, incident illumination allows little light to be reflected from deeper skin layers due to high surface reflectance. A pilot study was conducted at the University Hospital Basel to evaluate, whether multispectral imaging with direct light coupling could extract more information from deeper skin layers for more accurate dignity classification of melanocytic lesions. 27 suspicious pigmented lesions from 23 patients were included (6 melanomas, 6 dysplastic nevi, 12 melanocytic nevi, 3 other). Lesions were imaged before excision using a prototype snapshot mosaic multispectral camera with incident and direct illumination with subsequent dignity classification by a pre-trained multispectral image analysis model. Using incident light, a sensitivity of 83.3% and a specificity of 58.8% were achieved compared to dignity as determined by histopathological examination. Direct light coupling resulted in a superior sensitivity of 100% and specificity of 82.4%. Convolutional neural network classification of corresponding red, green, and blue lesion images resulted in 16.7% lower sensitivity (83.3%, 5/6 malignant lesions detected) and 20.9% lower specificity (61.5%) compared to direct light coupling with multispectral image classification. Our results show that incorporating direct light multispectral imaging into the melanoma detection process could potentially increase the accuracy of dignity classification. This newly evaluated illumination method could improve multispectral applications in skin cancer detection. Further larger studies are needed to validate the camera prototype.
Collapse
Affiliation(s)
| | - Paul-Gerald Dittrich
- Imaging and Sensing Department, Fraunhofer Institute for Applied Optics and Precision Engineering IOF, Albert-Einstein-Strasse 7, 07745, Jena, Germany.
- SpectroNet c/o Technologie- und Innovationspark Jena GmbH, Jena, Germany.
- Group for Quality Assurance and Industrial Image Processing, Department of Mechanical Engineering, Technische Universität Ilmenau, Ilmenau, Germany.
| | - Philipp Nöcker
- Imaging and Sensing Department, Fraunhofer Institute for Applied Optics and Precision Engineering IOF, Albert-Einstein-Strasse 7, 07745, Jena, Germany
| | - Gunther Notni
- Group for Quality Assurance and Industrial Image Processing, Department of Mechanical Engineering, Technische Universität Ilmenau, Ilmenau, Germany
| | | | - Sara Cerminara
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland
| | - Beda Mühleisen
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland
| | | | - Lara Valeska Maul
- Department of Dermatology, University Hospital of Basel, Basel, Switzerland.
- Department of Dermatology, University Hospital Zurich, Zurich, Switzerland.
- Faculty of Medicine, University of Zurich, Zurich, Switzerland.
- Department of Dermatology, Felix Platter Hospital, University Hospital Basel, Burgfelderstrasse 101, 4055, Basel, Switzerland.
| |
Collapse
|
4
|
Attallah O. Skin-CAD: Explainable deep learning classification of skin cancer from dermoscopic images by feature selection of dual high-level CNNs features and transfer learning. Comput Biol Med 2024; 178:108798. [PMID: 38925085 DOI: 10.1016/j.compbiomed.2024.108798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 05/30/2024] [Accepted: 06/19/2024] [Indexed: 06/28/2024]
Abstract
Skin cancer (SC) significantly impacts many individuals' health all over the globe. Hence, it is imperative to promptly identify and diagnose such conditions at their earliest stages using dermoscopic imaging. Computer-aided diagnosis (CAD) methods relying on deep learning techniques especially convolutional neural networks (CNN) can effectively address this issue with outstanding outcomes. Nevertheless, such black box methodologies lead to a deficiency in confidence as dermatologists are incapable of comprehending and verifying the predictions that were made by these models. This article presents an advanced an explainable artificial intelligence (XAI) based CAD system named "Skin-CAD" which is utilized for the classification of dermoscopic photographs of SC. The system accurately categorises the photographs into two categories: benign or malignant, and further classifies them into seven subclasses of SC. Skin-CAD employs four CNNs of different topologies and deep layers. It gathers features out of a pair of deep layers of every CNN, particularly the final pooling and fully connected layers, rather than merely depending on attributes from a single deep layer. Skin-CAD applies the principal component analysis (PCA) dimensionality reduction approach to minimise the dimensions of pooling layer features. This also reduces the complexity of the training procedure compared to using deep features from a CNN that has a substantial size. Furthermore, it combines the reduced pooling features with the fully connected features of each CNN. Additionally, Skin-CAD integrates the dual-layer features of the four CNNs instead of entirely depending on the features of a single CNN architecture. In the end, it utilizes a feature selection step to determine the most important deep attributes. This helps to decrease the general size of the feature set and streamline the classification process. Predictions are analysed in more depth using the local interpretable model-agnostic explanations (LIME) approach. This method is used to create visual interpretations that align with an already existing viewpoint and adhere to recommended standards for general clarifications. Two benchmark datasets are employed to validate the efficiency of Skin-CAD which are the Skin Cancer: Malignant vs. Benign and HAM10000 datasets. The maximum accuracy achieved using Skin-CAD is 97.2 % and 96.5 % for the Skin Cancer: Malignant vs. Benign and HAM10000 datasets respectively. The findings of Skin-CAD demonstrate its potential to assist professional dermatologists in detecting and classifying SC precisely and quickly.
Collapse
Affiliation(s)
- Omneya Attallah
- Department of Electronics and Communications Engineering, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandri, 21937, Egypt; Wearables, Biosensing, and Biosignal Processing Laboratory, Arab Academy for Science, Technology and Maritime Transport, Alexandria, 21937, Egypt.
| |
Collapse
|
5
|
Vasanthakumari P, Romano RA, Rosa RGT, Salvio AG, Yakovlev V, Kurachi C, Hirshburg JM, Jo JA. Pixel-level classification of pigmented skin cancer lesions using multispectral autofluorescence lifetime dermoscopy imaging. BIOMEDICAL OPTICS EXPRESS 2024; 15:4557-4583. [PMID: 39346997 PMCID: PMC11427192 DOI: 10.1364/boe.523831] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Revised: 06/18/2024] [Accepted: 06/27/2024] [Indexed: 10/01/2024]
Abstract
There is no clinical tool available to primary care physicians or dermatologists that could provide objective identification of suspicious skin cancer lesions. Multispectral autofluorescence lifetime imaging (maFLIM) dermoscopy enables label-free biochemical and metabolic imaging of skin lesions. This study investigated the use of pixel-level maFLIM dermoscopy features for objective discrimination of malignant from visually similar benign pigmented skin lesions. Clinical maFLIM dermoscopy images were acquired from 60 pigmented skin lesions before undergoing a biopsy examination. Random forest and deep neural networks classification models were explored, as they do not require explicit feature selection. Feature pools with either spectral intensity or bi-exponential maFLIM features, and a combined feature pool, were independently evaluated with each classification model. A rigorous cross-validation strategy tailored for small-size datasets was adopted to estimate classification performance. Time-resolved bi-exponential autofluorescence features were found to be critical for accurate detection of malignant pigmented skin lesions. The deep neural network model produced the best lesion-level classification, with sensitivity and specificity of 76.84%±12.49% and 78.29%±5.50%, respectively, while the random forest classifier produced sensitivity and specificity of 74.73%±14.66% and 76.83%±9.58%, respectively. Results from this study indicate that machine-learning driven maFLIM dermoscopy has the potential to assist doctors with identifying patients in real need of biopsy examination, thus facilitating early detection while reducing the rate of unnecessary biopsies.
Collapse
Affiliation(s)
| | - Renan A Romano
- University of São Paulo, São Carlos Institute of Physics, São Paulo, Brazil
| | - Ramon G T Rosa
- University of São Paulo, São Carlos Institute of Physics, São Paulo, Brazil
| | - Ana G Salvio
- Skin Department of Amaral Carvalho Hospital, São Paulo, Brazil
| | - Vladislav Yakovlev
- Texas A&M University, Department of Biomedical Engineering, College Station, TX, USA
| | - Cristina Kurachi
- University of São Paulo, São Carlos Institute of Physics, São Paulo, Brazil
| | - Jason M Hirshburg
- University of Oklahoma Health Science Center, Department of Dermatology, Oklahoma City, OK, USA
| | - Javier A Jo
- University of Oklahoma, School of Electrical and Computer Engineering, Norman, OK, USA
| |
Collapse
|
6
|
Jiao W, Zhang Z, Zeng N, Hao R, He H, He C, Ma H. Complex Spatial Illumination Scheme Optimization of Backscattering Mueller Matrix Polarimetry for Tissue Imaging and Biosensing. BIOSENSORS 2024; 14:208. [PMID: 38667201 PMCID: PMC11048429 DOI: 10.3390/bios14040208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2024] [Revised: 04/16/2024] [Accepted: 04/20/2024] [Indexed: 04/28/2024]
Abstract
Polarization imaging and sensing techniques have shown great potential for biomedical and clinical applications. As a novel optical biosensing technology, Mueller matrix polarimetry can provide abundant microstructural information of tissue samples. However, polarimetric aberrations, which lead to inaccurate characterization of polarization properties, can be induced by uneven biomedical sample surfaces while measuring Mueller matrices with complex spatial illuminations. In this study, we analyze the detailed features of complex spatial illumination-induced aberrations by measuring the backscattering Mueller matrices of experimental phantom and tissue samples. We obtain the aberrations under different spatial illumination schemes in Mueller matrix imaging. Furthermore, we give the corresponding suggestions for selecting appropriate illumination schemes to extract specific polarization properties, and then provide strategies to alleviate polarimetric aberrations by adjusting the incident and detection angles in Mueller matrix imaging. The optimized scheme gives critical criteria for the spatial illumination scheme selection of non-collinear backscattering Mueller matrix measurements, which can be helpful for the further development of quantitative tissue polarimetric imaging and biosensing.
Collapse
Affiliation(s)
- Wei Jiao
- Guangdong Research Center of Polarization Imaging and Measurement Engineering Technology, Shenzhen Key Laboratory for Minimal Invasive Medical Technologies, Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (W.J.); (Z.Z.); (N.Z.); (R.H.); (H.M.)
| | - Zheng Zhang
- Guangdong Research Center of Polarization Imaging and Measurement Engineering Technology, Shenzhen Key Laboratory for Minimal Invasive Medical Technologies, Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (W.J.); (Z.Z.); (N.Z.); (R.H.); (H.M.)
| | - Nan Zeng
- Guangdong Research Center of Polarization Imaging and Measurement Engineering Technology, Shenzhen Key Laboratory for Minimal Invasive Medical Technologies, Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (W.J.); (Z.Z.); (N.Z.); (R.H.); (H.M.)
| | - Rui Hao
- Guangdong Research Center of Polarization Imaging and Measurement Engineering Technology, Shenzhen Key Laboratory for Minimal Invasive Medical Technologies, Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (W.J.); (Z.Z.); (N.Z.); (R.H.); (H.M.)
| | - Honghui He
- Guangdong Research Center of Polarization Imaging and Measurement Engineering Technology, Shenzhen Key Laboratory for Minimal Invasive Medical Technologies, Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (W.J.); (Z.Z.); (N.Z.); (R.H.); (H.M.)
| | - Chao He
- Department of Engineering Science, University of Oxford, Parks Road, Oxford OX1 3PJ, UK
| | - Hui Ma
- Guangdong Research Center of Polarization Imaging and Measurement Engineering Technology, Shenzhen Key Laboratory for Minimal Invasive Medical Technologies, Institute of Biopharmaceutical and Health Engineering, Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen 518055, China; (W.J.); (Z.Z.); (N.Z.); (R.H.); (H.M.)
| |
Collapse
|
7
|
Knab A, Anwer AG, Pedersen B, Handley S, Marupally AG, Habibalahi A, Goldys EM. Towards label-free non-invasive autofluorescence multispectral imaging for melanoma diagnosis. JOURNAL OF BIOPHOTONICS 2024; 17:e202300402. [PMID: 38247053 DOI: 10.1002/jbio.202300402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 12/11/2023] [Accepted: 12/31/2023] [Indexed: 01/23/2024]
Abstract
This study focuses on the use of cellular autofluorescence which visualizes the cell metabolism by monitoring endogenous fluorophores including NAD(P)H and flavins. It explores the potential of multispectral imaging of native fluorophores in melanoma diagnostics using excitation wavelengths ranging from 340 nm to 510 nm and emission wavelengths above 391 nm. Cultured immortalized cells are utilized to compare the autofluorescent signatures of two melanoma cell lines to one fibroblast cell line. Feature analysis identifies the most significant and least correlated features for differentiating the cells. The investigation successfully applies this analysis to pre-processed, noise-removed images and original background-corrupted data. Furthermore, the applicability of distinguishing melanomas and healthy fibroblasts based on their autofluorescent characteristics is validated using the same evaluation technique on patient cells. Additionally, the study tentatively maps the detected features to underlying biological processes. This research demonstrates the potential of cellular autofluorescence as a promising tool for melanoma diagnostics.
Collapse
Affiliation(s)
- Aline Knab
- Graduate School of Biomedical Engineering, Faculty of Engineering, University of New South Wales, Sydney, Australia
- ARC Centre of Excellence for Nanoscale Biophotonics, University of New South Wales, Sydney, Australia
| | - Ayad G Anwer
- Graduate School of Biomedical Engineering, Faculty of Engineering, University of New South Wales, Sydney, Australia
- ARC Centre of Excellence for Nanoscale Biophotonics, University of New South Wales, Sydney, Australia
| | - Bernadette Pedersen
- Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, New South Wales, Australia
- Melanoma Institute Australia, The University of Sydney, Sydney, New South Wales, Australia
| | - Shannon Handley
- Graduate School of Biomedical Engineering, Faculty of Engineering, University of New South Wales, Sydney, Australia
- ARC Centre of Excellence for Nanoscale Biophotonics, University of New South Wales, Sydney, Australia
| | - Abhilash Goud Marupally
- Graduate School of Biomedical Engineering, Faculty of Engineering, University of New South Wales, Sydney, Australia
- ARC Centre of Excellence for Nanoscale Biophotonics, University of New South Wales, Sydney, Australia
| | - Abbas Habibalahi
- Graduate School of Biomedical Engineering, Faculty of Engineering, University of New South Wales, Sydney, Australia
- ARC Centre of Excellence for Nanoscale Biophotonics, University of New South Wales, Sydney, Australia
| | - Ewa M Goldys
- Graduate School of Biomedical Engineering, Faculty of Engineering, University of New South Wales, Sydney, Australia
- ARC Centre of Excellence for Nanoscale Biophotonics, University of New South Wales, Sydney, Australia
| |
Collapse
|
8
|
Myslicka M, Kawala-Sterniuk A, Bryniarska A, Sudol A, Podpora M, Gasz R, Martinek R, Kahankova Vilimkova R, Vilimek D, Pelc M, Mikolajewski D. Review of the application of the most current sophisticated image processing methods for the skin cancer diagnostics purposes. Arch Dermatol Res 2024; 316:99. [PMID: 38446274 DOI: 10.1007/s00403-024-02828-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Revised: 12/28/2023] [Accepted: 01/25/2024] [Indexed: 03/07/2024]
Abstract
This paper presents the most current and innovative solutions applying modern digital image processing methods for the purpose of skin cancer diagnostics. Skin cancer is one of the most common types of cancers. It is said that in the USA only, one in five people will develop skin cancer and this trend is constantly increasing. Implementation of new, non-invasive methods plays a crucial role in both identification and prevention of skin cancer occurrence. Early diagnosis and treatment are needed in order to decrease the number of deaths due to this disease. This paper also contains some information regarding the most common skin cancer types, mortality and epidemiological data for Poland, Europe, Canada and the USA. It also covers the most efficient and modern image recognition methods based on the artificial intelligence applied currently for diagnostics purposes. In this work, both professional, sophisticated as well as inexpensive solutions were presented. This paper is a review paper and covers the period of 2017 and 2022 when it comes to solutions and statistics. The authors decided to focus on the latest data, mostly due to the rapid technology development and increased number of new methods, which positively affects diagnosis and prognosis.
Collapse
Affiliation(s)
- Maria Myslicka
- Faculty of Medicine, Wroclaw Medical University, J. Mikulicza-Radeckiego 5, 50-345, Wroclaw, Poland.
| | - Aleksandra Kawala-Sterniuk
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland.
| | - Anna Bryniarska
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
| | - Adam Sudol
- Faculty of Natural Sciences and Technology, University of Opole, Dmowskiego 7-9, 45-368, Opole, Poland
| | - Michal Podpora
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
| | - Rafal Gasz
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
| | - Radek Martinek
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
- Department of Cybernetics and Biomedical Engineering, VSB-Technical University of Ostrava, 17. Listopadu 2172/15, Ostrava, 70800, Czech Republic
| | - Radana Kahankova Vilimkova
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Proszkowska 76, 45-758, Opole, Poland
- Department of Cybernetics and Biomedical Engineering, VSB-Technical University of Ostrava, 17. Listopadu 2172/15, Ostrava, 70800, Czech Republic
| | - Dominik Vilimek
- Department of Cybernetics and Biomedical Engineering, VSB-Technical University of Ostrava, 17. Listopadu 2172/15, Ostrava, 70800, Czech Republic
| | - Mariusz Pelc
- Institute of Computer Science, University of Opole, Oleska 48, 45-052, Opole, Poland
- School of Computing and Mathematical Sciences, University of Greenwich, Old Royal Naval College, Park Row, SE10 9LS, London, UK
| | - Dariusz Mikolajewski
- Institute of Computer Science, Kazimierz Wielki University in Bydgoszcz, ul. Kopernika 1, 85-074, Bydgoszcz, Poland
- Neuropsychological Research Unit, 2nd Clinic of the Psychiatry and Psychiatric Rehabilitation, Medical University in Lublin, Gluska 1, 20-439, Lublin, Poland
| |
Collapse
|
9
|
Petracchi B, Torti E, Marenzi E, Leporati F. Acceleration of Hyperspectral Skin Cancer Image Classification through Parallel Machine-Learning Methods. SENSORS (BASEL, SWITZERLAND) 2024; 24:1399. [PMID: 38474935 DOI: 10.3390/s24051399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 01/29/2024] [Accepted: 02/16/2024] [Indexed: 03/14/2024]
Abstract
Hyperspectral imaging (HSI) has become a very compelling technique in different scientific areas; indeed, many researchers use it in the fields of remote sensing, agriculture, forensics, and medicine. In the latter, HSI plays a crucial role as a diagnostic support and for surgery guidance. However, the computational effort in elaborating hyperspectral data is not trivial. Furthermore, the demand for detecting diseases in a short time is undeniable. In this paper, we take up this challenge by parallelizing three machine-learning methods among those that are the most intensively used: Support Vector Machine (SVM), Random Forest (RF), and eXtreme Gradient Boosting (XGB) algorithms using the Compute Unified Device Architecture (CUDA) to accelerate the classification of hyperspectral skin cancer images. They all showed a good performance in HS image classification, in particular when the size of the dataset is limited, as demonstrated in the literature. We illustrate the parallelization techniques adopted for each approach, highlighting the suitability of Graphical Processing Units (GPUs) to this aim. Experimental results show that parallel SVM and XGB algorithms significantly improve the classification times in comparison with their serial counterparts.
Collapse
Affiliation(s)
- Bernardo Petracchi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, I-27100 Pavia, Italy
| | - Emanuele Torti
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, I-27100 Pavia, Italy
| | - Elisa Marenzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, I-27100 Pavia, Italy
| | - Francesco Leporati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, I-27100 Pavia, Italy
| |
Collapse
|
10
|
Olesen UH, Foged C, Jacobsen K, Ortner VK, Fredman G, Paasch U, Haedersdal M. Line-field confocal optical coherence tomography for in vivo visualization of morphological characteristics of squamous cell carcinoma in a murine model. Lasers Surg Med 2024; 56:14-18. [PMID: 38129971 DOI: 10.1002/lsm.23750] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 12/05/2023] [Accepted: 12/07/2023] [Indexed: 12/23/2023]
Abstract
OBJECTIVES Non-invasive imaging with line-field confocal optical coherence tomography (LC-OCT) can support the diagnosis of squamous cell carcinoma (SCC) through visualization of morphological characteristics specific to skin cancer. We aimed to visualize prominent morphological characteristics of SCC using LC-OCT in a well-established murine SCC model. MATERIALS AND METHODS Nine hairless mice were exposed to ultraviolet radiation three times weekly for 9 months to induce SCC development. Visible SCC tumors (n = 9) were imaged with LC-OCT and the presence of 10 well-described morphological characteristics of SCC were evaluated in the scans by two physicians with adjudication by a third. RESULTS Overall, murine morphological characteristics resembled corresponding features previously reported in human SCCs. Interrupted dermal-epidermal junction occurred in 100% of tumors. In epidermis, the most frequently observed characteristics were severe epidermal dysplasia (100%) and tumor budding (89%). Common dermal characteristics included broad strands (100%) and collagen alterations (78%). CONCLUSION LC-OCT imaging can be used to non-invasively visualize morphological characteristics specific to SCC in an in vivo preclinical model.
Collapse
Affiliation(s)
- Uffe H Olesen
- Department of Dermatology, Copenhagen University Hospital Bispebjerg, Copenhagen, Denmark
| | - Camilla Foged
- Department of Dermatology, Copenhagen University Hospital Bispebjerg, Copenhagen, Denmark
| | - Kevin Jacobsen
- Department of Dermatology, Copenhagen University Hospital Bispebjerg, Copenhagen, Denmark
| | - Vinzent K Ortner
- Department of Dermatology, Copenhagen University Hospital Bispebjerg, Copenhagen, Denmark
| | - Gabriella Fredman
- Department of Dermatology, Copenhagen University Hospital Bispebjerg, Copenhagen, Denmark
| | - Uwe Paasch
- Department of Dermatology, Venereology and Allergy, University of Leipzig, Leipzig, Germany
| | - Merete Haedersdal
- Department of Dermatology, Copenhagen University Hospital Bispebjerg, Copenhagen, Denmark
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
11
|
Hou H, Mitbander R, Tang Y, Azimuddin A, Carns J, Schwarz RA, Richards-Kortum RR. Optical imaging technologies for in vivo cancer detection in low-resource settings. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2023; 28:100495. [PMID: 38406798 PMCID: PMC10883072 DOI: 10.1016/j.cobme.2023.100495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2024]
Abstract
Cancer continues to affect underserved populations disproportionately. Novel optical imaging technologies, which can provide rapid, non-invasive, and accurate cancer detection at the point of care, have great potential to improve global cancer care. This article reviews the recent technical innovations and clinical translation of low-cost optical imaging technologies, highlighting the advances in both hardware and software, especially the integration of artificial intelligence, to improve in vivo cancer detection in low-resource settings. Additionally, this article provides an overview of existing challenges and future perspectives of adapting optical imaging technologies into clinical practice, which can potentially contribute to novel insights and programs that effectively improve cancer detection in low-resource settings.
Collapse
Affiliation(s)
- Huayu Hou
- Department of Bioengineering, Rice University, Houston, TX 77005, USA
| | - Ruchika Mitbander
- Department of Bioengineering, Rice University, Houston, TX 77005, USA
| | - Yubo Tang
- Department of Bioengineering, Rice University, Houston, TX 77005, USA
| | - Ahad Azimuddin
- School of Medicine, Texas A&M University, Houston, TX 77030, USA
| | - Jennifer Carns
- Department of Bioengineering, Rice University, Houston, TX 77005, USA
| | - Richard A Schwarz
- Department of Bioengineering, Rice University, Houston, TX 77005, USA
| | | |
Collapse
|
12
|
Huang HY, Hsiao YP, Karmakar R, Mukundan A, Chaudhary P, Hsieh SC, Wang HC. A Review of Recent Advances in Computer-Aided Detection Methods Using Hyperspectral Imaging Engineering to Detect Skin Cancer. Cancers (Basel) 2023; 15:5634. [PMID: 38067338 PMCID: PMC10705122 DOI: 10.3390/cancers15235634] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 11/20/2023] [Accepted: 11/24/2023] [Indexed: 08/15/2024] Open
Abstract
Skin cancer, a malignant neoplasm originating from skin cell types including keratinocytes, melanocytes, and sweat glands, comprises three primary forms: basal cell carcinoma (BCC), squamous cell carcinoma (SCC), and malignant melanoma (MM). BCC and SCC, while constituting the most prevalent categories of skin cancer, are generally considered less aggressive compared to MM. Notably, MM possesses a greater capacity for invasiveness, enabling infiltration into adjacent tissues and dissemination via both the circulatory and lymphatic systems. Risk factors associated with skin cancer encompass ultraviolet (UV) radiation exposure, fair skin complexion, a history of sunburn incidents, genetic predisposition, immunosuppressive conditions, and exposure to environmental carcinogens. Early detection of skin cancer is of paramount importance to optimize treatment outcomes and preclude the progression of disease, either locally or to distant sites. In pursuit of this objective, numerous computer-aided diagnosis (CAD) systems have been developed. Hyperspectral imaging (HSI), distinguished by its capacity to capture information spanning the electromagnetic spectrum, surpasses conventional RGB imaging, which relies solely on three color channels. Consequently, this study offers a comprehensive exploration of recent CAD investigations pertaining to skin cancer detection and diagnosis utilizing HSI, emphasizing diagnostic performance parameters such as sensitivity and specificity.
Collapse
Affiliation(s)
- Hung-Yi Huang
- Department of Dermatology, Ditmanson Medical Foundation Chiayi Christian Hospital, Chia Yi City 60002, Taiwan;
| | - Yu-Ping Hsiao
- Department of Dermatology, Chung Shan Medical University Hospital, No.110, Sec. 1, Jianguo N. Rd., South District, Taichung City 40201, Taiwan;
- Institute of Medicine, School of Medicine, Chung Shan Medical University, No.110, Sec. 1, Jianguo N. Rd., South District, Taichung City 40201, Taiwan
| | - Riya Karmakar
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi City 62102, Taiwan; (R.K.); (A.M.)
| | - Arvind Mukundan
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi City 62102, Taiwan; (R.K.); (A.M.)
| | - Pramod Chaudhary
- Department of Aeronautical Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai 600 062, India;
| | - Shang-Chin Hsieh
- Department of Plastic Surgery, Kaohsiung Armed Forces General Hospital, 2, Zhongzheng 1st. Rd., Lingya District, Kaohsiung 80284, Taiwan
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi City 62102, Taiwan; (R.K.); (A.M.)
- Department of Medical Research, Dalin Tzu Chi General Hospital, No. 2, Min-Sheng Rd., Dalin Town, Chia Yi City 62247, Taiwan
- Technology Development, Hitspectra Intelligent Technology Co., Ltd., Kaohsiung 80661, Taiwan
| |
Collapse
|
13
|
Pham TTH, Luu TN, Nguyen TV, Huynh NT, Phan QH, Le TH. Polarimetric imaging combining optical parameters for classification of mice non-melanoma skin cancer tissue using machine learning. Heliyon 2023; 9:e22081. [PMID: 38034801 PMCID: PMC10682661 DOI: 10.1016/j.heliyon.2023.e22081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 11/02/2023] [Accepted: 11/03/2023] [Indexed: 12/02/2023] Open
Abstract
Polarimetric imaging systems combining machine learning is emerging as a promising tool for the support of diagnosis and intervention decision-making processes in cancer detection/staging. A present study proposes a novel method based on Mueller matrix imaging combining optical parameters and machine learning models for classifying the progression of skin cancer based on the identification of three different types of mice skin tissues: healthy, papilloma, and squamous cell carcinoma. Three different machine learning algorithms (K-Nearest Neighbors, Decision Tree, and Support Vector Machine (SVM)) are used to construct a classification model using a dataset consisting of Mueller matrix images and optical properties extracted from the tissue samples. The experimental results show that the SVM model is robust to discriminate among three classes in the training stage and achieves an accuracy of 94 % on the testing dataset. Overall, it is provided that polarimetric imaging systems and machine learning algorithms can dynamically combine for the reliable diagnosis of skin cancer.
Collapse
Affiliation(s)
- Thi-Thu-Hien Pham
- School of Biomedical Engineering, International University (VNU-HCM), Ho Chi Minh City, Viet Nam
- Vietnam National University HCMC, Ho Chi Minh City, 700000, Viet Nam
| | - Thanh-Ngan Luu
- School of Biomedical Engineering, International University (VNU-HCM), Ho Chi Minh City, Viet Nam
- Vietnam National University HCMC, Ho Chi Minh City, 700000, Viet Nam
| | - Thao-Vi Nguyen
- School of Biomedical Engineering, International University (VNU-HCM), Ho Chi Minh City, Viet Nam
- Vietnam National University HCMC, Ho Chi Minh City, 700000, Viet Nam
| | - Ngoc-Trinh Huynh
- Department of Pharmacology, University of Medicine and Pharmacy at Ho Chi Minh City, HCMC, Viet Nam
| | - Quoc-Hung Phan
- Mechanical Engineering Department, National United University, Miaoli 36063, Taiwan
| | - Thanh-Hai Le
- Department of Information Technology Specialization, FPT University, Ho Chi Minh City, 700000, Viet Nam
| |
Collapse
|
14
|
Rahaman A, Anantharaju A, Jeyachandran K, Manideep R, Pal UM. Optical imaging for early detection of cervical cancer: state of the art and perspectives. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:080902. [PMID: 37564164 PMCID: PMC10411916 DOI: 10.1117/1.jbo.28.8.080902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 07/26/2023] [Accepted: 07/28/2023] [Indexed: 08/12/2023]
Abstract
Significance Cervical cancer is one of the major causes of death in females worldwide. HPV infection is the key cause of uncontrolled cell growth leading to cervical cancer. About 90% of cervical cancer is preventable because of the slow progression of the disease, giving a window of about 10 years for the precancerous lesion to be recognized and treated. Aim The present challenges for cervical cancer diagnosis are interobserver variation in clinicians' interpretation of visual inspection with acetic acid/visual inspection with Lugol's iodine, cost of cytology-based screening, and lack of skilled clinicians. The optical modalities can assist in qualitatively and quantitatively analyzing the tissue to differentiate between cancerous and surrounding normal tissues. Approach This work is on the recent advances in optical techniques for cervical cancer diagnosis, which promise to overcome the above-listed challenges faced by present screening techniques. Results The optical modalities provide substantial measurable information in addition to the conventional colposcopy and Pap smear test to clinically aid the diagnosis. Conclusions Recent optical modalities on fluorescence, multispectral imaging, polarization-sensitive imaging, microendoscopy, Raman spectroscopy, especially with the portable design and assisted by artificial intelligence, have a significant scope in the diagnosis of premalignant cervical cancer in future.
Collapse
Affiliation(s)
- Alisha Rahaman
- Savitribai Phule Pune University, Department of Microbiology, Pune, Maharashtra, India
| | - Arpitha Anantharaju
- Jawaharlal Institute of Postgraduate Medical Education and Research, Department of Obstetrics and Gynaecology, Puducherry, India
| | - Karthika Jeyachandran
- Indian Institute of Information Technology, Design and Manufacturing, Kancheepuram, Department of Electronics and Communication Engineering, Chennai, Tamil Nadu, India
| | - Repala Manideep
- Indian Institute of Information Technology, Design and Manufacturing, Kancheepuram, Department of Electronics and Communication Engineering, Chennai, Tamil Nadu, India
| | - Uttam M. Pal
- Indian Institute of Information Technology, Design and Manufacturing, Kancheepuram, Department of Electronics and Communication Engineering, Chennai, Tamil Nadu, India
| |
Collapse
|
15
|
Huang P, Lee C, Lee L, Huang H, Huang Y, Lan J, Lee C. Surface-enhanced Raman scattering (SERS) by gold nanoparticle characterizes dermal thickening by collagen in bleomycin-treated skin ex vivo. Skin Res Technol 2023; 29:e13334. [PMID: 37231930 PMCID: PMC10316472 DOI: 10.1111/srt.13334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Accepted: 04/10/2023] [Indexed: 05/27/2023]
Abstract
PURPOSE Current skin imaging modalities, including optical, electron, and confocal microscopy, mostly require tissue fixations that could damage proteins and biological molecules. Live tissue or cell imaging such as ultrasonography and optical coherent microscope may not adequately measure the dynamic spectroscopical changes. Raman spectroscopy has been adopted for skin imaging in vivo, mostly for skin cancer imaging. However, whether the epidermal and dermal thickening in skin could be measured and distinguished by conventional Ramen spectroscopy or the surface-enhanced Raman scattering (SERS), a rapid and label-free method for noninvasive measurement remains unknown. METHODS Human skin sections from patients of atopic dermatitis and keloid, which represent epidermal and dermal thickening, respectively, were measured by conventional Ramen spectroscopy. In mice, skin sections from imiquimod (IMQ)- and bleomycin (BLE)-treated mice, which reflect the epidermal and dermal thickening, respectively, were measured by SERS, that incorporates gold nanoparticles to generate surface plasma and enhance Raman signals. RESULTS Conventional Ramen spectroscopy failed to consistently show the Raman shift in human samples among the different groups. SERS successfully revealed a prominent peak around 1300 cm-1 in the IMQ-treated skin; and two significant peaks around 1100 and 1300 cm-1 in BLE-treated group. Further quantitative analysis showed 1100 cm-1 peak was significantly accentuated in the BLE-treated skin than that in control skin. SERS identified in vitro a similar 1100 cm-1 peak in solutions of collagen, the major dermal biological molecules. CONCLUSION SERS distinguishes the epidermal or dermal thickening in mouse skin with rapid and label-free measures. A prominent 1100 cm-1 SERS peak in the BLE-treated skin may result from collagen. SERS might help precision diagnosis in the future.
Collapse
Affiliation(s)
- Po‐Jung Huang
- Institute of Environmental EngineeringNational Sun Yat‐sen UniversityKaohsiungTaiwan
- Department of Chemical and Materials EngineeringNational Central UniversityTaoyuanTaiwan
| | - Chao‐Kuei Lee
- Department of PhotonicsNational Sun Yat‐Sen UniversityKaohsiungTaiwan
| | - Ling‐Hau Lee
- Department of DermatologyKaohsiung Chang Gung Memorial HospitalKaohsiungTaiwan
- Department of DermatologyChang Gung University College of MedicineTaoyuanTaiwan
| | - Hsiang‐Fu Huang
- Department of PhotonicsNational Sun Yat‐Sen UniversityKaohsiungTaiwan
| | - Yi‐Hsuan Huang
- Department of PhotonicsNational Sun Yat‐Sen UniversityKaohsiungTaiwan
| | - Jia‐Chi Lan
- Department of PhotonicsNational Sun Yat‐Sen UniversityKaohsiungTaiwan
| | - Chih‐Hung Lee
- Department of DermatologyKaohsiung Chang Gung Memorial HospitalKaohsiungTaiwan
- Department of DermatologyChang Gung University College of MedicineTaoyuanTaiwan
| |
Collapse
|
16
|
Ilișanu MA, Moldoveanu F, Moldoveanu A. Multispectral Imaging for Skin Diseases Assessment-State of the Art and Perspectives. SENSORS (BASEL, SWITZERLAND) 2023; 23:3888. [PMID: 37112229 PMCID: PMC10140977 DOI: 10.3390/s23083888] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 03/30/2023] [Accepted: 04/07/2023] [Indexed: 06/19/2023]
Abstract
Skin optical inspection is an imperative procedure for a suspicious dermal lesion since very early skin cancer detection can guarantee total recovery. Dermoscopy, confocal laser scanning microscopy, optical coherence tomography, multispectral imaging, multiphoton laser imaging, and 3D topography are the most outstanding optical techniques implemented for skin examination. The accuracy of dermatological diagnoses attained by each of those methods is still debatable, and only dermoscopy is frequently used by all dermatologists. Therefore, a comprehensive method for skin analysis has not yet been established. Multispectral imaging (MSI) is based on light-tissue interaction properties due to radiation wavelength variation. An MSI device collects the reflected radiation after illumination of the lesion with light of different wavelengths and provides a set of spectral images. The concentration maps of the main light-absorbing molecules in the skin, the chromophores, can be retrieved using the intensity values from those images, sometimes even for deeper-located tissues, due to interaction with near-infrared light. Recent studies have shown that portable and cost-efficient MSI systems can be used for extracting skin lesion characteristics useful for early melanoma diagnoses. This review aims to describe the efforts that have been made to develop MSI systems for skin lesions evaluation in the last decade. We examined the hardware characteristics of the produced devices and identified the typical structure of an MSI device for dermatology. The analyzed prototypes showed the possibility of improving the specificity of classification between the melanoma and benign nevi. Currently, however, they are rather adjuvants tools for skin lesion assessment, and efforts are needed towards a fully fledged diagnostic MSI device.
Collapse
|
17
|
Mostafavi Zadeh SM, Rezaei Y, Barahimi A, Abbasi E, Malekzadeh R. Impact of COVID-19 pandemic on the diagnosis of patients with skin cancer: a systematic review protocol. BMJ Open 2023; 13:e069720. [PMID: 36898745 PMCID: PMC10008412 DOI: 10.1136/bmjopen-2022-069720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/12/2023] Open
Abstract
INTRODUCTION The COVID-19 pandemic has changed aspects of patient care in the many scheduled medical activities, restricted access to healthcare facilities, and affected the diagnosis and organisation of patients with other health problems, specifically skin cancer. Skin cancer, the uninhibited progress of atypical skin cells, happens with unrepaired DNA genetic faults that lead them to multiply and create malignant tumours. Currently, dermatologists perform skin cancer diagnosis based on their specialised experience using the results of pathological tests from the skin biopsy. Sometimes, some specialists advise sonography imaging to check the skin tissue as a non-invasive method. The outbreak has led to postponements in the treatment and diagnosis of patients with skin cancer, including diagnostic delays because of limitations of diagnostic capacities and delays in referring patients to the physician. The purpose of this review is to improve our understanding of the impact of the COVID-19 outbreak on the diagnosis of patients with skin cancer and conduct a scoping review to identify whether routine skin cancer diagnoses are affected by the persistent incidence of COVID-19. METHODS AND ANALYSIS The structure of research was compiled using Population/Intervention/Comparison/Outcomes/Study Design and Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. First, we will find the main keywords to capture scientific studies related to the impact of the COVID-19 pandemic on the diagnosis of skin cancer: COVID-19 and skin neoplasms. To warrant sufficient coverage and identify potential articles, we will search the combination of four electronic databases PubMed/MEDLINE, Scopus, Web of Science and EMBASE, and ProQuest from 1 January 2019 until 30 September 2022. The screening, selection and data extraction of studies will be performed by two independent authors, who will then assessed the quality of the included studies according to Newcastle-Ottawa Scale. ETHICS AND DISSEMINATION As this study will be a systematic review without human participants' involvement, no formal ethical assessment is required. Findings will be presented at conferences related to this field and will be disseminated in a peer-reviewed journal. PROSPERO REGISTRATION NUMBER CRD42022361569.
Collapse
Affiliation(s)
- Seyed Mostafa Mostafavi Zadeh
- Oncopathology Research Center, Iran University of Medical Sciences, Tehran, Iran (the Islamic Republic of)
- Department of Molecular Medicine, Iran University of Medical Sciences, Tehran, Iran (the Islamic Republic of)
| | - Yasaman Rezaei
- Oncopathology Research Center, Iran University of Medical Sciences, Tehran, Iran (the Islamic Republic of)
| | - Ahmadreza Barahimi
- Department of Medical Mycology & Parasitology, Shiraz University of Medical Sciences, Shiraz, Iran (the Islamic Republic of)
| | - Ebrahim Abbasi
- Department of Medical Entomology and Vector Control, Shiraz University of Medical Sciences, Shiraz, Iran (the Islamic Republic of)
| | - Roudabeh Malekzadeh
- Department of Genetics, College of Science, Islamic Azad University Kazerun Branch, Kazerun, Iran (the Islamic Republic of)
| |
Collapse
|
18
|
Zhang Q, Gamekkanda JC, Pandit A, Tang W, Papageorgiou C, Mitchell C, Yang Y, Schwaerzler M, Oyetunde T, Braatz RD, Myerson AS, Barbastathis G. Extracting particle size distribution from laser speckle with a physics-enhanced autocorrelation-based estimator (PEACE). Nat Commun 2023; 14:1159. [PMID: 36859392 PMCID: PMC9977959 DOI: 10.1038/s41467-023-36816-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Accepted: 02/17/2023] [Indexed: 03/03/2023] Open
Abstract
Extracting quantitative information about highly scattering surfaces from an imaging system is challenging because the phase of the scattered light undergoes multiple folds upon propagation, resulting in complex speckle patterns. One specific application is the drying of wet powders in the pharmaceutical industry, where quantifying the particle size distribution (PSD) is of particular interest. A non-invasive and real-time monitoring probe in the drying process is required, but there is no suitable candidate for this purpose. In this report, we develop a theoretical relationship from the PSD to the speckle image and describe a physics-enhanced autocorrelation-based estimator (PEACE) machine learning algorithm for speckle analysis to measure the PSD of a powder surface. This method solves both the forward and inverse problems together and enjoys increased interpretability, since the machine learning approximator is regularized by the physical law.
Collapse
Affiliation(s)
- Qihang Zhang
- grid.116068.80000 0001 2341 2786Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Janaka C. Gamekkanda
- grid.116068.80000 0001 2341 2786Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Ajinkya Pandit
- grid.116068.80000 0001 2341 2786Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Wenlong Tang
- grid.419849.90000 0004 0447 7762Data Sciences Institutes, Takeda Pharmaceuticals International Co, 650 E Kendall St, Cambridge, MA 02142 USA
| | - Charles Papageorgiou
- grid.419849.90000 0004 0447 7762Process Chemistry Development, Takeda Pharmaceuticals International Co, 40 Landsdowne St, Cambridge, MA 02139 USA
| | - Chris Mitchell
- grid.419849.90000 0004 0447 7762Process Chemistry Development, Takeda Pharmaceuticals International Co, 40 Landsdowne St, Cambridge, MA 02139 USA
| | - Yihui Yang
- grid.419849.90000 0004 0447 7762Process Chemistry Development, Takeda Pharmaceuticals International Co, 40 Landsdowne St, Cambridge, MA 02139 USA
| | - Michael Schwaerzler
- Innovation and Technology Sciences, Takeda Pharmaceutical Company Limited, 200 Shire Way, Lexington, MA 02421 USA
| | - Tolutola Oyetunde
- Innovation and Technology Sciences, Takeda Pharmaceutical Company Limited, 200 Shire Way, Lexington, MA 02421 USA
| | - Richard D. Braatz
- grid.116068.80000 0001 2341 2786Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Allan S. Myerson
- grid.116068.80000 0001 2341 2786Department of Chemical Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - George Barbastathis
- Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA. .,Singapore-MIT Alliance for Research and Technology (SMART) Centre, 1 Create Way, Singapore, 117543, Singapore.
| |
Collapse
|
19
|
Dobre EG, Surcel M, Constantin C, Ilie MA, Caruntu A, Caruntu C, Neagu M. Skin Cancer Pathobiology at a Glance: A Focus on Imaging Techniques and Their Potential for Improved Diagnosis and Surveillance in Clinical Cohorts. Int J Mol Sci 2023; 24:ijms24021079. [PMID: 36674595 PMCID: PMC9866322 DOI: 10.3390/ijms24021079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 01/02/2023] [Accepted: 01/03/2023] [Indexed: 01/08/2023] Open
Abstract
Early diagnosis is essential for completely eradicating skin cancer and maximizing patients' clinical benefits. Emerging optical imaging modalities such as reflectance confocal microscopy (RCM), optical coherence tomography (OCT), magnetic resonance imaging (MRI), near-infrared (NIR) bioimaging, positron emission tomography (PET), and their combinations provide non-invasive imaging data that may help in the early detection of cutaneous tumors and surgical planning. Hence, they seem appropriate for observing dynamic processes such as blood flow, immune cell activation, and tumor energy metabolism, which may be relevant for disease evolution. This review discusses the latest technological and methodological advances in imaging techniques that may be applied for skin cancer detection and monitoring. In the first instance, we will describe the principle and prospective clinical applications of the most commonly used imaging techniques, highlighting the challenges and opportunities of their implementation in the clinical setting. We will also highlight how imaging techniques may complement the molecular and histological approaches in sharpening the non-invasive skin characterization, laying the ground for more personalized approaches in skin cancer patients.
Collapse
Affiliation(s)
- Elena-Georgiana Dobre
- Faculty of Biology, University of Bucharest, Splaiul Independentei 91-95, 050095 Bucharest, Romania
| | - Mihaela Surcel
- Immunology Department, “Victor Babes” National Institute of Pathology, 050096 Bucharest, Romania
| | - Carolina Constantin
- Immunology Department, “Victor Babes” National Institute of Pathology, 050096 Bucharest, Romania
- Department of Pathology, Colentina University Hospital, 020125 Bucharest, Romania
| | | | - Ana Caruntu
- Department of Oral and Maxillofacial Surgery, “Carol Davila” Central Military Emergency Hospital, 010825 Bucharest, Romania
- Department of Oral and Maxillofacial Surgery, Faculty of Dental Medicine, “Titu Maiorescu” University, 031593 Bucharest, Romania
| | - Constantin Caruntu
- Department of Physiology, “Carol Davila” University of Medicine and Pharmacy, 050474 Bucharest, Romania
- Department of Dermatology, “Prof. N.C. Paulescu” National Institute of Diabetes, Nutrition and Metabolic Diseases, 011233 Bucharest, Romania
- Correspondence:
| | - Monica Neagu
- Faculty of Biology, University of Bucharest, Splaiul Independentei 91-95, 050095 Bucharest, Romania
- Immunology Department, “Victor Babes” National Institute of Pathology, 050096 Bucharest, Romania
- Department of Pathology, Colentina University Hospital, 020125 Bucharest, Romania
| |
Collapse
|
20
|
Owida HA. Developments and Clinical Applications of Noninvasive Optical Technologies for Skin Cancer Diagnosis. J Skin Cancer 2022; 2022:9218847. [PMID: 36437851 PMCID: PMC9699785 DOI: 10.1155/2022/9218847] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 10/29/2022] [Accepted: 11/09/2022] [Indexed: 04/03/2024] Open
Abstract
Skin cancer has shown a sharp increase in prevalence over the past few decades and currently accounts for one-third of all cancers diagnosed. The most lethal form of skin cancer is melanoma, which develops in 4% of individuals. The rising prevalence and increased number of fatalities of skin cancer put a significant burden on healthcare resources and the economy. However, early detection and treatment greatly improve survival rates for patients with skin cancer. Since the rising rates of both the incidence and mortality have been particularly noticeable with melanoma, significant resources have been allocated to research aimed at earlier diagnosis and a deeper knowledge of the disease. Dermoscopy, reflectance confocal microscopy, optical coherence tomography, multiphoton-excited fluorescence imaging, and dermatofluorescence are only a few of the optical modalities reviewed here that have been employed to enhance noninvasive diagnosis of skin cancer in recent years. This review article discusses the methodology behind newly emerging noninvasive optical diagnostic technologies, their clinical applications, and advantages and disadvantages of these techniques, as well as the potential for their further advancement in the future.
Collapse
Affiliation(s)
- Hamza Abu Owida
- Medical Engineering Department, Faculty of Engineering, Al Ahliyya Amman University, Amman 19328, Jordan
| |
Collapse
|
21
|
Cavedo F, Esmaili P, Norgia M. Self-Mixing Laser Distance-Sensor Enhanced by Multiple Modulation Waveforms. SENSORS (BASEL, SWITZERLAND) 2022; 22:8456. [PMID: 36366155 PMCID: PMC9655176 DOI: 10.3390/s22218456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/28/2022] [Accepted: 10/30/2022] [Indexed: 06/16/2023]
Abstract
Optical rangefinders based on Self-Mixing Interferometry are widely described in literature, but not yet on the market as commercial instruments. The main reason is that it is relatively easy to propose new elaboration techniques and get results in controlled conditions, while it is very difficult to develop a reliable instrument. In this paper, we propose a laser distance sensor with improved reliability, realized through a wavelength modulation at a different frequency, able to decorrelate single measurement errors and obtain improvement by averages. A dedicated software is implemented to automatically calculate the modulation pre-emphasis, needed to linearize the wavelength modulation. Finally, data selection algorithms allow to overcome signal fading problems due to the speckle effect. A prototype demonstrates the approach with about 0.1 mm accuracy up to 2 m of distance at 200 measurements per second.
Collapse
|
22
|
La Salvia M, Torti E, Leon R, Fabelo H, Ortega S, Balea-Fernandez F, Martinez-Vega B, Castaño I, Almeida P, Carretero G, Hernandez JA, Callico GM, Leporati F. Neural Networks-Based On-Site Dermatologic Diagnosis through Hyperspectral Epidermal Images. SENSORS (BASEL, SWITZERLAND) 2022; 22:7139. [PMID: 36236240 PMCID: PMC9571453 DOI: 10.3390/s22197139] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 09/15/2022] [Accepted: 09/18/2022] [Indexed: 06/16/2023]
Abstract
Cancer originates from the uncontrolled growth of healthy cells into a mass. Chromophores, such as hemoglobin and melanin, characterize skin spectral properties, allowing the classification of lesions into different etiologies. Hyperspectral imaging systems gather skin-reflected and transmitted light into several wavelength ranges of the electromagnetic spectrum, enabling potential skin-lesion differentiation through machine learning algorithms. Challenged by data availability and tiny inter and intra-tumoral variability, here we introduce a pipeline based on deep neural networks to diagnose hyperspectral skin cancer images, targeting a handheld device equipped with a low-power graphical processing unit for routine clinical testing. Enhanced by data augmentation, transfer learning, and hyperparameter tuning, the proposed architectures aim to meet and improve the well-known dermatologist-level detection performances concerning both benign-malignant and multiclass classification tasks, being able to diagnose hyperspectral data considering real-time constraints. Experiments show 87% sensitivity and 88% specificity for benign-malignant classification and specificity above 80% for the multiclass scenario. AUC measurements suggest classification performance improvement above 90% with adequate thresholding. Concerning binary segmentation, we measured skin DICE and IOU higher than 90%. We estimated 1.21 s, at most, consuming 5 Watts to segment the epidermal lesions with the U-Net++ architecture, meeting the imposed time limit. Hence, we can diagnose hyperspectral epidermal data assuming real-time constraints.
Collapse
Affiliation(s)
- Marco La Salvia
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy
| | - Emanuele Torti
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy
| | - Raquel Leon
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35001 Las Palmas de Gran Canaria, Spain
| | - Himar Fabelo
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35001 Las Palmas de Gran Canaria, Spain
| | - Samuel Ortega
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35001 Las Palmas de Gran Canaria, Spain
- Norwegian Institute of Food, Fisheries and Aquaculture Research (Nofima), 6122 Tromsø, Norway
| | - Francisco Balea-Fernandez
- Department of Psychology, Sociology and Social Work, University of Las Palmas de Gran Canaria, 35001 Las Palmas de Gran Canaria, Spain
| | - Beatriz Martinez-Vega
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35001 Las Palmas de Gran Canaria, Spain
| | - Irene Castaño
- Department of Dermatology, Hospital Universitario de Gran Canaria Doctor Negrín, Barranco de la Ballena, s/n, 35010 Las Palmas de Gran Canaria, Spain
| | - Pablo Almeida
- Department of Dermatology, Complejo Hospitalario Universitario Insular-Materno Infantil, Avenida Maritima del Sur, s/n, 35016 Las Palmas de Gran Canaria, Spain
| | - Gregorio Carretero
- Department of Dermatology, Hospital Universitario de Gran Canaria Doctor Negrín, Barranco de la Ballena, s/n, 35010 Las Palmas de Gran Canaria, Spain
| | - Javier A. Hernandez
- Department of Dermatology, Complejo Hospitalario Universitario Insular-Materno Infantil, Avenida Maritima del Sur, s/n, 35016 Las Palmas de Gran Canaria, Spain
| | - Gustavo M. Callico
- Research Institute for Applied Microelectronics (IUMA), University of Las Palmas de Gran Canaria (ULPGC), 35001 Las Palmas de Gran Canaria, Spain
| | - Francesco Leporati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy
| |
Collapse
|
23
|
Yáñez C, DeMas-Giménez G, Royo S. Overview of Biofluids and Flow Sensing Techniques Applied in Clinical Practice. SENSORS (BASEL, SWITZERLAND) 2022; 22:6836. [PMID: 36146183 PMCID: PMC9503462 DOI: 10.3390/s22186836] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 09/03/2022] [Accepted: 09/06/2022] [Indexed: 06/16/2023]
Abstract
This review summarizes the current knowledge on biofluids and the main flow sensing techniques applied in healthcare today. Since the very beginning of the history of medicine, one of the most important assets for evaluating various human diseases has been the analysis of the conditions of the biofluids within the human body. Hence, extensive research on sensors intended to evaluate the flow of many of these fluids in different tissues and organs has been published and, indeed, continues to be published very frequently. The purpose of this review is to provide researchers interested in venturing into biofluid flow sensing with a concise description of the physiological characteristics of the most important body fluids that are likely to be altered by diverse medical conditions. Similarly, a reported compilation of well-established sensors and techniques currently applied in healthcare regarding flow sensing is aimed at serving as a starting point for understanding the theoretical principles involved in the existing methodologies, allowing researchers to determine the most suitable approach to adopt according to their own objectives in this broad field.
Collapse
Affiliation(s)
- Carlos Yáñez
- Centre for Sensors, Instruments and Systems Development, Universitat Politècnica de Catalunya, 08222 Terrassa, Spain
| | | | | |
Collapse
|
24
|
Raita-Hakola AM, Annala L, Lindholm V, Trops R, Näsilä A, Saari H, Ranki A, Pölönen I. FPI Based Hyperspectral Imager for the Complex Surfaces—Calibration, Illumination and Applications. SENSORS 2022; 22:s22093420. [PMID: 35591109 PMCID: PMC9103796 DOI: 10.3390/s22093420] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 04/13/2022] [Accepted: 04/23/2022] [Indexed: 01/27/2023]
Abstract
Hyperspectral imaging (HSI) applications for biomedical imaging and dermatological applications have been recently under research interest. Medical HSI applications are non-invasive methods with high spatial and spectral resolution. HS imaging can be used to delineate malignant tumours, detect invasions, and classify lesion types. Typical challenges of these applications relate to complex skin surfaces, leaving some skin areas unreachable. In this study, we introduce a novel spectral imaging concept and conduct a clinical pre-test, the findings of which can be used to develop the concept towards a clinical application. The SICSURFIS spectral imager concept combines a piezo-actuated Fabry–Pérot interferometer (FPI) based hyperspectral imager, a specially designed LED module and several sizes of stray light protection cones for reaching and adapting to the complex skin surfaces. The imager is designed for the needs of photometric stereo imaging for providing the skin surface models (3D) for each captured wavelength. The captured HS images contained 33 selected wavelengths (ranging from 477 nm to 891 nm), which were captured simultaneously with accordingly selected LEDs and three specific angles of light. The pre-test results show that the data collected with the new SICSURFIS imager enable the use of the spectral and spatial domains with surface model information. The imager can reach complex skin surfaces. Healthy skin, basal cell carcinomas and intradermal nevi lesions were classified and delineated pixel-wise with promising results, but further studies are needed. The results were obtained with a convolutional neural network.
Collapse
Affiliation(s)
- Anna-Maria Raita-Hakola
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
- Correspondence:
| | - Leevi Annala
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| | - Vivian Lindholm
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (V.L.); (A.R.)
| | - Roberts Trops
- VTT Technical Research Centre of Finland Ltd., 02150 Espoo, Finland; (R.T.); (A.N.); (H.S.)
| | - Antti Näsilä
- VTT Technical Research Centre of Finland Ltd., 02150 Espoo, Finland; (R.T.); (A.N.); (H.S.)
| | - Heikki Saari
- VTT Technical Research Centre of Finland Ltd., 02150 Espoo, Finland; (R.T.); (A.N.); (H.S.)
| | - Annamari Ranki
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (V.L.); (A.R.)
| | - Ilkka Pölönen
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| |
Collapse
|
25
|
Lindholm V, Raita-Hakola AM, Annala L, Salmivuori M, Jeskanen L, Saari H, Koskenmies S, Pitkänen S, Pölönen I, Isoherranen K, Ranki A. Differentiating Malignant from Benign Pigmented or Non-Pigmented Skin Tumours-A Pilot Study on 3D Hyperspectral Imaging of Complex Skin Surfaces and Convolutional Neural Networks. J Clin Med 2022; 11:1914. [PMID: 35407522 PMCID: PMC8999463 DOI: 10.3390/jcm11071914] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2022] [Accepted: 03/28/2022] [Indexed: 02/08/2023] Open
Abstract
Several optical imaging techniques have been developed to ease the burden of skin cancer disease on our health care system. Hyperspectral images can be used to identify biological tissues by their diffuse reflected spectra. In this second part of a three-phase pilot study, we used a novel hand-held SICSURFIS Spectral Imager with an adaptable field of view and target-wise selectable wavelength channels to provide detailed spectral and spatial data for lesions on complex surfaces. The hyperspectral images (33 wavelengths, 477-891 nm) provided photometric data through individually controlled illumination modules, enabling convolutional networks to utilise spectral, spatial, and skin-surface models for the analyses. In total, 42 lesions were studied: 7 melanomas, 13 pigmented and 7 intradermal nevi, 10 basal cell carcinomas, and 5 squamous cell carcinomas. All lesions were excised for histological analyses. A pixel-wise analysis provided map-like images and classified pigmented lesions with a sensitivity of 87% and a specificity of 93%, and 79% and 91%, respectively, for non-pigmented lesions. A majority voting analysis, which provided the most probable lesion diagnosis, diagnosed 41 of 42 lesions correctly. This pilot study indicates that our non-invasive hyperspectral imaging system, which involves shape and depth data analysed by convolutional neural networks, is feasible for differentiating between malignant and benign pigmented and non-pigmented skin tumours, even on complex skin surfaces.
Collapse
Affiliation(s)
- Vivian Lindholm
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Anna-Maria Raita-Hakola
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| | - Leevi Annala
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| | - Mari Salmivuori
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Leila Jeskanen
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Heikki Saari
- VTT Technical Research Centre of Finland, 02150 Espoo, Finland;
| | - Sari Koskenmies
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Sari Pitkänen
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Ilkka Pölönen
- Faculty of Information Technology, University of Jyväskylä, 40100 Jyväskylä, Finland; (L.A.); (I.P.)
| | - Kirsi Isoherranen
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| | - Annamari Ranki
- Department of Dermatology and Allergology, University of Helsinki and Helsinki University Hospital, 00290 Helsinki, Finland; (M.S.); (L.J.); (S.K.); (S.P.); (K.I.); (A.R.)
| |
Collapse
|
26
|
Multiclass Skin Lesion Classification Using a Novel Lightweight Deep Learning Framework for Smart Healthcare. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12052677] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Skin lesion classification has recently attracted significant attention. Regularly, physicians take much time to analyze the skin lesions because of the high similarity between these skin lesions. An automated classification system using deep learning can assist physicians in detecting the skin lesion type and enhance the patient’s health. The skin lesion classification has become a hot research area with the evolution of deep learning architecture. In this study, we propose a novel method using a new segmentation approach and wide-ShuffleNet for skin lesion classification. First, we calculate the entropy-based weighting and first-order cumulative moment (EW-FCM) of the skin image. These values are used to separate the lesion from the background. Then, we input the segmentation result into a new deep learning structure wide-ShuffleNet and determine the skin lesion type. We evaluated the proposed method on two large datasets: HAM10000 and ISIC2019. Based on our numerical results, EW-FCM and wide-ShuffleNet achieve more accuracy than state-of-the-art approaches. Additionally, the proposed method is superior lightweight and suitable with a small system like a mobile healthcare system.
Collapse
|
27
|
Anushree U, Shetty S, Kumar R, Bharati S. Adjunctive Diagnostic Methods for Skin Cancer Detection: A Review of Electrical Impedance-Based Techniques. Bioelectromagnetics 2022; 43:193-210. [PMID: 35181899 DOI: 10.1002/bem.22396] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Revised: 12/06/2021] [Accepted: 02/04/2022] [Indexed: 12/15/2022]
Abstract
Skin cancer is among the fastest-growing cancers with an excellent prognosis, if detected early. However, the current method of diagnosis by visual inspection has several disadvantages such as overlapping tumor characteristics, subjectivity, low sensitivity, and specificity. Hence, several adjunctive diagnostic techniques such as thermal imaging, optical imaging, ultrasonography, tape stripping methods, and electrical impedance imaging are employed along with visual inspection to improve the diagnosis. Electrical impedance-based skin cancer detection depends upon the variations in electrical impedance characteristics of the transformed cells. The information provided by this technique is fundamentally different from other adjunctive techniques and thus has good prospects. Depending on the stage, type, and location of skin cancer, various impedance-based devices have been developed. These devices when used as an adjunct to visual methods have increased the sensitivity and specificity of skin cancer detection up to 100% and 87%, respectively, thus demonstrating their potential to minimize unnecessary biopsies. In this review, the authors track the advancements and progress made in this technique for the detection of skin cancer, focusing mainly on the advantages and limitations in the clinical setting. © 2022 Bioelectromagnetics Society.
Collapse
Affiliation(s)
- U Anushree
- Department of Nuclear Medicine, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Sachin Shetty
- Department of Nuclear Medicine, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Rajesh Kumar
- Department of Nuclear Medicine, All India Institute of Medical Sciences, Jodhpur, Rajasthan, India
| | - Sanjay Bharati
- Department of Nuclear Medicine, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal, Karnataka, India
| |
Collapse
|
28
|
Kuzmina I, Oshina I, Dambite L, Lukinsone V, Maslobojeva A, Berzina A, Spigulis J. Skin chromophore mapping by smartphone RGB camera under spectral band and spectral line illumination. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:JBO-210361GR. [PMID: 35191236 PMCID: PMC8860175 DOI: 10.1117/1.jbo.27.2.026004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Accepted: 01/26/2022] [Indexed: 05/05/2023]
Abstract
SIGNIFICANCE Multispectral imaging enables mapping of chromophore content changes in skin neoplasms, which helps to diagnose a pathology. Different types of light sources can be used for the imaging. Design of laser-based illuminators is more complicated and, consequently, they are more expensive than LED-based illuminators. On the other hand, spectral line illumination has the advantage of less complicated calculations, since only the discrete maximum wavelengths need to be considered. Spectral band and spectral line approaches for multispectral skin diagnostics have not been compared so far. This can help to evaluate the accuracy and effectiveness of both approaches. AIM To compare two specific illumination modalities-spectral band and spectral line illumination-from the point of performance for mapping of in vivo skin chromophores. APPROACH Three spectral images of the same skin malformations were captured by a smartphone RGB camera with two different add-on illuminators comprising LED emitters and laser emitters, respectively. Five types of benign skin neoplasms were included in our study. Concentrations of skin melanin, oxy- and deoxy-hemoglobin at image pixel groups were calculated using the Beer-Lambert law. RESULTS Skin chromophore maps and statistical analysis of mean concentrations' changes in the neoplasms compared to the surrounding skin are presented and discussed. The data of the laser emitters led to significantly higher (∼10 times) increase of the oxy-hemoglobin values in vascular neoplasms and much lower deoxy-hemoglobin values, if compared to the data obtained by the LED emitters. CONCLUSIONS Analysis of the obtained chromophore distribution maps and concentration variations in neoplasms led to conclusion that the spectral line illumination approach is more appropriate for this application. Considering only the peak wavelengths of illumination spectral bands leads to essentially different results if compared to those obtained by spectral line illumination and may cause misinterpretations in the clinical assessment of skin neoplasms.
Collapse
Affiliation(s)
- Ilona Kuzmina
- University of Latvia, Institute of Atomic Physics and Spectroscopy, Biophotonics Laboratory, Riga, Latvia
- Address all correspondence to Ilona Kuzmina,
| | - Ilze Oshina
- University of Latvia, Institute of Atomic Physics and Spectroscopy, Biophotonics Laboratory, Riga, Latvia
| | - Laura Dambite
- University of Latvia, Institute of Atomic Physics and Spectroscopy, Biophotonics Laboratory, Riga, Latvia
| | - Vanesa Lukinsone
- University of Latvia, Institute of Atomic Physics and Spectroscopy, Biophotonics Laboratory, Riga, Latvia
| | - Anna Maslobojeva
- University of Latvia, Institute of Atomic Physics and Spectroscopy, Biophotonics Laboratory, Riga, Latvia
| | - Anna Berzina
- University of Latvia, Institute of Atomic Physics and Spectroscopy, Biophotonics Laboratory, Riga, Latvia
- The Clinic of Laser Plastics, Riga, Latvia
| | - Janis Spigulis
- University of Latvia, Institute of Atomic Physics and Spectroscopy, Biophotonics Laboratory, Riga, Latvia
| |
Collapse
|
29
|
Abstract
The healing power of light has attracted interest for thousands of years. Scientific discoveries and technological advancements in the field have eventually led to the emergence of photodynamic therapy, which soon became a promising approach in treating a broad range of diseases. Based on the interaction between light, molecular oxygen, and various photosensitizers, photodynamic therapy represents a non-invasive, non-toxic, repeatable procedure for tumor treatment, wound healing, and pathogens inactivation. However, classic photosensitizing compounds impose limitations on their clinical applications. Aiming to overcome these drawbacks, nanotechnology came as a solution for improving targeting efficiency, release control, and solubility of traditional photosensitizers. This paper proposes a comprehensive path, starting with the photodynamic therapy mechanism, evolution over the years, integration of nanotechnology, and ending with a detailed review of the most important applications of this therapeutic approach.
Collapse
|