1
|
Jütte L, González-Villà S, Quintana J, Steven M, Garcia R, Roth B. Integrating generative AI with ABCDE rule analysis for enhanced skin cancer diagnosis, dermatologist training and patient education. Front Med (Lausanne) 2024; 11:1445318. [PMID: 39421873 PMCID: PMC11484268 DOI: 10.3389/fmed.2024.1445318] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Accepted: 09/25/2024] [Indexed: 10/19/2024] Open
Abstract
Significance The early detection and accurate monitoring of suspicious skin lesions are critical for effective dermatological diagnosis and treatment, particularly for reliable identification of the progression of nevi to melanoma. The traditional diagnostic framework, the ABCDE rule, provides a foundation for evaluating lesion characteristics by visual examination using dermoscopes. Simulations of skin lesion progression could improve the understanding of melanoma growth patterns. Aim This study aims to enhance lesion analysis and understanding of lesion progression by providing a simulated potential progression of nevi into melanomas. Approach The study generates a dataset of simulated lesion progressions, from nevi to simulated melanoma, based on a Cycle-Consistent Adversarial Network (Cycle-GAN) and frame interpolation. We apply an optical flow analysis to the generated dermoscopic image sequences, enabling the quantification of lesion transformation. In parallel, we evaluate changes in ABCDE rule metrics as example to assess the simulated evolution. Results We present the first simulation of nevi progressing into simulated melanoma counterparts, consisting of 152 detailed steps. The ABCDE rule metrics correlate with the simulation in a natural manner. For the seven samples studied, the asymmetry metric increased by an average of 19%, the border gradient metric increased by an average of 63%, the convexity metric decreased by an average of 3%, the diameter increased by an average of 2%, and the color dispersion metric increased by an average of 45%. The diagnostic value of the ABCDE rule is enhanced through the addition of insights based on optical flow. The outward expansion of lesions, as captured by optical flow vectors, correlates strongly with the expected increase in diameter, confirming the simulation's fidelity to known lesion growth patterns. The heatmap visualizations further illustrate the degree of change within lesions, offering an intuitive visual proxy for lesion evolution. Conclusion The achieved simulations of potential lesion progressions could facilitate improved early detection and understanding of how lesions evolve. By combining the optical flow analysis with the established criteria of the ABCDE rule, this study presents a significant advancement in dermatoscopic diagnostics and patient education. Future research will focus on applying this integrated approach to real patient data, with the aim of enhancing the understanding of lesion progression and the personalization of dermatological care.
Collapse
Affiliation(s)
- Lennart Jütte
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | | | | | - Martin Steven
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | - Rafael Garcia
- Institute of Computer Vision and Robotics Research, Universitat de Girona, Girona, Spain
| | - Bernhard Roth
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
- Cluster of Excellence PhoenixD, Leibniz University Hannover, Hannover, Germany
| |
Collapse
|
2
|
Jütte L, Patel H, Roth B. Improved polarimetric analysis of human skin through stitching: advantages, limitations, and applications in dermatology. Biomed Phys Eng Express 2023; 10:015007. [PMID: 37988749 DOI: 10.1088/2057-1976/ad0e87] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 11/21/2023] [Indexed: 11/23/2023]
Abstract
Polarimetry is a powerful tool for the analysis of the optical properties of materials and systems, such as human skin. However, in many polarimetric setups, the field of view is limited to a few square centimeters. In these cases, it is possible to resort to stitching techniques, which involve combining multiple Mueller matrix measurements obtained from different overlapping regions of the sample. In this paper, we propose a stitching technique for polarimetric data and discuss its advantages and limitations. We also describe the potential of image stitching for improving the accuracy and robustness ofin vivopolarimetry in the presence of random patient movement. We conducted our research using a diverse set of samples which included porcine skin, human skin from arms and fingers, cold cuts of chicken and gelatine, alongside synthetically created sample data. Our results demonstrate the effectiveness of this technique for the application in dermatology. Each additionalin vivomeasurement enhances the field of view by approximately one third, thereby considerably augmenting the total observation area. We show that stitching enables for the polarimetric assessment of large skin patches which is useful for the diagnosis of inflammatory skin diseases.
Collapse
Affiliation(s)
- Lennart Jütte
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | - Harshkumar Patel
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | - Bernhard Roth
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
- PhoenixD, Leibniz University Hannover, Hannover, Germany
| |
Collapse
|
3
|
Jütte L, Roth B. Mueller Matrix Microscopy for In Vivo Scar Tissue Diagnostics and Treatment Evaluation. SENSORS (BASEL, SWITZERLAND) 2022; 22:9349. [PMID: 36502051 PMCID: PMC9740816 DOI: 10.3390/s22239349] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 11/28/2022] [Accepted: 11/30/2022] [Indexed: 06/17/2023]
Abstract
Scars usually do not show strong contrast under standard skin examination relying on dermoscopes. They usually develop after skin injury when the body repairs the damaged tissue. In general, scars cause multiple types of distress such as movement restrictions, pain, itchiness and the psychological impact of the associated cosmetic disfigurement with no universally successful treatment option available at the moment. Scar treatment has significant economic impact as well. Mueller matrix polarimetry with integrated autofocus and automatic data registration can potentially improve scar assessment by the dermatologist and help to make the evaluation of the treatment outcome objective. Polarimetry can provide new physical parameters for an objective treatment evaluation. We show that Mueller matrix polarimetry can enable strong contrast for in vivo scar imaging. Additionally, our results indicate that the polarization stain images obtained form there could be a useful tool for dermatology. Furthermore, we demonstrate that polarimetry can be used to monitor wound healing, which may help prevent scarring altogether.
Collapse
Affiliation(s)
- Lennart Jütte
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Nienburger Straße 17, 30167 Hannover, Germany
| | - Bernhard Roth
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Nienburger Straße 17, 30167 Hannover, Germany
- Cluster of Excellence PhoenixD (Photonics, Optics and Engineering—Innovation Across Disciplines), Welfengarten 1A, 30167 Hannover, Germany
| |
Collapse
|
4
|
Tailoring the V-Model for Optics: A Methodology for Optomechatronic Systems. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12157798] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
The integration of optical technologies into once purely mechatronic systems enables innovative functions, but simultaneously increases the complexity of previous mechatronic system development. Therefore, a process has been elaborated to develop these so-called optomechatronic systems by Knöchelmann at the Institute of Product Development at Leibniz University Hanover, which is based on the V-Model of VDI 2206 and can be applied to various fields of application. For a target-oriented development in a specific product context and for systems with competing main requirements, detailing and adapting the process is recommended. High-resolution lighting systems are one of them, where requirements for high optical efficiency and image quality lead to a conflict of objectives. Focusing on the optics domain, Ley elaborated methods for the preliminary and detailed design of high-resolution lighting systems to address the aforementioned conflict of objectives. This contribution focuses on the integration of Ley’s design methods into Knöchelmann’s process model within the phases of system design and domain-specific design, allowing us to analyze the impact of the system design on the fulfillment of main requirements to achieve an optimal solution of the conflict of objectives. To illustrate this, the integrated process model is described using an example from automotive lighting technology.
Collapse
|
5
|
Jütte L, Sharma G, Patel H, Roth B. Registration of polarimetric images for in vivo skin diagnostics. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:096001. [PMID: 36042549 PMCID: PMC9424913 DOI: 10.1117/1.jbo.27.9.096001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Accepted: 08/12/2022] [Indexed: 06/15/2023]
Abstract
SIGNIFICANCE Mueller matrix (MM) polarimetry is a promising tool for the detection of skin cancer. Polarimetric in vivo measurements often suffer from misalignment of the polarimetric images due to motion, which can lead to false results. AIM We aim to provide an easy-to-implement polarimetric image data registration method to ensure proper image alignment. APPROACH A feature-based image registration is implemented for an MM polarimeter for phantom and in vivo human skin measurements. RESULTS We show that the keypoint-based registration of polarimetric images is necessary for in vivo skin polarimetry to ensure reliable results. Further, we deliver an efficient semiautomated method for the registration of polarimetric images. CONCLUSIONS Image registration for in vivo polarimetry of human skin is required for improved diagnostics and can be efficiently enhanced with a keypoint-based approach.
Collapse
Affiliation(s)
- Lennart Jütte
- Leibniz University Hannover, Hannover Centre for Optical Technologies, Hannover, Germany
| | - Gaurav Sharma
- Leibniz University Hannover, Hannover Centre for Optical Technologies, Hannover, Germany
| | - Harshkumar Patel
- Leibniz University Hannover, Hannover Centre for Optical Technologies, Hannover, Germany
| | - Bernhard Roth
- Leibniz University Hannover, Hannover Centre for Optical Technologies, Hannover, Germany
- Leibniz University Hannover, Cluster of Excellence PhoenixD, Hannover, Germany
| |
Collapse
|
6
|
Fricke D, Becker A, Heratizadeh A, Knigge S, Jütte L, Wollweber M, Werfel T, Roth BW, Glasmacher B. Mueller Matrix Analysis of Collagen and Gelatin Containing Samples Towards More Objective Skin Tissue Diagnostics. Polymers (Basel) 2020; 12:polym12061400. [PMID: 32580462 PMCID: PMC7361993 DOI: 10.3390/polym12061400] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2020] [Revised: 06/16/2020] [Accepted: 06/19/2020] [Indexed: 11/19/2022] Open
Abstract
Electrospun polycaprolactone:gelatin (PCL:GT) fibre scaffolds are widely employed in the field of tissue implants. Here, the orientation of fibres plays an important role in regard to implantation due to the impact on the mechanical properties. Likewise, the orientation of collagen fibres in skin tissue is relevant for dermatology. State-of-the-art fibre orientation measurement methods like electron microscopy are time consuming and destructive. In this work, we demonstrate polarimetry as a non-invasive approach and evaluate its potential by measuring the Mueller matrix (MM) of gelatin and collagen containing samples as simple skin tissue phantoms. We demonstrate that it is possible to determine the orientation of PCL:GT fibre scaffolds within one MM measurement. Furthermore, we determine the structural orientation in collagen film samples. Currently, the diagnosis of skin diseases is often performed by image analysis or histopathology respectively, which are either subjective or invasive. The method presented, here, provides an interesting alternative approach for such investigations. Our findings indicate that the orientation of collagen fibres within skin lesions might be detectable by MM measurements in the future, which is of interest for skin diagnostics, and will be further investigated during the next step.
Collapse
Affiliation(s)
- Dierk Fricke
- Hannover Centre for Optical Technologies (HOT), Leibniz University Hannover, 30167 Hannover, Germany; (L.J.); (M.W.); (B.W.R.)
- Correspondence:
| | - Alexander Becker
- Institute for Multiphase Processes (IMP), Leibniz University Hannover, 30167 Hannover, Germany; (A.B.); (S.K.); (B.G.)
- Implant Research and Development (NIFE), Lower Saxony Centre for Biomedical Engineering, 30625 Hannover, Germany
| | - Annice Heratizadeh
- Hannover Medical School, Department of Dermatology and Allergy, 30625 Hannover, Germany; (A.H.); (T.W.)
| | - Sara Knigge
- Institute for Multiphase Processes (IMP), Leibniz University Hannover, 30167 Hannover, Germany; (A.B.); (S.K.); (B.G.)
- Implant Research and Development (NIFE), Lower Saxony Centre for Biomedical Engineering, 30625 Hannover, Germany
| | - Lennart Jütte
- Hannover Centre for Optical Technologies (HOT), Leibniz University Hannover, 30167 Hannover, Germany; (L.J.); (M.W.); (B.W.R.)
| | - Merve Wollweber
- Hannover Centre for Optical Technologies (HOT), Leibniz University Hannover, 30167 Hannover, Germany; (L.J.); (M.W.); (B.W.R.)
- Laser Zentrum Hannover e.V., 30419 Hannover, Germany
| | - Thomas Werfel
- Hannover Medical School, Department of Dermatology and Allergy, 30625 Hannover, Germany; (A.H.); (T.W.)
| | - Bernhard Wilhelm Roth
- Hannover Centre for Optical Technologies (HOT), Leibniz University Hannover, 30167 Hannover, Germany; (L.J.); (M.W.); (B.W.R.)
- Cluster of Excellence PhoenixD, Leibniz University Hannover, 30167 Hannover, Germany
| | - Birgit Glasmacher
- Institute for Multiphase Processes (IMP), Leibniz University Hannover, 30167 Hannover, Germany; (A.B.); (S.K.); (B.G.)
- Implant Research and Development (NIFE), Lower Saxony Centre for Biomedical Engineering, 30625 Hannover, Germany
| |
Collapse
|
7
|
Image Quality Assessment of Digital Image Capturing Devices for Melanoma Detection. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10082876] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
The fast-growing incidence of skin cancer, especially melanoma, is the guiding principle for intense development of various digital image-capturing devices providing easier recognition of melanoma by dermatologists. Handheld and digital dermoscopy, following of mole changes with smartphones and digital analysing of mole images, is based on evaluation of the colours, shape and deep structures in the skin moles. Incorrect colour information of an image, under- or overexposed images, lack of sharpness and low resolution of the images, can lead to melanoma misdiagnosis. The purpose of our study was to determine the colour error in the image according to the given lighting conditions and different camera settings. We focused on measuring the image quality parameters of smartphones and high-resolution cameras to compare them with the results of state-of-the-art dermoscopy device systems. We applied standardised measuring methods. The spatial frequency response method was applied for measuring the sharpness and resolution of the tested camera systems. Colour images with known reference values were captured from the test target, to evaluate colour error as a CIELAB (Commission Internationale de l’Eclairage) ΔE*ab colour difference as seen by a human observer. The results of our measurements yielded two significant findings. First, all tested cameras produced inaccurate colours when operating in automatic mode, and second, the amount of sharpening was too intensive. These deficiencies can be eliminated through adjusting the camera parameters manually or by image post-production. The presented two-step camera calibration procedure improves the colour accuracy of captured clinical and dermoscopy images significantly.
Collapse
|
8
|
Mueller Matrix Measurement of Electrospun Fiber Scaffolds for Tissue Engineering. Polymers (Basel) 2019; 11:polym11122062. [PMID: 31835798 PMCID: PMC6960730 DOI: 10.3390/polym11122062] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2019] [Revised: 11/28/2019] [Accepted: 12/09/2019] [Indexed: 12/29/2022] Open
Abstract
Electrospun fiber scaffolds are gaining in importance in the area of tissue engineering. They can be used, for example, to fabricate graded implants to mimic the tendon bone junction. For the grading of the tensile strength of the fiber scaffolds, the orientation of the fibers plays a major role. This is currently measured by hand in scanning electron microscope (SEM) images. In this work, a correlation between polarimetric information generated by measuring the Mueller matrix (MM) and the orientation of the fibers of electrospun fiber scaffolds is reported. For this, the MM of fiber scaffolds, which were manufactured with different production parameters, was measured and analyzed. These data were correlated with fiber orientation and mechanical properties, which were evaluated in an established manner. We found that by measurement of the MM the production parameters as well as the relative orientation of the fibers in space can be determined. Thus, the MM measurement is suitable as an alternative tool for non-contact, non-destructive determination of the production parameters and, thus, the degree of alignment of electrospun fiber scaffolds.
Collapse
|
9
|
Heratizadeh A, Fricke D, Meinhardt-Wollweber M, Roth B, Werfel T. Non-contact remote digital dermoscopy - new perspectives on differential diagnosis of inflammatory skin diseases. J Eur Acad Dermatol Venereol 2019; 34:e125-e126. [PMID: 31710132 DOI: 10.1111/jdv.16056] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Affiliation(s)
- A Heratizadeh
- Division of Immunodermatology and Allergy Research, Department of Dermatology and Allergy, Hannover Medical School, Hannover, Germany
| | - D Fricke
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | - M Meinhardt-Wollweber
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | - B Roth
- Hannover Centre for Optical Technologies, Leibniz University Hannover, Hannover, Germany
| | - T Werfel
- Division of Immunodermatology and Allergy Research, Department of Dermatology and Allergy, Hannover Medical School, Hannover, Germany
| |
Collapse
|