Hyperspectral imaging enabled by an unmodified smartphone for analyzing skin morphological features and monitoring hemodynamics

A proof of concept for microcirculation monitoring using machine learning based hyperspectral imaging in critically ill patients: a monocentric observational study

BACKGROUND

Impaired microcirculation is a cornerstone of sepsis development and leads to reduced tissue oxygenation, influenced by fluid and catecholamine administration during treatment. Hyperspectral imaging (HSI) is a non-invasive bedside technology for visualizing physicochemical tissue characteristics. Machine learning (ML) for skin HSI might offer an automated approach for bedside microcirculation assessment, providing an individualized tissue fingerprint of critically ill patients in intensive care. The study aimed to determine if machine learning could be utilized to automatically identify regions of interest (ROIs) in the hand, thereby distinguishing between healthy individuals and critically ill patients with sepsis using HSI.

METHODS

HSI raw data from 75 critically ill sepsis patients and from 30 healthy controls were recorded using TIVITA® Tissue System and analyzed using an automated ML approach. Additionally, patients were divided into two groups based on their SOFA scores for further subanalysis: less severely ill (SOFA ≤ 5) and severely ill (SOFA > 5). The analysis of the HSI raw data was fully-automated using MediaPipe for ROI detection (palm and fingertips) and feature extraction. HSI Features were statistically analyzed to highlight relevant wavelength combinations using Mann-Whitney-U test and Benjamini, Krieger, and Yekutieli (BKY) correction. In addition, Random Forest models were trained using bootstrapping, and feature importances were determined to gain insights regarding the wavelength importance for a model decision.

RESULTS

An automated pipeline for generating ROIs and HSI feature extraction was successfully established. HSI raw data analysis accurately distinguished healthy controls from sepsis patients. Wavelengths at the fingertips differed in the ranges of 575-695 nm and 840-1000 nm. For the palm, significant differences were observed in the range of 925-1000 nm. Feature importance plots indicated relevant information in the same wavelength ranges. Combining palm and fingertip analysis provided the highest reliability, with an AUC of 0.92 to distinguish between sepsis patients and healthy controls.

CONCLUSION

Based on this proof of concept, the integration of automated and standardized ROIs along with automated skin HSI analyzes, was able to differentiate between healthy individuals and patients with sepsis. This approach offers a reliable and objective assessment of skin microcirculation, facilitating the rapid identification of critically ill patients.

Learning to Recover Spectral Reflectance From RGB Images

This paper tackles spectral reflectance recovery (SRR) from RGB images. Since capturing ground-truth spectral reflectance and camera spectral sensitivity are challenging and costly, most existing approaches are trained on synthetic images and utilize the same parameters for all unseen testing images, which are suboptimal especially when the trained models are tested on real images because they never exploit the internal information of the testing images. To address this issue, we adopt a self-supervised meta-auxiliary learning (MAXL) strategy that fine-tunes the well-trained network parameters with each testing image to combine external with internal information. To the best of our knowledge, this is the first work that successfully adapts the MAXL strategy to this problem. Instead of relying on naive end-to-end training, we also propose a novel architecture that integrates the physical relationship between the spectral reflectance and the corresponding RGB images into the network based on our mathematical analysis. Besides, since the spectral reflectance of a scene is independent to its illumination while the corresponding RGB images are not, we recover the spectral reflectance of a scene from its RGB images captured under multiple illuminations to further reduce the unknown. Qualitative and quantitative evaluations demonstrate the effectiveness of our proposed network and of the MAXL. Our code and data are available at https://github.com/Dong-Huo/SRR-MAXL.

Diffuse transmittance visible spectroscopy using smartphone flashlight for photoplethysmography and vital signs measurements

Photoplethysmography (PPG), with its wide range of applications, has become one of the most promising modalities for healthcare monitoring technology. In this work, we present a new PPG measurement technique based on diffuse transmittance spectroscopy (DTS) with the help of a smartphone built-in flashlight as an alternative broadband light source. The blood Volume Pulse (BVP) signal was extracted from recorded transmittance spectra at 620 nm. The results were compared with the ground truth and conventional contact finger PPG sensors. A very high correlation was found between the diffuse transmittance signal and the reference PPG signals (r = 0.997, p < 0.0001). The accuracy and root mean square error (RMSE) were 99.23% and 0.8 bpm, respectively. In addition, a Bland-Altman analysis showed a good agreement between both techniques, with a very small bias between mean paired differences of heart rate observations. A simple forward model for diffuse transmittance spectra for different levels of blood oxygen saturation is developed and supported by experimental measurements. It was also found that blood oxygen saturation (SpO2) can be estimated with the aid of DTS based smartphone flash by tracking the wavelength corresponding to the oxygenation level in the visible range between orange and red regions of the visible spectrum particularly in the range between 610 and 635 nm for 26 healthy subjects. 624 nm on average seems to be the wavelength that corresponds with the normal blood oxygenation level. These findings show the potential of DTS PPG to reliably extract cardiac frequency and estimate SpO2 with adequate accuracy. The results also demonstrate the capability of smartphone flash as a miniature visible light source for recording multispectral PPG signals and quantifying vital signs in the transmission mode at the fingertip with acceptable signal quality over a wide range of wavelengths from 550 nm to 650 nm.

Optical imaging technologies for in vivo cancer detection in low-resource settings

Cancer continues to affect underserved populations disproportionately. Novel optical imaging technologies, which can provide rapid, non-invasive, and accurate cancer detection at the point of care, have great potential to improve global cancer care. This article reviews the recent technical innovations and clinical translation of low-cost optical imaging technologies, highlighting the advances in both hardware and software, especially the integration of artificial intelligence, to improve in vivo cancer detection in low-resource settings. Additionally, this article provides an overview of existing challenges and future perspectives of adapting optical imaging technologies into clinical practice, which can potentially contribute to novel insights and programs that effectively improve cancer detection in low-resource settings.

SpeCamX: mobile app that turns unmodified smartphones into multispectral imagers

We present the development of SpeCamX, a mobile application that enables an unmodified smartphone into a multispectral imager. Multispectral imaging provides detailed spectral information about objects or scenes, but its accessibility has been limited due to its specialized requirements for the device. SpeCamX overcomes this limitation by utilizing the RGB photographs captured by smartphones and converting them into multispectral images spanning a range of 420 to 680 nm without a need for internal modifications or external attachments. The app also includes plugin functions for extracting medical information from the resulting multispectral data cube. In a clinical study, SpeCamX was used to implement an augmented smartphone bilirubinometer, predicting blood bilirubin levels (BBL) with superior performance in accuracy, efficiency and stability compared to default smartphone cameras. This innovative technology democratizes multispectral imaging, making it accessible to a wider audience and opening new possibilities for both medical and non-medical applications.

Analysis of facial redness by comparing VISIA and YLGTD

BACKGROUND

Erythema, characterized by redness of the skin, is a common symptom in various facial skin conditions. Recent advancements in image processing and analysis techniques have led to the development of methods for analyzing and assessing skin texture. This study aimed to investigate the correlation between the parameters of "You Look Good Today" (YLGTD) and VISIA in the detection and assessment of facial redness.

MATERIALS AND METHODS

Thirty female subjects participated in this experiment, undergoing assessments using both YLGTD and VISIA. The subjects were evaluated for facial redness, and the feature count results within the red zone were measured by VISIA. YLGTD analyzed the number and percentage of red zone pixels. The assessments were conducted between [specific dates] in [location].

RESULTS

The results demonstrated a significant positive correlation between the feature count results within the red zone measured by VISIA and the number of red zone pixels. Similarly, YLGTD exhibited a significant positive correlation with the number and percentage of red zone pixels.

CONCLUSION

In conclusion, our findings suggest a correlation between YLGTD and VISIA in the measurement of facial erythema. YLGTD can serve as a portable device for primary screening assessments, offering a convenient and reliable method to evaluate facial redness. This research contributes to the development of non-invasive techniques for assessing and monitoring facial skin conditions, providing valuable insights for dermatological diagnosis and cosmetic testing.

SmartOCT: smartphone-integrated optical coherence tomography

Smartphone devices have seen unprecedented technical innovation in computational power and optical imaging capabilities, making them potentially invaluable tools in scientific imaging applications. The smartphone's compact form-factor and broad accessibility has motivated researchers to develop smartphone-integrated imaging systems for a wide array of applications. Optical coherence tomography (OCT) is one such technique that could benefit from smartphone-integration. Here, we demonstrate smartOCT, a smartphone-integrated OCT system that leverages built-in components of a smartphone for detection, processing and display of OCT data. SmartOCT uses a broadband visible-light source and line-field OCT design that enables snapshot 2D cross-sectional imaging. Furthermore, we describe methods for processing smartphone data acquired in a RAW data format for scientific applications that improves the quality of OCT images. The results presented here demonstrate the potential of smartphone-integrated OCT systems for low-resource environments.

Evaluation of the Reduction of Skin Hyperpigmentation Changes under the Influence of a Preparation Containing Kojic Acid Using Hyperspectral Imaging—Preliminary Study

Aim: The aim of this study was to demonstrate the effects of using a preparation containing kojic acid on skin hyperpigmentation using hyperspectral imaging, which enables a quantitative assessment of the effect of the preparation used on the reduction of skin discoloration. Materials and methods: Preliminary studies were carried out on 12 patients with post-acne skin. A hyperspectral camera with a spectral range of 400–1000 nm was used to image skin hyperpigmentation before and after the application of 3% kojic acid. Hyperspectral profiles were analyzed, and image analysis and processing methods were applied. Results: Studies performed using a hyperspectral camera have shown that kojic acid reduces skin discoloration by increasing skin brightness in 75% of patients tested, reducing skin contrast in approximately 83% and increasing skin homogeneity in approximately 67% of patients.

mHealth hyperspectral learning for instantaneous spatiospectral imaging of hemodynamics

Hyperspectral imaging acquires data in both the spatial and frequency domains to offer abundant physical or biological information. However, conventional hyperspectral imaging has intrinsic limitations of bulky instruments, slow data acquisition rate, and spatiospectral trade-off. Here we introduce hyperspectral learning for snapshot hyperspectral imaging in which sampled hyperspectral data in a small subarea are incorporated into a learning algorithm to recover the hypercube. Hyperspectral learning exploits the idea that a photograph is more than merely a picture and contains detailed spectral information. A small sampling of hyperspectral data enables spectrally informed learning to recover a hypercube from a red-green-blue (RGB) image without complete hyperspectral measurements. Hyperspectral learning is capable of recovering full spectroscopic resolution in the hypercube, comparable to high spectral resolutions of scientific spectrometers. Hyperspectral learning also enables ultrafast dynamic imaging, leveraging ultraslow video recording in an off-the-shelf smartphone, given that a video comprises a time series of multiple RGB images. To demonstrate its versatility, an experimental model of vascular development is used to extract hemodynamic parameters via statistical and deep learning approaches. Subsequently, the hemodynamics of peripheral microcirculation is assessed at an ultrafast temporal resolution up to a millisecond, using a conventional smartphone camera. This spectrally informed learning method is analogous to compressed sensing; however, it further allows for reliable hypercube recovery and key feature extractions with a transparent learning algorithm. This learning-powered snapshot hyperspectral imaging method yields high spectral and temporal resolutions and eliminates the spatiospectral trade-off, offering simple hardware requirements and potential applications of various machine learning techniques.

Compact and ultracompact spectral imagers: technology and applications in biomedical imaging

Significance

Spectral imaging, which includes hyperspectral and multispectral imaging, can provide images in numerous wavelength bands within and beyond the visible light spectrum. Emerging technologies that enable compact, portable spectral imaging cameras can facilitate new applications in biomedical imaging.

Aim

With this review paper, researchers will (1) understand the technological trends of upcoming spectral cameras, (2) understand new specific applications that portable spectral imaging unlocked, and (3) evaluate proper spectral imaging systems for their specific applications.

Approach

We performed a comprehensive literature review in three databases (Scopus, PubMed, and Web of Science). We included only fully realized systems with definable dimensions. To best accommodate many different definitions of "compact," we included a table of dimensions and weights for systems that met our definition.

Results

There is a wide variety of contributions from industry, academic, and hobbyist spaces. A variety of new engineering approaches, such as Fabry-Perot interferometers, spectrally resolved detector array (mosaic array), microelectro-mechanical systems, 3D printing, light-emitting diodes, and smartphones, were used in the construction of compact spectral imaging cameras. In bioimaging applications, these compact devices were used for in vivo and ex vivo diagnosis and surgical settings.

Conclusions

Compact and ultracompact spectral imagers are the future of spectral imaging systems. Researchers in the bioimaging fields are building systems that are low-cost, fast in acquisition time, and mobile enough to be handheld.

Conditional Generative Adversarial Network (cGAN) for Synthesis of Digital Histologic Images from Hyperspectral Images

Hyperspectral imaging (HSI) has been demonstrated in various digital pathology applications. However, the intrinsic high dimensionality of hyperspectral images makes it difficult for pathologists to visualize the information. The aim of this study is to develop a method to transform hyperspectral images of hemoxylin & eosin (H&E)-stained slides to natural-color RGB histologic images for easy visualization. Hyperspectral images were obtained at 40× magnification with an automated microscopic imaging system and downsampled by various factors to generate data equivalent to different magnifications. High-resolution digital histologic RGB images were cropped and registered to the corresponding hyperspectral images as the ground truth. A conditional generative adversarial network (cGAN) was trained to output natural color RGB images of the histological tissue samples. The generated synthetic RGBs have similar color and sharpness to real RGBs. Image classification was implemented using the real and synthetic RGBs, respectively, with a pretrained network. The classification of tumor and normal tissue using the HSI-synthesized RGBs yielded a comparable but slightly higher accuracy and AUC than the real RGBs. The proposed method can reduce the acquisition time of two imaging modalities while giving pathologists access to the high information density of HSI and the quality visualization of RGBs. This study demonstrated that HSI may provide a potentially better alternative to current RGB-based pathologic imaging and thus make HSI a viable tool for histopathological diagnosis.

Heart rate estimation from color video sequences with high SNR

We propose an absorption intensity heartbeat modulation-averaged shifted histogram (AIHM-ASH) method for estimating human heart rate (HR) using color videos of lip image sequences. When heartbeat occurs, AIHM is generated. Based on the AIHM, HR signals can be demodulated by computing the instantaneous HR modulation depth that presents the relative red blood cell (RBC) concentration from the green channel image of the RGB color video. In addition, the ASH algorithm further suppresses the background tissue and vein signals, and increases the signal-to-noise ratio (SNR). The experimental results for flow phantoms, chicken embryos, and human lips validated the proposed method's optimal estimation conditions and effectiveness, where the accuracy and root mean square error (RMSE) were 99.23% and 0.8 bpm, respectively. The proposed HR estimation method has significant potential to advance health monitoring and disease prevention via conventional color video cameras installed in public places.

Inflammatory response: The target for treating hyperpigmentation during the repair of a burn wound

Hyperpigmentation is a common complication in patients with burn injuries during wound healing; however, the mechanisms underlying its occurrence and development remain unclear. Recently, postinflammatory hyperpigmentation (PIH) was found to result from overproduction of melanin. Local or systemic inflammatory responses are often observed in patients who develop hyperpigmentation. However, we lack studies on the relationship between PIH and burn injury. Therefore, we comprehensively reviewed the existing literature on the melanogenesis of the skin, inflammatory mechanisms in pigmentation, and local or systemic alteration in inflammatory cytokines in patients suffering from burn trauma to elucidate the relationship between PIH and burn injury. We believe that this review will guide further research on regulating melanin production in the burn management process.

Three-dimensional optical coherence digital-null deformography of multi-refractive-surface optics with nanometer sensitivity

Knowledge of the lens deformation during the reliability test is critical for lens design and fabrication. Refractive surface distorts the optical path of probing light, and poses a great challenge to measuring the test-induced nanoscale changes of all refractive lens surfaces simultaneously. In this work, we present an optical coherence digital-null deformography (ODD). A digital null, i.e., the interference signals (including intensity and phase) of the backscattered probing light from each lens surface, was recorded prior to the test with a phase-sensitive optical coherence tomography (OCT). Then the post-test lens was physically aligned to the digital null by actuating a hexapod iteratively with a digital null alignment (DNA) method, so that the refractive distortion was matched. Finally, the changes between the aligned lens and its digital null were measured with an intensity centroid shift (ICS) at micron scale and a joint wavenumber (k)-depth (z) domain phase shift (kz-PhS) at nanoscale. We demonstrate that the proposed kz-PhS has a sensitivity of 4.15 nm and a range of 5 µm without phase wrapping; and the sensitivities of DNA are z translation 0.04 µm, x/y translation 0.24 µm, tilt 0.0003°, and rotation 0.03°. A lens drop test was performed with ODD. Circumventing refractive distortion by the null measurement, ODD can visualize the test-induced changes of all refractive surfaces non-destructively and simultaneously, and it will greatly facilitate lens design and fabrication.

Irradiance Independent Spectrum Reconstruction from Camera Signals Using the Interpolation Method

The spectrum of light captured by a camera can be reconstructed using the interpolation method. The reconstructed spectrum is a linear combination of the reference spectra, where the weighting coefficients are calculated from the signals of the pixel and the reference samples by interpolation. This method is known as the look-up table (LUT) method. It is irradiance-dependent due to the dependence of the reconstructed spectrum shape on the sample irradiance. Since the irradiance can vary in field applications, an irradiance-independent LUT (II-LUT) method is required to recover spectral reflectance. This paper proposes an II-LUT method to interpolate the spectrum in the normalized signal space. Munsell color chips irradiated with D65 were used as samples. Example cameras are a tricolor camera and a quadcolor camera. Results show that the proposed method can achieve the irradiance independent spectrum reconstruction and computation time saving at the expense of the recovered spectral reflectance error. Considering that the irradiance variation will introduce additional errors, the actual mean error using the II-LUT method might be smaller than that of the ID-LUT method. It is also shown that the proposed method outperformed the weighted principal component analysis method in both accuracy and computation speed.

RGB camera-based simultaneous measurements of percutaneous arterial oxygen saturation, tissue oxygen saturation, pulse rate, and respiratory rate

We propose a method to perform simultaneous measurements of percutaneous arterial oxygen saturation (SpO₂), tissue oxygen saturation (StO₂), pulse rate (PR), and respiratory rate (RR) in real-time, using a digital red–green–blue (RGB) camera. Concentrations of oxygenated hemoglobin (C_HbO), deoxygenated hemoglobin (C_HbR), total hemoglobin (C_HbT), and StO₂ were estimated from videos of the human face using a method based on a tissue-like light transport model of the skin. The photoplethysmogram (PPG) signals are extracted from the temporal fluctuations in C_HbO, C_HbR, and C_HbT using a finite impulse response (FIR) filter (low and high cut-off frequencies of 0.7 and 3 Hz, respectively). The PR is calculated from the PPG signal for C_HbT. The ratio of pulse wave amplitude for C_HbO and that for C_HbR are associated with the reference value of SpO₂ measured by a commercially available pulse oximeter, which provides an empirical formula to estimate SpO₂ from videos. The respiration-dependent oscillation in C_HbT was extracted from another FIR filter (low and high cut-off frequencies of 0.05 and 0.5 Hz, respectively) and used to calculate the RR. In vivo experiments with human volunteers while varying the fraction of inspired oxygen were performed to evaluate the comparability of the proposed method with commercially available devices. The Bland–Altman analysis showed that the mean bias for PR, RR, SpO₂, and StO₂ were -1.4 (bpm), -1.2(rpm), 0.5 (%), and -3.0 (%), respectively. The precisions for PR, RR, Sp O₂, and StO₂ were ±3.1 (bpm), ±3.5 (rpm), ±4.3 (%), and ±4.8 (%), respectively. The resulting precision and RMSE for StO₂ were pretty close to the clinical accuracy requirement. The accuracy of the RR is considered a little less accurate than clinical requirements. This is the first demonstration of a low-cost RGB camera-based method for contactless simultaneous measurements of the heart rate, percutaneous arterial oxygen saturation, and tissue oxygen saturation in real-time.

Noninvasive hemoglobin sensing and imaging: optical tools for disease diagnosis

SIGNIFICANCE

Measurement and imaging of hemoglobin oxygenation are used extensively in the detection and diagnosis of disease; however, the applied instruments vary widely in their depth of imaging, spatiotemporal resolution, sensitivity, accuracy, complexity, physical size, and cost. The wide variation in available instrumentation can make it challenging for end users to select the appropriate tools for their application and to understand the relative limitations of different methods.

AIM

We aim to provide a systematic overview of the field of hemoglobin imaging and sensing.

APPROACH

We reviewed the sensing and imaging methods used to analyze hemoglobin oxygenation, including pulse oximetry, spectral reflectance imaging, diffuse optical imaging, spectroscopic optical coherence tomography, photoacoustic imaging, and diffuse correlation spectroscopy.

RESULTS

We compared and contrasted the ability of different methods to determine hemoglobin biomarkers such as oxygenation while considering factors that influence their practical application.

CONCLUSIONS

We highlight key limitations in the current state-of-the-art and make suggestions for routes to advance the clinical use and interpretation of hemoglobin oxygenation information.

Imaging-photoplethysmography-guided optical microangiography

We report a method to image facial cutaneous microvascular perfusion using wide-field imaging photoplethysmography (iPPG) and handheld swept-source optical coherence tomography (OCT). The iPPG system employs a 16-bit-depth camera to provide a 2D wide-field blood pulsation map that is then used as a positioning guidance for OCT imaging of cutaneous microvasculature. We show the results from iPPG and OCT to demonstrate the ability of guided imaging of cutaneous microvasculature, which is potentially useful for the assessment of skin conditions in dermatology and cosmetology.

Improved method for spectral reflectance estimation and application to mobile phone cameras

We propose an improved method for estimating surface-spectral reflectance from the image data acquired by an RGB digital camera. We suppose a multispectral image acquisition system in the visible range, where a camera captures multiple images for the scene of an object under multiple light sources. First, the observed image data are described using the camera spectral sensitivities, the surface-spectral reflectance, the illuminant spectral power distributions, an additive noise term, and a gain parameter. Then, the optimal reflectance estimate is determined to minimize the mean-square error between the estimate and the original surface-spectral reflectance. We attempt to further improve the estimation accuracy and develop a novel linear estimator in a more general form than the Wiener estimator. Furthermore, we calibrate the imaging system using a reference standard sample. Finally, experiments are performed to validate the proposed method for estimating the surface-spectral reflectance using different mobile phone cameras.

Camera-based assessment of cutaneous perfusion strength in a clinical setting

Objective. After skin flap transplants, perfusion strength monitoring is essential for the early detection of tissue perfusion disorders and thus to ensure the survival of skin flaps. Camera-based photoplethysmography (cbPPG) is a non-contact measurement method, using video cameras and ambient light, which provides spatially resolved information about tissue perfusion. It has not been researched yet whether the measurement depth of cbPPG, which is limited by the penetration depth of ambient light, is sufficient to reach pulsatile vessels and thus to measure the perfusion strength in regions that are relevant for skin flap transplants.Approach. We applied constant negative pressure (compared to ambient pressure) to the anterior thighs of 40 healthy subjects. Seven measurements (two before and five up to 90 minutes after the intervention) were acquired using an RGB video camera and photospectrometry simultaneously. We investigated the performance of different algorithmic approaches for perfusion strength assessment, including the signal-to-noise ratio (SNR), its logarithmic components logS and logN, amplitude maps, and the amplitude height of alternating and direct signal components.Main results. We found strong correlations of up tor=0.694 (p<0.001) between photospectrometric measurements and all cbPPG parameters except SNR when using the green color channel. The transfer of cbPPG signals to POS, CHROM, and O3C did not lead to systematic improvements. However, for direct signal components, the transformation to O3C led to correlations of up tor=0.744 (p<0.001) with photospectrometric measurements.Significance. Our results indicate that a camera-based perfusion strength assessment in tissue with deep-seated pulsatile vessels is possible.

Skin chromophore mapping by smartphone RGB camera under spectral band and spectral line illumination

SIGNIFICANCE

Multispectral imaging enables mapping of chromophore content changes in skin neoplasms, which helps to diagnose a pathology. Different types of light sources can be used for the imaging. Design of laser-based illuminators is more complicated and, consequently, they are more expensive than LED-based illuminators. On the other hand, spectral line illumination has the advantage of less complicated calculations, since only the discrete maximum wavelengths need to be considered. Spectral band and spectral line approaches for multispectral skin diagnostics have not been compared so far. This can help to evaluate the accuracy and effectiveness of both approaches.

AIM

To compare two specific illumination modalities-spectral band and spectral line illumination-from the point of performance for mapping of in vivo skin chromophores.

APPROACH

Three spectral images of the same skin malformations were captured by a smartphone RGB camera with two different add-on illuminators comprising LED emitters and laser emitters, respectively. Five types of benign skin neoplasms were included in our study. Concentrations of skin melanin, oxy- and deoxy-hemoglobin at image pixel groups were calculated using the Beer-Lambert law.

RESULTS

Skin chromophore maps and statistical analysis of mean concentrations' changes in the neoplasms compared to the surrounding skin are presented and discussed. The data of the laser emitters led to significantly higher (∼10 times) increase of the oxy-hemoglobin values in vascular neoplasms and much lower deoxy-hemoglobin values, if compared to the data obtained by the LED emitters.

CONCLUSIONS

Analysis of the obtained chromophore distribution maps and concentration variations in neoplasms led to conclusion that the spectral line illumination approach is more appropriate for this application. Considering only the peak wavelengths of illumination spectral bands leads to essentially different results if compared to those obtained by spectral line illumination and may cause misinterpretations in the clinical assessment of skin neoplasms.

Hyperspectral Imaging for Clinical Applications

Measuring morphological and biochemical features of tissue is crucial for disease diagnosis and surgical guidance, providing clinically significant information related to pathophysiology. Hyperspectral imaging (HSI) techniques obtain both spatial and spectral features of tissue without labeling molecules such as fluorescent dyes, which provides rich information for improved disease diagnosis and treatment. Recent advances in HSI systems have demonstrated its potential for clinical applications, especially in disease diagnosis and image-guided surgery. This review summarizes the basic principle of HSI and optical systems, deep-learning-based image analysis, and clinical applications of HSI to provide insight into this rapidly growing field of research. In addition, the challenges facing the clinical implementation of HSI techniques are discussed.

A New Framework for Robust Heart Rate Measurement Based on the Head Motion State Estimation

It is of great significance in managing human health, preventing and curing diseases such as heart disease to measure and monitor the physiological parameters accurately and robustly. However, imaging photoplethysmography (iPPG) can be easily affected by the ambient illumination variations or the subject's motions. In this paper, therefore, a novel framework of heart rate (HR) measurement robust to both illumination and motion artefacts is proposed, which combines the projection-plane-switching-based iPPG method (2PS) with the singular spectrum analysis (SSA). Based on the estimation of the head motion state, one reasonable projection plane is firstly determined, the temporally normalized red-green-blue signals are projected onto the plane and a pulse signal is obtained by alpha-tuning. After that, singular spectrum analysis (SSA) is applied to the obtained pulse signal and the normalized B-channel signal of the facial region of interest (ROI) to remove the artefacts remained in the pulse signal. For the self-collected database and the public PURE database, Bland-Altman plots show that the proposed 2PS-SSA has better agreement than the five compared methods, where the mean biases are 0.59 beat per minute (bpm) and 0.034 bpm, with 95% limits from -2.59 bpm to 3.78 bpm and from -1.97 bpm to 2.04 bpm, respectively.

Low-Cost Hyperspectral Imaging with A Smartphone

Recent advances in smartphone technologies have opened the door to the development of accessible, highly portable sensing tools capable of accurate and reliable data collection in a range of environmental settings. In this article, we introduce a low-cost smartphone-based hyperspectral imaging system that can convert a standard smartphone camera into a visible wavelength hyperspectral sensor for ca. £100. To the best of our knowledge, this represents the first smartphone capable of hyperspectral data collection without the need for extensive post processing. The Hyperspectral Smartphone’s abilities are tested in a variety of environmental applications and its capabilities directly compared to the laboratory-based analogue from our previous research, as well as the wider existing literature. The Hyperspectral Smartphone is capable of accurate, laboratory- and field-based hyperspectral data collection, demonstrating the significant promise of both this device and smartphone-based hyperspectral imaging as a whole.

Diffuse Reflectance Parameters of Treated Leishmaniasis Cutaneous Ulcers and Association with Histopathologies in an Animal Model: A Proof of Concept

Cutaneous leishmaniasis (CL) is a parasitic disease that produces chronic skin ulcers. Although it has a worldwide presence, it is a neglected disease that still requires novel tools for its management. In order to study the use of optical tools in CL, this article presents a preliminary study of the correlation between CL histopathological and optical parameters. Optical parameters correspond to absorption and scattering coefficients obtained from diffuse reflectance spectra of treated CL in golden hamsters. Independently, histopathological data were collected from the same hamsters. As a result, after Spearman correlation and the Kruskal-Wallis test, inverse correlation was found between absorption/scattering optical parameters and inflammatory histopathological values, such as the scattering parameter related to the diameter of fibroblasts with the histopathological parameters of fibrosis, polymorphonuclear neutrophils, lymphocytes, plasmocytes, hyperplasia, and Leishmania, and the absorption parameter oxygen saturation showed a relation with the granulation tissue histopathological parameter. These correlations agree with the expected behavior of tissue composition during the healing process in CL. The results correspond to a proof of concept that shows that optical diffuse reflectance-based tools and methods could be considered as an alternative to assist in CL diagnosis and treatment follow-up.

Mobile snapshot hyperspectral imaging device for skin evaluation using diffractive optical elements

OBJECTIVE

A mobile handheld snapshot hyperspectral imaging device was developed and tested for in vivo skin evaluation using a new spectral imaging technology.

METHODS

The device is equipped with four different LED light sources (VIS, 810 nm, 850 nm, and 940 nm) for illumination. Based on a diffractive optical element (DOE) combined with a CMOS sensor chip, a snapshot hyperspectral imager is achieved for the application on human skin. The diffractive optical element (DOE) consists of a two-dimensional array of identically repeated diffractive microstructures. One hyperspectral image for all wavelength regions is taken within a few seconds. Complex recalculation of the VIS spectral distribution and image information from the received DOE image requires several minutes, depending on computing performance. A risk assessment on the irradiation sources shows no risk of harm due to the LED radiation.

RESULTS

Skin tone color patches experiments reproducibly deliver images and spectra of different skin tones. First in vivo use of the device identified pigmentation changes within the field of view.

CONCLUSION

We present a working mobile snapshot hyperspectral imaging tool based on diffractive optical elements. This device or future developments thereof can be used for broad skin evaluation in vivo.

Spatiotemporal monitoring of changes in oxy/deoxy-hemoglobin concentration and blood pulsation on human skin using smartphone-enabled remote multispectral photoplethysmography

We propose a smartphone-enabled remote multispectral photoplethysmography (SP-rmPPG) system and method to realize spatiotemporal monitoring of perfusion changes and pulsations of the oxyhemoglobin (HbO2) and deoxyhemoglobin (Hb) information of the effective blood volume within light interrogated skin tissue beds. The system is implemented on an unmodified smartphone utilizing its built-in camera and flashlight to acquire videos of the skin reflectance. The SP-rmPPG method converts the RGB video into multispectral cubes, upon which to decouple the dynamic changes in HbO2 and Hb information using a modified Beer-Lambert law and the selective wavelength bands of 500 nm and 650 nm. Blood pulsation amplitudes are then obtained by applying a window-based lock-in amplification on the derived spatiotemporal changes in HbO2 or Hb signals. To demonstrate the feasibility of proposed method, we conduct two experiments on the skin tissue beds that are conditioned by occlusive maneuver of supplying arteries: one using the popular blood cuff pressure maneuver on the upper arm, and another artificially inducing a transient ischemic condition on the facial skin tissue beds by finger pressing on the supplying external carotid artery. The cuff experiment shows that the measured dynamic information of HbO2 and Hb in the downstream agrees well with the parallel measurements of oxygenation saturation given by the standard pulse oximeter. We also observe the expected imbalance of spatiotemporal changes in the HbO2 and Hb between the right and left cheeks when the transient ischemic condition is induced in the one side of facial skin tissue beds. The results from the two experiments sufficiently demonstrate the feasibility of the proposed method to monitor the spatiotemporal changes in the skin hemodynamics, including blood oxygenation and pulsation amplitudes. Considering the ever-growing accessibility and affordability of the smartphone to the general public, the proposed strategy promises the early screening of vascular diseases and improving general public health particularly in rural areas with low resource settings.

Smartphone-based imaging systems for medical applications: a critical review

SIGNIFICANCE

Smartphones come with an enormous array of functionality and are being more widely utilized with specialized attachments in a range of healthcare applications. A review of key developments and uses, with an assessment of strengths/limitations in various clinical workflows, was completed.

AIM

Our review studies how smartphone-based imaging (SBI) systems are designed and tested for specialized applications in medicine and healthcare. An evaluation of current research studies is used to provide guidelines for improving the impact of these research advances.

APPROACH

First, the established and emerging smartphone capabilities that can be leveraged for biomedical imaging are detailed. Then, methods and materials for fabrication of optical, mechanical, and electrical interface components are summarized. Recent systems were categorized into four groups based on their intended application and clinical workflow: ex vivo diagnostic, in vivo diagnostic, monitoring, and treatment guidance. Lastly, strengths and limitations of current SBI systems within these various applications are discussed.

RESULTS

The native smartphone capabilities for biomedical imaging applications include cameras, touchscreens, networking, computation, 3D sensing, audio, and motion, in addition to commercial wearable peripheral devices. Through user-centered design of custom hardware and software interfaces, these capabilities have the potential to enable portable, easy-to-use, point-of-care biomedical imaging systems. However, due to barriers in programming of custom software and on-board image analysis pipelines, many research prototypes fail to achieve a prospective clinical evaluation as intended. Effective clinical use cases appear to be those in which handheld, noninvasive image guidance is needed and accommodated by the clinical workflow. Handheld systems for in vivo, multispectral, and quantitative fluorescence imaging are a promising development for diagnostic and treatment guidance applications.

CONCLUSIONS

A holistic assessment of SBI systems must include interpretation of their value for intended clinical settings and how their implementations enable better workflow. A set of six guidelines are proposed to evaluate appropriateness of smartphone utilization in terms of clinical context, completeness, compactness, connectivity, cost, and claims. Ongoing work should prioritize realistic clinical assessments with quantitative and qualitative comparison to non-smartphone systems to clearly demonstrate the value of smartphone-based systems. Improved hardware design to accommodate the rapidly changing smartphone ecosystem, creation of open-source image acquisition and analysis pipelines, and adoption of robust calibration techniques to address phone-to-phone variability are three high priority areas to move SBI research forward.

A measurement of illumination variation-resistant noncontact heart rate based on the combination of singular spectrum analysis and sub-band method

BACKGROUND AND OBJECTIVE

The imaging photoplethysmography method is a non-contact and non-invasive measurement method that usually uses surrounding illumination as an illuminant, which can be easily influenced by the surrounding illumination variations. Thus, it has a practical value to develop an efficient method of heart rate measurement that can remove the interference of illumination variations robustly.

METHOD

We propose a novel framework of heart rate measurement that is robust to illumination variations by combining singular spectrum analysis and sub-band method. At first, we extract the blood volume pulse signal by applying the modified sub-band method to the raw facial RGB trace signals. Then the spectra for the interference of illumination variations are extracted from the raw signal obtained from facial regions of interest by using singular spectrum analysis. Finally, we estimate the more robust heart rate through comparison analysis between the spectra of the extracted blood volume pulse signal and the illumination variations.

RESULTS

We compared our method with several state-of-the-art methods through the analysis using the self-collected data and the UBFC-RPPG database. Bland-Altman plots and Pearson correlation coefficients pointed out that the proposed method could measure the heart rate more accurately than the state-of-the-art methods. For the self-collected data and the UBFC-RPPG database, Bland-Altman plots showed that proposed method caused better agreement with 95% limits from -4 bpm to 10 bpm and from -2 bpm to 4 bpm respectively than the other state-of-the-art methods. It also revealed that the highly linear relation was held between the estimated heart rate and ground truth with the correlation coefficients of 0.89 and 0.99, respectively.

CONCLUSION

By extracting illumination variation directly from the facial region of interest rather than from the background region of interest, the proposed method demonstrates that it can overcome the drawbacks of the previous methods due to the illumination variation difference between the background and facial regions of interest. It can be found that the proposed method has a relatively good robustness regardless of whether illumination variation exists or not.

Robust non-contact peripheral oxygenation saturation measurement using smartphone-enabled imaging photoplethysmography

We propose a robust non-contact method to accurately estimate peripheral oxygen saturation (SpO₂) using a smartphone-based imaging photoplethysmography. The method utilizes the built-in color camera as a remote sensor and the built-in flashlight as illumination to estimate the SpO₂. Following the ratio of ratios between green and red channels, we introduce a multiple linear regression algorithm to improve the SpO₂ estimation. The algorithm considers the ratio of ratios and the reflectance images recorded at the RGB channels during a calibration process to obtain a set of weighting coefficients to weigh each contributor to the final determination of SpO₂. We demonstrate the proposed smartphone-based method of estimating the SpO₂ on five healthy volunteers whose arms are conditioned by a manual pressure cuff to manipulate the SpO₂ between 90∼100% as detected simultaneously by a medical-grade pulse oximeter. Experimental results indicate that the overall estimated error between the smartphone and the reference pulse oximeter is 0.029 ± 1.141%, leading to a 43% improvement over the conventional ratio of ratios method (0.008 ± 2.008%). In addition, the data sampling time in the current method is 2 seconds, similar to the sampling cycle used in the commercial medical-grade pulse oximeters.

Melanins as Sustainable Resources for Advanced Biotechnological Applications

Melanins are a class of biopolymers that are widespread in nature and have diverse origins, chemical compositions, and functions. Their chemical, electrical, optical, and paramagnetic properties offer opportunities for applications in materials science, particularly for medical and technical uses. This review focuses on the application of analytical techniques to study melanins in multidisciplinary contexts with a view to their use as sustainable resources for advanced biotechnological applications, and how these may facilitate the achievement of the United Nations Sustainable Development Goals.

Hyperspectral Imagery for Assessing Laser-Induced Thermal State Change in Liver

This work presents the potential of hyperspectral imaging (HSI) to monitor the thermal outcome of laser ablation therapy used for minimally invasive tumor removal. Our main goal is the establishment of indicators of the thermal damage of living tissues, which can be used to assess the effect of the procedure. These indicators rely on the spectral variation of temperature-dependent tissue chromophores, i.e., oxyhemoglobin, deoxyhemoglobin, methemoglobin, and water. Laser treatment was performed at specific temperature thresholds (from 60 to 110 °C) on in-vivo animal liver and was assessed with a hyperspectral camera (500-995 nm) during and after the treatment. The indicators were extracted from the hyperspectral images after the following processing steps: the breathing motion compensation and the spectral and spatial filtering, the selection of spectral bands corresponding to specific tissue chromophores, and the analysis of the areas under the curves for each spectral band. Results show that properly combining spectral information related to deoxyhemoglobin, methemoglobin, lipids, and water allows for the segmenting of different zones of the laser-induced thermal damage. This preliminary investigation provides indicators for describing the thermal state of the liver, which can be employed in the future as clinical endpoints of the procedure outcome.

Optical Technologies for Improving Healthcare in Low-Resource Settings: introduction to the feature issue

This feature issue of Biomedical Optics Express presents a cross-section of interesting and emerging work of relevance to optical technologies in low-resource settings. In particular, the technologies described here aim to address challenges to meeting healthcare needs in resource-constrained environments, including in rural and underserved areas. This collection of 18 papers includes papers on both optical system design and image analysis, with applications demonstrated for ex vivo and in vivo use. All together, these works portray the importance of global health research to the scientific community and the role that optics can play in addressing some of the world's most pressing healthcare challenges.