Regression-based neural network for improving image reconstruction in diffuse optical tomography

Roadmap on computational methods in optical imaging and holography [invited]

Computational methods have been established as cornerstones in optical imaging and holography in recent years. Every year, the dependence of optical imaging and holography on computational methods is increasing significantly to the extent that optical methods and components are being completely and efficiently replaced with computational methods at low cost. This roadmap reviews the current scenario in four major areas namely incoherent digital holography, quantitative phase imaging, imaging through scattering layers, and super-resolution imaging. In addition to registering the perspectives of the modern-day architects of the above research areas, the roadmap also reports some of the latest studies on the topic. Computational codes and pseudocodes are presented for computational methods in a plug-and-play fashion for readers to not only read and understand but also practice the latest algorithms with their data. We believe that this roadmap will be a valuable tool for analyzing the current trends in computational methods to predict and prepare the future of computational methods in optical imaging and holography.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00340-024-08280-3.

One-dimensional convolutional neural network for Jacobian in Diffuse Optical Tomography

Non-linear least square minimization algorithms are often employed to solve Diffuse Optical Tomography (DOT) inverse problem. However, it is time-consuming to calculate the Jacobian matrix. This work has proposed a data-driven neural network method to improve computational efficiency. The singular value decomposition is employed to compute the updated Jacobian and a mapping from boundary measurements to the singular values based on a convolutional neural network (CNN) is learned to obtain the singular values. The method is validated with 3D numerical simulation data. We have demonstrated that the approach can save computation time compared to Adjoint method, and reconstructed absorption coefficient close to Adjoint method.Clinical Relevance- These results are not focused on clinical relevance currently, but in the future may be helpful to accelerant DOT reconstruction in clinic.

Real-time and accurate estimation ex vivo of four basic optical properties from thin tissue based on a cascade forward neural network

Double integrating sphere measurements obtained from thin ex vivo tissues provides more spectral information and hence allows full estimation of all basic optical properties (OPs) theoretically. However, the ill-conditioned nature of the OP determination increases excessively with the reduction in tissue thickness. Therefore, it is crucial to develop a model for thin ex vivo tissues that is robust to noise. Herein, we present a deep learning solution to precisely extract four basic OPs in real-time from thin ex vivo tissues, leveraging a dedicated cascade forward neural network (CFNN) for each OP with an additional introduced input of the refractive index of the cuvette holder. The results show that the CFNN-based model enables accurate and fast evaluation of OPs, as well as robustness to noise. Our proposed method overcomes the highly ill-conditioned restriction of OP evaluation and can distinguish the effects of slight changes in measurable quantities without any a priori knowledge.

Machine Learning Diffuse Optical Tomography Using Extreme Gradient Boosting and Genetic Programming

Diffuse optical tomography (DOT) is a non-invasive method for detecting breast cancer; however, it struggles to produce high-quality images due to the complexity of scattered light and the limitations of traditional image reconstruction algorithms. These algorithms can be affected by boundary conditions and have a low imaging accuracy, a shallow imaging depth, a long computation time, and a high signal-to-noise ratio. However, machine learning can potentially improve the performance of DOT by being better equipped to solve inverse problems, perform regression, classify medical images, and reconstruct biomedical images. In this study, we utilized a machine learning model called "XGBoost" to detect tumors in inhomogeneous breasts and applied a post-processing technique based on genetic programming to improve accuracy. The proposed algorithm was tested using simulated DOT measurements from complex inhomogeneous breasts and evaluated using the cosine similarity metrics and root mean square error loss. The results showed that the use of XGBoost and genetic programming in DOT could lead to more accurate and non-invasive detection of tumors in inhomogeneous breasts compared to traditional methods, with the reconstructed breasts having an average cosine similarity of more than 0.97 ± 0.07 and average root mean square error of around 0.1270 ± 0.0031 compared to the ground truth.

Periodic-net: an end-to-end data driven framework for diffuse optical imaging of breast cancer from noisy boundary data

Significance

The machine learning (ML) approach plays a critical role in assessing biomedical imaging processes especially optical imaging (OI) including segmentation, classification, and reconstruction, intending to achieve higher accuracy efficiently.

Aim

This research aims to develop an end-to-end deep learning framework for diffuse optical imaging (DOI) with multiple datasets to detect breast cancer and reconstruct its optical properties in the early stages.

Approach

The proposed Periodic-net is a nondestructive deep learning (DL) algorithm for the reconstruction and evaluation of inhomogeneities in an inverse model with high accuracy, while boundary measurements are calculated by solving a forward problem with sources/detectors arranged uniformly around a circular domain in various combinations, including 16 × 15 , 20 × 19 , and 36 × 35 boundary measurement setups.

Results

The results of image reconstruction on numerical and phantom datasets demonstrate that the proposed network provides higher-quality images with a greater amount of small details, superior immunity to noise, and sharper edges with a reduction in image artifacts than other state-of-the-art competitors.

Conclusions

The network is highly effective at the simultaneous reconstruction of optical properties, i.e., absorption and reduced scattering coefficients, by optimizing the imaging time without degrading inclusions localization and image quality.

Rapid extraction of skin physiological parameters from hyperspectral images using machine learning

Noninvasive assessment of skin structure using hyperspectral images has been intensively studied in recent years. Due to the high computational cost of the classical methods, such as the inverse Monte Carlo (IMC), much research has been done with the aim of using machine learning (ML) methods to reduce the time required for estimating parameters. This study aims to evaluate the accuracy and the estimation speed of the ML methods for this purpose and compare them to the traditionally used inverse adding-doubling (IAD) algorithm. We trained three models – an artificial neural network (ANN), a 1D convolutional neural network (CNN), and a random forests (RF) model – to predict seven skin parameters. The models were trained on simulated data computed using the adding-doubling algorithm. To improve predictive performance, we introduced a stacked dynamic weighting (SDW) model combining the predictions of all three individually trained models. SDW model was trained by using only a handful of real-world spectra on top of the ANN, CNN and RF models that were trained using simulated data. Models were evaluated based on the estimated parameters’ mean absolute error (MAE), considering the surface inclination angle and comparing skin spectra with spectra fitted by the IAD algorithm. On simulated data, the lowest MAE was achieved by the RF model (0.0030), while the SDW model achieved the lowest MAE on in vivo measured spectra (0.0113). The shortest time to estimate parameters for a single spectrum was 93.05 μs. Results suggest that ML algorithms can produce accurate estimates of human skin optical parameters in near real-time.