Deep learning-based method to accurately estimate breast tissue optical properties in the presence of the chest wall

MamoRef: an optical mammography device using whole-field CW diffuse reflectance. Presentation, validation and preliminary clinical results

Objective.MamoRef is an mammography device that uses near-infrared light, designed to provide clinically relevant information for the screening of diseases of the breast. Using low power continuous wave lasers and a high sensitivity CCD (Charge-coupled device) that captures a diffusely reflected image of the tissue, MamoRef results in a versatile diagnostic tool that aims to fulfill a complementary role in the diagnosis of breast cancer providing information about the relative hemoglobin concentrations as well as oxygen saturation.Approach.We present the design and development of an initial prototype of MamoRef. To ensure its effectiveness, we conducted validation tests on both the theoretical basis of the reconstruction algorithm and the hardware design. Furthermore, we initiated a clinical feasibility study involving patients diagnosed with breast disease, thus evaluating the practical application and potential benefits of MamoRef in a real-world setting.Main results.Our study demonstrates the effectiveness of the reconstruction algorithm in recovering relative concentration differences among various chromophores, as confirmed by Monte Carlo simulations. These simulations show that the recovered data correlates well with the ground truth, with SSIMs of 0.8 or more. Additionally, the phantom experiments validate the hardware implementation. The initial clinical findings exhibit highly promising outcomes regarding MamoRef's ability to differentiate between lesions.Significance.MamoRef aims to be an advancement in the field of breast pathology screening and diagnostics, providing complementary information to standard diagnostic techniques. One of its main advantages is the ability of determining oxy/deoxyhemoglobin concentrations and oxygen saturation; this constitutes valuable complementary information to standard diagnostic techniques. Besides, MamoRef is a portable and relatively inexpensive device, intended to be not only used in specific medical imaging facilities. Finally, its use does not require external compression of the breast. The findings of this study underscore the potential of MamoRef in fulfilling this crucial role.

Automated pipeline for breast cancer diagnosis using US assisted diffuse optical tomography

Ultrasound (US)-guided diffuse optical tomography (DOT) is a portable and non-invasive imaging modality for breast cancer diagnosis and treatment response monitoring. However, DOT data pre-processing and imaging reconstruction often require labor intensive manual processing which hampers real-time diagnosis. In this study, we aim at providing an automated US-assisted DOT pre-processing, imaging and diagnosis pipeline to achieve near real-time diagnosis. We have developed an automated DOT pre-processing method including motion detection, mismatch classification using deep-learning approach, and outlier removal. US-lesion information needed for DOT reconstruction was extracted by a semi-automated lesion segmentation approach combined with a US reading algorithm. A deep learning model was used to evaluate the quality of the reconstructed DOT images and a two-step deep-learning model developed earlier is implemented to provide final diagnosis based on US imaging features and DOT measurements and imaging results. The presented US-assisted DOT pipeline accurately processed the DOT measurements and reconstruction and reduced the procedure time to 2 to 3 minutes while maintained a comparable classification result with manually processed dataset.

FDU-Net: Deep Learning-Based Three-Dimensional Diffuse Optical Image Reconstruction

Near-infrared diffuse optical tomography (DOT) is a promising functional modality for breast cancer imaging; however, the clinical translation of DOT is hampered by technical limitations. Specifically, conventional finite element method (FEM)-based optical image reconstruction approaches are time-consuming and ineffective in recovering full lesion contrast. To address this, we developed a deep learning-based reconstruction model (FDU-Net) comprised of a Fully connected subnet, followed by a convolutional encoder-Decoder subnet, and a U-Net for fast, end-to-end 3D DOT image reconstruction. The FDU-Net was trained on digital phantoms that include randomly located singular spherical inclusions of various sizes and contrasts. Reconstruction performance was evaluated in 400 simulated cases with realistic noise profiles for the FDU-Net and conventional FEM approaches. Our results show that the overall quality of images reconstructed by FDU-Net is significantly improved compared to FEM-based methods and a previously proposed deep-learning network. Importantly, once trained, FDU-Net demonstrates substantially better capability to recover true inclusion contrast and location without using any inclusion information during reconstruction. The model was also generalizable to multi-focal and irregularly shaped inclusions unseen during training. Finally, FDU-Net, trained on simulated data, could successfully reconstruct a breast tumor from a real patient measurement. Overall, our deep learning-based approach demonstrates marked superiority over the conventional DOT image reconstruction methods while also offering over four orders of magnitude acceleration in computational time. Once adapted to the clinical breast imaging workflow, FDU-Net has the potential to provide real-time accurate lesion characterization by DOT to assist the clinical diagnosis and management of breast cancer.

Two-stage classification strategy for breast cancer diagnosis using ultrasound-guided diffuse optical tomography and deep learning

Significance

Ultrasound (US)-guided diffuse optical tomography (DOT) has demonstrated great potential for breast cancer diagnosis in which real-time or near real-time diagnosis with high accuracy is desired.

Aim

We aim to use US-guided DOT to achieve an automated, fast, and accurate classification of breast lesions.

Approach

We propose a two-stage classification strategy with deep learning. In the first stage, US images and histograms created from DOT perturbation measurements are combined to predict benign lesions. Then the non-benign suspicious lesions are passed through to the second stage, which combine US image features, DOT histogram features, and 3D DOT reconstructed images for final diagnosis.

Results

The first stage alone identified 73.0% of benign cases without image reconstruction. In distinguishing between benign and malignant breast lesions in patient data, the two-stage classification approach achieved an area under the receiver operating characteristic curve of 0.946, outperforming the diagnoses of all single-modality models and of a single-stage classification model that combines all US images, DOT histogram, and imaging features.

Conclusions

The proposed two-stage classification strategy achieves better classification accuracy than single-modality-only models and a single-stage classification model that combines all features. It can potentially distinguish breast cancers from benign lesions in near real-time.

Physics-guided neural network for tissue optical properties estimation

Finding the optical properties of tissue is essential for various biomedical diagnostic/therapeutic applications such as monitoring of blood oxygenation, tissue metabolism, skin imaging, photodynamic therapy, low-level laser therapy, and photo-thermal therapy. Hence, the research for more accurate and versatile optical properties estimation techniques has always been a primary interest of researchers, especially in the field of bioimaging and bio-optics. In the past, most of the prediction methods were based on physics-based models such as the pronounced diffusion approximation method. In more recent years, with the advancement and growing popularity of machine learning techniques, most of the prediction methods are data-driven. While both methods have been proven to be useful, each of them suffers from several shortcomings that could be complemented by their counterparts. Thus, there is a need to bring the two domains together to obtain superior prediction accuracy and generalizability. In this work, we proposed a physics-guided neural network (PGNN) for tissue optical properties regression which integrates physics prior and constraint into the artificial neural network (ANN) model. With this method, we have demonstrated superior generalizability of PGNN compared to its pure ANN counterpart. The prediction accuracy and generalizability of the network were evaluated on single-layered tissue samples simulated with Monte Carlo simulation. Two different test datasets, the in-domain test dataset and out-domain dataset were used to evaluate in-domain generalizability and out-domain generalizability, respectively. The physics-guided neural network (PGNN) showed superior generalizability for both in-domain and out-domain prediction compared to pure ANN.

Fusion deep learning approach combining diffuse optical tomography and ultrasound for improving breast cancer classification

Diffuse optical tomography (DOT) is a promising technique that provides functional information related to tumor angiogenesis. However, reconstructing the DOT function map of a breast lesion is an ill-posed and underdetermined inverse process. A co-registered ultrasound (US) system that provides structural information about the breast lesion can improve the localization and accuracy of DOT reconstruction. Additionally, the well-known US characteristics of benign and malignant breast lesions can further improve cancer diagnosis based on DOT alone. Inspired by a fusion model deep learning approach, we combined US features extracted by a modified VGG-11 network with images reconstructed from a DOT deep learning auto-encoder-based model to form a new neural network for breast cancer diagnosis. The combined neural network model was trained with simulation data and fine-tuned with clinical data: it achieved an AUC of 0.931 (95% CI: 0.919-0.943), superior to those achieved using US images alone (0.860) or DOT images alone (0.842).

Machine Learning Diffuse Optical Tomography Using Extreme Gradient Boosting and Genetic Programming

Diffuse optical tomography (DOT) is a non-invasive method for detecting breast cancer; however, it struggles to produce high-quality images due to the complexity of scattered light and the limitations of traditional image reconstruction algorithms. These algorithms can be affected by boundary conditions and have a low imaging accuracy, a shallow imaging depth, a long computation time, and a high signal-to-noise ratio. However, machine learning can potentially improve the performance of DOT by being better equipped to solve inverse problems, perform regression, classify medical images, and reconstruct biomedical images. In this study, we utilized a machine learning model called "XGBoost" to detect tumors in inhomogeneous breasts and applied a post-processing technique based on genetic programming to improve accuracy. The proposed algorithm was tested using simulated DOT measurements from complex inhomogeneous breasts and evaluated using the cosine similarity metrics and root mean square error loss. The results showed that the use of XGBoost and genetic programming in DOT could lead to more accurate and non-invasive detection of tumors in inhomogeneous breasts compared to traditional methods, with the reconstructed breasts having an average cosine similarity of more than 0.97 ± 0.07 and average root mean square error of around 0.1270 ± 0.0031 compared to the ground truth.

Periodic-net: an end-to-end data driven framework for diffuse optical imaging of breast cancer from noisy boundary data

SIGNIFICANCE

The machine learning (ML) approach plays a critical role in assessing biomedical imaging processes especially optical imaging (OI) including segmentation, classification, and reconstruction, intending to achieve higher accuracy efficiently.

AIM

This research aims to develop an end-to-end deep learning framework for diffuse optical imaging (DOI) with multiple datasets to detect breast cancer and reconstruct its optical properties in the early stages.

APPROACH

The proposed Periodic-net is a nondestructive deep learning (DL) algorithm for the reconstruction and evaluation of inhomogeneities in an inverse model with high accuracy, while boundary measurements are calculated by solving a forward problem with sources/detectors arranged uniformly around a circular domain in various combinations, including 16 × 15 , 20 × 19 , and 36 × 35 boundary measurement setups.

RESULTS

The results of image reconstruction on numerical and phantom datasets demonstrate that the proposed network provides higher-quality images with a greater amount of small details, superior immunity to noise, and sharper edges with a reduction in image artifacts than other state-of-the-art competitors.

CONCLUSIONS

The network is highly effective at the simultaneous reconstruction of optical properties, i.e., absorption and reduced scattering coefficients, by optimizing the imaging time without degrading inclusions localization and image quality.

Deep Learning for Type 1 Diabetes Mellitus Diagnosis Using Infrared Quantum Cascade Laser Spectroscopy

An estimated 10.5% of the world’s population aged 20–79 years are currently living with diabetes in 2021. An urgent task is to develop a non-invasive express-diagnostics of diabetes with high accuracy. Type 1 diabetes mellitus (T1DM) diagnostic method based on infrared laser spectroscopy of human exhaled breath is described. A quantum cascade laser emitting in a pulsed mode with a peak power of up to 150 mW in the spectral range of 5.3–12.8 μm and Herriot multipass gas cell with an optical path length of 76 m were used. We propose a method for collecting and drying an exhaled human air sample and have measured 1200 infrared exhaled breath spectra from 60 healthy volunteers (the control group) and 60 volunteers with confirmed T1DM (the target group). A 1-D convolutional neural network for the classification of healthy and T1DM volunteers with an accuracy of 99.7%, recall 99.6% and AUC score 99.9% was used. The demonstrated results require clarification on a larger dataset and series of clinical studies and, further, the method can be implemented in routine medical practice.