Attention mechanism-based locally connected network for accurate and stable reconstruction in Cerenkov luminescence tomography

Highly robust reconstruction framework for three-dimensional optical imaging based on physical model constrained neural networks

Objective. The reconstruction of three-dimensional optical imaging that can quantitatively acquire the target distribution from surface measurements is a serious ill-posed problem. Traditional regularization-based reconstruction can solve such ill-posed problem to a certain extent, but its accuracy is highly dependent ona priorinformation, resulting in a less stable and adaptable method. Data-driven deep learning-based reconstruction avoids the errors of light propagation models and the reliance on experience and a prior by learning the mapping relationship between the surface light distribution and the target directly from the dataset. However, the acquisition of the training dataset and the training of the network itself are time consuming, and the high dependence of the network performance on the training dataset results in a low generalization ability. The objective of this work is to develop a highly robust reconstruction framework to solve the existing problems.Approach. This paper proposes a physical model constrained neural networks-based reconstruction framework. In the framework, the neural networks are to generate a target distribution from surface measurements, while the physical model is used to calculate the surface light distribution based on this target distribution. The mean square error between the calculated surface light distribution and the surface measurements is then used as a loss function to optimize the neural network. To further reduce the dependence ona prioriinformation, a movable region is randomly selected and then traverses the entire solution interval. We reconstruct the target distribution in this movable region and the results are used as the basis for its next movement.Main Results. The performance of the proposed framework is evaluated with a series of simulations andin vivoexperiment, including accuracy robustness of different target distributions, noise immunity, depth robustness, and spatial resolution. The results collectively demonstrate that the framework can reconstruct targets with a high accuracy, stability and versatility.Significance. The proposed framework has high accuracy and robustness, as well as good generalizability. Compared with traditional regularization-based reconstruction methods, it eliminates the need to manually delineate feasible regions and adjust regularization parameters. Compared with emerging deep learning assisted methods, it does not require any training dataset, thus saving a lot of time and resources and solving the problem of poor generalization and robustness of deep learning methods. Thus, the framework opens up a new perspective for the reconstruction of three-dimension optical imaging.

Molecularly generated light and its biomedical applications

Molecularly generated light, referred to here as "molecular light", mainly includes bioluminescence, chemiluminescence, and Cerenkov luminescence. Molecular light possesses unique dual features of being both a molecule and a source of light. Its molecular nature enables it to be delivered as molecules to regions deep within the body, overcoming the limitations of natural sunlight and physically generated light sources like lasers and LEDs. Simultaneously, its light properties make it valuable for applications such as imaging, photodynamic therapy, photo-oxidative therapy, and photobiomodulation. In this review article, we provide an updated overview of the diverse applications of molecular light and discuss the strengths and weaknesses of molecular light across various domains. Lastly, we present forward-looking perspectives on the potential of molecular light in the realms of molecular imaging, photobiological mechanisms, therapeutic applications, and photobiomodulation. While some of these perspectives may be considered bold and contentious, our intent is to inspire further innovations in the field of molecular light applications.

FISTA-NET: Deep Algorithm Unrolling for Cerenkov luminescence tomography

Cerenkov luminescence tomography (CLT) is a highly sensitive and promising imaging technique that can be used to reconstruct the three-dimensional distribution of radioactive probes in living animals. However, the accuracy of CLT reconstruction is limited by the simplified radiative transfer equation and ill-conditioned inverse problem. To address this issue, we propose a model-based deep learning network that combines the neural network with a model-based approach to enhance the performance of CLT reconstruction. The Fast Iterative Shrinkage Thresholding Algorithm (FISTA), a traditional model-based approach, is expanded into a deep network (known as FISTA-NET). Each layer in the network represents an iteration of the algorithm steps, and connecting these layers can form a deep neural network. In addition, different from the traditional FISTA, the key parameters in FISTA, such as gradient step size and threshold value, can be learned through training data without manual production. To evaluate the performance of FISTA-NET, numerical simulation experiments were conducted, which demonstrate its excellent positioning and shape recovery abilities.Clinical Relevance-This indicates that FISTA-NET strategy can significantly improve the quality of CLT reconstruction, which is further beneficial to the assessment of disease activity and treatment effect based on CLT.

Elastic net-based non-negative iterative three-operator splitting strategy for Cerenkov luminescence tomography

Cerenkov luminescence tomography (CLT) provides a powerful optical molecular imaging technique for non-invasive detection and visualization of radiopharmaceuticals in living objects. However, the severe photon scattering effect causes ill-posedness of the inverse problem, and the location accuracy and shape recovery of CLT reconstruction results are unsatisfactory for clinical application. Here, to improve the reconstruction spatial location accuracy and shape recovery ability, a non-negative iterative three operator splitting (NNITOS) strategy based on elastic net (EN) regularization was proposed. NNITOS formalizes the CLT reconstruction as a non-convex optimization problem and splits it into three operators, the least square, L_1/2-norm regularization, and adaptive grouping manifold learning, then iteratively solved them. After stepwise iterations, the result of NNITOS converged progressively. Meanwhile, to speed up the convergence and ensure the sparsity of the solution, shrinking the region of interest was utilized in this strategy. To verify the effectiveness of the method, numerical simulations and in vivo experiments were performed. The result of these experiments demonstrated that, compared to several methods, NNITOS can achieve superior performance in terms of location accuracy, shape recovery capability, and robustness. We hope this work can accelerate the clinical application of CLT in the future.