Weight Multispectral Reconstruction Strategy for Enhanced Reconstruction Accuracy and Stability With Cerenkov Luminescence Tomography

Fluorescence molecular tomography based on an online maximum a posteriori estimation algorithm

Fluorescence molecular tomography (FMT) is a non-invasive, radiation-free, and highly sensitive optical molecular imaging technique for early tumor detection. However, inadequate measurement information along with significant scattering of near-infrared light within the tissue leads to high ill-posedness in the inverse problem of FMT. To improve the quality and efficiency of FMT reconstruction, we build a reconstruction model based on log-sum regularization and introduce an online maximum a posteriori estimation (OPE) algorithm to solve the non-convex optimization problem. The OPE algorithm approximates a stationary point by evaluating the gradient of the objective function at each iteration, and its notable strength lies in the remarkable speed of convergence. The results of simulations and experiments demonstrate that the OPE algorithm ensures good reconstruction quality and exhibits outstanding performance in terms of reconstruction efficiency.

Molecularly generated light and its biomedical applications

Molecularly generated light, referred to here as "molecular light", mainly includes bioluminescence, chemiluminescence, and Cerenkov luminescence. Molecular light possesses unique dual features of being both a molecule and a source of light. Its molecular nature enables it to be delivered as molecules to regions deep within the body, overcoming the limitations of natural sunlight and physically generated light sources like lasers and LEDs. Simultaneously, its light properties make it valuable for applications such as imaging, photodynamic therapy, photo-oxidative therapy, and photobiomodulation. In this review article, we provide an updated overview of the diverse applications of molecular light and discuss the strengths and weaknesses of molecular light across various domains. Lastly, we present forward-looking perspectives on the potential of molecular light in the realms of molecular imaging, photobiological mechanisms, therapeutic applications, and photobiomodulation. While some of these perspectives may be considered bold and contentious, our intent is to inspire further innovations in the field of molecular light applications.

Multi-target reconstruction based on subspace decision optimization for bioluminescence tomography

BACKGROUND AND OBJECTIVE

Bioluminescence tomography (BLT) is a noninvasive optical imaging technique that provides qualitative and quantitative information on the spatial distribution of tumors in living animals. Researchers have proposed a list of algorithms and strategies for BLT reconstruction to improve its reconstruction quality. However, multi-target BLT reconstruction remains challenging in practical clinical applications due to the mutual interference of optical signals and difficulty in source separation.

METHODS

To solve this problem, this study proposes the subspace decision optimization (SDO) approach based on the traditional iterative permissible region strategy. The SDO approach transforms a single permissible region into multiple subspaces by clustering analysis. These subspaces are shrunk based on subspace shrinking optimization to achieve spatial continuity of the permissible regions. In addition, these subspaces are merged to construct a new permissible region and then the next iteration of reconstruction is carried out to ensure the stability of the results. Finally, all the iterative results are optimized based on the normal distribution model and the distribution properties of the targets to ensure the sparsity of each target and the non-biasing of the overall results.

RESULTS

Experimental results show that the SDO approach can automatically identify and separate different targets, ensuring the accuracy and quality of multi-target BLT reconstruction results. Meanwhile, SDO can combine various types of reconstruction algorithms and provide stable and high-quality reconstruction results independent of the algorithm parameters.

CONCLUSIONS

The SDO approach provides an integrated solution to the multi-target BLT reconstruction problem, realizing the whole process including target recognition, separation, reconstruction, and result enhancement, which can extend the application domain of BLT.

Regularized reconstruction based on joint smoothly clipped absolute deviation regularization and graph manifold learning for fluorescence molecular tomography

Objective.Fluorescence molecular tomography (FMT) is an optical imaging modality that provides high sensitivity and low cost, which can offer the three-dimensional distribution of biomarkers by detecting the fluorescently labeled probe noninvasively. In the field of preclinical cancer diagnosis and treatment, FMT has gained significant traction. Nonetheless, the current FMT reconstruction results suffer from unsatisfactory morphology and location accuracy of the fluorescence distribution, primarily due to the light scattering effect and the ill-posed nature of the inverse problem.Approach.To address these challenges, a regularized reconstruction method based on joint smoothly clipped absolute deviation regularization and graph manifold learning (SCAD-GML) for FMT is presented in this paper. The SCAD-GML approach combines the sparsity of the fluorescent sources with the latent manifold structure of fluorescent source distribution to achieve more accurate and sparse reconstruction results. To obtain the reconstruction results efficiently, the non-convex gradient descent iterative method is employed to solve the established objective function. To assess the performance of the proposed SCAD-GML method, a comprehensive evaluation is conducted through numerical simulation experiments as well asin vivoexperiments.Main results.The results demonstrate that the SCAD-GML method outperforms other methods in terms of both location and shape recovery of fluorescence biomarkers distribution.Siginificance.These findings indicate that the SCAD-GML method has the potential to advance the application of FMT inin vivobiological research.

K-CapsNet: K-Nearest Neighbor Based Convolution Capsule Network for Cerenkov Luminescence Tomography Reconstruction

Cerenkov luminescence tomography (CLT) has received significant attention as a promising imaging modality that can display the three-dimensional (3D) distribution of radioactive probes. However, the reconstruction of CLT suffers from severe ill-posed problem. It is difficult for traditional model-based method to obtain satisfactory result. Recently, deep learning-based method have shown great potential for accurate and efficient CLT reconstruction. In this study, a KNN-based convolution capsule network, named K-CapsNet, is proposed for cerenkov luminescence tomography. In K-CapsNet, the surface photon intensity is encoded in capsule form. The KNN-based convolution and K-means clustering are proposed for efficient encoding. Numerical simulation experiments have been carried out to verify the performance of K-CapsNet, and the results show that it performs superior in source localization and morphological restoration compared with existing methods.

Robust transformed l1 metric for fluorescence molecular tomography

BACKGROUND AND OBJECTIVE

Fluorescence molecular tomography (FMT) is a non-invasive molecular imaging modality that can be used to observe the three-dimensional distribution of fluorescent probes in vivo. FMT is a promising imaging technique in clinical and preclinical research that has attracted significant attention. Numerous regularization based reconstruction algorithms have been proposed. However, traditional algorithms that use the squared l₂-norm distance usually exaggerate the influence of noise and measurement and calculation errors, and their robustness cannot be guaranteed.

METHODS

In this study, we propose a novel robust transformed l₁ (TL1) metric that interpolates l₀ and l₁ norms through a nonnegative parameter α∈(0,+∞). The TL1 metric looks like the l_p-norm with p∈(0,1). These are markedly different because TL1 metric has two properties, boundedness and Lipschitz-continuity, which make the TL1 criterion suitable distance metric, particularly for robustness, owing to its stronger noise suppression. Subsequently, we apply the proposed metric to FMT and build a robust model to reduce the influence of noise. The nonconvexity of the proposed model made direct optimization difficult, and a continuous optimization method was developed to solve the model. The problem was converted into a difference in convex programming problem for the TL1 metric (DCATL1), and the corresponding algorithm converged linearly.

RESULTS

Various numerical simulations and in vivo bead-implanted mouse experiments were conducted to verify the performance of the proposed method. The experimental results show that the DCATL1 algorithm is more robust than the state-of-the-art approaches and achieves better source localization and morphology recovery.

CONCLUSIONS

The in vivo experiments showed that DCATL1 can be used to visualize the distribution of fluorescent probes inside biological tissues and promote preclinical application in small animals, demonstrating the feasibility and effectiveness of the proposed method.

Reconstruction based on adaptive group least angle regression for fluorescence molecular tomography

Fluorescence molecular tomography can combine two-dimensional fluorescence imaging with anatomical information to reconstruct three-dimensional images of tumors. Reconstruction based on traditional regularization with tumor sparsity priors does not take into account that tumor cells form clusters, so it performs poorly when multiple light sources are used. Here we describe reconstruction based on an "adaptive group least angle regression elastic net" (AGLEN) method, in which local spatial structure correlation and group sparsity are integrated with elastic net regularization, followed by least angle regression. The AGLEN method works iteratively using the residual vector and a median smoothing strategy in order to adaptively obtain a robust local optimum. The method was verified using numerical simulations as well as imaging of mice bearing liver or melanoma tumors. AGLEN reconstruction performed better than state-of-the-art methods with different sizes of light sources at different distances from the sample and in the presence of Gaussian noise at 5-25%. In addition, AGLEN-based reconstruction accurately imaged tumor expression of cell death ligand-1, which can guide immunotherapy.

An adaptive parameter selection strategy based on maximizing the probability of data for robust fluorescence molecular tomography reconstruction

To alleviate the ill-posed of the inverse problem in fluorescent molecular tomography (FMT), many regularization methods based on L₂ or L₁ norm have been proposed. Whereas, the quality of regularization parameters affects the performance of the reconstruction algorithm. Some classical parameter selection strategies usually need initialization of parameter range and high computing costs, which is not universal in the practical application of FMT. In this paper, an universally applicable adaptive parameter selection method based on maximizing the probability of data (MPD) strategy was proposed. This strategy used maximum a posteriori (MAP) estimation and maximum likelihood (ML) estimation to establish a regularization parameters model. The stable optimal regularization parameters can be determined by multiple iterative estimates. Numerical simulations and in vivo experiments show that MPD strategy can obtain stable regularization parameters for both regularization algorithms based on L₂ or L₁ norm and achieve good reconstruction performance.

Elastic net-based non-negative iterative three-operator splitting strategy for Cerenkov luminescence tomography

Cerenkov luminescence tomography (CLT) provides a powerful optical molecular imaging technique for non-invasive detection and visualization of radiopharmaceuticals in living objects. However, the severe photon scattering effect causes ill-posedness of the inverse problem, and the location accuracy and shape recovery of CLT reconstruction results are unsatisfactory for clinical application. Here, to improve the reconstruction spatial location accuracy and shape recovery ability, a non-negative iterative three operator splitting (NNITOS) strategy based on elastic net (EN) regularization was proposed. NNITOS formalizes the CLT reconstruction as a non-convex optimization problem and splits it into three operators, the least square, L_1/2-norm regularization, and adaptive grouping manifold learning, then iteratively solved them. After stepwise iterations, the result of NNITOS converged progressively. Meanwhile, to speed up the convergence and ensure the sparsity of the solution, shrinking the region of interest was utilized in this strategy. To verify the effectiveness of the method, numerical simulations and in vivo experiments were performed. The result of these experiments demonstrated that, compared to several methods, NNITOS can achieve superior performance in terms of location accuracy, shape recovery capability, and robustness. We hope this work can accelerate the clinical application of CLT in the future.

Application of Cherenkov radiation in tumor imaging and treatment

Cherenkov radiation (CR) is the characteristic blue glow that is generated during radiotherapy or radioisotope decay. Its distribution and intensity naturally reflect the actual dose and field of radiotherapy and the location of radioisotope imaging agents in vivo. Therefore, CR can represent a potential in situ light source for radiotherapy monitoring and radioisotope-based tumor imaging. When used in combination with new imaging techniques, molecular probes or nanomedicine, CR imaging exhibits unique advantages (accuracy, low cost, convenience and fast) in tumor radiotherapy monitoring and imaging. Furthermore, photosensitive nanomaterials can be used for CR photodynamic therapy, providing new approaches for integrating tumor imaging and treatment. Here the authors review the latest developments in the use of CR in tumor research and discuss current challenges and new directions for future studies.

Dual-Mode Tumor Imaging Using Probes That Are Responsive to Hypoxia-Induced Pathological Conditions

Hypoxia in solid tumors is associated with poor prognosis, increased aggressiveness, and strong resistance to therapeutics, making accurate monitoring of hypoxia important. Several imaging modalities have been used to study hypoxia, but each modality has inherent limitations. The use of a second modality can compensate for the limitations and validate the results of any single imaging modality. In this review, we describe dual-mode imaging systems for the detection of hypoxia that have been reported since the start of the 21st century. First, we provide a brief overview of the hallmarks of hypoxia used for imaging and the imaging modalities used to detect hypoxia, including optical imaging, ultrasound imaging, photoacoustic imaging, single-photon emission tomography, X-ray computed tomography, positron emission tomography, Cerenkov radiation energy transfer imaging, magnetic resonance imaging, electron paramagnetic resonance imaging, magnetic particle imaging, and surface-enhanced Raman spectroscopy, and mass spectrometric imaging. These overviews are followed by examples of hypoxia-relevant imaging using a mixture of probes for complementary single-mode imaging techniques. Then, we describe dual-mode molecular switches that are responsive in multiple imaging modalities to at least one hypoxia-induced pathological change. Finally, we offer future perspectives toward dual-mode imaging of hypoxia and hypoxia-induced pathophysiological changes in tumor microenvironments.

Cherenkov Luminescence in Tumor Diagnosis and Treatment: A Review

Malignant tumors rank as a leading cause of death worldwide. Accurate diagnosis and advanced treatment options are crucial to win battle against tumors. In recent years, Cherenkov luminescence (CL) has shown its technical advantages and clinical transformation potential in many important fields, particularly in tumor diagnosis and treatment, such as tumor detection in vivo, surgical navigation, radiotherapy, photodynamic therapy, and the evaluation of therapeutic effect. In this review, we summarize the advances in CL for tumor diagnosis and treatment. We first describe the physical principles of CL and discuss the imaging techniques used in tumor diagnosis, including CL imaging, CL endoscope, and CL tomography. Then we present a broad overview of the current status of surgical resection, radiotherapy, photodynamic therapy, and tumor microenvironment monitoring using CL. Finally, we shed light on the challenges and possible solutions for tumor diagnosis and therapy using CL.

Total Variation Constrained Graph Manifold Learning Strategy for Cerenkov Luminescence Tomography

Harnessing the power and flexibility of radiolabeled molecules, Cerenkov luminescence tomography (CLT) provides a novel technique for non-invasive visualisation and quantification of viable tumour cells in a living organism. However, owing to the photon scattering effect and the ill-posed inverse problem, CLT still suffers from insufficient spatial resolution and shape recovery in various preclinical applications. In this study, we proposed a total variation constrained graph manifold learning (TV-GML) strategy for achieving accurate spatial location, dual-source resolution, and tumour morphology. TV-GML integrates the isotropic total variation term and dynamic graph Laplacian constraint to make a trade-off between edge preservation and piecewise smooth region reconstruction. Meanwhile, the tetrahedral mesh-Cartesian grid pair method based on the k-nearest neighbour, and the adaptive and composite Barzilai-Borwein method, were proposed to ensure global super linear convergence of the solution of TV-GML. The comparison results of both simulation experiments and in vivo experiments further indicated that TV-GML achieved superior reconstruction performance in terms of location accuracy, dual-source resolution, shape recovery capability, robustness, and in vivo practicability. Significance: We believe that this novel method will be beneficial to the application of CLT for quantitative analysis and morphological observation of various preclinical applications and facilitate the development of the theory of solving inverse problem.

L1-L2 norm regularization via forward-backward splitting for fluorescence molecular tomography

Fluorescent molecular tomography (FMT) is a highly sensitive and noninvasive imaging approach for providing three-dimensional distribution of fluorescent marker probes. However, owing to its light scattering effect and the ill-posedness of inverse problems, it is challenging to develop an efficient reconstruction algorithm that can achieve the exact location and morphology of the fluorescence source. In this study, therefore, in order to satisfy the need for early tumor detection and improve the sparsity of solution, we proposed a novel L ₁-L ₂ norm regularization via the forward-backward splitting method for enhancing the FMT reconstruction accuracy and the robustness. By fully considering the highly coherent nature of the system matrix of FMT, it operates by splitting the objective to be minimized into simpler functions, which are dealt with individually to obtain a sparser solution. An analytic solution of L ₁-L ₂ norm proximal operators and a forward-backward splitting algorithm were employed to efficiently solve the nonconvex L ₁-L ₂ norm minimization problem. Numerical simulations and an in-vivo glioma mouse model experiment were conducted to evaluate the performance of our algorithm. The comparative results of these experiments demonstrated that the proposed algorithm obtained superior reconstruction performance in terms of spatial location, dual-source resolution, and in-vivo practicability. It was believed that this study would promote the preclinical and clinical applications of FMT in early tumor detection.

Attention mechanism-based locally connected network for accurate and stable reconstruction in Cerenkov luminescence tomography

Cerenkov luminescence tomography (CLT) is a novel and highly sensitive imaging technique, which could obtain the three-dimensional distribution of radioactive probes to achieve accurate tumor detection. However, the simplified radiative transfer equation and ill-conditioned inverse problem cause a reconstruction error. In this study, a novel attention mechanism based locally connected (AMLC) network was proposed to reduce barycenter error and improve morphological restorability. The proposed AMLC network consisted of two main parts: a fully connected sub-network for providing a coarse reconstruction result, and a locally connected sub-network based on an attention matrix for refinement. Both numerical simulations and in vivo experiments were conducted to show the superiority of the AMLC network in accuracy and stability over existing methods (MFCNN, KNN-LC network). This method improved CLT reconstruction performance and promoted the application of machine learning in optical imaging research.

A Multilevel Probabilistic Cerenkov Luminescence Tomography Reconstruction Framework Based on Energy Distribution Density Region Scaling

Cerenkov luminescence tomography (CLT) is a promising non-invasive optical imaging method with three-dimensional semiquantitative in vivo imaging capability. However, CLT itself relies on Cerenkov radiation, a low-intensity radiation, making CLT reconstruction more challenging than other imaging modalities. In order to solve the ill-posed inverse problem of CLT imaging, some numerical optimization or regularization methods need to be applied. However, in commonly used methods for solving inverse problems, parameter selection significantly influences the results. Therefore, this paper proposed a probabilistic energy distribution density region scaling (P-EDDRS) framework. In this framework, multiple reconstruction iterations are performed, and the Cerenkov source distribution of each reconstruction is treated as random variables. According to the spatial energy distribution density, the new region of interest (ROI) is solved. The size of the region required for the next operation was determined dynamically by combining the intensity characteristics. In addition, each reconstruction source distribution is given a probability weight value, and the prior probability in the subsequent reconstruction is refreshed. Last, all the reconstruction source distributions are weighted with the corresponding probability weights to get the final Cerenkov source distribution. To evaluate the performance of the P-EDDRS framework in CLT, this article performed numerical simulation, in vivo pseudotumor model mouse experiment, and breast cancer mouse experiment. Experimental results show that this reconstruction framework has better positioning accuracy and shape recovery ability and can optimize the reconstruction effect of multiple algorithms on CLT.

L1-L2 Minimization Via A Proximal Operator For Fluorescence Molecular Tomography

Fluorescent Molecular Tomography (FMT) is a highly sensitive and noninvasive imaging method that provides three-dimensional distribution of biomarkers by noninvasive detection of fluorescent marker probes. However, due to the light scattering effect and ill-posedness of inverse problems, it is challenging to develop an efficient construction method that can provide the exact location and morphology of the fluorescence distribution. In this paper, we proposed L₁-L₂ norm regularization to improve FMT reconstruction. In our research, proximal operators of non-convex L₁ -L₂ norm and forward-backward splitting method was adopted to solve the inverse problem of FMT. Simulation results on heterogeneous mouse model demonstrated that the proposed FBS method is superior to IVTCG, DCA and IRW-L_1/2 reconstruction methods in location accuracy and other aspects.

X-ray luminescence computed tomography using a hybrid proton propagation model and Lasso-LSQR algorithm

X-ray luminescence computed tomography (XLCT) uses external X-rays for luminescence excitation, which is becoming a promising molecular imaging technique with superb penetration depth and spatial resolution. To achieve the tomographic mapping of luminescence distribution, accurate optical propagation model and suitable reconstruction method are two keys for XLCT, but not satisfied. To overcome the limitation of the single proton propagation model (e.g., DE, SP₃ ), we adopted a hybrid diffusion equation with third order simplified spherical harmonics (DE-SP₃ ) model for XLCT. To enable fast iteration and accurate sparse reconstruction, we also integrated in the inversion optimization, with a novel Least Square QR-factorization based on the Lasso (Lasso-LSQR) algorithm. We first simulated the light propagation in various kinds of organs under DE model and SP₃ model, respectively. By comparison with the Monte Carlo, these tissues can be categorized into two types, namely DE-fitted tissues that include muscle and lung, and SP₃ -fitted tissues including heart, kidney, liver, and stomach. According to the above classification results, we built a hybrid DE-SP₃ model to more accurately describing light transport. Numerical simulations and in vivo experiments illustrated that hybrid DE-SP₃ model achieves superior reconstruction performance in terms of location accuracy, and spatial resolution than DE, and less computational cost than SP₃ . The hybrid DE-SP₃ model materializes a balance between accuracy and efficiency for XLCT.

Prior Compensation Algorithm for Cerenkov Luminescence Tomography From Single-View Measurements

Cerenkov luminescence tomography (CLT) has attracted much attention because of the wide clinically-used probes and three-dimensional (3D) quantification ability. However, due to the serious morbidity of 3D optical imaging, the reconstructed images of CLT are not appreciable, especially when single-view measurements are used. Single-view CLT improves the efficiency of data acquisition. It is much consistent with the actual imaging environment of using commercial imaging system, but bringing the problem that the reconstructed results will be closer to the animal surface on the side where the single-view image is collected. To avoid this problem to the greatest extent possible, we proposed a prior compensation algorithm for CLT reconstruction based on depth calibration strategy. This method takes full account of the fact that the attenuation of light in the tissue will depend heavily on the depth of the light source as well as the distance between the light source and the detection plane. Based on this consideration, a depth calibration matrix was designed to calibrate the attenuation between the surface light flux and the density of the internal light source. The feature of the algorithm was that the depth calibration matrix directly acts on the system matrix of CLT reconstruction, rather than modifying the regularization penalty items. The validity and effectiveness of the proposed algorithm were evaluated with a numerical simulation and a mouse-based experiment, whose results illustrated that it located the radiation sources accurately by using single-view measurements.

Correntropy-induced metric with Laplacian kernel for robust fluorescence molecular tomography

Fluorescence molecular tomography (FMT), which is used to visualize the three-dimensional distribution of fluorescence probe in small animals via the reconstruction method, has become a promising imaging technique in preclinical research. However, the classical reconstruction criterion is formulated based on the squared l ₂-norm distance metric, leaving it prone to being influenced by the presence of outliers. In this study, we propose a robust distance based on the correntropy-induced metric with a Laplacian kernel (CIML). The proposed metric satisfies the conditions of distance metric function and contains first and higher order moments of samples. Moreover, we demonstrate important properties of the proposed metric such as nonnegativity, nonconvexity, and boundedness, and analyze its robustness from the perspective of M-estimation. The proposed metric includes and extends the traditional metrics such as l ₀-norm and l ₁-norm metrics by setting an appropriate parameter. We show that, in reconstruction, the metric is a sparsity-promoting penalty. To reduce the negative effects of noise and outliers, a novel robust reconstruction framework is presented with the proposed correntropy-based metric. The proposed CIML model retains the advantages of the traditional model and promotes robustness. However, the nonconvexity of the proposed metric renders the CIML model difficult to optimize. Furthermore, an effective iterative algorithm for the CIML model is designed, and we present a theoretical analysis of its ability to converge. Numerical simulation and in vivo mouse experiments were conducted to evaluate the CIML method's performance. The experimental results show that the proposed method achieved more accurate fluorescent target reconstruction than the state-of-the-art methods in most cases, which illustrates the feasibility and robustness of the CIML method.

Comparison of the distributions of bremsstrahlung X-rays, Cerenkov light, and annihilation radiations for positron emitters

Positron emission tomography (PET) is a powerful tool because we can acquire functional information of tissue from the images with high sensitivity and relatively high spatial resolution. However, high-spatial-resolution PET imaging for high-energy positron emitters is difficult because the positrons have a long range and annihilation radiations are emitted at the endpoints of the positrons' trajectories. Along the trajectories, Cerenkov light (CL) is also emitted in advance of the emission of annihilation radiations. Hence, CL can be used for the imaging of high-energy positron emitters. Bremsstrahlung X-rays are also emitted along the trajectories of positrons, and imaging is possible. However, the differences in the spatial distributions of these three types of radiations are not obvious. Because CL and bremsstrahlung X-rays are produced before the endpoint of the positron, high-spatial-resolution imaging may be possible for high-energy positrons. In this study, to clarify this point, we simulated the spatial distribution of CL, bremsstrahlung X-rays, and annihilation radiations using Monte Carlo simulation and compared the distributions. The distributions of the bremsstrahlung X-rays and CL were smaller than those of the annihilation radiations in case of high energy positrons, and we found that the distributions of bremsstrahlung X-rays nearly matched those of CL for high-energy positron emitters. We concluded that CL and bremsstrahlung X-ray imaging have higher spatial resolution than annihilation radiation imaging for MeV ordered positron emitters, and thus they are promising for high-spatial-resolution imaging of high-energy positron emitters such as O-15 for ion therapy and Ga-68 for PET imaging.

Noninvasive multimodal fluorescence and magnetic resonance imaging of whole-organ intervertebral discs

Low back pain (LBP) is a commonly experienced symptom posing a tremendous healthcare burden to individuals and society at large. The LBP pathology is strongly linked to degeneration of the intervertebral disc (IVD), calling for development of early-stage diagnostic tools for visualizing biomolecular changes in IVD. Multimodal measurements of fluorescence molecular tomography (FMT) and magnetic resonance imaging (MRI) were performed on IVD whole organ culture model using an in-house built FMT system and a high-field MRI scanner. The resulted multimodal images were systematically validated through epifluorescence imaging of the IVD sections at a microscopic level. Multiple image contrasts were exploited, including fluorescence distribution, anatomical map associated with T1-weighted MRI contrast, and water content related with T2 relaxation time. The developed multimodality imaging approach may thus serve as a new assessment tool for early diagnosis of IVD degeneration and longitudinal monitoring of IVD organ culture status using fluorescence markers.

A Novel Adaptive Parameter Search Elastic Net Method for Fluorescent Molecular Tomography

Fluorescence molecular tomography (FMT) is a new type of medical imaging technology that can quantitatively reconstruct the three-dimensional distribution of fluorescent probes in vivo. Traditional Lp norm regularization techniques used in FMT reconstruction often face problems such as over-sparseness, over-smoothness, spatial discontinuity, and poor robustness. To address these problems, this paper proposes an adaptive parameter search elastic net (APSEN) method that is based on elastic net regularization, using weight parameters to combine the L1 and L2 norms. For the selection of elastic net weight parameters, this approach introduces the L0 norm of valid reconstruction results and the L2 norm of the residual vector, which are used to adjust the weight parameters adaptively. To verify the proposed method, a series of numerical simulation experiments were performed using digital mice with tumors as experimental subjects, and in vivo experiments of liver tumors were also conducted. The results showed that, compared with the state-of-the-art methods with different light source sizes or distances, Gaussian noise of 5%-25%, and the brute-force parameter search method, the APSEN method has better location accuracy, spatial resolution, fluorescence yield recovery ability, morphological characteristics, and robustness. Furthermore, the in vivo experiments demonstrated the applicability of APSEN for FMT.

Real-time intraoperative glioma diagnosis using fluorescence imaging and deep convolutional neural networks

Purpose

Surgery is the predominant treatment modality of human glioma but suffers difficulty on clearly identifying tumor boundaries in clinic. Conventional practice involves neurosurgeon’s visual evaluation and intraoperative histological examination of dissected tissues using frozen section, which is time-consuming and complex. The aim of this study was to develop fluorescent imaging coupled with artificial intelligence technique to quickly and accurately determine glioma in real-time during surgery.

Methods

Glioma patients (N = 23) were enrolled and injected with indocyanine green for fluorescence image–guided surgery. Tissue samples (N = 1874) were harvested from surgery of these patients, and the second near-infrared window (NIR-II, 1000–1700 nm) fluorescence images were obtained. Deep convolutional neural networks (CNNs) combined with NIR-II fluorescence imaging (named as FL-CNN) were explored to automatically provide pathological diagnosis of glioma in situ in real-time during patient surgery. The pathological examination results were used as the gold standard.

Results

The developed FL-CNN achieved the area under the curve (AUC) of 0.945. Comparing to neurosurgeons’ judgment, with the same level of specificity >80%, FL-CNN achieved a much higher sensitivity (93.8% versus 82.0%, P < 0.001) with zero time overhead. Further experiments demonstrated that FL-CNN corrected >70% of the errors made by neurosurgeons. FL-CNN was also able to rapidly predict grade and Ki-67 level (AUC 0.810 and 0.625) of tumor specimens intraoperatively.

Conclusion

Our study demonstrates that deep CNNs are better at capturing important information from fluorescence images than surgeons’ evaluation during patient surgery. FL-CNN is highly promising to provide pathological diagnosis intraoperatively and assist neurosurgeons to obtain maximum resection safely.

Trial registration

ChiCTR ChiCTR2000029402. Registered 29 January 2020, retrospectively registered

Supplementary Information

The online version contains supplementary material available at 10.1007/s00259-021-05326-y.

A deep unsupervised clustering-based post-processing framework for high-fidelity Cerenkov luminescence tomography

Cerenkov Luminescence Tomography (CLT) is a promising optical molecular imaging technology. It involves the three-dimensional reconstruction of the distribution of radionuclide probes inside a single object to indicate a tumor's localization and distribution. However, reconstruction using CLT suffers from severe ill-posedness, resulting in numerous artifacts within the reconstructed images. These artifacts influence the visual effect and may misguide the medical professional (diagnostician), resulting in a wrong diagnosis. Here, we proposed a deep unsupervised clustering-based post-processing framework to eliminate artifacts and facilitate high-fidelity CLT. First, an initial reconstructed image was obtained by a specific reconstruction method. Second, voxel data were generated based on the initial reconstructed result. Third, these voxels were divided into three groups, and only the group with the highest mean intensity was chosen as the final reconstructed result. A group of numerical simulation and in vivo mouse-based experiments were conducted to assess the presented framework's feasibility and potential. The results indicated that the proposed framework could reduce the number of artifacts effectively. The reconstructed image's shape and distribution were more similar to the actual light source than those obtained without the proposed framework.

Non-Negative Iterative Convex Refinement Approach for Accurate and Robust Reconstruction in Cerenkov Luminescence Tomography

Cerenkov luminescence tomography (CLT) is a promising imaging tool for obtaining three-dimensional (3D) non-invasive visualization of the in vivo distribution of radiopharmaceuticals. However, the reconstruction performance remains unsatisfactory for biomedical applications because the inverse problem of CLT is severely ill-conditioned and intractable. In this study, therefore, a novel non-negative iterative convex refinement (NNICR) approach was utilized to improve the CLT reconstruction accuracy, robustness as well as the shape recovery capability. The spike and slab prior information was employed to capture the sparsity of Cerenkov source, which could be formalized as a non-convex optimization problem. The NNICR approach solved this non-convex problem by refining the solutions of the convex sub-problems. To evaluate the performance of the NNICR approach, numerical simulations and in vivo tumor-bearing mice models experiments were conducted. Conjugated gradient based Tikhonov regularization approach (CG-Tikhonov), fast iterative shrinkage-thresholding algorithm based Lasso approach (Fista-Lasso) and Elastic-Net regularization approach were used for the comparison of the reconstruction performance. The results of these experiments demonstrated that the NNICR approach obtained superior reconstruction performance in terms of location accuracy, shape recovery capability, robustness and in vivo practicability. It was believed that this study would facilitate the preclinical and clinical applications of CLT in the future.

Development of tomographic reconstruction for three-dimensional optical imaging: From the inversion of light propagation to artificial intelligence

Optical molecular tomography (OMT) is an imaging modality which uses an optical signal, especially near-infrared light, to reconstruct the three-dimensional information of the light source in biological tissue. With the advantages of being low-cost, noninvasive and having high sensitivity, OMT has been applied in preclinical and clinical research. However, due to its serious ill-posedness and ill-condition, the solution of OMT requires heavy data analysis and the reconstruction quality is limited. Recently, the artificial intelligence (commonly known as AI)-based methods have been proposed to provide a different tool to solve the OMT problem. In this paper, we review the progress on OMT algorithms, from conventional methods to AI-based methods, and we also give a prospective towards future developments in this domain.

Sparse-graph manifold learning method for bioluminescence tomography

In preclinical researches, bioluminescence tomography (BLT) has widely been used for tumor imaging and monitoring, imaged-guided tumor therapy, and so forth. For these biological applications, both tumor spatial location and morphology analysis are the leading problems needed to be taken into account. However, most existing BLT reconstruction methods were proposed for some specific applications with a focus on sparse representation or morphology recovery, respectively. How to design a versatile algorithm that can simultaneously deal with both aspects remains an impending problem. In this study, a Sparse-Graph Manifold Learning (SGML) method was proposed to balance the source sparseness and morphology, by integrating non-convex sparsity constraint and dynamic Laplacian graph model. Furthermore, based on the nonconvex optimization theory and some iterative approximation, we proposed a novel iteratively reweighted soft thresholding algorithm (IRSTA) to solve the SGML model. Numerical simulations and in vivo experiments result demonstrated that the proposed SGML method performed much superior to the comparative methods in spatial localization and tumor morphology recovery for various source settings. It is believed that the SGML method can be applied to the related optical tomography and facilitate the development of optical molecular tomography.

A novel in vivo Cerenkov luminescence image-guided surgery on primary and metastatic colorectal cancer

Intraoperative Cerenkov luminescence imaging (CLI) can effectively improve the performance of tumor surgery. Nevertheless, the existing approaches are still unsatisfying to the clinical demands of open surgery. This study develops a novel intraoperative in vivo CLI approach to investigate the potential and value of Cerenkov luminescence (CL) image-guided surgery. A system characterized with high sensitivity (19.61 kBq mL^{-1 18} F-FDG) and desirable spatial resolution (88.34 μm) is developed. CL image-guided surgery is performed on colorectal cancer (CRC) models of mice and swine. Tumor surgery is guided by the static CL images, and the resection quality is evaluated quantitatively and contrasted with other imaging modalities exemplified by bioluminescence imaging (BLI). The in vivo results demonstrated the effectiveness of the proposed intraoperative CLI approach for removing primary and metastatic CRC. Safety of performing in vivo CL image-guided surgery is verified as well through radiation measurements of related staffs. Overall, the developed intraoperative in vivo CLI approach can efficiently improve the cancer treatment.

Reconstruction for Fluorescence Molecular Tomography via Adaptive Group Orthogonal Matching Pursuit

OBJECTIVE

Fluorescence molecular tomography (FMT) is a promising medical imaging technology aimed at the non-invasive, specific, and sensitive detection of the distribution of fluorophore. Conventional sparsity prior-based methods of FMT commonly face problems such as over-sparseness, spatial discontinuity, and poor robustness, due to the neglect of the interrelation within the local subspace. To address this, we propose an adaptive group orthogonal matching pursuit (AGOMP) method.

METHODS

AGOMP is based on a novel local spatial-structured sparse regularization, which leverages local spatial interrelations as group sparsity without the hard prior of the tumor region. The adaptive grouped subspace matching pursuit method was adopted to enhance the interrelatedness of elements within a group, which alleviates the over-sparsity problem to some extent and improves the accuracy, robustness, and morphological similarity of FMT reconstruction. A series of numerical simulation experiments, based on digital mouse with both one and several tumors, were conducted, as well as in vivo mouse experiments.

RESULTS

The results demonstrated that the proposed AGOMP method achieved better location accuracy, fluorescent yield reconstruction, relative sparsity, and morphology than state-of-the-art methods under complex conditions for levels of Gaussian noise ranging from 5-25%. Furthermore, the in vivo mouse experiments demonstrated the practical application of FMT with AGOMP.

CONCLUSION

The proposed AGOMP can improve the accuracy and robustness for FMT reconstruction in biomedical application.

A novel Cerenkov luminescence tomography approach using multilayer fully connected neural network

Cerenkov luminescence tomography (CLT) has been proved as an effective tool for various biomedical applications. Because of the severe scattering of Cerenkov luminescence, the performance of CLT remains unsatisfied. This paper proposed a novel CLT reconstruction approach based on a multilayer fully connected neural network (MFCNN). Monte Carlo simulation data was employed to train the MFCNN, and the complex relationship between the surface signals and the true sources was effectively learned by the network. Both simulation and in vivo experiments were performed to validate the performance of MFCNN CLT, and it was further compared with the typical radiative transfer equation (RTE) based method. The experimental data showed the superiority of MFCNN CLT in terms of accuracy and stability. This promising approach for CLT is expected to improve the performance of optical tomography, and to promote the exploration of machine learning in biomedical applications.

Endoscopic Cerenkov luminescence imaging and image-guided tumor resection on hepatocellular carcinoma-bearing mouse models

Detecting deep tumors inside living subject is still challenging for Cerenkov luminescence imaging (CLI). In this study, a high-sensitivity endoscopic CLI (ECLI) system was developed with a dual-mode deep cooling approach to improve the imaging sensitivity. System was characterized through a series of ex vivo studies. Furthermore, subcutaneous and orthotropic human hepatocellular carcinoma (HCC) mouse models were established for ECLI guided tumor resection in vivo. The results showed that the ECLI system had spatial resolution (62.5 μm) and imaging sensitivity (6.29 × 10^-2 kBq/μl ¹⁸F-FDG). The in vivo experimental data from the HCC mouse models demonstrated that the system was effective to intraoperatively guide the surgery of deep tumors such as liver cancer. Overall, the developed system exhibits promising potential for the applications of tumor precise resection and novel nanoprobe based optical imaging.

Iridium complex nanoparticle mediated radiopharmaceutical-excited phosphorescence imaging

We firstly perpared liposome coated [Ir(pq)₂(bpy)]Cl (Ir@liposome) as a transducer for radiopharmaceutical (¹⁸F-FDG) excited phosphorescence imaging (REPI).

Recent methodology advances in fluorescence molecular tomography

Molecular imaging (MI) is a novel imaging discipline that has been continuously developed in recent years. It combines biochemistry, multimodal imaging, biomathematics, bioinformatics, cell & molecular physiology, biophysics, and pharmacology, and it provides a new technology platform for the early diagnosis and quantitative analysis of diseases, treatment monitoring and evaluation, and the development of comprehensive physiology. Fluorescence Molecular Tomography (FMT) is a type of optical imaging modality in MI that captures the three-dimensional distribution of fluorescence within a biological tissue generated by a specific molecule of fluorescent material within a biological tissue. Compared with other optical molecular imaging methods, FMT has the characteristics of high sensitivity, low cost, and safety and reliability. It has become the research frontier and research hotspot of optical molecular imaging technology. This paper took an overview of the recent methodology advances in FMT, mainly focused on the photon propagation model of FMT based on the radiative transfer equation (RTE), and the reconstruction problem solution consist of forward problem and inverse problem. We introduce the detailed technologies utilized in reconstruction of FMT. Finally, the challenges in FMT were discussed. This survey aims at summarizing current research hotspots in methodology of FMT, from which future research may benefit.