1
|
Deng Q, Wong CO, Sitharan R, Meng X. Design of image intelligent focusing system based on improved SMD function and RBF algorithm. PLoS One 2024; 19:e0307319. [PMID: 39116090 PMCID: PMC11309426 DOI: 10.1371/journal.pone.0307319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Accepted: 07/02/2024] [Indexed: 08/10/2024] Open
Abstract
The utilization of digital statistical processes in images and videos can effectively tackle numerous challenges encountered in optical sensors. This research endeavors to overcome the limitations inherent in traditional focus models, particularly their inadequate accuracy. It aims to bolster the precision of real-time perception and dynamic control by employing enhanced data fusion methodologies. The ultimate objective is to facilitate information services that enable seamless interaction and profound integration between computational and physical processes within an open environment. To achieve this, an enhanced sum-modulus difference (SMD) evaluation function has been proposed. This innovation is founded on the concept of threshold value evaluation, aimed at rectifying the accuracy shortcomings of traditional focusing models. Through the computation of each gray value after threshold segmentation, the method identifies the most suitable threshold for image segmentation. This identified threshold is then applied to the focus search strategy employing the radial basis function (RBF) algorithm. Furthermore, an intelligent focusing system has been developed on the Zynq development platform, encompassing both hardware design and software program development. The test results affirm that the focusing model based on the improved SMD evaluation function rapidly identifies the peak point of the gray variance curve, ascertains the optimal focal plane position, and notably enhances the sensitivity of the focusing model.
Collapse
Affiliation(s)
- Qianwei Deng
- School of Film and Television Media, Wuchang University of Technology, Wuhan, Hubei, China
- Faculty of Creative Multimedia, Multimedia University, Cyberjaya, Negeri Selangor, Malaysia
| | - Chee-Onn Wong
- Faculty of Creative Multimedia, Multimedia University, Cyberjaya, Negeri Selangor, Malaysia
| | - Roopesh Sitharan
- Faculty of Creative Multimedia, Multimedia University, Cyberjaya, Negeri Selangor, Malaysia
| | - Xiangbin Meng
- Cheung Kong School of Journalism and Communication, Shantou University, Shantou, Guangdong, China
| |
Collapse
|
2
|
Xu J, Zhang P, Chen Y. Surface Plasmon Resonance Biosensors: A Review of Molecular Imaging with High Spatial Resolution. BIOSENSORS 2024; 14:84. [PMID: 38392003 PMCID: PMC10886473 DOI: 10.3390/bios14020084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/28/2023] [Revised: 01/23/2024] [Accepted: 01/25/2024] [Indexed: 02/24/2024]
Abstract
Surface plasmon resonance (SPR) is a powerful tool for determining molecular interactions quantitatively. SPR imaging (SPRi) further improves the throughput of SPR technology and provides the spatially resolved capability for observing the molecular interaction dynamics in detail. SPRi is becoming more and more popular in biological and chemical sensing and imaging. However, SPRi suffers from low spatial resolution due to the imperfect optical components and delocalized features of propagating surface plasmonic waves along the surface. Diverse kinds of approaches have been developed to improve the spatial resolution of SPRi, which have enormously impelled the development of the methodology and further extended its possible applications. In this minireview, we introduce the mechanisms for building a high-spatial-resolution SPRi system and present its experimental schemes from prism-coupled SPRi and SPR microscopy (SPRM) to surface plasmonic scattering microscopy (SPSM); summarize its exciting applications, including molecular interaction analysis, molecular imaging and profiling, tracking of single entities, and analysis of single cells; and discuss its challenges in recent decade as well as the promising future.
Collapse
Affiliation(s)
- Jiying Xu
- National & Local Joint Engineering Research Center for Mineral Salt Deep Utilization, Faculty of Chemical Engineering, Huaiyin Institute of Technology, Huaian 223003, China
- Key Laboratory of Analytical Chemistry for Living Biosystems, Institute of Chemistry, Chinese Academy of Sciences, Beijing 100190, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Pengfei Zhang
- Key Laboratory of Analytical Chemistry for Living Biosystems, Institute of Chemistry, Chinese Academy of Sciences, Beijing 100190, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yi Chen
- National & Local Joint Engineering Research Center for Mineral Salt Deep Utilization, Faculty of Chemical Engineering, Huaiyin Institute of Technology, Huaian 223003, China
- Key Laboratory of Analytical Chemistry for Living Biosystems, Institute of Chemistry, Chinese Academy of Sciences, Beijing 100190, China
| |
Collapse
|
3
|
Chen H, Yang L, Zhu W, Tang P, Xing X, Zhang W, Zhong L. Raman signal optimization based on residual network adaptive focusing. SPECTROCHIMICA ACTA. PART A, MOLECULAR AND BIOMOLECULAR SPECTROSCOPY 2024; 310:123949. [PMID: 38277779 DOI: 10.1016/j.saa.2024.123949] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 01/18/2024] [Accepted: 01/21/2024] [Indexed: 01/28/2024]
Abstract
Due to its high sensitivity and specificity, Micro-Raman spectroscopy has emerged as a vital technique for molecular recognition and identification. As a weakly scattered signal, ensuring the accurate focus of the sample is essential for acquiring high quality Raman spectral signal and its analysis, especially in some complex microenvironments such as intracellular settings. Traditional autofocus methods are often time consuming or necessitate additional hardware, limiting real-time sample observation and device compatibility. Here, we propose an adaptive focusing method based on residual network to realize rapid and accurate focusing on Micro-Raman measurements. Using only a bright field image of the sample acquired on any image plane, we can predict the defocus distance with a residual network trained by Resnet50, in which the focus position is determined by combining the gradient and discrete cosine transform. Further, detailed regional division of the bright field map used for characterizing the height variation of actual sample surface is performed. As a result, a focus prediction map with 1μm accuracy is obtained from a bright field image in 120 ms. Based on this method, we successfully realize Raman signal optimization and the necessary correction of spectral information. This adaptive focusing method based on residual network is beneficial to further enhance the sensitivity and accuracy of Micro-Raman spectroscopy technology, which is of great significance in promoting the wide application of Raman spectroscopy.
Collapse
Affiliation(s)
- Haozhao Chen
- Key Laboratory of Photonic Technology for Integrated Sensing and Communication, Ministry of Education, Guangdong University of Technology, Guangzhou 510006, China
| | - Liwei Yang
- Guangdong Provincial Key Laboratory of Nanophotonic Functional Materials and Devices, South China Normal University, Guangzhou 510006, China
| | - Weile Zhu
- Key Laboratory of Photonic Technology for Integrated Sensing and Communication, Ministry of Education, Guangdong University of Technology, Guangzhou 510006, China
| | - Ping Tang
- Key Laboratory of Photonic Technology for Integrated Sensing and Communication, Ministry of Education, Guangdong University of Technology, Guangzhou 510006, China
| | - Xinyue Xing
- Guangdong Provincial Key Laboratory of Nanophotonic Functional Materials and Devices, South China Normal University, Guangzhou 510006, China
| | - Weina Zhang
- Key Laboratory of Photonic Technology for Integrated Sensing and Communication, Ministry of Education, Guangdong University of Technology, Guangzhou 510006, China
| | - Liyun Zhong
- Key Laboratory of Photonic Technology for Integrated Sensing and Communication, Ministry of Education, Guangdong University of Technology, Guangzhou 510006, China.
| |
Collapse
|
4
|
Hua Z, Zhang X, Tu D. High-precision microscopic autofocus with a single natural image. OPTICS EXPRESS 2023; 31:43372-43389. [PMID: 38178432 DOI: 10.1364/oe.507757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2023] [Accepted: 11/20/2023] [Indexed: 01/06/2024]
Abstract
In industrial microscopic detection, learning-based autofocus methods have empowered operators to acquire high-quality images quickly. However, there are two parts of errors in Learning-based methods: the fitting error of the network model and the making error of the prior dataset, which limits the potential for further improvements in focusing accuracy. In this paper, a high-precision autofocus pipeline was introduced, which predicts the defocus distance from a single natural image. A new method for making datasets was proposed, which overcomes the limitations of the sharpness metric itself and improves the overall accuracy of the dataset. Furthermore, a lightweight regression network was built, namely Natural-image Defocus Prediction Model (NDPM), to improve the focusing accuracy. A realistic dataset of sufficient size was made to train all models. The experiment shows NDPM has better focusing performance compared with other models, with a mean focusing error of 0.422µm.
Collapse
|
5
|
Recent advances in surface plasmon resonance imaging and biological applications. Talanta 2023; 255:124213. [PMID: 36584617 DOI: 10.1016/j.talanta.2022.124213] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 12/19/2022] [Accepted: 12/20/2022] [Indexed: 12/28/2022]
Abstract
Surface Plasmon Resonance Imaging (SPRI) is a robust technique for visualizing refractive index changes, which enables researchers to observe interactions between nanoscale objects in an imaging manner. In the past period, scholars have been attracted by the Prism-Coupled and Non-prism Coupled configurations of SPRI and have published numerous experimental results. This review describes the principle of SPRI and discusses recent developments in Prism-Coupled and Non-prism Coupled SPRI techniques in detail, respectively. And then, major advances in biological applications of SPRI are reviewed, including four sub-fields (cells, viruses, bacteria, exosomes, and biomolecules). The purpose is to briefly summarize the recent advances of SPRI and provide an outlook on the development of SPRI in various fields.
Collapse
|
6
|
Sonoi R, Hagihara Y. Quantitative understanding of HepaRG cells during drug-induced intrahepatic cholestasis through changes in bile canaliculi dynamics. Pharmacol Res Perspect 2022; 10:e00960. [PMID: 35621230 PMCID: PMC9137115 DOI: 10.1002/prp2.960] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 04/18/2022] [Indexed: 11/09/2022] Open
Abstract
An understanding of the quantitative relationship between bile canaliculus (BC) dynamics and the disruption of tight junctions (TJs) during drug-induced intrahepatic cholestasis may lead to new strategies aimed at drug development and toxicity testing. To investigate the relationship between BC dynamics and TJ disruption, we retrospectively analyzed the extent of TJ disruption in response to changes in the dynamics of BCs cultured with entacapone (ENT). Three hours after adding ENT, the ZO-1-negative BC surface area ratio became significantly higher (4.1-fold) than those of ZO-1-positive BCs. Based on these data, we calculated slopes of surface area changes, m, of each ZO-1-positive and ZO-1-negative BC. BCs with m ≤ 15 that fell within the 95% confidence interval of ZO-1-positive BCs were defined as ZO-1-positive. To validate this method, we compared the frequency of ZO-1-positive BCs, FZ , with that of BCs with m ≤ 15, FT , in culture using drugs that regulate TJ, or induce intrahepatic cholestasis. FT values were correlated with FZ under all culture conditions (R2 = .99). Our results indicate that the magnitude of BC surface area changes is a factor affecting TJ disruption, suggesting that maintaining TJ integrity by slowing BC dilation inhibits cell death.
Collapse
Affiliation(s)
- Rie Sonoi
- Biomedical Research Institute, National Institute of Advanced Industrial Science and Technology, Ikeda, Osaka, Japan
| | - Yoshihisa Hagihara
- Biomedical Research Institute, National Institute of Advanced Industrial Science and Technology, Ikeda, Osaka, Japan
| |
Collapse
|
7
|
Wang X, Zeng Q, Xie F, Wang J, Yang Y, Xu Y, Li J, Yu H. Automated Nanoparticle Analysis in Surface Plasmon Resonance Microscopy. Anal Chem 2021; 93:7399-7404. [PMID: 33973472 DOI: 10.1021/acs.analchem.1c01493] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
The unique capability of surface plasmon resonance microscopy (SPRM) in single nanoparticle analysis has found use in various chemical and biological applications. While SPRM offers exceptional sensitivity, the statistical analysis of numerous nanoparticles has been extremely laborious and time-consuming. Herein, we presented an image processing software package for nanoparticle analysis in SPRM, which is empowered by a deep learning algorithm. This package enabled fully automated nanoparticle identification, digital counting, three-dimensional tracking of particle locations, and quantification of dwell time and Brownian motion properties. With a built-in image filtering process to improve the contrast, robust identification and analysis have been achieved from SPRM images of low refractive index nanoparticles. This software tool would largely promote the translation of SPRM technology into the digital sensing platform for high throughput sample screening.
Collapse
Affiliation(s)
- Xu Wang
- College of Automation, Hangzhou Dianzi University, Hangzhou, Zhejiang Province 310018, People's Republic of China
| | - Qiang Zeng
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, People's Republic of China
| | - Feng Xie
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, People's Republic of China
| | - Jingan Wang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, People's Republic of China
| | - Yuting Yang
- Department of Instrument Science and Engineering, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200030, People's Republic of China
| | - Ying Xu
- College of Automation, Hangzhou Dianzi University, Hangzhou, Zhejiang Province 310018, People's Republic of China
| | - Jinghong Li
- Department of Chemistry, Key Laboratory of Bioorganic Phosphorus Chemistry and Chemical Biology, Tsinghua University, Beijing 100084, China
| | - Hui Yu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, People's Republic of China
| |
Collapse
|