1
|
Chang M, Zhang Z, Zhang X, He M, Qiu Z, Xu J. The configuration of DMD and the maximum intensity projection method for improving contrast in DMD-based confocal microscope. Microsc Res Tech 2018; 81:1017-1023. [PMID: 30238548 DOI: 10.1002/jemt.23067] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2018] [Revised: 04/11/2018] [Accepted: 05/17/2018] [Indexed: 11/08/2022]
Abstract
In this article, an operation strategy of digital micromirror device (DMD) and the maximum intensity projection (MIP) image processing method are proposed to improve the contrast of images in confocal microscopy. First, the configuration of DMD is demonstrated and the effect of scanning unit size on image performance is analyzed. Then, the image processing method MIP is applied. According to the MIP method, only the maximum intensity projection point of the same pixel is chosen from every image, and the maximum intensity projection point exactly corresponds to the positon where mirror is at "on" position during the scanning process in DMD-based confocal microscope system,. Thus, high contrast of images can be achieved by using MIP. Finally, experiments are conducted to verify imaging performance by changing the parameter of scanning unit size and applying a MIP image processing technique. The results show that DMD scanning unit size and MIP image processing techniques play important roles in improving image contrast. Smaller scanning unit size of DMD improves axial contrast but greatly decreases the signal to noise ratio, which thus leads to reduced image contrast. Larger scanning unit size produces a better signal to noise ratio, thus better image contrast. However, a large S will sacrifice the processing time. Therefore, DMD scanning unit size should be smaller on the premise that image contrast can be satisfied. RESEARCH HIGHLIGHTS: Effect of DMD scanning unit size setting on image contrast is analyzed and verified. The maximum intensity projection (MIP) is investigated to improve the image contrast. Experiments are conducted to verify the enhancement of the image contrast.
Collapse
Affiliation(s)
- Min Chang
- Shanghai Key Laboratory of Contemporary Optics System, College of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Zhiqiang Zhang
- Shanghai Key Laboratory of Contemporary Optics System, College of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Xuedian Zhang
- Shanghai Key Laboratory of Contemporary Optics System, College of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Menghui He
- Shanghai Key Laboratory of Contemporary Optics System, College of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Zhijie Qiu
- Shanghai Key Laboratory of Contemporary Optics System, College of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Jian Xu
- Department of Engineering Science and Mechanics, The Pennsylvania State University, University Park, Pennsylvania, 16802
| |
Collapse
|
2
|
Lee D, Gweon DG, Yoo H. Multipoint scanning dual-detection confocal microscopy for fast 3D volumetric measurement. J Microsc 2017; 270:200-209. [PMID: 29251786 DOI: 10.1111/jmi.12674] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2017] [Revised: 09/13/2017] [Accepted: 11/28/2017] [Indexed: 11/29/2022]
Abstract
We propose a multipoint scanning dual-detection confocal microscopy (MS-DDCM) system for fast 3D volumetric measurements. Unlike conventional confocal microscopy, MS-DDCM can accomplish surface profiling without axial scanning. Also, to rapidly obtain 2D images, the MS-DDCM employs a multipoint scanning technique, with a digital micromirror device used to produce arrays of effective pinholes, which are then scanned. The MS-DDCM is composed of two CCDs: one collects the conjugate images and the other collects nonconjugate images. The ratio of the axial response curves, measured by the two detectors, provides a linear relationship between the height of the sample surface and the ratio of the intensity signals. Furthermore, the difference between the two images results in enhanced contrast. The normalising effect of the MS-DDCM provides accurate sample heights, even when the reflectance distribution of the surface varies. Experimental results confirmed that the MS-DDCM achieved high-speed surface profiling with improved image contrast capability.
Collapse
Affiliation(s)
- D Lee
- Nano Opto-Mechatronics Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea.,Engineering Physics Division, National Institute of Standards and Technology (NIST), Gaithersburg, Maryland, USA
| | - D-G Gweon
- Nano Opto-Mechatronics Laboratory, Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | - H Yoo
- Biomedical Optics and Photomedicine Laboratory, Department of Biomedical Engineering, Hanyang University, Seoul, South Korea
| |
Collapse
|
3
|
Wang Q, Zheng J, Wang K, Gui K, Guo H, Zhuang S. Parallel detection experiment of fluorescence confocal microscopy using DMD. SCANNING 2016; 38:234-9. [PMID: 26331288 DOI: 10.1002/sca.21265] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2015] [Revised: 08/19/2015] [Accepted: 08/21/2015] [Indexed: 05/02/2023]
Abstract
Parallel detection of fluorescence confocal microscopy (PDFCM) system based on Digital Micromirror Device (DMD) is reported in this paper in order to realize simultaneous multi-channel imaging and improve detection speed. DMD is added into PDFCM system, working to take replace of the single traditional pinhole in the confocal system, which divides the laser source into multiple excitation beams. The PDFCM imaging system based on DMD is experimentally set up. The multi-channel image of fluorescence signal of potato cells sample is detected by parallel lateral scanning in order to verify the feasibility of introducing the DMD into fluorescence confocal microscope. In addition, for the purpose of characterizing the microscope, the depth response curve is also acquired. The experimental result shows that in contrast to conventional microscopy, the DMD-based PDFCM system has higher axial resolution and faster detection speed, which may bring some potential benefits in the biology and medicine analysis. SCANNING 38:234-239, 2016. © 2015 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
- Qingqing Wang
- Shanghai Key Laboratory of Modern Optical System, Engineering Research Center of Optical Instrument and System, Ministry of Education, University of Shanghai for Science and Technology, Shanghai, China
| | - Jihong Zheng
- Shanghai Key Laboratory of Modern Optical System, Engineering Research Center of Optical Instrument and System, Ministry of Education, University of Shanghai for Science and Technology, Shanghai, China
| | - Kangni Wang
- Shanghai Key Laboratory of Modern Optical System, Engineering Research Center of Optical Instrument and System, Ministry of Education, University of Shanghai for Science and Technology, Shanghai, China
| | - Kun Gui
- Shanghai Key Laboratory of Modern Optical System, Engineering Research Center of Optical Instrument and System, Ministry of Education, University of Shanghai for Science and Technology, Shanghai, China
| | - Hanming Guo
- Shanghai Key Laboratory of Modern Optical System, Engineering Research Center of Optical Instrument and System, Ministry of Education, University of Shanghai for Science and Technology, Shanghai, China
| | - Songlin Zhuang
- Shanghai Key Laboratory of Modern Optical System, Engineering Research Center of Optical Instrument and System, Ministry of Education, University of Shanghai for Science and Technology, Shanghai, China
| |
Collapse
|
4
|
Martial FP, Hartell NA. Programmable illumination and high-speed, multi-wavelength, confocal microscopy using a digital micromirror. PLoS One 2012; 7:e43942. [PMID: 22937130 PMCID: PMC3427176 DOI: 10.1371/journal.pone.0043942] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2012] [Accepted: 07/30/2012] [Indexed: 11/19/2022] Open
Abstract
Confocal microscopy is routinely used for high-resolution fluorescence imaging of biological specimens. Most standard confocal systems scan a laser across a specimen and collect emitted light passing through a single pinhole to produce an optical section of the sample. Sequential scanning on a point-by-point basis limits the speed of image acquisition and even the fastest commercial instruments struggle to resolve the temporal dynamics of rapid cellular events such as calcium signals. Various approaches have been introduced that increase the speed of confocal imaging. Nipkov disk microscopes, for example, use arrays of pinholes or slits on a spinning disk to achieve parallel scanning which significantly increases the speed of acquisition. Here we report the development of a microscope module that utilises a digital micromirror device as a spatial light modulator to provide programmable confocal optical sectioning with a single camera, at high spatial and axial resolution at speeds limited by the frame rate of the camera. The digital micromirror acts as a solid state Nipkov disk but with the added ability to change the pinholes size and separation and to control the light intensity on a mirror-by-mirror basis. The use of an arrangement of concave and convex mirrors in the emission pathway instead of lenses overcomes the astigmatism inherent with DMD devices, increases light collection efficiency and ensures image collection is achromatic so that images are perfectly aligned at different wavelengths. Combined with non-laser light sources, this allows low cost, high-speed, multi-wavelength image acquisition without the need for complex wavelength-dependent image alignment. The micromirror can also be used for programmable illumination allowing spatially defined photoactivation of fluorescent proteins. We demonstrate the use of this system for high-speed calcium imaging using both a single wavelength calcium indicator and a genetically encoded, ratiometric, calcium sensor.
Collapse
Affiliation(s)
- Franck P. Martial
- Department of Cell Physiology and Pharmacology, University of Leicester, Leicester, United Kingdom
| | - Nicholas A. Hartell
- Department of Cell Physiology and Pharmacology, University of Leicester, Leicester, United Kingdom
- * E-mail:
| |
Collapse
|
5
|
ZHENG J, JIANG Y, ZHANG Y, TANG P, HUANG A, ZHUANG S. Experiments and quantitative analysis of frequency division multiplexing confocal fluorescence microscopy with UV excitation. J Microsc 2011; 244:129-35. [DOI: 10.1111/j.1365-2818.2011.03517.x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
6
|
Zheng J, Sun G, Jiang Y, Wang T, Huang A, Zhang Y, Tang P, Zhuang S, Liu Y, Yin S. H-PDLC based waveform controllable optical choppers for FDMF microscopy. OPTICS EXPRESS 2011; 19:2216-2224. [PMID: 21369039 DOI: 10.1364/oe.19.002216] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
An electrically waveform controllable optical chopper based on holographic polymer dispersed liquid crystal grating (H-PDLC) is presented in this paper. The theoretical analyses and experimental results show that the proposed optical chopper has following merits: (1) controllable waveform, (2) no mechanical motion induced vibrational noise, and
(3) multiple-channel integration capability. The application of this unique electrically controllable optical chopper to frequency division multiplexed fluorescent microscopy is also addressed in this paper, which has the potential to increase the channel capacity, the stability and the reliability. This will be beneficial to the parallel detection, especially for dynamic studies of living biological samples.
Collapse
Affiliation(s)
- Jihong Zheng
- College of Optics and Electron Information Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China.
| | | | | | | | | | | | | | | | | | | |
Collapse
|