1
|
Song P, Wang R, Loetgering L, Liu J, Vouras P, Lee Y, Jiang S, Feng B, Maiden A, Yang C, Zheng G. Ptycho-endoscopy on a lensless ultrathin fiber bundle tip. LIGHT, SCIENCE & APPLICATIONS 2024; 13:168. [PMID: 39019852 DOI: 10.1038/s41377-024-01510-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Revised: 06/10/2024] [Accepted: 06/25/2024] [Indexed: 07/19/2024]
Abstract
Synthetic aperture radar (SAR) utilizes an aircraft-carried antenna to emit electromagnetic pulses and detect the returning echoes. As the aircraft travels across a designated area, it synthesizes a large virtual aperture to improve image resolution. Inspired by SAR, we introduce synthetic aperture ptycho-endoscopy (SAPE) for micro-endoscopic imaging beyond the diffraction limit. SAPE operates by hand-holding a lensless fiber bundle tip to record coherent diffraction patterns from specimens. The fiber cores at the distal tip modulate the diffracted wavefield within a confined area, emulating the role of the 'airborne antenna' in SAR. The handheld operation introduces positional shifts to the tip, analogous to the aircraft's movement. These shifts facilitate the acquisition of a ptychogram and synthesize a large virtual aperture extending beyond the bundle's physical limit. We mitigate the influences of hand motion and fiber bending through a low-rank spatiotemporal decomposition of the bundle's modulation profile. Our tests demonstrate the ability to resolve a 548-nm linewidth on a resolution target. The achieved space-bandwidth product is ~1.1 million effective pixels, representing a 36-fold increase compared to that of the original fiber bundle. Furthermore, SAPE's refocusing capability enables imaging over an extended depth of field exceeding 2 cm. The aperture synthesizing process in SAPE surpasses the diffraction limit set by the probe's maximum collection angle, opening new opportunities for both fiber-based and distal-chip endoscopy in applications such as medical diagnostics and industrial inspection.
Collapse
Affiliation(s)
- Pengming Song
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA.
| | - Ruihai Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Lars Loetgering
- CarlZeiss AG, Carl Zeiss Promenade, Jena, Thuringia, 07745, Germany
| | - Jia Liu
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Peter Vouras
- United States Department of Defense, Washington, DC, 20301, USA
| | - Yujin Lee
- School of Electrical and Electronic Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Shaowei Jiang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Bin Feng
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Andrew Maiden
- Department of Electronic and Electrical Engineering, University of Sheffield, Sheffield, South Yorkshire S1 3JD, UK
- Diamond Light Source, Harwell, Oxfordshire, OX11 0DE, UK
| | - Changhuei Yang
- Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, 91125, USA
| | - Guoan Zheng
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA.
- Center for Biomedical and Bioengineering Innovation, University of Connecticut, Storrs, CT, 06269, USA.
| |
Collapse
|
2
|
Guo C, Huang Y, Han R, Wang R, Zhao Q, Jiang S, Song P, Shao X, Zheng G. Fly-scan high-throughput coded ptychographic microscopy via active micro-vibration and rolling-shutter distortion correction. OPTICS EXPRESS 2024; 32:8778-8790. [PMID: 38571127 DOI: 10.1364/oe.515249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 01/09/2024] [Indexed: 04/05/2024]
Abstract
Recent advancements in ptychography have demonstrated the potential of coded ptychography (CP) for high-resolution optical imaging in a lensless configuration. However, CP suffers imaging throughput limitations due to scanning inefficiencies. To address this, we propose what we believe is a novel 'fly-scan' scanning strategy utilizing two eccentric rotating mass (ERM) vibration motors for high-throughput coded ptychographic microscopy. The intrinsic continuity of the 'fly-scan' technique effectively eliminates the scanning overhead typically encountered during data acquisition. Additionally, its randomized scanning trajectory considerably reduces periodic artifacts in image reconstruction. We also developed what we believe to be a novel rolling-shutter distortion correction algorithm to fix the rolling-shutter effects. We built up a low-cost, DIY-made prototype platform and validated our approach with various samples including a resolution target, a quantitative phase target, a thick potato sample and biospecimens. The reported platform may offer a cost-effective and turnkey solution for high-throughput bio-imaging.
Collapse
|
3
|
Jiang S, Song P, Wang T, Yang L, Wang R, Guo C, Feng B, Maiden A, Zheng G. Spatial- and Fourier-domain ptychography for high-throughput bio-imaging. Nat Protoc 2023:10.1038/s41596-023-00829-4. [PMID: 37248392 DOI: 10.1038/s41596-023-00829-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 03/03/2023] [Indexed: 05/31/2023]
Abstract
First envisioned for determining crystalline structures, ptychography has become a useful imaging tool for microscopists. However, ptychography remains underused by biomedical researchers due to its limited resolution and throughput in the visible light regime. Recent developments of spatial- and Fourier-domain ptychography have successfully addressed these issues and now offer the potential for high-resolution, high-throughput optical imaging with minimal hardware modifications to existing microscopy setups, often providing an excellent trade-off between resolution and field of view inherent to conventional imaging systems, giving biomedical researchers the best of both worlds. Here, we provide extensive information to enable the implementation of ptychography by biomedical researchers in the visible light regime. We first discuss the intrinsic connections between spatial-domain coded ptychography and Fourier ptychography. A step-by-step guide then provides the user instructions for developing both systems with practical examples. In the spatial-domain implementation, we explain how a large-scale, high-performance blood-cell lens can be made at negligible expense. In the Fourier-domain implementation, we explain how adding a low-cost light source to a regular microscope can improve the resolution beyond the limit of the objective lens. The turnkey operation of these setups is suitable for use by professional research laboratories, as well as citizen scientists. Users with basic experience in optics and programming can build the setups within a week. The do-it-yourself nature of the setups also allows these procedures to be implemented in laboratory courses related to Fourier optics, biomedical instrumentation, digital image processing, robotics and capstone projects.
Collapse
Affiliation(s)
- Shaowei Jiang
- Department of Biomedical Engineering, University of Connecticut, Storrs, USA
| | - Pengming Song
- Department of Biomedical Engineering, University of Connecticut, Storrs, USA
| | - Tianbo Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, USA
| | - Liming Yang
- Department of Biomedical Engineering, University of Connecticut, Storrs, USA
| | - Ruihai Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, USA
| | - Chengfei Guo
- Department of Biomedical Engineering, University of Connecticut, Storrs, USA
- Hangzhou Institute of Technology, Xidian University, Hangzhou, China
| | - Bin Feng
- Department of Biomedical Engineering, University of Connecticut, Storrs, USA
| | - Andrew Maiden
- Department of Electronic and Electrical Engineering, University of Sheffield, Sheffield, UK
- Diamond Light Source, Harwell Science and Innovation Campus, Chilton, UK
| | - Guoan Zheng
- Department of Biomedical Engineering, University of Connecticut, Storrs, USA.
| |
Collapse
|