1
|
Adams P, Greaves TL, Martin AV. Crystal structure via fluctuation scattering. IUCRJ 2024; 11:538-555. [PMID: 38842120 PMCID: PMC11220891 DOI: 10.1107/s2052252524003932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2023] [Accepted: 04/30/2024] [Indexed: 06/07/2024]
Abstract
Crystallography is a quintessential method for determining the atomic structure of crystals. The most common implementation of crystallography uses single crystals that must be of sufficient size, typically tens of micrometres or larger, depending on the complexity of the crystal structure. The emergence of serial data-collection methods in crystallography, particularly for time-resolved experiments, opens up opportunities to develop new routes to structure determination for nanocrystals and ensembles of crystals. Fluctuation X-ray scattering is a correlation-based approach for single-particle imaging from ensembles of identical particles, but has yet to be applied to crystal structure determination. Here, an iterative algorithm is presented that recovers crystal structure-factor intensities from fluctuation X-ray scattering correlations. The capabilities of this algorithm are demonstrated by recovering the structure of three small-molecule crystals and a protein crystal from simulated fluctuation X-ray scattering correlations. This method could facilitate the recovery of structure-factor intensities from crystals in serial crystallography experiments and relax sample requirements for crystallography experiments.
Collapse
|
2
|
Orr KP, Diao J, Dey K, Hameed M, Dubajić M, Gilbert HL, Selby TA, Zelewski SJ, Han Y, Fitzsimmons MR, Roose B, Li P, Fan J, Jiang H, Briscoe J, Robinson IK, Stranks SD. Strain Heterogeneity and Extended Defects in Halide Perovskite Devices. ACS ENERGY LETTERS 2024; 9:3001-3011. [PMID: 38911532 PMCID: PMC11190982 DOI: 10.1021/acsenergylett.4c00921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/31/2024] [Revised: 05/13/2024] [Accepted: 05/20/2024] [Indexed: 06/25/2024]
Abstract
Strain is an important property in halide perovskite semiconductors used for optoelectronic applications because of its ability to influence device efficiency and stability. However, descriptions of strain in these materials are generally limited to bulk averages of bare films, which miss important property-determining heterogeneities that occur on the nanoscale and at interfaces in multilayer device stacks. Here, we present three-dimensional nanoscale strain mapping using Bragg coherent diffraction imaging of individual grains in Cs0.1FA0.9Pb(I0.95Br0.05)3 and Cs0.15FA0.85SnI3 (FA = formamidinium) halide perovskite absorbers buried in full solar cell devices. We discover large local strains and striking intragrain and grain-to-grain strain heterogeneity, identifying distinct islands of tensile and compressive strain inside grains. Additionally, we directly image dislocations with surprising regularity in Cs0.15FA0.85SnI3 grains and find evidence for dislocation-induced antiphase boundary formation. Our results shine a rare light on the nanoscale strains in these materials in their technologically relevant device setting.
Collapse
Affiliation(s)
- Kieran
W. P. Orr
- Department
of Physics, Cavendish Laboratory, University
of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, U.K.
- Department
of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge CB3 0AS, U.K.
| | - Jiecheng Diao
- Center
for Transformative Science, ShanghaiTech
University, Shanghai 201210, China
| | - Krishanu Dey
- Department
of Physics, Cavendish Laboratory, University
of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, U.K.
| | - Madsar Hameed
- School
of Engineering and Materials Science, Queen
Mary University of London, Mile End Road, London E1 4NS, U.K.
| | - Miloš Dubajić
- Department
of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge CB3 0AS, U.K.
| | - Hayley L. Gilbert
- Department
of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge CB3 0AS, U.K.
- Diamond
Light Source, Harwell Science and Innovation Campus, Fermi Avenue, Didcot OX11 0DE, U.K.
| | - Thomas A. Selby
- Department
of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge CB3 0AS, U.K.
| | - Szymon J. Zelewski
- Department
of Physics, Cavendish Laboratory, University
of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, U.K.
- Department
of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge CB3 0AS, U.K.
| | - Yutong Han
- Department
of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge CB3 0AS, U.K.
| | - Melissa R. Fitzsimmons
- Department
of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge CB3 0AS, U.K.
| | - Bart Roose
- Department
of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge CB3 0AS, U.K.
| | - Peng Li
- Diamond
Light Source, Harwell Science and Innovation Campus, Fermi Avenue, Didcot OX11 0DE, U.K.
| | - Jiadong Fan
- Center
for Transformative Science, ShanghaiTech
University, Shanghai 201210, China
| | - Huaidong Jiang
- Center
for Transformative Science, ShanghaiTech
University, Shanghai 201210, China
| | - Joe Briscoe
- School
of Engineering and Materials Science, Queen
Mary University of London, Mile End Road, London E1 4NS, U.K.
| | - Ian K. Robinson
- London
Centre
for Nanotechnology, University College London, London WC1E 6BT, U.K.
- Condensed
Matter Physics and Materials Science Department, Brookhaven National Laboratory, Upton, New York 11793, United States
| | - Samuel D. Stranks
- Department
of Physics, Cavendish Laboratory, University
of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, U.K.
- Center
for Transformative Science, ShanghaiTech
University, Shanghai 201210, China
| |
Collapse
|
3
|
Kandel S, Maddali S, Huang X, Nashed YSG, Jacobsen C, Allain M, Hruszkewycz SO. Imaging extended single crystal lattice distortion fields with multi-peak Bragg ptychography. OPTICS EXPRESS 2024; 32:19594-19610. [PMID: 38859091 DOI: 10.1364/oe.516729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 02/27/2024] [Indexed: 06/12/2024]
Abstract
Recent advances in phase-retrieval-based x-ray imaging methods have demonstrated the ability to reconstruct 3D distortion vector fields within a nanocrystal by using coherent diffraction information from multiple crystal Bragg reflections. However, these works do not provide a solution to the challenges encountered in imaging lattice distortions in crystals with significant defect content that result in phase wrapping. Moreover, these methods only apply to isolated crystals smaller than the x-ray illumination, and therefore cannot be used for imaging of distortions in extended crystals. We introduce multi-peak Bragg ptychography which addresses both challenges via an optimization framework that combines stochastic gradient descent and phase unwrapping methods for robust image reconstruction of lattice distortions and defects in extended crystals. Our work uses modern automatic differentiation toolsets so that the method is easy to extend to other settings and easy to implement in high-performance computers. This work is particularly timely given the broad interest in using the increased coherent flux in fourth-generation synchrotrons for innovative material research.
Collapse
|
4
|
Dejkameh A, Nebling R, Locans U, Kim HS, Mochi I, Ekinci Y. Recovery of spatial frequencies in coherent diffraction imaging in the presence of a central obscuration. Ultramicroscopy 2024; 258:113912. [PMID: 38217894 DOI: 10.1016/j.ultramic.2023.113912] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 12/08/2023] [Accepted: 12/19/2023] [Indexed: 01/15/2024]
Abstract
Coherent diffraction imaging (CDI) and its scanning version, ptychography, are lensless imaging approaches used to iteratively retrieve a sample's complex scattering amplitude from its measured diffraction patterns. These imaging methods are most useful in extreme ultraviolet (EUV) and X-ray regions of the electromagnetic spectrum, where efficient imaging optics are difficult to manufacture. CDI relies on high signal-to-noise ratio diffraction data to recover the phase, but increasing the flux can cause saturation effects on the detector. A conventional solution to this problem is to place a beam stop in front of the detector. The pixel masking method is a common solution to the problem of missing frequencies due to a beam stop. This paper describes the information redundancy in the recorded data set and expands on how the reconstruction algorithm can exploit this redundancy to estimate the missing frequencies. Thereafter, we modify the size of the beam stop in experimental and simulation data to assess the impact of the missing frequencies, investigate the extent to which the lost portion of the diffraction spectrum can be recovered, and quantify the effect of the beam stop on the image quality. The experimental findings and simulations conducted for EUV imaging demonstrate that when using a beam stop, the numerical aperture of the condenser is a crucial factor in the recovery of lost frequencies. Our thorough investigation of the reconstructed images provides information on the overall quality of reconstruction and highlights the vulnerable frequencies if the beam stop size is larger than the extent of the illumination NA. The outcome of this study can be applied to other sources of frequency loss, and it will contribute to the improvement of experiments and reconstruction algorithms in CDI.
Collapse
Affiliation(s)
- Atoosa Dejkameh
- ETH Zürich, Rämistrasse 101, Zürich, 8092, Switzerland; Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland.
| | - Ricarda Nebling
- ETH Zürich, Rämistrasse 101, Zürich, 8092, Switzerland; Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| | - Uldis Locans
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| | - Hyun-Su Kim
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| | - Iacopo Mochi
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| | - Yasin Ekinci
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| |
Collapse
|
5
|
Berberich TB, Molodtsov SL, Kurta RP. A workflow for single-particle structure determination via iterative phasing of rotational invariants in fluctuation X-ray scattering. J Appl Crystallogr 2024; 57:324-343. [PMID: 38596737 PMCID: PMC11001396 DOI: 10.1107/s1600576724000992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 01/29/2024] [Indexed: 04/11/2024] Open
Abstract
Fluctuation X-ray scattering (FXS) offers a complementary approach for nano- and bioparticle imaging with an X-ray free-electron laser (XFEL), by extracting structural information from correlations in scattered XFEL pulses. Here a workflow is presented for single-particle structure determination using FXS. The workflow includes procedures for extracting the rotational invariants from FXS patterns, performing structure reconstructions via iterative phasing of the invariants, and aligning and averaging multiple reconstructions. The reconstruction pipeline is implemented in the open-source software xFrame and its functionality is demonstrated on several simulated structures.
Collapse
Affiliation(s)
- Tim B. Berberich
- European XFEL, Holzkoppel 4, 22869 Schenefeld, Germany
- I. Institute of Theoretical Physics, University of Hamburg, Notkestraße 9-11, 22607 Hamburg, Germany
| | - Serguei L. Molodtsov
- European XFEL, Holzkoppel 4, 22869 Schenefeld, Germany
- Institute of Experimental Physics, TU Bergakademie Freiberg, Leipziger Straße 23, 09599 Freiberg, Germany
- Center for Efficient High Temperature Processes and Materials Conversion (ZeHS), TU Bergakademie Freiberg, Winklerstrasse 5, 09599 Freiberg, Germany
| | | |
Collapse
|
6
|
Mi X, Zhang M, Li Z. Ultrafast X-ray Diffraction Probe of Coherent Spin-State Dynamics in Molecules. J Phys Chem Lett 2024; 15:681-686. [PMID: 38206838 DOI: 10.1021/acs.jpclett.3c02892] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2024]
Abstract
We propose an approach to probe coherent spin-state dynamics of molecules using circularly polarized hard X-ray pulses. For the dynamically aligned nitric oxide molecules in a coherent superposition spin-orbit coupled electronic state that can be prepared through stimulated Raman scattering, we demonstrate the capability of ultrafast X-ray diffraction to not only reveal the quantum beating of the coherent spin-state wave packet but also image the spatial spin density of the molecule. With a circularly polarized ultrafast X-ray diffraction signal, we show that the electronic density matrix can be retrieved. The spatiotemporal resolving power of ultrafast X-ray diffraction paves the way for tracking transient spatial wave function in molecular dynamics involving the spin degree of freedom.
Collapse
Affiliation(s)
- Xiaoyu Mi
- State Key Laboratory for Mesoscopic Physics and Collaborative Innovation Center of Quantum Matter, School of Physics, Peking University, Beijing 100871, China
| | - Ming Zhang
- State Key Laboratory for Mesoscopic Physics and Collaborative Innovation Center of Quantum Matter, School of Physics, Peking University, Beijing 100871, China
| | - Zheng Li
- State Key Laboratory for Mesoscopic Physics and Collaborative Innovation Center of Quantum Matter, School of Physics, Peking University, Beijing 100871, China
- Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan, Shanxi 030006, China
- Peking University Yangtze Delta Institute of Optoelectronics, Nantong, Jiangsu 226000, China
| |
Collapse
|
7
|
Lee SY, Cho DH, Song SC, Shin J, Hwang J, Park E, Lee SY, Kim S, Lee J, Song C. Nanoscale Three-Dimensional Network Structure of a Mesoporous Particle Unveiled via Adaptive Multidistance Coherent X-ray Tomography. ACS NANO 2023; 17:22488-22498. [PMID: 37851941 DOI: 10.1021/acsnano.3c05977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/20/2023]
Abstract
Mesoporous nanoparticles provide rich platforms to devise functional materials by customizing the three-dimensional (3D) structures of nanopores. With the pore network as a key tuning parameter, the noninvasive and quantitative characterization of these 3D structures is crucial for the rational design of functional materials. This has prompted researchers to develop versatile nanoprobes with a high penetration power to inspect various specimens sized a few micrometers at nanoscale 3D resolutions. Here, with adaptive phase retrievals on independent data sets with different sampling frequencies, we introduce multidistance coherent X-ray tomography as a noninvasive and quantitative nanoprobe to realize high-resolution 3D imaging of micrometer-sized specimens. The 3D density distribution of an entire mesoporous silica nanoparticle was obtained at 13 nm 3D resolution for quantitative physical and morphological analyses of its 3D pore structure. The morphological features of the whole 3D pore network and pore connectivity were examined to gain insight into the potential functions of the particles. The proposed multidistance tomographic imaging scheme with quantitative structural analyses is expected to advance studies of functional materials by facilitating their structure-based rational design.
Collapse
Affiliation(s)
- Sung Yun Lee
- Department of Physics, POSTECH, Pohang 37673, Korea
- Photon Science Center, POSTECH, Pohang 37673, Korea
- Center for Ultrafast Science on Quantum Matter, Max Planck POSTECH Korea Research Initiative, Pohang 37673, Korea
| | - Do Hyung Cho
- Department of Physics, POSTECH, Pohang 37673, Korea
- Photon Science Center, POSTECH, Pohang 37673, Korea
| | - Sung Chan Song
- Center for Ultrafast Science on Quantum Matter, Max Planck POSTECH Korea Research Initiative, Pohang 37673, Korea
- Department of Materials Science and Engineering, POSTECH, Pohang 37673, Korea
| | - Jaeyong Shin
- Department of Physics, POSTECH, Pohang 37673, Korea
- Photon Science Center, POSTECH, Pohang 37673, Korea
- Center for Ultrafast Science on Quantum Matter, Max Planck POSTECH Korea Research Initiative, Pohang 37673, Korea
| | - Junha Hwang
- Department of Physics, POSTECH, Pohang 37673, Korea
- Photon Science Center, POSTECH, Pohang 37673, Korea
- Center for Ultrafast Science on Quantum Matter, Max Planck POSTECH Korea Research Initiative, Pohang 37673, Korea
| | - Eunyoung Park
- Department of Physics, POSTECH, Pohang 37673, Korea
- Photon Science Center, POSTECH, Pohang 37673, Korea
- Center for Ultrafast Science on Quantum Matter, Max Planck POSTECH Korea Research Initiative, Pohang 37673, Korea
| | - Su Yong Lee
- Pohang Accelerator Laboratory, POSTECH, Pohang 37673, Korea
| | - Seongseop Kim
- School of Chemical Engineering, Clean Energy Research Center, Jeonbuk National University, Jeonju 54896, Korea
| | - Jinwoo Lee
- Department of Chemical and Biomolecular Engineering, KAIST, Daejeon 34141, Korea
| | - Changyong Song
- Department of Physics, POSTECH, Pohang 37673, Korea
- Photon Science Center, POSTECH, Pohang 37673, Korea
- Center for Ultrafast Science on Quantum Matter, Max Planck POSTECH Korea Research Initiative, Pohang 37673, Korea
| |
Collapse
|
8
|
Orr KWP, Diao J, Lintangpradipto MN, Batey DJ, Iqbal AN, Kahmann S, Frohna K, Dubajic M, Zelewski SJ, Dearle AE, Selby TA, Li P, Doherty TAS, Hofmann S, Bakr OM, Robinson IK, Stranks SD. Imaging Light-Induced Migration of Dislocations in Halide Perovskites with 3D Nanoscale Strain Mapping. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2023; 35:e2305549. [PMID: 37735999 DOI: 10.1002/adma.202305549] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 09/01/2023] [Indexed: 09/23/2023]
Abstract
In recent years, halide perovskite materials have been used to make high-performance solar cells and light-emitting devices. However, material defects still limit device performance and stability. Here, synchrotron-based Bragg coherent diffraction imaging is used to visualize nanoscale strain fields, such as those local to defects, in halide perovskite microcrystals. Significant strain heterogeneity within MAPbBr3 (MA = CH3 NH3 + ) crystals is found in spite of their high optoelectronic quality, and both 〈100〉 and 〈110〉 edge dislocations are identified through analysis of their local strain fields. By imaging these defects and strain fields in situ under continuous illumination, dramatic light-induced dislocation migration across hundreds of nanometers is uncovered. Further, by selectively studying crystals that are damaged by the X-ray beam, large dislocation densities and increased nanoscale strains are correlated with material degradation and substantially altered optoelectronic properties assessed using photoluminescence microscopy measurements. These results demonstrate the dynamic nature of extended defects and strain in halide perovskites, which will have important consequences for device performance and operational stability.
Collapse
Affiliation(s)
- Kieran W P Orr
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
- Department of Physics, Cavendish Laboratory, University of Cambridge, JJ Thomson Avenue, Cambridge, CB3 0HE, UK
| | - Jiecheng Diao
- London Centre for Nanotechnology, University College London, London, WC1E 6BT, UK
| | - Muhammad Naufal Lintangpradipto
- KAUST Catalysis Center (KCC), Division of Physical Sciences and Engineering (PSE), King Abdullah University of Science and Technology (KAUST), 23955-6900, Thuwal, Kingdom of Saudi Arabia
| | - Darren J Batey
- Diamond Light Source, Harwell Science and Innovation Campus, Fermi Ave, Didcot, OX11 0DE, UK
| | - Affan N Iqbal
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
- Department of Physics, Cavendish Laboratory, University of Cambridge, JJ Thomson Avenue, Cambridge, CB3 0HE, UK
| | - Simon Kahmann
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
- Department of Physics, Cavendish Laboratory, University of Cambridge, JJ Thomson Avenue, Cambridge, CB3 0HE, UK
| | - Kyle Frohna
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
- Department of Physics, Cavendish Laboratory, University of Cambridge, JJ Thomson Avenue, Cambridge, CB3 0HE, UK
| | - Milos Dubajic
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
| | - Szymon J Zelewski
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
- Department of Physics, Cavendish Laboratory, University of Cambridge, JJ Thomson Avenue, Cambridge, CB3 0HE, UK
| | - Alice E Dearle
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
- Department of Physics, Cavendish Laboratory, University of Cambridge, JJ Thomson Avenue, Cambridge, CB3 0HE, UK
- Department of Engineering, University of Cambridge, Cambridge, CB2 1PZ, UK
| | - Thomas A Selby
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
| | - Peng Li
- Diamond Light Source, Harwell Science and Innovation Campus, Fermi Ave, Didcot, OX11 0DE, UK
| | - Tiarnan A S Doherty
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
- Department of Physics, Cavendish Laboratory, University of Cambridge, JJ Thomson Avenue, Cambridge, CB3 0HE, UK
- Department of Materials Science & Metallurgy, University of Cambridge, 27 Charles Babbage Road, Cambridge, CB3 0FS, UK
| | - Stephan Hofmann
- Department of Engineering, University of Cambridge, Cambridge, CB2 1PZ, UK
| | - Osman M Bakr
- KAUST Catalysis Center (KCC), Division of Physical Sciences and Engineering (PSE), King Abdullah University of Science and Technology (KAUST), 23955-6900, Thuwal, Kingdom of Saudi Arabia
| | - Ian K Robinson
- London Centre for Nanotechnology, University College London, London, WC1E 6BT, UK
- Condensed Matter Physics and Materials Science Department, Brookhaven National Lab, Upton, New York, 11793, USA
| | - Samuel D Stranks
- Department of Chemical Engineering and Biotechnology, University of Cambridge, Philippa Fawcett Drive, Cambridge, CB3 0AS, UK
- Department of Physics, Cavendish Laboratory, University of Cambridge, JJ Thomson Avenue, Cambridge, CB3 0HE, UK
| |
Collapse
|
9
|
Yang Y, Sinha SK. Three-dimensional imaging using coherent x rays at grazing incidence geometry. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2023; 40:1500-1506. [PMID: 37707105 DOI: 10.1364/josaa.487448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Accepted: 06/26/2023] [Indexed: 09/15/2023]
Abstract
We have developed a three-dimensional coherent diffraction imaging algorithm to retrieve phases of diffraction patterns of samples in grazing incidence small angle x-ray scattering experiments. The algorithm interprets the diffraction patterns using the distorted-wave Born approximation instead of the Born approximation, as in this case, the existence of a reflected beam from the substrate causes the diffraction pattern to deviate significantly from the simple Fourier transform of the object. Detailed computer simulations show that the algorithm works. Verification with real experiments is planned.
Collapse
|
10
|
Kuzmenko AV, Butok OM. Phase retrieval for arbitrary complex-valued objects using structured illumination. OPTICS EXPRESS 2023; 31:24505-24515. [PMID: 37475276 DOI: 10.1364/oe.493331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Accepted: 06/26/2023] [Indexed: 07/22/2023]
Abstract
A method to solve of the phase retrieval problem in a non-convex formulation for complex-valued objects with a support constraint is proposed. It is shown that two coded diffraction patterns (CDPs) obtained in the same Fresnel or Fraunhofer diffraction plane by masking an object with two, direct and inverse, random binary amplitude masks, are sufficient to reconstruct an arbitrary complex-valued object up to the global phase. The general solution of the problem was found as the sum of two mutually phase-consistent partial solutions obtained by applying the modified error-reduction or hybrid input-output algorithm to each of two "mask+CDP" pairs. The results of model experiments confirmed the possibility of noise-resistant and high-accuracy retrieval of complex-valued objects of various types with the oversampling ratio σ ≥ 2 making use of a small number of iterations. The method is applicable to coherent radiation of any kind.
Collapse
|
11
|
Li X, Liu K, Liu Z, Guo J. High-precision phase retrieval method for speckle suppression based on optimized modulation masks. OPTICS EXPRESS 2023; 31:18824-18839. [PMID: 37381313 DOI: 10.1364/oe.489492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 05/05/2023] [Indexed: 06/30/2023]
Abstract
Traditional methods of coherent diffraction imaging using random masks result in an insufficient difference between the diffraction patterns, making it challenging to form a strong amplitude constraint, causing significant speckle noise in the measurement results. Hence, this study proposes an optimized mask design method combining random and Fresnel masks. Increasing the difference between diffraction intensity patterns enhances the amplitude constraint, suppresses the speckle noise effectively, and improves the phase recovery accuracy. The numerical distribution of the modulation masks is optimized by adjusting the combination ratio of the two mask modes. The simulation and physical experiments show that the reconstruction results of PSNR and SSIM using the proposed method are higher than those using random masks, and the speckle noises are effectively reduced.
Collapse
|
12
|
Lee K, Lim J, Lee SY, Park Y. Direct high-resolution X-ray imaging exploiting pseudorandomness. LIGHT, SCIENCE & APPLICATIONS 2023; 12:88. [PMID: 37024454 PMCID: PMC10079858 DOI: 10.1038/s41377-023-01124-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 02/28/2023] [Accepted: 03/03/2023] [Indexed: 06/19/2023]
Abstract
Owing to its unique penetrating power and high-resolution capability, X-ray imaging has been an irreplaceable tool since its discovery. Despite the significance, the resolution of X-ray imaging has largely been limited by the technical difficulties on X-ray lens making. Various lensless imaging methods have been proposed, but are yet relying on multiple measurements or additional constraints on measurements or samples. Here we present coherent speckle-correlation imaging (CSI) using a designed X-ray diffuser. CSI has no prerequisites for samples or measurements. Instead, from a single shot measurement, the complex sample field is retrieved based on the pseudorandomness of the speckle intensity pattern, ensured through a diffuser. We achieve a spatial resolution of 13.9 nm at 5.46 keV, beating the feature size of the diffuser used (300 nm). The high-resolution imaging capability is theoretically explained based on fundamental and practical limits. We expect the CSI to be a versatile tool for navigating the unexplored world of nanometer.
Collapse
Affiliation(s)
- KyeoReh Lee
- Department of Physics, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Republic of Korea.
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Republic of Korea.
| | - Jun Lim
- Pohang Accelerator Laboratory, Pohang University of Science and Technology, Pohang, Kyungbuk, 37637, Republic of Korea.
| | - Su Yong Lee
- Pohang Accelerator Laboratory, Pohang University of Science and Technology, Pohang, Kyungbuk, 37637, Republic of Korea
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Republic of Korea.
- KAIST Institute for Health Science and Technology, Korea Advanced Institute of Science and Technology, Daejeon, 34141, Republic of Korea.
- Tomocube Inc, Daejeon, 34051, Republic of Korea.
| |
Collapse
|
13
|
Colombo A, Dold S, Kolb P, Bernhardt N, Behrens P, Correa J, Düsterer S, Erk B, Hecht L, Heilrath A, Irsig R, Iwe N, Jordan J, Kruse B, Langbehn B, Manschwetus B, Martinez F, Meiwes-Broer KH, Oldenburg K, Passow C, Peltz C, Sauppe M, Seel F, Tanyag RMP, Treusch R, Ulmer A, Walz S, Fennel T, Barke I, Möller T, von Issendorff B, Rupp D. Three-dimensional femtosecond snapshots of isolated faceted nanostructures. SCIENCE ADVANCES 2023; 9:eade5839. [PMID: 36812315 PMCID: PMC9946342 DOI: 10.1126/sciadv.ade5839] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/25/2022] [Accepted: 01/24/2023] [Indexed: 06/18/2023]
Abstract
The structure and dynamics of isolated nanosamples in free flight can be directly visualized via single-shot coherent diffractive imaging using the intense and short pulses of x-ray free-electron lasers. Wide-angle scattering images encode three-dimensional (3D) morphological information of the samples, but its retrieval remains a challenge. Up to now, effective 3D morphology reconstructions from single shots were only achieved via fitting with highly constrained models, requiring a priori knowledge about possible geometries. Here, we present a much more generic imaging approach. Relying on a model that allows for any sample morphology described by a convex polyhedron, we reconstruct wide-angle diffraction patterns from individual silver nanoparticles. In addition to known structural motives with high symmetries, we retrieve imperfect shapes and agglomerates that were not previously accessible. Our results open unexplored routes toward true 3D structure determination of single nanoparticles and, ultimately, 3D movies of ultrafast nanoscale dynamics.
Collapse
Affiliation(s)
- Alessandro Colombo
- Laboratory for Solid State Physics, ETH Zurich, 8093 Zurich, Switzerland
| | - Simon Dold
- European XFEL GmbH, 22869 Schenefeld, Germany
| | - Patrice Kolb
- Laboratory for Solid State Physics, ETH Zurich, 8093 Zurich, Switzerland
| | - Nils Bernhardt
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Patrick Behrens
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Jonathan Correa
- Deutsches Elektronen-Synchrotron DESY, 22607 Hamburg, Germany
| | - Stefan Düsterer
- Deutsches Elektronen-Synchrotron DESY, 22607 Hamburg, Germany
| | - Benjamin Erk
- Deutsches Elektronen-Synchrotron DESY, 22607 Hamburg, Germany
| | - Linos Hecht
- Laboratory for Solid State Physics, ETH Zurich, 8093 Zurich, Switzerland
| | - Andrea Heilrath
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Robert Irsig
- Institute of Physics, University of Rostock, 18057 Rostock, Germany
| | - Norman Iwe
- Institute of Physics, University of Rostock, 18057 Rostock, Germany
| | - Jakob Jordan
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Björn Kruse
- Institute of Physics, University of Rostock, 18057 Rostock, Germany
| | - Bruno Langbehn
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | | | | | - Karl-Heinz Meiwes-Broer
- Institute of Physics, University of Rostock, 18057 Rostock, Germany
- Department of Life, Light and Matter, University of Rostock, 18051 Rostock, Germany
| | - Kevin Oldenburg
- Institute of Physics, University of Rostock, 18057 Rostock, Germany
| | | | - Christian Peltz
- Institute of Physics, University of Rostock, 18057 Rostock, Germany
| | - Mario Sauppe
- Laboratory for Solid State Physics, ETH Zurich, 8093 Zurich, Switzerland
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Fabian Seel
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Rico Mayro P. Tanyag
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Rolf Treusch
- Deutsches Elektronen-Synchrotron DESY, 22607 Hamburg, Germany
| | - Anatoli Ulmer
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Saida Walz
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Thomas Fennel
- Institute of Physics, University of Rostock, 18057 Rostock, Germany
| | - Ingo Barke
- Institute of Physics, University of Rostock, 18057 Rostock, Germany
- Department of Life, Light and Matter, University of Rostock, 18051 Rostock, Germany
| | - Thomas Möller
- Institut für Optik und Atomare Physik, Technische Universität Berlin, 10623 Berlin, Germany
| | - Bernd von Issendorff
- Department of Physics, University of Freiburg, 79104 Freiburg, Germany
- Freiburg Materials Research Center, University of Freiburg, 79104 Freiburg, Germany
| | - Daniela Rupp
- Laboratory for Solid State Physics, ETH Zurich, 8093 Zurich, Switzerland
- Max Born Institute, 12489 Berlin, Germany
| |
Collapse
|
14
|
Chubar O, Williams G, Gao Y, Li R, Berman L. Physical optics simulations for synchrotron radiation sources. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2022; 39:C240-C252. [PMID: 36520774 DOI: 10.1364/josaa.473367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Accepted: 11/07/2022] [Indexed: 06/17/2023]
Abstract
We describe approaches to high-accuracy physical optics calculations used for the development of x-ray beamlines at synchrotron radiation sources, as well as simulation of experiments and processing of experimental data at some of these beamlines. We pay special attention to the treatment of the partial coherence of x rays, a topic of high practical importance for modern low-emittance high-brightness synchrotron radiation facilities. The approaches are based, to a large extent, on the works of Emil Wolf and co-authors, including the basic scalar diffraction theory and the coherent mode decomposition method. The presented simulation examples are related to the case of the novel Coherent Diffractive Imaging beamline that is currently under development at the National Synchrotron Light Source II at the Brookhaven National Laboratory.
Collapse
|
15
|
Zhou G, Zhang S, Hu Y, Cao L, Huang Y, Hao Q. Embedded parallel Fourier ptychographic microscopy reconstruction system. APPLIED OPTICS 2022; 61:9296-9304. [PMID: 36607065 DOI: 10.1364/ao.468503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Accepted: 10/10/2022] [Indexed: 06/17/2023]
Abstract
Fourier ptychographic microscopy (FPM) has attracted a wide range of focus for its ability of large space-bandwidth product and quantitative phase imaging. It is a typical computational imaging technique that jointly optimizes imaging hardware and reconstruction algorithms. The data redundancy and inverse problem algorithms are the sources of FPM's excellent performance. But at the same time, this large amount of data processing and complex algorithms also evidently reduce the imaging speed. To accelerate the FPM reconstruction speed, we proposed a fast FPM reconstruction framework consisting of three levels of parallel computation and implemented it with an embedded computing module. In the conventional FPM framework, the sample image is divided into multiple sub-regions to process separately because the illumination angles and defocus distances for different sub-regions may also be different. Our parallel framework first performs digital refocusing and high-resolution reconstruction for each sub-region separately and then stitches the complex sub-regions together to obtain the final high-resolution complex image. The feasibility of the proposed parallel FPM reconstruction framework is verified with different experimental results acquired with the system we built.
Collapse
|
16
|
Kingston RL, Millane RP. A general method for directly phasing diffraction data from high-solvent-content protein crystals. IUCRJ 2022; 9:648-665. [PMID: 36071801 PMCID: PMC9438493 DOI: 10.1107/s2052252522006996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2021] [Accepted: 07/08/2022] [Indexed: 06/15/2023]
Abstract
A procedure is described for direct phase determination in protein crystallography, applicable to crystals with high solvent content. The procedure requires only the diffraction data and an estimate of the solvent content as input. Direct phase determination is treated as a constraint satisfaction problem, in which an image is sought that is consistent with both the diffraction data and generic constraints on the density distribution in the crystal. The problem is solved using an iterative projection algorithm, the Difference Map algorithm, which has good global convergence properties, and can locate the correct solution without any initial phase information. Computational efficiency is improved by breaking the problem down into two stages; initial approximation of the molecular envelope at low resolution, followed by subsequent phase determination using all of the data. The molecular envelope is continually updated during the phase determination step. At both stages, the algorithm is initiated with many different and random phase sets, which are evolved subject to the constraints. A clustering procedure is used to identify consistent results across multiple runs, which are then averaged to generate consensus envelopes or phase sets. The emergence of highly consistent phase sets is diagnostic of success. The effectiveness of the procedure is demonstrated by application to 42 known structures of solvent fraction 0.60-0.85. The procedure works robustly at intermediate resolutions (1.9-3.5 Å) but is strongly dependent on crystal solvent content, only working routinely with solvent fractions greater than 0.70.
Collapse
Affiliation(s)
- Richard Lawrence Kingston
- School of Biological Sciences, University of Auckland, 3a Symonds St, Auckland City, Auckland 1010, New Zealand
| | - Rick P. Millane
- Computational Imaging Group, Department of Electrical and Computer Engineering, University of Canterbury, Christchurch, New Zealand
| |
Collapse
|
17
|
Chen H, Huang L, Liu T, Ozcan A. Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalization. LIGHT, SCIENCE & APPLICATIONS 2022; 11:254. [PMID: 35970839 PMCID: PMC9378708 DOI: 10.1038/s41377-022-00949-8] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 07/30/2022] [Accepted: 08/01/2022] [Indexed: 05/25/2023]
Abstract
Deep learning-based image reconstruction methods have achieved remarkable success in phase recovery and holographic imaging. However, the generalization of their image reconstruction performance to new types of samples never seen by the network remains a challenge. Here we introduce a deep learning framework, termed Fourier Imager Network (FIN), that can perform end-to-end phase recovery and image reconstruction from raw holograms of new types of samples, exhibiting unprecedented success in external generalization. FIN architecture is based on spatial Fourier transform modules that process the spatial frequencies of its inputs using learnable filters and a global receptive field. Compared with existing convolutional deep neural networks used for hologram reconstruction, FIN exhibits superior generalization to new types of samples, while also being much faster in its image inference speed, completing the hologram reconstruction task in ~0.04 s per 1 mm2 of the sample area. We experimentally validated the performance of FIN by training it using human lung tissue samples and blindly testing it on human prostate, salivary gland tissue and Pap smear samples, proving its superior external generalization and image reconstruction speed. Beyond holographic microscopy and quantitative phase imaging, FIN and the underlying neural network architecture might open up various new opportunities to design broadly generalizable deep learning models in computational imaging and machine vision fields.
Collapse
Affiliation(s)
- Hanlong Chen
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Luzhe Huang
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Tairan Liu
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA
- California Nano Systems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
| | - Aydogan Ozcan
- Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA.
- Bioengineering Department, University of California, Los Angeles, CA, 90095, USA.
- California Nano Systems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA.
- David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, 90095, USA.
| |
Collapse
|
18
|
Assalauova D, Ignatenko A, Isensee F, Trofimova D, Vartanyants IA. Classification of diffraction patterns using a convolutional neural network in single-particle-imaging experiments performed at X-ray free-electron lasers. J Appl Crystallogr 2022; 55:444-454. [PMID: 35719305 PMCID: PMC9172041 DOI: 10.1107/s1600576722002667] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Accepted: 03/08/2022] [Indexed: 11/10/2022] Open
Abstract
Single particle imaging (SPI) at X-ray free-electron lasers is particularly well suited to determining the 3D structure of particles at room temperature. For a successful reconstruction, diffraction patterns originating from a single hit must be isolated from a large number of acquired patterns. It is proposed that this task could be formulated as an image-classification problem and solved using convolutional neural network (CNN) architectures. Two CNN configurations are developed: one that maximizes the F1 score and one that emphasizes high recall. The CNNs are also combined with expectation-maximization (EM) selection as well as size filtering. It is observed that the CNN selections have lower contrast in power spectral density functions relative to the EM selection used in previous work. However, the reconstruction of the CNN-based selections gives similar results. Introducing CNNs into SPI experiments allows the reconstruction pipeline to be streamlined, enables researchers to classify patterns on the fly, and, as a consequence, enables them to tightly control the duration of their experiments. Incorporating non-standard artificial-intelligence-based solutions into an existing SPI analysis workflow may be beneficial for the future development of SPI experiments.
Collapse
Affiliation(s)
- Dameli Assalauova
- Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, 22607 Hamburg, Germany
| | - Alexandr Ignatenko
- Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, 22607 Hamburg, Germany
| | - Fabian Isensee
- Applied Computer Vision Lab, Helmholtz Imaging, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, 69120 Heidelberg, Germany
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, 69120 Heidelberg, Germany
| | - Darya Trofimova
- Applied Computer Vision Lab, Helmholtz Imaging, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, 69120 Heidelberg, Germany
- Division of Medical Image Computing, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, 69120 Heidelberg, Germany
| | - Ivan A. Vartanyants
- Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, 22607 Hamburg, Germany
| |
Collapse
|
19
|
Sun M, Shao L, Zhang J, Zhu Y, Wu P, Wang Y, Diao Z, Mu Q, Li D, Wang H, Xuan L. High-resolution 3D Fourier ptychographic reconstruction using a hemispherical illumination source with multiplexed-coded strategy. BIOMEDICAL OPTICS EXPRESS 2022; 13:2050-2067. [PMID: 35519265 PMCID: PMC9045925 DOI: 10.1364/boe.452363] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Revised: 02/17/2022] [Accepted: 02/17/2022] [Indexed: 05/29/2023]
Abstract
Fourier ptychography is a promising and flexible imaging technique that can achieve 2D quantitative reconstruction with higher resolution beyond the limitation of the system. Meanwhile, by using different imaging models, the same platform can be applied to achieve 3D refractive index reconstruction. To improve the illumination NA as much as possible while reducing the intensity attenuation problem caused by the LED board used in the traditional FP platform, we apply a hemispherical lighting structure and design a new LED arrangement according to 3D Fourier diffraction theory. Therefore, we could obtain the illumination of 0.98NA using 187 LEDs and achieve imaging half-pitch resolutions of ∼174 nm and ∼524 nm for the lateral and axial directions respectively, using a 40×/0.6NA objective lens. Furthermore, to reduce the number of captured images required and realize real-time data collection, we apply the multiplexed-coded illumination strategy and compare several coded patterns through simulation and experiment. Through comparison, we determined a radial-coded illumination pattern that could achieve more similar results as sequential scanning and increase the acquisition speed to above 1 Hz. Therefore, this paper provides the possibility of this technique in real-time 3D observation of in vitro live samples.
Collapse
Affiliation(s)
- Minglu Sun
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
- Contributed equally
| | - Lina Shao
- State Key Laboratory of Electroanalytical Chemistry, Changchun Institute of Applied Chemistry, Chinese Academy of Sciences, Changchun, Jilin 130022, China
- Contributed equally
| | - Jinrui Zhang
- State Key Laboratory of Electroanalytical Chemistry, Changchun Institute of Applied Chemistry, Chinese Academy of Sciences, Changchun, Jilin 130022, China
| | - Youqiang Zhu
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Peilin Wu
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yukun Wang
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhihui Diao
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - QuanQuan Mu
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Dayu Li
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Hongda Wang
- State Key Laboratory of Electroanalytical Chemistry, Changchun Institute of Applied Chemistry, Chinese Academy of Sciences, Changchun, Jilin 130022, China
| | - Li Xuan
- State Key Laboratory of Applied Optics, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China
- Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
20
|
Abstract
An adaptive method for determining the type and magnitude of aberration in a wide range is proposed on the basis of an optical processing of the analyzed wavefront using a multichannel filter matched to the adjustable Zernike phase functions. The approach is based on an adaptive (or step-by-step) compensation of wavefront aberrations based on a dynamically tunable multichannel filter implemented on a spatial light modulator. For adaptive filter adjustment, a set of criteria is proposed that takes into account not only the magnitude of the correlation peak, but also the maximum intensity, compactness, and orientation of the distribution in each diffraction order. The experimental results have shown the efficiency of the proposed approach for detecting wavefront aberrations in a wide range (from 0.1λ to λ).
Collapse
|
21
|
Zhang M, Guo Z, Mi X, Li Z, Liu Y. Ultrafast Imaging of Molecular Dynamics Using Ultrafast Low-Frequency Lasers, X-ray Free Electron Lasers, and Electron Pulses. J Phys Chem Lett 2022; 13:1668-1680. [PMID: 35147438 DOI: 10.1021/acs.jpclett.1c03916] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The requirement of high space-time resolution and brightness is a great challenge for imaging atomic motion and making molecular movies. Important breakthroughs in ultrabright tabletop laser, X-ray, and electron sources have enabled the direct imaging of evolving molecular structures in chemical processes, and recent experimental advances in preparing ultrafast laser and electron pulses resulted in molecular imaging with femtosecond time resolution. This Perspective presents an overview of the versatile imaging methods of molecular dynamics. High-order harmonic generation imaging and photoelectron diffraction imaging are based on laser-induced ionization and rescattering processes. Coulomb explosion imaging retrieves molecular structural information by detecting the momentum vectors of fragmented ions. Diffraction imaging encodes molecular structural and electronic information in reciprocal space. We also present various applications of these ultrafast imaging methods in resolving laser-induced nuclear and electronic dynamics.
Collapse
Affiliation(s)
- Ming Zhang
- State Key Laboratory for Mesoscopic Physics and Collaborative Innovation Center of Quantum Matter, School of Physics, Peking University, Beijing 100871, China
| | - Zhengning Guo
- State Key Laboratory for Mesoscopic Physics and Collaborative Innovation Center of Quantum Matter, School of Physics, Peking University, Beijing 100871, China
| | - Xiaoyu Mi
- State Key Laboratory for Mesoscopic Physics and Collaborative Innovation Center of Quantum Matter, School of Physics, Peking University, Beijing 100871, China
| | - Zheng Li
- State Key Laboratory for Mesoscopic Physics and Collaborative Innovation Center of Quantum Matter, School of Physics, Peking University, Beijing 100871, China
- Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan, Shanxi 030006, China
- Yangtze Delta Institute of Optoelectronics, Peking University, Nantong 226010, China
| | - Yunquan Liu
- State Key Laboratory for Mesoscopic Physics and Collaborative Innovation Center of Quantum Matter, School of Physics, Peking University, Beijing 100871, China
- Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan, Shanxi 030006, China
- Center for Applied Physics and Technology, HEDPS, Peking University, Beijing 100871, China
| |
Collapse
|
22
|
Abstract
Radiographic imaging and tomography (RadIT) come in many types such as x-ray imaging and tomography (IT), proton IT, neutron IT, muon IT, and more. We identify five RadIT themes: physics, sources, detectors, methods, and data science, which are integral parts of image interpretation and 3D tomographic reconstruction. Traditionally, RadIT has been driven by medicine, non-destructive testing, material sciences, and security applications. The latest thrusts of growth come from automation, machine vision, additive manufacturing, and virtual reality (the "metaverse"). The five RadIT themes parallel their counterparts in optical IT. Synergies among different forms of RadIT and with optical IT motivate further advances towards multi-modal IT and quantum IT.
Collapse
|
23
|
Loetgering L, Witte S, Rothhardt J. Advances in laboratory-scale ptychography using high harmonic sources [Invited]. OPTICS EXPRESS 2022; 30:4133-4164. [PMID: 35209658 DOI: 10.1364/oe.443622] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 12/22/2021] [Indexed: 06/14/2023]
Abstract
Extreme ultraviolet microscopy and wavefront sensing are key elements for next-generation ultrafast applications, such as chemically-resolved imaging, focal spot diagnostics in pump-and-probe experiments, and actinic metrology for the state-of-the-art lithography node at 13.5 nm wavelength. Ptychography offers a robust solution to the aforementioned challenges. Originally adapted by the electron and synchrotron communities, advances in the stability and brightness of high-harmonic tabletop sources have enabled the transfer of ptychography to the laboratory. This review covers the state of the art in tabletop ptychography with high harmonic generation sources. We consider hardware options such as illumination optics and detector concepts as well as algorithmic aspects in the analysis of multispectral ptychography data. Finally, we review technological application cases such as multispectral wavefront sensing, attosecond pulse characterization, and depth-resolved imaging.
Collapse
|
24
|
Whetten BG, Jackson JS, Sandberg RL, Durfee DS. Understanding and correcting wavenumber error in interference pattern structured illumination imaging. OPTICS EXPRESS 2022; 30:70-80. [PMID: 35201195 DOI: 10.1364/oe.444570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Accepted: 12/06/2021] [Indexed: 06/14/2023]
Abstract
The impacts of uncertainty in mirror movements in mechanically scanned interference pattern structured illumination imaging (IPSII) are discussed. It is shown that uncertainty in IPSII mirror movements causes errors in both the phase and amplitude of the Fourier transform of the resulting imaging. Finally, we demonstrate that iterative phase retrieval algorithms can improve the quality of IPSII images by correcting the phase errors caused by mirror movement uncertainties.
Collapse
|
25
|
Abstract
Abstract
Methods of coherent X-ray diffraction imaging of the spatial structure of noncrystalline objects and nanocrystals (nanostructures) are considered. Particular attention is paid to the methods of scanning-based coherent diffraction imaging (ptychography), visualization based on coherent surface scattering with application of correlation spectroscopy approaches, and specific features of visualization using X-ray free-electron laser radiation. The corresponding data in the literature are analyzed to demonstrate the state of the art of the methods of coherent diffraction imaging and fields of their application.
Collapse
|
26
|
Khonina SN, Kazanskiy NL, Khorin PA, Butt MA. Modern Types of Axicons: New Functions and Applications. SENSORS 2021; 21:s21196690. [PMID: 34641014 PMCID: PMC8512447 DOI: 10.3390/s21196690] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2021] [Revised: 10/05/2021] [Accepted: 10/06/2021] [Indexed: 01/23/2023]
Abstract
Axicon is a versatile optical element for forming a zero-order Bessel beam, including high-power laser radiation schemes. Nevertheless, it has drawbacks such as the produced beam's parameters being dependent on a particular element, the output beam's intensity distribution being dependent on the quality of element manufacturing, and uneven axial intensity distribution. To address these issues, extensive research has been undertaken to develop nondiffracting beams using a variety of advanced techniques. We looked at four different and special approaches for creating nondiffracting beams in this article. Diffractive axicons, meta-axicons-flat optics, spatial light modulators, and photonic integrated circuit-based axicons are among these approaches. Lately, there has been noteworthy curiosity in reducing the thickness and weight of axicons by exploiting diffraction. Meta-axicons, which are ultrathin flat optical elements made up of metasurfaces built up of arrays of subwavelength optical antennas, are one way to address such needs. In addition, when compared to their traditional refractive and diffractive equivalents, meta-axicons have a number of distinguishing advantages, including aberration correction, active tunability, and semi-transparency. This paper is not intended to be a critique of any method. We have outlined the most recent advancements in this field and let readers determine which approach best meets their needs based on the ease of fabrication and utilization. Moreover, one section is devoted to applications of axicons utilized as sensors of optical properties of devices and elements as well as singular beams states and wavefront features.
Collapse
Affiliation(s)
- Svetlana N. Khonina
- Image Processing Systems Institute of RAS—Branch of the FSRC “Crystallography and Photonics” RAS, 443001 Samara, Russia; (S.N.K.); (N.L.K.)
- Samara National Research University, 443086 Samara, Russia;
| | - Nikolay L. Kazanskiy
- Image Processing Systems Institute of RAS—Branch of the FSRC “Crystallography and Photonics” RAS, 443001 Samara, Russia; (S.N.K.); (N.L.K.)
- Samara National Research University, 443086 Samara, Russia;
| | | | - Muhammad A. Butt
- Samara National Research University, 443086 Samara, Russia;
- Institute of Microelectronics and Optoelectronics, Warsaw University of Technology, Koszykowa 75, 00-662 Warszawa, Poland
- Correspondence:
| |
Collapse
|
27
|
Yang D, Zhang J, Tao Y, Lv W, Lu S, Chen H, Xu W, Shi Y. Dynamic coherent diffractive imaging with a physics-driven untrained learning method. OPTICS EXPRESS 2021; 29:31426-31442. [PMID: 34615235 DOI: 10.1364/oe.433507] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 09/07/2021] [Indexed: 06/13/2023]
Abstract
Reconstruction of a complex field from one single diffraction measurement remains a challenging task among the community of coherent diffraction imaging (CDI). Conventional iterative algorithms are time-consuming and struggle to converge to a feasible solution because of the inherent ambiguities. Recently, deep-learning-based methods have shown considerable success in computational imaging, but they require large amounts of training data that in many cases are difficult to obtain. Here, we introduce a physics-driven untrained learning method, termed Deep CDI, which addresses the above problem and can image a dynamic process with high confidence and fast reconstruction. Without any labeled data for pretraining, the Deep CDI can reconstruct a complex-valued object from a single diffraction pattern by combining a conventional artificial neural network with a real-world physical imaging model. To our knowledge, we are the first to demonstrate that the support region constraint, which is widely used in the iteration-algorithm-based method, can be utilized for loss calculation. The loss calculated from support constraint and free propagation constraint are summed up to optimize the network's weights. As a proof of principle, numerical simulations and optical experiments on a static sample are carried out to demonstrate the feasibility of our method. We then continuously collect 3600 diffraction patterns and demonstrate that our method can predict the dynamic process with an average reconstruction speed of 228 frames per second (FPS) using only a fraction of the diffraction data to train the weights.
Collapse
|
28
|
Wang B, He Z, Zhang F. Coherent modulation imaging using unknown modulators. OPTICS EXPRESS 2021; 29:30035-30044. [PMID: 34614735 DOI: 10.1364/oe.434111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Accepted: 08/16/2021] [Indexed: 06/13/2023]
Abstract
Coherent modulation imaging (CMI) is an effective lensless diffraction imaging method with fast algorithmic convergence and high robustness to data defects. In the reported algorithms for CMI, one important requirement is that the modulator function need to be known a priori; and an additional step for the modulator characterization is required to be carried out in advance by other methods, such as ptychography, which could be cumbersome in practice. Here, we propose an improved algorithm that allows for the transmission function of a completely unknown modulator to be recovered during the same iterative process of image reconstruction. We have verified the method in both simulations and optical experiments. This improvement would turn CMI into a more practical and standalone technique for broader applications in biology and materials science.
Collapse
|
29
|
Zhang S, Zhou G, Zheng C, Li T, Hu Y, Hao Q. Fast digital refocusing and depth of field extended Fourier ptychography microscopy. BIOMEDICAL OPTICS EXPRESS 2021; 12:5544-5558. [PMID: 34692200 PMCID: PMC8515960 DOI: 10.1364/boe.433033] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 07/20/2021] [Accepted: 07/20/2021] [Indexed: 06/01/2023]
Abstract
Fourier ptychography microscopy (FPM) shares its roots with the synthetic aperture technique and phase retrieval method, and is a recently developed computational microscopic super-resolution technique. By turning on the light-emitting diode (LED) elements sequentially and acquiring the corresponding images that contain different spatial frequencies, FPM can achieve a wide field-of-view (FOV), high-spatial-resolution imaging and phase recovery simultaneously. Conventional FPM assumes that the sample is sufficiently thin and strictly in focus. Nevertheless, even for a relatively thin sample, the non-planar distribution characteristics and the non-ideal position/posture of the sample will cause all or part of FOV to be defocused. In this paper, we proposed a fast digital refocusing and depth-of-field (DOF) extended FPM strategy by taking the advantages of image lateral shift caused by sample defocusing and varied-angle illuminations. The lateral shift amount is proportional to the defocus distance and the tangent of the illumination angle. Instead of searching the optimal defocus distance with the optimization search strategy, which is time consuming, the defocus distance of each subregion of the sample can be precisely and quickly obtained by calculating the relative lateral shift amounts corresponding to different oblique illuminations. And then, digital refocusing strategy rooting in the angular spectrum (AS) method is integrated into FPM framework to achieve the high-resolution and phase information reconstruction for each part of the sample, which means the DOF of the FPM can be effectively extended. The feasibility of the proposed method in fast digital refocusing and DOF extending is verified in the actual experiments with the USAF chart and biological samples.
Collapse
|
30
|
Gao Y, Cao L. Generalized optimization framework for pixel super-resolution imaging in digital holography. OPTICS EXPRESS 2021; 29:28805-28823. [PMID: 34615002 DOI: 10.1364/oe.434449] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 08/02/2021] [Indexed: 06/13/2023]
Abstract
The imaging quality of in-line digital holography is challenged by the twin-image and aliasing effects because sensors only respond to intensity and pixels are of finite size. As a result, phase retrieval and pixel super-resolution techniques serve as two essential ingredients for high-fidelity and high-resolution holographic imaging. In this work, we combine the two as a unified optimization problem and propose a generalized algorithmic framework for pixel-super-resolved phase retrieval. In particular, we introduce the iterative projection algorithms and gradient descent algorithms for solving this problem. The basic building blocks, namely the projection operator and the Wirtinger gradient, are derived and analyzed. As an example, the Wirtinger gradient descent algorithm for pixel-super-resolved phase retrieval, termed as Wirtinger-PSR, is proposed and compared with the classical error-reduction algorithm. The Wirtinger-PSR algorithm is verified with both simulated and experimental data. The proposed framework generalizes well to various physical settings and helps bridging the gap between empirical studies and theoretical analyses.
Collapse
|
31
|
Findlay SD, Brown HG, Pelz PM, Ophus C, Ciston J, Allen LJ. Scattering Matrix Determination in Crystalline Materials from 4D Scanning Transmission Electron Microscopy at a Single Defocus Value. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2021; 27:744-757. [PMID: 34311809 DOI: 10.1017/s1431927621000490] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Recent work has revived interest in the scattering matrix formulation of electron scattering in transmission electron microscopy as a stepping stone toward atomic-resolution structure determination in the presence of multiple scattering. We discuss ways of visualizing the scattering matrix that make its properties clear. Through a simulation-based case study incorporating shot noise, we shown how regularizing on this continuity enables the scattering matrix to be reconstructed from 4D scanning transmission electron microscopy (STEM) measurements from a single defocus value. Intriguingly, for crystalline samples, this process also yields the sample thickness to nanometer accuracy with no a priori knowledge about the sample structure. The reconstruction quality is gauged by using the reconstructed scattering matrix to simulate STEM images at defocus values different from that of the data from which it was reconstructed.
Collapse
Affiliation(s)
- Scott D Findlay
- School of Physics and Astronomy, Monash University, Clayton, VIC3800, Australia
| | - Hamish G Brown
- National Center for Electron Microscopy Facility, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA94720, USA
- Ian Holmes Imaging Center, Bio21 Molecular Science and Biotechnology Institute, University of Melbourne, Parkville, VIC3052, Australia
| | - Philipp M Pelz
- National Center for Electron Microscopy Facility, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA94720, USA
- Department of Materials Science and Engineering, University of California, Berkeley, CA94720, USA
| | - Colin Ophus
- National Center for Electron Microscopy Facility, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA94720, USA
| | - Jim Ciston
- National Center for Electron Microscopy Facility, Molecular Foundry, Lawrence Berkeley National Laboratory, Berkeley, CA94720, USA
| | - Leslie J Allen
- School of Physics, University of Melbourne, Parkville, VIC3010, Australia
| |
Collapse
|
32
|
Kandel S, Maddali S, Nashed YSG, Hruszkewycz SO, Jacobsen C, Allain M. Efficient ptychographic phase retrieval via a matrix-free Levenberg-Marquardt algorithm. OPTICS EXPRESS 2021; 29:23019-23055. [PMID: 34614577 PMCID: PMC8327924 DOI: 10.1364/oe.422768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 06/04/2021] [Accepted: 06/04/2021] [Indexed: 06/13/2023]
Abstract
The phase retrieval problem, where one aims to recover a complex-valued image from far-field intensity measurements, is a classic problem encountered in a range of imaging applications. Modern phase retrieval approaches usually rely on gradient descent methods in a nonlinear minimization framework. Calculating closed-form gradients for use in these methods is tedious work, and formulating second order derivatives is even more laborious. Additionally, second order techniques often require the storage and inversion of large matrices of partial derivatives, with memory requirements that can be prohibitive for data-rich imaging modalities. We use a reverse-mode automatic differentiation (AD) framework to implement an efficient matrix-free version of the Levenberg-Marquardt (LM) algorithm, a longstanding method that finds popular use in nonlinear least-square minimization problems but which has seen little use in phase retrieval. Furthermore, we extend the basic LM algorithm so that it can be applied for more general constrained optimization problems (including phase retrieval problems) beyond just the least-square applications. Since we use AD, we only need to specify the physics-based forward model for a specific imaging application; the first and second-order derivative terms are calculated automatically through matrix-vector products, without explicitly forming the large Jacobian or Gauss-Newton matrices typically required for the LM method. We demonstrate that this algorithm can be used to solve both the unconstrained ptychographic object retrieval problem and the constrained "blind" ptychographic object and probe retrieval problems, under the popular Gaussian noise model as well as the Poisson noise model. We compare this algorithm to state-of-the-art first order ptychographic reconstruction methods to demonstrate empirically that this method outperforms best-in-class first-order methods: it provides excellent convergence guarantees with (in many cases) a superlinear rate of convergence, all with a computational cost comparable to, or lower than, the tested first-order algorithms.
Collapse
Affiliation(s)
- Saugat Kandel
- Applied Physics, Northwestern University, Evanston, Illinois 60208, USA
| | - S. Maddali
- Materials Science Division, Argonne National Laboratory, Lemont, IL 60439, USA
| | | | | | - Chris Jacobsen
- Advanced Photon Source, Argonne National Laboratory, Lemont, Illinois 60439, USA
- Department of Physics & Astronomy, Northwestern University, Evanston, Illinois 60208, USA
- Chemistry of Life Processes Institute, Northwestern University, Evanston, Illinois 60208, USA
| | - Marc Allain
- Aix Marseille Univ, CNRS, Centrale Marseille, Institut Fresnel, Marseille, France
| |
Collapse
|
33
|
Kharitonov K, Mehrjoo M, Ruiz-Lopez M, Keitel B, Kreis S, Seyrich M, Pop M, Plönjes E. Flexible ptychography platform to expand the potential of imaging at free electron lasers. OPTICS EXPRESS 2021; 29:22345-22365. [PMID: 34266001 DOI: 10.1364/oe.426931] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Accepted: 06/20/2021] [Indexed: 06/13/2023]
Abstract
Ptychography, a scanning coherent diffraction imaging method, can produce a high-resolution reconstruction of a sample and, at the same time, of the illuminating beam. The emergence of vacuum ultraviolet and X-ray free electron lasers (FELs) has brought sources with unprecedented characteristics that enable X-ray ptychography with highly intense and ultra-fast short-wavelength pulses. However, the shot-to-shot pulse fluctuations typical for FEL pulses and particularly the partial spatial coherence of self-amplified spontaneous emission (SASE) FELs lead to numerical complexities in the ptychographic algorithms and ultimately restrict the application of ptychography at FELs. We present a general adaptive forward model for ptychography based on automatic differentiation, which is able to perform reconstructions even under these conditions. We applied this model to the first ptychography experiment at FLASH, the Free electron LASer in Hamburg, and obtained a high-resolution reconstruction of the sample as well as the complex wavefronts of individual FLASH pulses together with their coherence properties. This is not possible with more common ptychography algorithms.
Collapse
|
34
|
Carnis J, Kirner F, Lapkin D, Sturm S, Kim YY, Baburin IA, Khubbutdinov R, Ignatenko A, Iashina E, Mistonov A, Steegemans T, Wieck T, Gemming T, Lubk A, Lazarev S, Sprung M, Vartanyants IA, Sturm EV. Exploring the 3D structure and defects of a self-assembled gold mesocrystal by coherent X-ray diffraction imaging. NANOSCALE 2021; 13:10425-10435. [PMID: 34028473 DOI: 10.1039/d1nr01806j] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Mesocrystals are nanostructured materials consisting of individual nanocrystals having a preferred crystallographic orientation. On mesoscopic length scales, the properties of mesocrystals are strongly affected by structural heterogeneity. Here, we report the detailed structural characterization of a faceted mesocrystal grain self-assembled from 60 nm sized gold nanocubes. Using coherent X-ray diffraction imaging, we determined the structure of the mesocrystal with the resolution sufficient to resolve each gold nanoparticle. The reconstructed electron density of the gold mesocrystal reveals its intrinsic structural heterogeneity, including local deviations of lattice parameters, and the presence of internal defects. The strain distribution shows that the average superlattice obtained by angular X-ray cross-correlation analysis and the real, "multidomain" structure of a mesocrystal are very close to each other, with a deviation less than 10%. These results will provide an important impact to understanding the fundamental principles of structuring and self-assembly including ensuing properties of mesocrystals.
Collapse
Affiliation(s)
- Jerome Carnis
- Deutsches Elektronen-Synchrotron DESY, Notkestrasse 85, D-22607 Hamburg, Germany.
| | - Felizitas Kirner
- University of Konstanz, Universitätsstraße 10, 78457 Konstanz, Germany.
| | - Dmitry Lapkin
- Deutsches Elektronen-Synchrotron DESY, Notkestrasse 85, D-22607 Hamburg, Germany.
| | - Sebastian Sturm
- Leibniz Institute for Solid State and Materials Research, Helmholtzstraße 20, 01069 Dresden, Germany
| | - Young Yong Kim
- Deutsches Elektronen-Synchrotron DESY, Notkestrasse 85, D-22607 Hamburg, Germany.
| | | | - Ruslan Khubbutdinov
- Deutsches Elektronen-Synchrotron DESY, Notkestrasse 85, D-22607 Hamburg, Germany. and National Research Nuclear University MEPhI (Moscow Engineering Physics Institute), Kashirskoe shosse 31, 115409 Moscow, Russia
| | - Alexandr Ignatenko
- Deutsches Elektronen-Synchrotron DESY, Notkestrasse 85, D-22607 Hamburg, Germany.
| | - Ekaterina Iashina
- Saint-Petersburg State University, University Embankment 7/9, 199034 St Petersburg, Russia
| | - Alexander Mistonov
- Saint-Petersburg State University, University Embankment 7/9, 199034 St Petersburg, Russia
| | | | - Thomas Wieck
- Leibniz Institute for Solid State and Materials Research, Helmholtzstraße 20, 01069 Dresden, Germany
| | - Thomas Gemming
- Leibniz Institute for Solid State and Materials Research, Helmholtzstraße 20, 01069 Dresden, Germany
| | - Axel Lubk
- Leibniz Institute for Solid State and Materials Research, Helmholtzstraße 20, 01069 Dresden, Germany
| | - Sergey Lazarev
- Deutsches Elektronen-Synchrotron DESY, Notkestrasse 85, D-22607 Hamburg, Germany. and National Research Tomsk Polytechnic University (TPU), pr. Lenina 30, 634050 Tomsk, Russia
| | - Michael Sprung
- Deutsches Elektronen-Synchrotron DESY, Notkestrasse 85, D-22607 Hamburg, Germany.
| | - Ivan A Vartanyants
- Deutsches Elektronen-Synchrotron DESY, Notkestrasse 85, D-22607 Hamburg, Germany. and National Research Nuclear University MEPhI (Moscow Engineering Physics Institute), Kashirskoe shosse 31, 115409 Moscow, Russia
| | - Elena V Sturm
- University of Konstanz, Universitätsstraße 10, 78457 Konstanz, Germany.
| |
Collapse
|
35
|
Niknam F, Qazvini H, Latifi H. Holographic optical field recovery using a regularized untrained deep decoder network. Sci Rep 2021; 11:10903. [PMID: 34035387 PMCID: PMC8149647 DOI: 10.1038/s41598-021-90312-5] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Accepted: 05/10/2021] [Indexed: 02/04/2023] Open
Abstract
Image reconstruction using minimal measured information has been a long-standing open problem in many computational imaging approaches, in particular in-line holography. Many solutions are devised based on compressive sensing (CS) techniques with handcrafted image priors or supervised deep neural networks (DNN). However, the limited performance of CS methods due to lack of information about the image priors and the requirement of an enormous amount of per-sample-type training resources for DNNs has posed new challenges over the primary problem. In this study, we propose a single-shot lensless in-line holographic reconstruction method using an untrained deep neural network which is incorporated with a physical image formation algorithm. We demonstrate that by modifying a deep decoder network with simple regularizers, a Gabor hologram can be inversely reconstructed via a minimization process that is constrained by a deep image prior. The outcoming model allows to accurately recover the phase and amplitude images without any training dataset, excess measurements, or specific assumptions about the object's or the measurement's characteristics.
Collapse
Affiliation(s)
- Farhad Niknam
- grid.412502.00000 0001 0686 4748Laser and Plasma Research Institute, Shahid Beheshti University, Tehran, 1983963113 Iran
| | - Hamed Qazvini
- grid.412502.00000 0001 0686 4748Laser and Plasma Research Institute, Shahid Beheshti University, Tehran, 1983963113 Iran
| | - Hamid Latifi
- grid.412502.00000 0001 0686 4748Department of Physics, Shahid Beheshti University, Tehran, 1983963113 Iran
| |
Collapse
|
36
|
Du M, Kandel S, Deng J, Huang X, Demortiere A, Nguyen TT, Tucoulou R, De Andrade V, Jin Q, Jacobsen C. Adorym: a multi-platform generic X-ray image reconstruction framework based on automatic differentiation. OPTICS EXPRESS 2021; 29:10000-10035. [PMID: 33820138 PMCID: PMC8237934 DOI: 10.1364/oe.418296] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Revised: 02/08/2021] [Accepted: 02/09/2021] [Indexed: 05/09/2023]
Abstract
We describe and demonstrate an optimization-based X-ray image reconstruction framework called Adorym. Our framework provides a generic forward model, allowing one code framework to be used for a wide range of imaging methods ranging from near-field holography to fly-scan ptychographic tomography. By using automatic differentiation for optimization, Adorym has the flexibility to refine experimental parameters including probe positions, multiple hologram alignment, and object tilts. It is written with strong support for parallel processing, allowing large datasets to be processed on high-performance computing systems. We demonstrate its use on several experimental datasets to show improved image quality through parameter refinement.
Collapse
Affiliation(s)
- Ming Du
- Advanced Photon Source, Argonne National Laboratory, Lemont, Illinois 60439, USA
| | - Saugat Kandel
- Applied Physics Program, Northwestern University, Evanston, Illinois 60208, USA
| | - Junjing Deng
- Advanced Photon Source, Argonne National Laboratory, Lemont, Illinois 60439, USA
| | - Xiaojing Huang
- National Synchrotron Light Source II, Brookhaven National Laboratory, Upton, New York 11973, USA
| | - Arnaud Demortiere
- Laboratoire de Réactivité et Chimie des Solides (LRCS), CNRS UMR 7314, Université de Picardie Jules Verne, Hub de l’Energie, 15 Rue Baudelocque, 80039 Amiens Cedex, France
| | - Tuan Tu Nguyen
- Laboratoire de Réactivité et Chimie des Solides (LRCS), CNRS UMR 7314, Université de Picardie Jules Verne, Hub de l’Energie, 15 Rue Baudelocque, 80039 Amiens Cedex, France
| | - Remi Tucoulou
- European Synchrotron Radiation Facility, 71 Avenue des Martyrs, 38000 Grenoble, France
| | - Vincent De Andrade
- Advanced Photon Source, Argonne National Laboratory, Lemont, Illinois 60439, USA
| | - Qiaoling Jin
- Department of Physics & Astronomy, Northwestern University, Evanston, Illinois 60208, USA
- Chemistry of Life Processes Institute, Northwestern University, Evanston, Illinois 60208, USA
| | - Chris Jacobsen
- Advanced Photon Source, Argonne National Laboratory, Lemont, Illinois 60439, USA
- Department of Physics & Astronomy, Northwestern University, Evanston, Illinois 60208, USA
- Chemistry of Life Processes Institute, Northwestern University, Evanston, Illinois 60208, USA
| |
Collapse
|
37
|
Metz M, Arnal RD, Brehm W, Chapman HN, Morgan AJ, Millane RP. Macromolecular phasing using diffraction from multiple crystal forms. ACTA CRYSTALLOGRAPHICA A-FOUNDATION AND ADVANCES 2021; 77:19-35. [PMID: 33399128 PMCID: PMC7842209 DOI: 10.1107/s2053273320013650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/29/2020] [Accepted: 10/12/2020] [Indexed: 11/23/2022]
Abstract
A phasing algorithm for protein crystallography using diffraction data from multiple crystal forms is proposed. The algorithm is evaluated by simulation, and practical aspects and potential for ab initio phasing are discussed. A phasing algorithm for macromolecular crystallography is proposed that utilizes diffraction data from multiple crystal forms – crystals of the same molecule with different unit-cell packings (different unit-cell parameters or space-group symmetries). The approach is based on the method of iterated projections, starting with no initial phase information. The practicality of the method is demonstrated by simulation using known structures that exist in multiple crystal forms, assuming some information on the molecular envelope and positional relationships between the molecules in the different unit cells. With incorporation of new or existing methods for determination of these parameters, the approach has potential as a method for ab initio phasing.
Collapse
Affiliation(s)
- Markus Metz
- Department of Physics, University of Hamburg, 22761 Hamburg, Germany
| | - Romain D Arnal
- Computational Imaging Group, Department of Electrical and Computer Engineering, University of Canterbury, Christchurch, New Zealand
| | - Wolfgang Brehm
- Department of Physics, University of Hamburg, 22761 Hamburg, Germany
| | - Henry N Chapman
- Department of Physics, University of Hamburg, 22761 Hamburg, Germany
| | - Andrew J Morgan
- Center for Free-Electron Laser Science, Deutsches Elektronen-Synchrotron (DESY), 22607 Hamburg, Germany
| | - Rick P Millane
- Computational Imaging Group, Department of Electrical and Computer Engineering, University of Canterbury, Christchurch, New Zealand
| |
Collapse
|
38
|
Choi S, Chung M, Kim D, Kim S, Yun K, Cha W, Harder R, Kawaguchi T, Liu Y, Ulvestad A, You H, Song MK, Kim H. In Situ Strain Evolution on Pt Nanoparticles during Hydrogen Peroxide Decomposition. NANO LETTERS 2020; 20:8541-8548. [PMID: 33174748 DOI: 10.1021/acs.nanolett.0c03005] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
Fundamental understanding of structural changes during catalytic reactions is crucial to understanding the underlying mechanisms and optimizing efficiencies. Surface energy and related catalytic mechanisms are widely studied. However, the catalyst lattice deformation induced by catalytic processes is not well understood. Here, we study the strain in an individual platinum (Pt) nanoparticle (NP) using Bragg coherent diffraction imaging under in situ oxidation and reduction reactions. When Pt NPs are exposed to H2O2, a typical oxidizer and an intermediate during the oxygen reduction reaction process, alternating overall strain distribution near the surface and inside the NP is observed at the (111) Bragg reflection. In contrast, relatively insignificant changes appear in the (200) reflection. Density functional theory calculations are employed to rationalize the anisotropic lattice strain in terms of induced stress by H2O2 adsorption and decomposition on the Pt NP surface. Our study provides deeper insight into the activity-structure relationship in this system.
Collapse
Affiliation(s)
- Sungwook Choi
- Department of Physics, Sogang University, Seoul 04107, Korea
| | - Myungwoo Chung
- Department of Physics, Sogang University, Seoul 04107, Korea
| | - Dongjin Kim
- Department of Physics, Sogang University, Seoul 04107, Korea
| | - Sungwon Kim
- Department of Physics, Sogang University, Seoul 04107, Korea
| | - Kyuseok Yun
- Department of Physics, Sogang University, Seoul 04107, Korea
| | - Wonsuk Cha
- Advanced Photon Source, Argonne National Laboratory, Argonne Illinois 60439, United States
| | - Ross Harder
- Advanced Photon Source, Argonne National Laboratory, Argonne Illinois 60439, United States
| | - Tomoya Kawaguchi
- Materials Science Division, Argonne National Laboratory, Argonne Illinois 60439, United States
| | - Yihua Liu
- Materials Science Division, Argonne National Laboratory, Argonne Illinois 60439, United States
| | - Andrew Ulvestad
- Materials Science Division, Argonne National Laboratory, Argonne Illinois 60439, United States
| | - Hoydoo You
- Materials Science Division, Argonne National Laboratory, Argonne Illinois 60439, United States
| | - Mee Kyung Song
- Center for Nano Materials, Sogang University, Seoul 04107, Korea
| | - Hyunjung Kim
- Department of Physics, Sogang University, Seoul 04107, Korea
| |
Collapse
|
39
|
Assalauova D, Kim YY, Bobkov S, Khubbutdinov R, Rose M, Alvarez R, Andreasson J, Balaur E, Contreras A, DeMirci H, Gelisio L, Hajdu J, Hunter MS, Kurta RP, Li H, McFadden M, Nazari R, Schwander P, Teslyuk A, Walter P, Xavier PL, Yoon CH, Zaare S, Ilyin VA, Kirian RA, Hogue BG, Aquila A, Vartanyants IA. An advanced workflow for single-particle imaging with the limited data at an X-ray free-electron laser. IUCRJ 2020; 7:1102-1113. [PMID: 33209321 PMCID: PMC7642788 DOI: 10.1107/s2052252520012798] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2020] [Accepted: 09/21/2020] [Indexed: 05/06/2023]
Abstract
An improved analysis for single-particle imaging (SPI) experiments, using the limited data, is presented here. Results are based on a study of bacteriophage PR772 performed at the Atomic, Molecular and Optical Science instrument at the Linac Coherent Light Source as part of the SPI initiative. Existing methods were modified to cope with the shortcomings of the experimental data: inaccessibility of information from half of the detector and a small fraction of single hits. The general SPI analysis workflow was upgraded with the expectation-maximization based classification of diffraction patterns and mode decomposition on the final virus-structure determination step. The presented processing pipeline allowed us to determine the 3D structure of bacteriophage PR772 without symmetry constraints with a spatial resolution of 6.9 nm. The obtained resolution was limited by the scattering intensity during the experiment and the relatively small number of single hits.
Collapse
Affiliation(s)
- Dameli Assalauova
- Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, Hamburg, D-22607, Germany
| | - Young Yong Kim
- Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, Hamburg, D-22607, Germany
| | - Sergey Bobkov
- National Research Center ‘Kurchatov Institute’, Akademika Kurchatova pl. 1, Moscow, 123182 Russian Federation
| | - Ruslan Khubbutdinov
- Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, Hamburg, D-22607, Germany
- National Research Nuclear University MEPhI (Moscow Engineering Physics Institute), Kashirskoe sh. 31, Moscow, 115409, Russian Federation
| | - Max Rose
- Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, Hamburg, D-22607, Germany
| | - Roberto Alvarez
- Department of Physics, Arizona State University, Tempe, Arizona AZ 85287, USA
- School of Mathematics and Statistical Sciences, Arizona State University, Tempe, Arizona AZ 85287, USA
| | - Jakob Andreasson
- Institute of Physics, ELI Beamlines, Academy of Sciences of the Czech Republic, Prague, CZ-18221, Czech Republic
| | - Eugeniu Balaur
- Australian Research Council Centre of Excellence in Advanced Molecular Imaging, Department of Chemistry and Physics, La Trobe Institute for Molecular Science (LIMS), La Trobe University, Melbourne, Victoria 3086, Australia
| | - Alice Contreras
- School of Life Sciences, Arizona State University, Tempe, Arizona AZ 85287, USA
- Biodesign Institute Center for Immunotherapy, Vaccines and Virotherapy, Arizona State University, Tempe, Arizona AZ 85287, USA
| | - Hasan DeMirci
- Stanford PULSE Institute, SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025, USA
- Department of Molecular Biology and Genetics, Koc University, Istanbul, 34450, Turkey
| | - Luca Gelisio
- Center for Free Electron Laser Science (CFEL), DESY, Notkestraße 85, Hamburg, D-22607, Germany
| | - Janos Hajdu
- Institute of Physics, ELI Beamlines, Academy of Sciences of the Czech Republic, Prague, CZ-18221, Czech Republic
- Laboratory of Molecular Biophysics, Department of Cell and Molecular Biology, Uppsala University, Husargatan 3, Uppsala, SE-75124, Sweden
| | - Mark S. Hunter
- SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025, USA
| | | | - Haoyuan Li
- SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025, USA
- Physics Department, Stanford University, 450 Jane Stanford Way, Stanford, CA 94305-2004, USA
| | - Matthew McFadden
- Biodesign Institute Center for Immunotherapy, Vaccines and Virotherapy, Arizona State University, Tempe, Arizona AZ 85287, USA
| | - Reza Nazari
- Department of Physics, Arizona State University, Tempe, Arizona AZ 85287, USA
- School for Engineering of Matter, Transport and Energy, Arizona State University, Tempe, AZ 85287, USA
| | | | - Anton Teslyuk
- National Research Center ‘Kurchatov Institute’, Akademika Kurchatova pl. 1, Moscow, 123182 Russian Federation
- Moscow Institute of Physics and Technology, Moscow, 141700, Russian Federation
| | - Peter Walter
- SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025, USA
| | - P. Lourdu Xavier
- Center for Free Electron Laser Science (CFEL), DESY, Notkestraße 85, Hamburg, D-22607, Germany
- SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025, USA
- Max-Planck Institute for the Structure and Dynamics of Matter, Luruper Chaussee 149, Hamburg, D-22761, Germany
| | - Chun Hong Yoon
- SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025, USA
| | - Sahba Zaare
- Department of Physics, Arizona State University, Tempe, Arizona AZ 85287, USA
- SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025, USA
| | - Viacheslav A. Ilyin
- National Research Center ‘Kurchatov Institute’, Akademika Kurchatova pl. 1, Moscow, 123182 Russian Federation
- Moscow Institute of Physics and Technology, Moscow, 141700, Russian Federation
| | - Richard A. Kirian
- Department of Physics, Arizona State University, Tempe, Arizona AZ 85287, USA
| | - Brenda G. Hogue
- School of Life Sciences, Arizona State University, Tempe, Arizona AZ 85287, USA
- Biodesign Institute Center for Immunotherapy, Vaccines and Virotherapy, Arizona State University, Tempe, Arizona AZ 85287, USA
- Biodesign Institute, Center for Applied Structural Discovery, Arizona State University, Tempe, AZ 85287, USA
| | - Andrew Aquila
- SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025, USA
| | - Ivan A. Vartanyants
- Deutsches Elektronen-Synchrotron DESY, Notkestraße 85, Hamburg, D-22607, Germany
- National Research Nuclear University MEPhI (Moscow Engineering Physics Institute), Kashirskoe sh. 31, Moscow, 115409, Russian Federation
| |
Collapse
|
40
|
Favre-Nicolin V, Girard G, Leake S, Carnis J, Chushkin Y, Kieffer J, Paleo P, Richard MI. PyNX: high-performance computing toolkit for coherent X-ray imaging based on operators. J Appl Crystallogr 2020. [DOI: 10.1107/s1600576720010985] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
The open-source PyNX toolkit has been extended to provide tools for coherent X-ray imaging data analysis and simulation. All calculations can be executed on graphical processing units (GPUs) to achieve high-performance computing speeds. The toolkit can be used for coherent diffraction imaging (CDI), ptychography and wavefront propagation, in the far- or near-field regime. Moreover, all imaging operations (propagation, projections, algorithm cycles…) can be implemented in Python as simple mathematical operators, an approach which can be used to easily combine basic algorithms in a tailored chain. Calculations can also be distributed to multiple GPUs, e.g. for large ptychography data sets. Command-line scripts are available for on-line CDI and ptychography analysis, either from raw beamline data sets or using the coherent X-ray imaging data format.
Collapse
|
41
|
Modulator refinement algorithm for coherent modulation imaging. Ultramicroscopy 2020; 216:113034. [PMID: 32521384 DOI: 10.1016/j.ultramic.2020.113034] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2020] [Revised: 05/16/2020] [Accepted: 05/24/2020] [Indexed: 11/23/2022]
Abstract
Coherent modulation imaging (CMI) has been shown to be an effective lensless diffraction approach to imaging general extended samples with fast algorithmic convergence and high robustness to data imperfection. In the reported phasing algorithms of CMI, an exact knowledge of modulator is used as a priori. Extra characterization of the modulator is thus required before the CMI experiments are conducted and this can be cumbersome. Here we propose a modulator refinement algorithm that allows for modulator refinement in the same iterative process of image reconstruction. We demonstrate the method for both near-field and far-field geometries in simulations and for a far-field experiment. A relaxed requirement on exactly knowing the modulator would turn CMI into a standalone technique and make it much easier to implement, thus open up its wider applications in biology and materials science.
Collapse
|
42
|
Konijnenberg AP, de Beurs ACC, Jansen GSM, Urbach HP, Witte S, Coene WMJ. Phase retrieval algorithms for lensless imaging using diffractive shearing interferometry. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2020; 37:914-924. [PMID: 32543591 DOI: 10.1364/josaa.389791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/05/2020] [Accepted: 04/13/2020] [Indexed: 06/11/2023]
Abstract
Diffractive shearing interferometry (DSI) is a method that has recently been developed to perform lensless imaging using extreme ultraviolet radiation generated by high-harmonic generation. In this paper, we investigate the uniqueness of the DSI solution and the requirements for the support constraint size. We find that there can be multiple solutions to the DSI problem that consist of displaced copies of the actual object. These alternative solutions can be eliminated by enforcing a sufficiently tight support constraint, or by introducing additional synthetic constraints. We furthermore propose a new DSI algorithm inspired by the analogy with coherent diffractive imaging (CDI) algorithms: the original DSI algorithm is in a way analogous to the hybrid input-output algorithm as used in CDI, and we propose a new algorithm that is more analogous to the error reduction algorithm as used in CDI. We find that the newly proposed algorithm is suitable for final refinement of the reconstruction.
Collapse
|
43
|
Lohse LM, Robisch AL, Töpperwien M, Maretzke S, Krenkel M, Hagemann J, Salditt T. A phase-retrieval toolbox for X-ray holography and tomography. JOURNAL OF SYNCHROTRON RADIATION 2020; 27:852-859. [PMID: 32381790 PMCID: PMC7206550 DOI: 10.1107/s1600577520002398] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2019] [Accepted: 02/19/2020] [Indexed: 05/10/2023]
Abstract
Propagation-based phase-contrast X-ray imaging is by now a well established imaging technique, which - as a full-field technique - is particularly useful for tomography applications. Since it can be implemented with synchrotron radiation and at laboratory micro-focus sources, it covers a wide range of applications. A limiting factor in its development has been the phase-retrieval step, which was often performed using methods with a limited regime of applicability, typically based on linearization. In this work, a much larger set of algorithms, which covers a wide range of cases (experimental parameters, objects and constraints), is compiled into a single toolbox - the HoloTomoToolbox - which is made publicly available. Importantly, the unified structure of the implemented phase-retrieval functions facilitates their use and performance test on different experimental data.
Collapse
Affiliation(s)
- Leon M. Lohse
- Institut für Röntgenphysik, Universität Göttingen, Germany
| | | | | | - Simon Maretzke
- Institut für Röntgenphysik, Universität Göttingen, Germany
| | - Martin Krenkel
- Institut für Röntgenphysik, Universität Göttingen, Germany
| | - Johannes Hagemann
- Institut für Röntgenphysik, Universität Göttingen, Germany
- Deutsches Elektronen-Synchrotron, Hamburg, Germany
| | - Tim Salditt
- Institut für Röntgenphysik, Universität Göttingen, Germany
| |
Collapse
|
44
|
Divitt S, Gardner DF, Watnik AT. Imaging around corners in the mid-infrared using speckle correlations. OPTICS EXPRESS 2020; 28:11051-11064. [PMID: 32403624 DOI: 10.1364/oe.388260] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 03/12/2020] [Indexed: 06/11/2023]
Abstract
Speckle correlation imaging offers the ability to see objects through diffusive materials and around corners. Imaging self-illuminating thermal objects in non-line-of-sight scenarios is of particular interest. Here, using bispectrum and phase retrieval methods, we demonstrate speckle correlation imaging of mid-infrared objects through diffusers and around corners at resolutions near the diffraction limit. The images agree well with those recorded by conventional cameras with line-of-sight to the same objects.
Collapse
|
45
|
Maddali S, Li P, Pateras A, Timbie D, Delegan N, Crook AL, Lee H, Calvo-Almazan I, Sheyfer D, Cha W, Heremans FJ, Awschalom DD, Chamard V, Allain M, Hruszkewycz SO. General approaches for shear-correcting coordinate transformations in Bragg coherent diffraction imaging. Part I. J Appl Crystallogr 2020. [DOI: 10.1107/s1600576720001363] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
This two-part article series provides a generalized description of the scattering geometry of Bragg coherent diffraction imaging (BCDI) experiments, the shear distortion effects inherent in the 3D image obtained from presently used methods and strategies to mitigate this distortion. Part I starts from fundamental considerations to present the general real-space coordinate transformation required to correct this shear, in a compact operator formulation that easily lends itself to implementation with available software packages. Such a transformation, applied as a final post-processing step following phase retrieval, is crucial for arriving at an undistorted, correctly oriented and physically meaningful image of the 3D crystalline scatterer. As the relevance of BCDI grows in the field of materials characterization, the available sparse literature that addresses the geometric theory of BCDI and the subsequent analysis methods are generalized here. This geometrical aspect, specific to coherent Bragg diffraction and absent in 2D transmission CDI experiments, gains particular importance when it comes to spatially resolved characterization of 3D crystalline materials in a reliable nondestructive manner. This series of articles describes this theory, from the diffraction in Bragg geometry to the corrections needed to obtain a properly rendered digital image of the 3D scatterer. Part I of this series provides the experimental BCDI community with the general form of the 3D real-space distortions in the phase-retrieved object, along with the necessary post-retrieval correction method. Part II builds upon the geometric theory developed in Part I with the formalism to correct the shear distortions directly on an orthogonal grid within the phase-retrieval algorithm itself, allowing more physically realistic constraints to be applied. Taken together, Parts I and II provide the X-ray science community with a set of generalized BCDI shear-correction techniques crucial to the final rendering of a 3D crystalline scatterer and for the development of new BCDI methods and experiments.
Collapse
|
46
|
Zhou G, Zhang S, Hu Y, Hao Q. Single-shot sequential projection phase retrieval and 3D localization from chromatic aberration. OPTICS EXPRESS 2020; 28:9976-9987. [PMID: 32225596 DOI: 10.1364/oe.389260] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2020] [Accepted: 03/10/2020] [Indexed: 06/10/2023]
Abstract
A phase retrieval method based on sequential projection and chromatic aberration is reported. Construction of this method includes a red, green and blue (RGB) LED, an objective and a color camera. Owing to the chromatic aberration characteristics of the objective, three color images obtained by the color camera correspond to three equivalent propagation planes. Equivalent relative distances among these planes can be obtained by defining and iteratively minimizing the convergence index. Then, sequential projection strategy is used for phase retrieval in each image plane. Based on the recovered phase information and angular spectrum propagation principle, digital refocusing and 3D localization can be achieved for each subregion of the sample. Finally, the feasibility of our method is demonstrated by simulations and experiments.
Collapse
|
47
|
Konda PC, Loetgering L, Zhou KC, Xu S, Harvey AR, Horstmeyer R. Fourier ptychography: current applications and future promises. OPTICS EXPRESS 2020; 28:9603-9630. [PMID: 32225565 DOI: 10.1364/oe.386168] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 01/30/2020] [Indexed: 05/18/2023]
Abstract
Traditional imaging systems exhibit a well-known trade-off between the resolution and the field of view of their captured images. Typical cameras and microscopes can either "zoom in" and image at high-resolution, or they can "zoom out" to see a larger area at lower resolution, but can rarely achieve both effects simultaneously. In this review, we present details about a relatively new procedure termed Fourier ptychography (FP), which addresses the above trade-off to produce gigapixel-scale images without requiring any moving parts. To accomplish this, FP captures multiple low-resolution, large field-of-view images and computationally combines them in the Fourier domain into a high-resolution, large field-of-view result. Here, we present details about the various implementations of FP and highlight its demonstrated advantages to date, such as aberration recovery, phase imaging, and 3D tomographic reconstruction, to name a few. After providing some basics about FP, we list important details for successful experimental implementation, discuss its relationship with other computational imaging techniques, and point to the latest advances in the field while highlighting persisting challenges.
Collapse
|
48
|
de Beurs ACC, Liu X, Jansen GSM, Konijnenberg AP, Coene WMJ, Eikema KSE, Witte S. Extreme ultraviolet lensless imaging without object support through rotational diversity in diffractive shearing interferometry. OPTICS EXPRESS 2020; 28:5257-5266. [PMID: 32121750 DOI: 10.1364/oe.380056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/11/2019] [Accepted: 02/02/2020] [Indexed: 06/10/2023]
Abstract
We report on a method that allows microscopic image reconstruction from extreme-ultraviolet diffraction patterns without the need for object support constraints or other prior knowledge about the object structure. This is achieved by introducing additional diversity through rotation of an object in a rotationally asymmetric probe beam, produced by the spatial interference between two phase-coherent high-harmonic beams. With this rotational diffractive shearing interferometry method, we demonstrate robust image reconstruction of microscopic objects at wavelengths around 30 nm, using images recorded at only three to five different object rotations.
Collapse
|
49
|
Favre-Nicolin V, Leake S, Chushkin Y. Free log-likelihood as an unbiased metric for coherent diffraction imaging. Sci Rep 2020; 10:2664. [PMID: 32060293 PMCID: PMC7021796 DOI: 10.1038/s41598-020-57561-2] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2019] [Accepted: 12/16/2019] [Indexed: 11/18/2022] Open
Abstract
Coherent Diffraction Imaging (CDI), a technique where an object is reconstructed from a single (2D or 3D) diffraction pattern, recovers the lost diffraction phases without a priori knowledge of the extent (support) of the object. The uncertainty of the object support can lead to over-fitting and prevents an unambiguous metric evaluation of solutions. We propose to use a ‘free’ log-likelihood indicator, where a small percentage of points are masked from the reconstruction algorithms, as an unbiased metric to evaluate the validity of computed solutions, independent of the sample studied. We also show how a set of solutions can be analysed through an eigen-decomposition to yield a better estimate of the real object. Example analysis on experimental data is presented both for a test pattern dataset, and the diffraction pattern from a live cyanobacteria cell. The method allows the validation of reconstructions on a wide range of materials (hard condensed or biological), and should be particularly relevant for 4th generation synchrotrons and X-ray free electron lasers, where large, high-throughput datasets require a method for unsupervised data evaluation.
Collapse
Affiliation(s)
- Vincent Favre-Nicolin
- ESRF, The European Synchrotron, 71 Avenue des Martyrs, 38000, Grenoble, France. .,Univ. Grenoble Alpes, Grenoble, France.
| | - Steven Leake
- ESRF, The European Synchrotron, 71 Avenue des Martyrs, 38000, Grenoble, France
| | - Yuriy Chushkin
- ESRF, The European Synchrotron, 71 Avenue des Martyrs, 38000, Grenoble, France
| |
Collapse
|
50
|
Malm E, Wikmark H, Pfau B, Villanueva-Perez P, Rudawski P, Peschel J, Maclot S, Schneider M, Eisebitt S, Mikkelsen A, L'Huillier A, Johnsson P. Singleshot polychromatic coherent diffractive imaging with a high-order harmonic source. OPTICS EXPRESS 2020; 28:394-404. [PMID: 32118967 DOI: 10.1364/oe.28.000394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/19/2019] [Accepted: 11/15/2019] [Indexed: 06/10/2023]
Abstract
Singleshot polychromatic coherent diffractive imaging is performed with a high-intensity high-order harmonic generation source. The coherence properties are analyzed and several reconstructions show the shot-to-shot fluctuations of the incident beam wavefront. The method is based on a multi-step approach. First, the spectrum is extracted from double-slit diffraction data. The spectrum is used as input to extract the monochromatic sample diffraction pattern, then phase retrieval is performed on the quasi-monochromatic data to obtain the sample's exit surface wave. Reconstructions based on guided error reduction (ER) and alternating direction method of multipliers (ADMM) are compared. ADMM allows additional penalty terms to be included in the cost functional to promote sparsity within the reconstruction.
Collapse
|