Compressive Broad-Band Hyperspectral Sum Frequency Generation Microscopy to Study Functionalized Surfaces

Spiral packing and chiral selectivity in model membranes probed by phase-resolved sum-frequency generation microscopy

Since the lipid raft model was developed at the end of the last century, it became clear that the specific molecular arrangements of phospholipid assemblies within a membrane have profound implications in a vast range of physiological functions. Studies of such condensed lipid islands in model systems using fluorescence and Brewster angle microscopies have shown a wide range of sizes and morphologies, with suggestions of substantial in-plane molecular anisotropy and mesoscopic structural chirality. Whilst these variations can significantly alter many membrane properties including its fluidity, permeability and molecular recognition, the details of the in-plane molecular orientations underlying these traits remain largely unknown. Here, we use phase-resolved sum-frequency generation microscopy on model membranes of mixed chirality phospholipid monolayers to fully determine the three-dimensional molecular structure of the constituent micron-scale condensed domains. We find that the domains possess curved molecular directionality with spiralling mesoscopic packing, where both the molecular and spiral turning directions depend on the lipid chirality, but form structures clearly deviating from mirror symmetry for different enantiomeric mixtures. This demonstrates strong enantioselectivity in the domain growth process and indicates fundamental thermodynamic differences between homo- and heterochiral membranes, which may be relevant in the evolution of homochirality in all living organisms.

Joint Diagnostic Method of Tumor Tissue Based on Hyperspectral Spectral-Spatial Transfer Features

In order to improve the clinical application of hyperspectral technology in the pathological diagnosis of tumor tissue, a joint diagnostic method based on spectral-spatial transfer features was established by simulating the actual clinical diagnosis process and combining micro-hyperspectral imaging with large-scale pathological data. In view of the limited sample volume of medical hyperspectral data, a multi-data transfer model pre-trained on conventional pathology datasets was applied to the classification task of micro-hyperspectral images, to explore the differences in spectral-spatial transfer features in the wavelength of 410-900 nm between tumor tissues and normal tissues. The experimental results show that the spectral-spatial transfer convolutional neural network (SST-CNN) achieved a classification accuracy of 95.46% for the gastric cancer dataset and 95.89% for the thyroid cancer dataset, thus outperforming models trained on single conventional digital pathology and single hyperspectral data. The joint diagnostic method established based on SST-CNN can complete the interpretation of a section of data in 3 min, thus providing a new technical solution for the rapid diagnosis of pathology. This study also explored problems involving the correlation between tumor tissues and typical spectral-spatial features, as well as the efficient transformation of conventional pathological and transfer spectral-spatial features, which solidified the theoretical research on hyperspectral pathological diagnosis.

Polarization-based idler elimination: enhancing the efficiency of optical parametric amplification

This study presents a novel way to increase the energy conversion efficiency of optical parametric amplification by eliminating the idler wave from the interaction using consecutive type-I and type-II amplification processes. By using the aforementioned straightforward approach the wavelength tunable narrow-bandwidth amplification with exceptionally high 40% peak pump-to-signal conversion efficiency and 68% peak pump depletion was achieved in the short-pulse regime, while preserving the beam quality factor of less than 1.4. The same optical layout can also serve as an enhanced idler amplification scheme.

Temporal and Chirp Effects of Laser Pulses on the Spectral Lineshape in Sum-Frequency Generation Vibrational Spectroscopy

Assignment and interpretation of the sum-frequency generation vibrational spectra (SFG-VS) depend on the ability to measure and understand the factors affecting the SFG-VS spectral lineshape accurately and reliably. In the past, the formulation of the polarization selection rules for SFG-VS and the development of the sub-wavenumber high-resolution broadband SFG-VS (HR-BB-SFG-VS) have provided solutions for many of these needs. However, despite these advantages, HR-BB-SFG-VS has not been widely adopted. The majority of SFG measurements so far still relies on the picosecond scanning SFG-VS (ps-SFG-VS) or the conventional broadband SFG-VS (BB-SFG-VS) with the spectral resolution around (mostly above) 10 cm-1, which also results in less ideal spectral lineshape in the SFG spectra due to the temporal and chirp effects of the laser pulses used in experiment. In this report, the temporal and the chirp effects of laser pulses with different profiles in the SFG experiment on the measured SFG-VS spectral lineshape are examined through spectral simulation. In addition, the experimental data of a classical model system, i.e., OTS (octadecyltrichlorosilane) monolayer on glass, obtained from the ps-SFG-VS, the BB-SFG-VS, and the HR-BB-SFG-VS measurements, are directly compared and examined. These results show that temporal and chirp effects are often significant in the conventional BB-SFG-VS, resulting lineshape distortions and peak position shifts besides spectral broadening. Such temporal and chirp effects are less significant in the ps scanning SFG-VS. For the HR-BB-SFG-VS, spectral broadening, and temporal and chirp effects are insignificant, making HR-BB-SFG-VS the choice for accurate and reliable measurement and analysis of SFG-VS spectra.

Revealing the Molecular Physics of Lattice Self-Assembly by Vibrational Hyperspectral Imaging

Lattice self-assemblies (LSAs), which mimic protein assemblies, were studied using a new nonlinear vibrational imaging technique called vibrational sum-frequency generation (VSFG) microscopy. This technique successfully mapped out the mesoscopic morphology, microscopic geometry, symmetry, and ultrafast dynamics of an LSA formed by β-cyclodextrin (β-CD) and sodium dodecyl sulfate (SDS). The spatial imaging also revealed correlations between these different physical properties. Such knowledge shed light on the functions and mechanical properties of LSAs. In this Feature Article, we briefly introduce the fundamental principles of the VSFG microscope and then discuss the in-depth molecular physics of the LSAs revealed by this imaging technique. The application of the VSFG microscope to the artificial LSAs also paved the way for an alternative approach to studying the structure-dynamic-function relationships of protein assemblies, which were essential for life and difficult to study because of their various and complicated interactions. We expect that the hyperspectral VSFG microscope could be broadly applied to many noncentrosymmetric soft materials.

Vibrational Sum-Frequency Generation Hyperspectral Microscopy for Molecular Self-Assembled Systems

In this review, we discuss the recent developments and applications of vibrational sum-frequency generation (VSFG) microscopy. This hyperspectral imaging technique can resolve systems without inversion symmetry, such as surfaces, interfaces and noncentrosymmetric self-assembled materials, in the spatial, temporal, and spectral domains. We discuss two common VSFG microscopy geometries: wide-field and confocal point-scanning. We then introduce the principle of VSFG and the relationships between hyperspectral imaging with traditional spectroscopy, microscopy, and time-resolved measurements. We further highlight crucial applications of VSFG microscopy in self-assembled monolayers, cellulose in plants, collagen fibers, and lattice self-assembled biomimetic materials. In these systems, VSFG microscopy reveals relationships between physical properties that would otherwise be hidden without being spectrally, spatially, and temporally resolved. Lastly, we discuss the recent development of ultrafast transient VSFG microscopy, which can spatially measure the ultrafast vibrational dynamics of self-assembled materials. The review ends with an outlook on the technical challenges of and scientific potential for VSFG microscopy.

Direct imaging of electric field behavior in 2,7-diphenyl[1]benzothieno[3,2-b][1]benzothiophene organic field-effect transistors by sum-frequency generation imaging microscopy

Sum-frequency generation imaging microscopy combined with compressive-sensing (CS-SFG) is a powerful micro-spectroscopic technique for probing interfaces and surfaces with a spatial resolution where contrast is based on the chemical functional groups. We reported the use of the CS-SFG technique to probe the electric field due to charge accumulation and the internal electric field in operating organic field-effect transistors (OFETs) with the aluminum oxide and octadecylphosphonic acid (ODPA) self-assembled monolayer as the gate dielectric layer and 2,7-diphenyl[1]benzothieno[3,2-b][1]benzothiophene (DPh-BTBT) as the semiconductor layer. In addition, the electric field behavior was discussed by a difference in the electric field induced SFG intensity between the open-circuit and the voltage application conditions. The SFG peak of CH stretching mode derived from methyl groups of ODPA and phenyl groups of DPh-BTBT could be observed at each interface of ODPA/DPh-BTBT or DPh-BTBT/Au, respectively. Moreover, the electric field induced SFG coming from ODPA/DPh-BTBT shows the presence of intense electric field due to charge injection and accumulation near the drain and source electrode edges under the operation of OFETs. Our studies show that the electric field-induced SFG imaging technique is useful for probing the local electric field distribution or charge accumulation behavior in OFETs under operating conditions.

Spectroscopic imaging of surfaces-Sum frequency generation microscopy (SFGM) combined with compressive sensing (CS) technique

Surface chemistry is notoriously difficult to study, in part, due to the decreased number of molecules that contribute to the properties compared to the bulk phase but often has significant effects on the chemical activity of the material. This is especially true in topics such as corrosion, catalysis, wetting, and many others in nature and industry. Sum frequency generation (SFG) spectroscopy was developed for interface studies due to its high molecular selectivity and surface sensitivity, which is quite useful to study the effects of structural inhomogeneity in microscopy. Compressive sensing (CS) combined with SFG spectroscopy minimizes the imaging time while still producing quality images. Selected systems are presented here to demonstrate the capability of CS-SFG microscopy. CS-SFG microscopy successfully distinguished the static monolayer molecular mixtures, the orientations and adsorption of adsorbed molecules by the dip-coating technique, and the localized CO behaviors on polycrystalline Pt electrodes. Further discussion includes dynamic imaging as a future direction in CS-SFG microscopy. As materials and surfaces become more complex, imaging with chemical contrast becomes indispensable to understanding their performance and CS-SFG microscopy seems highly beneficial in this respect.

Leaving the Limits of Linearity for Light Microscopy

Nonlinear microscopy has enabled additional modalities for chemical contrast, deep penetration into biological tissues, and the ability to collect dynamics on ultrafast timescales across heterogenous samples. The additional light fields introduced to a sample offer seemingly endless possibilities for variation to optimize and customize experimentation and the extraction of physical insight. This perspective highlights three areas of growth in this diverse field: the collection of information across multiple timescales, the selective imaging of interfacial chemistry, and the exploitation of quantum behavior for future imaging directions. Future innovations will leverage the work of the studies reviewed here as well as address the current challenges presented.

Chemical Imaging of Surfaces with Sum Frequency Generation Vibrational Spectroscopy

Surface chemistry is a key area of study in the chemical sciences, and many system properties are dominated by the chemistry at the interface between two bulk media. While the interface may have a large influence on the system behavior, there are relatively few molecules at the interface compared to the bulk; thus, probing their unique properties has become a specialized field in physical chemistry. In addition to the heterogeneous phase chemistry, surfaces also present spatial heterogeneity (Chemistry in Two Dimensions). This 2D chemistry affects the properties as much as the heterogeneous phases. If we consider the Cartesian z-axis as defining the dimension across the interface between the two bulk phases, then the x-y plane is the 2D region of the surface. We might even consider that the majority of surface chemistry has been concerned with this z-dimension, i.e., surface structure, partition excess, thermodynamics, etc. relative to the bulk, where the 2D distribution was only considered on average. This treatment is understandable since few techniques provide the spatial and chemical resolution needed to deduce the effects of 2D heterogeneity on the surface properties. It is desirable to use an all-optical technique for interface studies because the optical methods provide the chemical specificity through spectroscopy. Also, the use of second-order spectroscopy is typically surface-sensitive without background subtractions or enhancement mechanisms that could limit the range of systems to be investigated.In this Account, the development and selected results of sum frequency generation microscopy and its contributions to the surface chemistry are presented. Sum frequency generation (SFG) provides a unique probe for studying surface chemistry in ambient conditions with surface specificity. SFG provides image contrast based on multiple-chemically important-mechanisms such as chemical functional groups, molecular orientation, surface concentration, molecular conformation, local electric fields, among others. To understand the spatial distribution of heterogeneous chemistry, multiple microscopy methods have been developed which utilize the SFG process to yield spatial information with chemical sensitivity. These spectroscopic-microscopies come with unique advantages as well as challenges. Multiple solutions have been developed in this field to overcome the challenges and improve the advantages. In this Account, some of the leading SFG surface microscopies for surface studies are introduced. Initially, direct imaging of the SFG signal onto a CCD camera provided spatially and spectrally resolved imaging of monolayers on surfaces. However, to speed up the imaging process, the technique of compressive sensing was applied to SFG imaging. Most recently the use of machine learning methods and target factor analysis have improved the quality and acquisition speed of SFG images.

Salting Up of Proteins at the Air/Water Interface

Vibrational sum frequency generation (VSFG) spectroscopy and surface pressure measurements are used to investigate the adsorption of a globular protein, bovine serum albumin (BSA), at the air/water interface with and without the presence of salts. We find at low (2 to 5 ppm) protein concentrations, which is relevant to environmental conditions, both VSFG and surface pressure measurements of BSA behave drastically different from at higher concentrations. Instead of emerging to the surface immediately, as observed at 1000 ppm, protein adsorption kinetics is on the order of tens of minutes at lower concentrations. Most importantly, salts strongly enhance the presence of BSA at the interface. This "salting up" effect differs from the well-known "salting out" effect as it occurs at protein concentrations well-below where "salting out" occurs. The dependence on salt concentration suggests this effect relates to a large extent electrostatic interactions and volume exclusion. Additionally, results from other proteins and the pH dependence of the kinetics indicate that salting up depends on the flexibility of proteins. This initial report demonstrates "salting up" as a new type of salt-driven interfacial phenomenon, which is worthy of continued investigation given the importance of salts in biological and environmental aqueous systems.

A new approach to vibrational sum frequency generation spectroscopy using near infrared pulse shaping

We have developed a multipurpose vibrational sum frequency generation (vSFG) spectrometer that is uniquely capable of probing a broad range of chemical species, each requiring different experimental conditions, without optical realignment. Here, we take advantage of arbitrary near infrared (NIR) waveform generation using a 4f-pulse shaper equipped with a 2D spatial light modulator (SLM) to tailor upconversion pulses to meet sample dependent experimental requirements. This report details the experimental layout, details of the SLM calibration and implementation, and the intrinsic benefits/limitations of this new approach to vSFG spectroscopy. We have demonstrated the competency of this spectrometer by achieving an ∼3-fold increase in spectral resolution compared to conventional spectrometers by probing the model dimethyl sulfoxide/air interface. We also show the ability to suppress nonresonant background contributions from electrode interfaces using time delayed asymmetric waveforms that are generated by the NIR pulse shaper. It is expected that this advancement in instrumentation will broaden the types of samples researchers can readily study using nonlinear surface specific spectroscopies.

Correlated Materials Characterization via Multimodal Chemical and Functional Imaging

Multimodal chemical imaging simultaneously offers high-resolution chemical and physical information with nanoscale and, in select cases, atomic resolution. By coupling modalities that collect physical and chemical information, we can address scientific problems in biological systems, battery and fuel cell research, catalysis, pharmaceuticals, photovoltaics, medicine, and many others. The combined systems enable the local correlation of material properties with chemical makeup, making fundamental questions of how chemistry and structure drive functionality approachable. In this Review, we present recent progress and offer a perspective for chemical imaging used to characterize a variety of samples by a number of platforms. Specifically, we present cases of infrared and Raman spectroscopies combined with scanning probe microscopy; optical microscopy and mass spectrometry; nonlinear optical microscopy; and, finally, ion, electron, and probe microscopies with mass spectrometry. We also discuss the challenges associated with the use of data originated by the combinatorial hardware, analysis, and machine learning as well as processing tools necessary for the interpretation of multidimensional data acquired from multimodal studies.

Flexible approach to vibrational sum-frequency generation using shaped near-infrared light

We describe a new approach that expands the utility of vibrational sum-frequency generation (vSFG) spectroscopy using shaped near-infrared (NIR) laser pulses. We demonstrate that arbitrary pulse shapes can be specified to match experimental requirements without the need for changes to the optical alignment. In this way, narrowband NIR pulses as long as 5.75 ps are readily generated, with a spectral resolution of about 2.5  cm-1, an improvement of approximately a factor of 3 compared to a typical vSFG system. Moreover, the utility of having complete control over the NIR pulse characteristics is demonstrated through nonresonant background suppression from a metallic substrate by generating an etalon waveform in the pulse shaper. The flexibility afforded by switching between arbitrary NIR waveforms at the sample position with the same instrument geometry expands the type of samples that can be studied without extensive modifications to existing apparatuses or large investments in specialty optics.

Multimodal nonlinear microscope based on a compact fiber-format laser source

We present a multimodal non-linear optical (NLO) laser-scanning microscope, based on a compact fiber-format excitation laser and integrating coherent anti-Stokes Raman scattering (CARS), stimulated Raman scattering (SRS) and two-photon-excitation fluorescence (TPEF) on a single platform. We demonstrate its capabilities in simultaneously acquiring CARS and SRS images of a blend of 6-μm poly(methyl methacrylate) beads and 3-μm polystyrene beads. We then apply it to visualize cell walls and chloroplast of an unprocessed fresh leaf of Elodea aquatic plant via SRS and TPEF modalities, respectively. The presented NLO microscope, developed in house using off-the-shelf components, offers full accessibility to the optical path and ensures its easy re-configurability and flexibility.

Hyperspectral imaging with laser-scanning sum-frequency generation microscopy

Vibrationally sensitive sum-frequency generation (SFG) microscopy is a chemically selective imaging technique sensitive to non-centrosymmetric molecular arrangements in biological samples. The routine use of SFG microscopy has been hampered by the difficulty of integrating the required mid-infrared excitation light into a conventional, laser-scanning nonlinear optical (NLO) microscope. In this work, we describe minor modifications to a regular laser-scanning microscope to accommodate SFG microscopy as an imaging modality. We achieve vibrationally sensitive SFG imaging of biological samples with sub-μm resolution at image acquisition rates of 1 frame/s, almost two orders of magnitude faster than attained with previous point-scanning SFG microscopes. Using the fast scanning capability, we demonstrate hyperspectral SFG imaging in the CH-stretching vibrational range and point out its use in the study of molecular orientation and arrangement in biologically relevant samples. We also show multimodal imaging by combining SFG microscopy with second-harmonic generation (SHG) and coherent anti-Stokes Raman scattering (CARS) on the same imaging platfrom. This development underlines that SFG microscopy is a unique modality with a spatial resolution and image acquisition time comparable to that of other NLO imaging techniques, making point-scanning SFG microscopy a valuable member of the NLO imaging family.

Chemical Imaging of Self-Assembled Monolayers on Copper Using Compressive Hyperspectral Sum Frequency Generation Microscopy

Sum frequency generation microscopy is a label-free optical imaging technique with intrinsic molecular vibrational contrast for surface studies. Recent developments of compressive sensing broad-band hyperspectral SFG microscopy have demonstrated the potential application for imaging monolayer at metal surfaces with micrometer spatial resolution. Here is presented the capability of chemical imaging of spatially patterned monolayers of 1-octadecanethiol (ODT) and 16-methoxy-1-hexadecanethiol (MeOHT) molecules assembled on a copper surface. The spatial distributions of the monolayer with vibrational-spectral contrast are well-demonstrated at different frequency regions through reconstruction of the hypercube using a 3-dimensional total variation regularization algorithm (3DTV). Spatial-chemical distributions of each component are also reconstructed directly from the compressive measurements by endmember unmixing (CEU) scheme. Compared to 3DTV algorithm, the reconstruction from CEU shows spatial distribution of each component on the surfaces, and demonstrates the ability to characterize the domains of mixed-molecules on surfaces.

Sum Frequency Generation Vibrational Spectroscopy for Characterization of Buried Polymer Interfaces

Sum frequency generation vibrational spectroscopy (SFG-VS) has become one of the most appealing technologies to characterize molecular structures at interfaces. In this focal point review, we focus on SFG-VS studies at buried polymer interfaces and review many of the recent publications in the field. We also cover the essential theoretical background of SFG-VS and discuss the experimental implementation of SFG-VS.

Single Particle Tracking: From Theory to Biophysical Applications

After three decades of developments, single particle tracking (SPT) has become a powerful tool to interrogate dynamics in a range of materials including live cells and novel catalytic supports because of its ability to reveal dynamics in the structure-function relationships underlying the heterogeneous nature of such systems. In this review, we summarize the algorithms behind, and practical applications of, SPT. We first cover the theoretical background including particle identification, localization, and trajectory reconstruction. General instrumentation and recent developments to achieve two- and three-dimensional subdiffraction localization and SPT are discussed. We then highlight some applications of SPT to study various biological and synthetic materials systems. Finally, we provide our perspective regarding several directions for future advancements in the theory and application of SPT.

Programmable single-pixel-based broadband stimulated Raman scattering

We report a simple add-on for broadband stimulated Raman scattering (SRS) microscopes to enable fast and programmable spectroscopy acquisition. It comprises a conventional dispersive spectrometer layout incorporating a fast digital micromirror device (DMD). The approach is validated by acquiring SRS spectra of standard chemicals. We demonstrate a DMD's advantage in broadband SRS by showing higher signal-to-noise ratio using a multiplexed Hadamard spectral basis and compressive sensing detection. Our results apply to a variety of frequency-domain pump-probe spectroscopy.