High-throughput FCS using an LCOS spatial light modulator and an 8 × 1 SPAD array

Segmented fluorescence correlation spectroscopy (FCS) on a commercial laser scanning microscope

Performing accurate Fluorescence Correlation Spectroscopy (FCS) measurements in cells can be challenging due to cellular motion or other intracellular processes. In this respect, it has recently been shown that analysis of FCS data in short temporal segments (segmented FCS) can be very useful to increase the accuracy of FCS measurements inside cells. Here, we demonstrate that segmented FCS can be performed on a commercial laser scanning microscope (LSM), even in the absence of the dedicated FCS module. We show how data can be acquired on a Leica SP8 confocal microscope and then exported and processed with a custom software in MATLAB. The software performs segmentation of the data to extract an average ACF and measure the diffusion coefficient in specific subcellular regions. First of all, we measure the diffusion of fluorophores of different size in solution, to show that good-quality ACFs can be obtained in a commercial LSM. Next, we validate the method by measuring the diffusion coefficient of GFP in the nucleus of HeLa cells, exploiting variations of the intensity to distinguish between nucleoplasm and nucleolus. As expected, the measured diffusion coefficient of GFP is slower in the nucleolus relative to nucleoplasm. Finally, we apply the method to HeLa cells expressing a PARP1 chromobody to measure the diffusion coefficient of PARP1 in different subcellular regions. We find that PARP1 diffusion is slower in the nucleolus compared to the nucleoplasm.

Performance of Active-Quenching SPAD Array Based on the Tri-State Gates of FPGA and Packaged with Bare Chip Stacking

The performance of an active-quenching single-photon avalanche diode (SPAD) array that is based on the tri-state gates of a field programmable gate array (FPGA) is presented. The array is implemented by stacking a bare 4 × 4 N-on-P SPAD array on a bare FPGA die, and the electrodes of the SPAD pixels and the I/O ports of the FPGA are connected through wire bonding within the same package. The active quenching action on each SPAD pixel is performed by using the properties of the tri-state gates of the FPGA. Digital signal processing, such as pulse counters, data encoders, and command interactions, is also performed by using the same FPGA. The breakdown voltage of the SPAD pixels, with an active area of 60 μm × 60 μm, is 47.2-48.0 V. When the device is reverse biased at a voltage of ~50.4 V, a response delay of ~50 ns, a dead time of 157 ns, a dark count rate of 2.44 kHz, and an afterpulsing probability of 6.9% are obtained. Its peak photon detection probability (PDP) reaches 17.0% at a peak wavelength of 760 nm and remains above 10% at 900 nm. This hybrid integrated SPAD array is reconfigurable and cost effective.

Computational Proposal for Tracking Multiple Molecules in a Multifocus Confocal Setup

Tracking single molecules continues to provide new insights into the fundamental rules governing biological function. Despite continued technical advances in fluorescent and non-fluorescent labeling as well as data analysis, direct observations of trajectories and interactions of multiple molecules in dense environments remain aspirational goals. While confocal methods provide a means to deduce dynamical parameters with high temporal resolution, such as diffusion coefficients, they do so at the expense of spatial resolution. Indeed, on account of a confocal volume's symmetry, typically only distances from the center of the confocal spot can be deduced. Motivated by the need for true three dimensional high speed tracking in densely labeled environments, we propose a computational tool for tracking many fluorescent molecules traversing multiple, closely spaced, confocal measurement volumes providing independent observations. Various realizations of this multiple confocal volumes strategy have previously been used for long term, large area, tracking of one fluorescent molecule in three dimensions. What is more, we achieve tracking by directly using single photon arrival times to inform our likelihood and exploit Hamiltonian Monte Carlo to efficiently sample trajectories from our posterior within a Bayesian nonparametric paradigm. A nonparametric paradigm here is warranted as the number of molecules present are, themselves, a priori unknown. Taken together, we provide a computational framework to infer trajectories of multiple molecules at once, below the diffraction limit (the width of a confocal spot), in three dimensions at sub-millisecond or faster time scales.

Rapid ensemble measurement of protein diffusion and probe blinking dynamics in cells

We present a fluorescence fluctuation image correlation analysis method that can rapidly and simultaneously measure the diffusion coefficient, photoblinking rates, and fraction of diffusing particles of fluorescent molecules in cells. Unlike other image correlation techniques, we demonstrated that our method could be applied irrespective of a nonuniformly distributed, immobile blinking fluorophore population. This allows us to measure blinking and transport dynamics in complex cell morphologies, a benefit for a range of super-resolution fluorescence imaging approaches that rely on probe emission blinking. Furthermore, we showed that our technique could be applied without directly accounting for photobleaching. We successfully employed our technique on several simulations with realistic EMCCD noise and photobleaching models, as well as on Dronpa-C12-labeled β-actin in living NIH/3T3 and HeLa cells. We found that the diffusion coefficients measured using our method were consistent with previous literature values. We further found that photoblinking rates measured in the live HeLa cells varied as expected with changing excitation power.

Confocal-based fluorescence fluctuation spectroscopy with a SPAD array detector

The combination of confocal laser-scanning microscopy (CLSM) and fluorescence fluctuation spectroscopy (FFS) is a powerful tool in studying fast, sub-resolution biomolecular processes in living cells. A detector array can further enhance CLSM-based FFS techniques, as it allows the simultaneous acquisition of several samples-essentially images-of the CLSM detection volume. However, the detector arrays that have previously been proposed for this purpose require tedious data corrections and preclude the combination of FFS with single-photon techniques, such as fluorescence lifetime imaging. Here, we solve these limitations by integrating a novel single-photon-avalanche-diode (SPAD) array detector in a CLSM system. We validate this new implementation on a series of FFS analyses: spot-variation fluorescence correlation spectroscopy, pair-correlation function analysis, and image-derived mean squared displacement analysis. We predict that the unique combination of spatial and temporal information provided by our detector will make the proposed architecture the method of choice for CLSM-based FFS.

Custom silicon technology for SPAD-arrays with red-enhanced sensitivity and low timing jitter

Single-photon detection is an invaluable tool for many applications ranging from basic research to consumer electronics. In this respect, the Single Photon Avalanche Diode (SPAD) plays a key role in enabling a broad diffusion of these techniques thanks to its remarkable performance, room-temperature operation, and scalability. In this paper we present a silicon technology that allows the fabrication of SPAD-arrays with an unprecedented combination of low timing jitter (95 ps FWHM) and high detection efficiency at red and near infrared wavelengths (peak of 70% at 650 nm, 45% at 800 nm). We discuss the device structure, the fabrication process, and we present a thorough experimental characterization of the fabricated detectors. We think that these results can pave the way to new exciting developments in many fields, ranging from quantum optics to single molecule spectroscopy.

High-throughput fluorescence correlation spectroscopy enables analysis of surface components of cell-derived vesicles

Extracellular vesicles (EVs) and cell-derived vesicles (CDVs), generated by fragmenting cellular membranes, have both been explored as therapeutic delivery vehicles. Surface proteins on these vesicles are of great importance as they are characteristic to the cell of origin and modulate vesicle interactions with target cells. Here, we introduced a high-throughput fluorescence correlation spectroscopy (ht-FCS) approach capable of characterizing vesicle surface proteins across a large number of samples. We used automated screening and acquisition of FCS data to profile surface proteins of cell-derived vesicles with high fidelity based on changes in diffusion time upon antibody-vesicle interactions. We characterized vesicles generated from 4 cell types using antibodies for known exosome biomarkers. The ht-FCS technique presented here offers the capability to screen EVs or cell-derived vesicles against a library of surface markers or to screen a library of cell-derived vesicles for a specific identifying marker at a high speed.

High-throughput, multi-parametric, and correlative fluorescence lifetime imaging

In this review, we discuss methods and advancements in fluorescence lifetime imaging microscopy that permit measurements to be performed at faster speed and higher resolution than previously possible. We review fast single-photon timing technologies and the use of parallelized detection schemes to enable high-throughput and high content imaging applications. We appraise different technological implementations of fluorescence lifetime imaging, primarily in the time-domain. We also review combinations of fluorescence lifetime with other imaging modalities to capture multi-dimensional and correlative information from a single sample. Throughout the review, we focus on applications in biomedical research. We conclude with a critical outlook on current challenges and future opportunities in this rapidly developing field.

Functional Fluorescence Microscopy Imaging: Quantitative Scanning-Free Confocal Fluorescence Microscopy for the Characterization of Fast Dynamic Processes in Live Cells

Functional fluorescence microscopy imaging (fFMI), a time-resolved (21 μs/frame) confocal fluorescence microscopy imaging technique without scanning, is developed for quantitative characterization of fast reaction-transport processes in solution and in live cells. The method is based on massively parallel fluorescence correlation spectroscopy (FCS). Simultaneous excitation of fluorescent molecules in multiple spots in the focal plane is achieved using a diffractive optical element (DOE). Fluorescence from the DOE-generated 1024 illuminated spots is detected in a confocal arrangement by a matching matrix detector comprising 32 × 32 single-photon avalanche photodiodes (SPADs). Software for data acquisition and fast auto- and cross-correlation analysis by parallel signal processing using a graphic processing unit (GPU) allows temporal autocorrelation across all pixels in the image frame in 4 s and cross-correlation between first- and second-order neighbor pixels in 45 s. We present here this quantitative, time-resolved imaging method with single-molecule sensitivity and demonstrate its usefulness for mapping in live cell location-specific differences in the concentration and translational diffusion of molecules in different subcellular compartments. In particular, we show that molecules without a specific biological function, e.g., the enhanced green fluorescent protein (eGFP), exhibit uniform diffusion. In contrast, molecules that perform specialized biological functions and bind specifically to their molecular targets show location-specific differences in their concentration and diffusion, exemplified here for two transcription factor molecules, the glucocorticoid receptor (GR) before and after nuclear translocation and the Sex combs reduced (Scr) transcription factor in the salivary gland of Drosophila ex vivo.

High-throughput smFRET analysis of freely diffusing nucleic acid molecules and associated proteins

Single-molecule Förster resonance energy transfer (smFRET) is a powerful technique for nanometer-scale studies of single molecules. Solution-based smFRET, in particular, can be used to study equilibrium intra- and intermolecular conformations, binding/unbinding events and conformational changes under biologically relevant conditions without ensemble averaging. However, single-spot smFRET measurements in solution are slow. Here, we detail a high-throughput smFRET approach that extends the traditional single-spot confocal geometry to a multispot one. The excitation spots are optically conjugated to two custom silicon single photon avalanche diode (SPAD) arrays. Two-color excitation is implemented using a periodic acceptor excitation (PAX), allowing distinguishing between singly- and doubly-labeled molecules. We demonstrate the ability of this setup to rapidly and accurately determine FRET efficiencies and population stoichiometries by pooling the data collected independently from the multiple spots. We also show how the high throughput of this approach can be used o increase the temporal resolution of single-molecule FRET population characterization from minutes to seconds. Combined with microfluidics, this high-throughput approach will enable simple real-time kinetic studies as well as powerful molecular screening applications.

Optical crosstalk in SPAD arrays for high-throughput single-molecule fluorescence spectroscopy

Single-molecule fluorescence spectroscopy (SMFS), based on the detection of individual molecules freely diffusing through the excitation spot of a confocal microscope, has allowed unprecedented insights into biological processes at the molecular level, but suffers from limited throughput. We have recently introduced a multispot version of SMFS, which allows achieving high-throughput SMFS by virtue of parallelization, and relies on custom silicon single-photon avalanche diode (SPAD) detector arrays. Here, we examine the premise of this parallelization approach, which is that data acquired from different spots is uncorrelated. In particular, we measure the optical crosstalk characteristics of the two 48-pixel SPAD arrays used in our recent SMFS studies, and demonstrate that it is negligible (crosstalk probability ≤ 1.1 10^-3) and undetectable in cross-correlation analysis of actual single-molecule fluorescence data.

Multifocal multiphoton volumetric imaging approach for high-speed time-resolved Förster resonance energy transfer imaging in vivo

In this Letter, we will discuss the development of a multifocal multiphoton fluorescent lifetime imaging system where four individual fluorescent intensity and lifetime planes are acquired simultaneously, allowing us to obtain volumetric data without the need for sequential scanning at different axial depths. Using a phase-only spatial light modulator (SLM) with an appropriate algorithm to generate a holographic pattern, we project a beamlet array within a sample volume of a size, which can be preprogrammed by the user. We demonstrate the capabilities of the system to image live-cell interactions. While only four planes are shown, this technique can be rescaled to a large number of focal planes, enabling full 3D acquisition and reconstruction.

48-spot single-molecule FRET setup with periodic acceptor excitation

Single-molecule Förster resonance energy transfer (smFRET) allows measuring distances between donor and acceptor fluorophores on the 3-10 nm range. Solution-based smFRET allows measurement of binding-unbinding events or conformational changes of dye-labeled biomolecules without ensemble averaging and free from surface perturbations. When employing dual (or multi) laser excitation, smFRET allows resolving the number of fluorescent labels on each molecule, greatly enhancing the ability to study heterogeneous samples. A major drawback to solution-based smFRET is the low throughput, which renders repetitive measurements expensive and hinders the ability to study kinetic phenomena in real-time. Here we demonstrate a high-throughput smFRET system that multiplexes acquisition by using 48 excitation spots and two 48-pixel single-photon avalanche diode array detectors. The system employs two excitation lasers allowing separation of species with one or two active fluorophores. The performance of the system is demonstrated on a set of doubly labeled double-stranded DNA oligonucleotides with different distances between donor and acceptor dyes along the DNA duplex. We show that the acquisition time for accurate subpopulation identification is reduced from several minutes to seconds, opening the way to high-throughput screening applications and real-time kinetics studies of enzymatic reactions such as DNA transcription by bacterial RNA polymerase.

Widefield High Frame Rate Single-Photon SPAD Imagers for SPIM-FCS

Photon-counting sensors based on standard complementary metal-oxide-semiconductor single-photon avalanche diodes (SPADs) represent an emerging class of imagers that enable the counting and/or timing of single photons at zero readout noise (better than high-speed electron-multiplying charge-coupling devices) and over large arrays. They have seen substantial progress over the last 15 years, increasing their spatial resolution, timing accuracy, and sensitivity while reducing spurious signals such as afterpulsing and dark counts. They are increasingly being applied for time-resolved applications with the added advantage of enabling real-time options such as autocorrelation. We report in this study on the use of such a state-of-the-art 512 × 128 SPAD array, capable of a time resolution of 10^-5-10^-6 s for full frames while retaining acceptable photosensitivity thanks to the use of dedicated microlenses, in a selective plane illumination-fluorescence correlation spectroscopy setup. The latter allows us to perform thousands of fluorescence-correlation spectroscopy measurements simultaneously in a two-dimensional slice of the sample. This high-speed SPAD imager enables the measurement of molecular motion of small fluorescent particles such as single chemical dye molecules. Inhomogeneities in the molecular detection efficiency were compensated for by means of a global fit of the auto- and cross-correlation curves, which also made a calibration-free measurement of various samples possible. The afterpulsing effect could also be mitigated, making the measurement of the diffusion of Alexa-488 possible, and the overall result quality was further improved by spatial binning. The particle concentrations in the focus tend to be overestimated by a factor of 1.7 compared to a confocal setup; a calibration is thus required if absolute concentrations need to be measured. The first high-speed selective plane illumination-fluorescence correlation spectroscopy in vivo measurements to our knowledge were also recorded: although two-component fit models could not be employed because of noise, the diffusion of eGFP oligomers in HeLa cells could be measured. Sensitivity and noise will be further improved in the next generation of SPAD-based widefield sensors, which are currently under testing.

Local raster image correlation spectroscopy generates high-resolution intracellular diffusion maps

Raster image correlation spectroscopy (RICS) is a powerful method for measuring molecular diffusion in live cells directly from images acquired on a laser scanning microscope. However, RICS only provides single average diffusion coefficients from regions with a lateral size on the order of few micrometers, which means that its spatial resolution is mainly limited to the cellular level. Here we introduce the local RICS (L-RICS), an easy-to-use tool that generates high resolution maps of diffusion coefficients from images acquired on a laser scanning microscope. As an application we show diffusion maps of a green fluorescent protein (GFP) within the nucleus and within the nucleolus of live cells at an effective spatial resolution of 500 nm. We find not only that diffusion in the nucleolus is slowed down compared to diffusion in the nucleoplasm, but also that diffusion in the nucleolus is highly heterogeneous.

Lorenzo Scipioni et al. present Local Raster Image Correlation Spectroscopy (L-RICS), a method for generating sub-micrometer diffusion maps. They apply L-RICS to GFP in live cells and find that diffusion coefficients differ between the nucleus and nucleolus and are highly heterogeneous within compartments.

Multispot single-molecule FRET: High-throughput analysis of freely diffusing molecules

We describe an 8-spot confocal setup for high-throughput smFRET assays and illustrate its performance with two characteristic experiments. First, measurements on a series of freely diffusing doubly-labeled dsDNA samples allow us to demonstrate that data acquired in multiple spots in parallel can be properly corrected and result in measured sample characteristics consistent with those obtained with a standard single-spot setup. We then take advantage of the higher throughput provided by parallel acquisition to address an outstanding question about the kinetics of the initial steps of bacterial RNA transcription. Our real-time kinetic analysis of promoter escape by bacterial RNA polymerase confirms results obtained by a more indirect route, shedding additional light on the initial steps of transcription. Finally, we discuss the advantages of our multispot setup, while pointing potential limitations of the current single laser excitation design, as well as analysis challenges and their solutions.

High-voltage integrated active quenching circuit for single photon count rate up to 80 Mcounts/s

Single photon avalanche diodes (SPADs) have been subject to a fast improvement in recent years. In particular, custom technologies specifically developed to fabricate SPAD devices give the designer the freedom to pursue the best detector performance required by applications. A significant breakthrough in this field is represented by the recent introduction of a red enhanced SPAD (RE-SPAD) technology, capable of attaining a good photon detection efficiency in the near infrared range (e.g. 40% at a wavelength of 800 nm) while maintaining a remarkable timing resolution of about 100ps full width at half maximum. Being planar, the RE-SPAD custom technology opened the way to the development of SPAD arrays particularly suited for demanding applications in the field of life sciences. However, to achieve such excellent performance custom SPAD detectors must be operated with an external active quenching circuit (AQC) designed on purpose. Next steps toward the development of compact and practical multichannel systems will require a new generation of monolithically integrated AQC arrays. In this paper we present a new, fully integrated AQC fabricated in a high-voltage 0.18 µm CMOS technology able to provide quenching pulses up to 50 Volts with fast leading and trailing edges. Although specifically designed for optimal operation of RE-SPAD devices, the new AQC is quite versatile: it can be used with any SPAD detector, regardless its fabrication technology, reaching remarkable count rates up to 80 Mcounts/s and generating a photon detection pulse with a timing jitter as low as 119 ps full width at half maximum. The compact design of our circuit has been specifically laid out to make this IC a suitable building block for monolithically integrated AQC arrays.

Silicon technologies for arrays of Single Photon Avalanche Diodes

In order to fulfill the requirements of many applications, we recently developed a new technology aimed at combining the advantages of traditional thin and thick silicon Single Photon Avalanche Diodes (SPAD). In particular we demonstrated single-pixel detectors with a remarkable improvement in the Photon Detection Efficiency in the red/near-infrared spectrum (e.g. 40% at 800nm) while maintaining a timing jitter better than 100ps. In this paper we discuss the limitations of such Red-Enhanced (RE) technology from the point of view of the fabrication of small arrays of SPAD and we propose modifications to the structure aimed at overcoming these issues. We also report the first preliminary experimental results attained on devices fabricated adopting the improved structure.

New high-speed centre of mass method incorporating background subtraction for accurate determination of fluorescence lifetime

We demonstrate an implementation of a centre-of-mass method (CMM) incorporating background subtraction for use in multifocal fluorescence lifetime imaging microscopy to accurately determine fluorescence lifetime in live cell imaging using the Megaframe camera. The inclusion of background subtraction solves one of the major issues associated with centre-of-mass approaches, namely the sensitivity of the algorithm to background signal. The algorithm, which is predominantly implemented in hardware, provides real-time lifetime output and allows the user to effectively condense large amounts of photon data. Instead of requiring the transfer of thousands of photon arrival times, the lifetime is simply represented by one value which allows the system to collect data up to limit of pulse pile-up without any limitations on data transfer rates. In order to evaluate the performance of this new CMM algorithm with existing techniques (i.e. rapid lifetime determination and Levenburg-Marquardt), we imaged live MCF-7 human breast carcinoma cells transiently transfected with FRET standards. We show that, it offers significant advantages in terms of lifetime accuracy and insensitivity to variability in dark count rate (DCR) between Megaframe camera pixels. Unlike other algorithms no prior knowledge of the expected lifetime is required to perform lifetime determination. The ability of this technique to provide real-time lifetime readout makes it extremely useful for a number of applications.

Correction of the afterpulsing effect in fluorescence correlation spectroscopy using time symmetry analysis

Afterpulsing of a photon-counting detector is a common problem in fluorescence correlation spectroscopy. We have developed a numerical procedure which eliminates the afterpulsing effect by analyzing the time reversal asymmetry of photon data that are recorded with a time-correlated single photon counting device. This method was applied to experimental data and was compared with a previous method [Rev. Sci. Instrum. 76, 033102 (2005).]. It is demonstrated that the present method can completely eliminate the afterpulsing effect even in the case of a sample solution that contains multiple fluorophores having different fluorescence lifetimes, for which the previous method underestimates the correlation amplitude. We also show a modification of the previous method incorporating the time symmetry analysis.

Sub-10 nm near-field localization by plasmonic metal nanoaperture arrays with ultrashort light pulses

Near-field localization by ultrashort femtosecond light pulses has been investigated using simple geometrical nanoapertures. The apertures employ circular, rhombic, and triangular shapes to localize the distribution of surface plasmon. To understand the geometrical effect on the localization, aperture length and period of the nanoapertures were varied. Aperture length was shown to affect the performance more than aperture period due mainly to intra-aperture coupling of near-fields. Triangular apertures provided the strongest spatial localization below 10 nm in size as well as the highest enhancement of field intensity by more than 7000 times compared to the incident light pulse. Use of ultrashort pulses was found to allow much stronger light localization than with continuous-wave light. The results can be used for super-localization sensing and imaging applications where spatially localized fields can break through the limits in achieving improved sensitivity and resolution.

Multifocal fluorescence microscope for fast optical recordings of neuronal action potentials

In recent years, optical sensors for tracking neural activity have been developed and offer great utility. However, developing microscopy techniques that have several kHz bandwidth necessary to reliably capture optically reported action potentials (APs) at multiple locations in parallel remains a significant challenge. To our knowledge, we describe a novel microscope optimized to measure spatially distributed optical signals with submillisecond and near diffraction-limit resolution. Our design uses a spatial light modulator to generate patterned illumination to simultaneously excite multiple user-defined targets. A galvanometer driven mirror in the emission path streaks the fluorescence emanating from each excitation point during the camera exposure, using unused camera pixels to capture time varying fluorescence at rates that are ∼1000 times faster than the camera's native frame rate. We demonstrate that this approach is capable of recording Ca(2+) transients resulting from APs in neurons labeled with the Ca(2+) sensor Oregon Green Bapta-1 (OGB-1), and can localize the timing of these events with millisecond resolution. Furthermore, optically reported APs can be detected with the voltage sensitive dye DiO-DPA in multiple locations within a neuron with a signal/noise ratio up to ∼40, resolving delays in arrival time along dendrites. Thus, the microscope provides a powerful tool for photometric measurements of dynamics requiring submillisecond sampling at multiple locations.

A high speed multifocal multiphoton fluorescence lifetime imaging microscope for live-cell FRET imaging

We demonstrate diffraction limited multiphoton imaging in a massively parallel, fully addressable time-resolved multi-beam multiphoton microscope capable of producing fluorescence lifetime images with sub-50ps temporal resolution. This imaging platform offers a significant improvement in acquisition speed over single-beam laser scanning FLIM by a factor of 64 without compromising in either the temporal or spatial resolutions of the system. We demonstrate FLIM acquisition at 500 ms with live cells expressing green fluorescent protein. The applicability of the technique to imaging protein-protein interactions in live cells is exemplified by observation of time-dependent FRET between the epidermal growth factor receptor (EGFR) and the adapter protein Grb2 following stimulation with the receptor ligand. Furthermore, ligand-dependent association of HER2-HER3 receptor tyrosine kinases was observed on a similar timescale and involved the internalisation and accumulation or receptor heterodimers within endosomes. These data demonstrate the broad applicability of this novel FLIM technique to the spatio-temporal dynamics of protein-protein interaction.

Digital phantoms generated by spectral and spatial light modulators

A hyperspectral image projector (HIP) based on liquid crystal on silicon spatial light modulators is explained and demonstrated to generate data cubes. The HIP-constructed data cubes are three-dimensional images of the spatial distribution of spectrally resolved abundances of intracellular light-absorbing oxyhemoglobin molecules in single erythrocytes. Spectrally and spatially resolved image data indistinguishable from the real scene may be used as standard data cubes, so-called digital phantoms, to calibrate image sensors and validate image analysis algorithms for their measurement quality, performance consistency, and interlaboratory comparisons for quantitative biomedical imaging applications.

High-throughput spatial light modulation two-photon microscopy for fast functional imaging

The optical monitoring of multiple single neuron activities requires high-throughput parallel acquisition of signals at millisecond temporal resolution. To this aim, holographic two-photon microscopy (2PM) based on spatial light modulators (SLMs) has been developed in combination with standard laser scanning microscopes. This requires complex coordinate transformations for the generation of holographic patterns illuminating the points of interest. We present a simpler and fully digital setup (SLM-2PM) which collects three-dimensional two-photon images by only exploiting the SLM. This configuration leads to an accurate placement of laser beamlets over small focal volumes, eliminating mechanically moving parts and making the system stable over long acquisition times. Fluorescence signals are diffraction limited and are acquired through a pixelated detector, setting the actual limit to the acquisition rate. High-resolution structural images were acquired by raster-scanning the sample with a regular grid of excitation focal volumes. These images allowed the selection of the structures to be further investigated through an interactive operator-guided selection process. Functional signals were collected by illuminating all the preselected points with a single hologram. This process is exemplified for high-speed (up to 1 kHz) two-photon calcium imaging on acute cerebellar slices.

Silicon photon-counting avalanche diodes for single-molecule fluorescence spectroscopy

Solution-based single-molecule fluorescence spectroscopy is a powerful experimental tool with applications in cell biology, biochemistry and biophysics. The basic feature of this technique is to excite and collect light from a very small volume and work in a low concentration regime resulting in rare burst-like events corresponding to the transit of a single molecule. Detecting photon bursts is a challenging task: the small number of emitted photons in each burst calls for high detector sensitivity. Bursts are very brief, requiring detectors with fast response time and capable of sustaining high count rates. Finally, many bursts need to be accumulated to achieve proper statistical accuracy, resulting in long measurement time unless parallelization strategies are implemented to speed up data acquisition. In this paper we will show that silicon single-photon avalanche diodes (SPADs) best meet the needs of single-molecule detection. We will review the key SPAD parameters and highlight the issues to be addressed in their design, fabrication and operation. After surveying the state-of-the-art SPAD technologies, we will describe our recent progress towards increasing the throughput of single-molecule fluorescence spectroscopy in solution using parallel arrays of SPADs. The potential of this approach is illustrated with single-molecule Förster resonance energy transfer measurements.

Time-resolved multifocal multiphoton microscope for high speed FRET imaging in vivo

Imaging the spatiotemporal interaction of proteins in vivo is essential to understanding the complexities of biological systems. The highest accuracy monitoring of protein-protein interactions is achieved using Förster resonance energy transfer (FRET) measured by fluorescence lifetime imaging, with measurements taking minutes to acquire a single frame, limiting their use in dynamic live cell systems. We present a diffraction limited, massively parallel, time-resolved multifocal multiphoton microscope capable of producing fluorescence lifetime images with 55 ps time-resolution, giving improvements in acquisition speed of a factor of 64. We present demonstrations with FRET imaging in a model cell system and demonstrate in vivo FLIM using a GTPase biosensor in the zebrafish embryo.

A 32-channel photon counting module with embedded auto/cross-correlators for real-time parallel fluorescence correlation spectroscopy

Fluorescence correlation spectroscopy (FCS) is a well-established technique to study binding interactions or the diffusion of fluorescently labeled biomolecules in vitro and in vivo. Fast FCS experiments require parallel data acquisition and analysis which can be achieved by exploiting a multi-channel Single Photon Avalanche Diode (SPAD) array and a corresponding multi-input correlator. This paper reports a 32-channel FPGA based correlator able to perform 32 auto/cross-correlations simultaneously over a lag-time ranging from 10 ns up to 150 ms. The correlator is included in a 32 × 1 SPAD array module, providing a compact and flexible instrument for high throughput FCS experiments. However, some inherent features of SPAD arrays, namely afterpulsing and optical crosstalk effects, may introduce distortions in the measurement of auto- and cross-correlation functions. We investigated these limitations to assess their impact on the module and evaluate possible workarounds.

Dual-color fluorescence cross-correlation spectroscopy on a single plane illumination microscope (SPIM-FCCS)

Single plane illumination microscopy based fluorescence correlation spectroscopy (SPIM-FCS) is a new method for imaging FCS in 3D samples, providing diffusion coefficients, flow velocities and concentrations in an imaging mode. Here we extend this technique to two-color fluorescence cross-correlation spectroscopy (SPIM-FCCS), which allows to measure molecular interactions in an imaging mode. We present a theoretical framework for SPIM-FCCS fitting models, which is subsequently used to evaluate several test measurements of in-vitro (labeled microspheres, several DNAs and small unilamellar vesicles) and in-vivo samples (dimeric and monomeric dual-color fluorescent proteins, as well as membrane bound proteins). Our method yields the same quantitative results as the well-established confocal FCCS, but in addition provides unmatched statistics and true imaging capabilities.

Ensemble and single-molecule detected time-resolved FRET methods in studies of protein conformations and dynamics

Most proteins are nanomachines that are selected to execute specific functions and therefore should have some degree of flexibility. The driving force that excites specific motions of domains and smaller chain elements is the thermal fluctuations of the solvent bath which are channeled to selected modes of motions by the structural constraints. Consequently characterization of the ensembles of conformers of proteins and their dynamics should be expressed in statistical terms, i.e., determination of probability distributions of the various conformers. This can be achieved by measurements of time-resolved dynamic non-radiative excitation energy transfer (trFRET) within ensembles of site specifically labeled protein molecules. Distributions of intramolecular segmental end-to-end distances and their fast fluctuations can be determined, and fast and slow conformational transitions within selected sections of the molecule can be monitored and analyzed. Both ensemble and single-molecule detection methods can be applied for data collection. In combination with synchronization methods, time-resolved FRET was also used for studies of fast conformational transitions, in particular the folding/unfolding transitions.

Imaging fluorescence fluctuation spectroscopy: new tools for quantitative bioimaging

Fluorescence fluctuation spectroscopy (FFS) techniques provide information at the single-molecule level with excellent time resolution. Usually applied at a single spot in a sample, they have been recently extended into imaging formats, referred to as imaging FFS. They provide spatial information at the optical diffraction limit and temporal information in the microsecond to millisecond range. This review provides an overview of the different modalities in which imaging FFS techniques have been implemented and discusses present imaging FFS capabilities and limitations. A combination of imaging FFS and nanoscopy would allow one to record information with the detailed spatial information of nanoscopy, which is ∼20 nm and limited only by fluorophore size and labeling density, and the time resolution of imaging FFS, limited by the fluorescence lifetime. This combination would provide new insights into biological events by providing spatiotemporal resolution at unprecedented levels.

Note: multi-confocal fluorescence correlation spectroscopy in living cells using a complementary metal oxide semiconductor-single photon avalanche diode array

Living cells are heterogeneous and rapidly changing biological samples. It is thus desirable to measure molecular concentration and dynamics in many locations at the same time. In this note, we present a multi-confocal setup capable of performing simultaneous fluorescence correlation spectroscopy measurements, by focusing the spots with a spatial light modulator and acquiring data with a monolithic 32 × 32 single-photon avalanche photodiode array. A post-processing method is proposed to correct cross-talk effects between neighboring spots. We demonstrate the applicability of our system by simultaneously measuring the diffusion of free enhanced Green Fluorescent Protein (eGFP) molecules at nine different points in living cells.

New silicon technologies enable high-performance arrays of Single Photon Avalanche Diodes

In order to fulfill the requirements of many applications, we recently developed a new technology aimed at combining the advantages of traditional thin and thick silicon Single Photon Avalanche Diodes (SPAD). In particular we demonstrated single-pixel detectors with a remarkable improvement in the Photon Detection Efficiency at the longer wavelengths (e.g. 40% at 800nm) while maintaining a timing jitter better than 100ps. In this paper we will analyze the factors the currently prevent the fabrication of arrays of SPADs by adopting such a Red-Enhanced (RE) technology and we will propose further modifications to the device structure that will enable the fabrication of high performance RE-SPAD arrays for photon timing applications.

The performance of 2D array detectors for light sheet based fluorescence correlation spectroscopy

Single plane illumination microscopy based fluorescence correlation spectroscopy (SPIM-FCS) is a new method for imaging FCS in 3D samples, providing diffusion coefficients, transport, flow velocities and concentrations in an imaging mode. SPIM-FCS records correlation functions over a whole plane in a sample, which requires array detectors for recording the fluorescence signal. Several types of image sensors are suitable for FCS. They differ in properties such as effective area per pixel, quantum efficiency, noise level and read-out speed. Here we compare the performance of several low light array detectors based on three different technologies: (1) Single-photon avalanche diode (SPAD) arrays, (2) passive-pixel electron multiplying charge coupled device (EMCCD) and (3) active-pixel scientific-grade complementary metal oxide semiconductor cameras (sCMOS). We discuss the influence of the detector characteristics on the effective FCS observation volume, and demonstrate that light sheet based SPIM-FCS provides absolute diffusion coefficients. This is verified by parallel measurements with confocal FCS, single particle tracking (SPT), and the determination of concentration gradients in space and time. While EMCCD cameras have a temporal resolution in the millisecond range, sCMOS cameras and SPAD arrays can extend the time resolution of SPIM-FCS down to 10 μs or lower.

Non-Coding RNAs: Functional Aspects and Diagnostic Utility in Oncology

Noncoding RNAs (ncRNAs) have been found to have roles in a large variety of biological processes. Recent studies indicate that ncRNAs are far more abundant and important than initially imagined, holding great promise for use in diagnostic, prognostic, and therapeutic applications. Within ncRNAs, microRNAs (miRNAs) are the most widely studied and characterized. They have been implicated in initiation and progression of a variety of human malignancies, including major pathologies such as cancers, arthritis, neurodegenerative disorders, and cardiovascular diseases. Their surprising stability in serum and other bodily fluids led to their rapid ascent as a novel class of biomarkers. For example, several properties of stable miRNAs, and perhaps other classes of ncRNAs, make them good candidate biomarkers for early cancer detection and for determining which preneoplastic lesions are likely to progress to cancer. Of particular interest is the identification of biomarker signatures, which may include traditional protein-based biomarkers, to improve risk assessment, detection, and prognosis. Here, we offer a comprehensive review of the ncRNA biomarker literature and discuss state-of-the-art technologies for their detection. Furthermore, we address the challenges present in miRNA detection and quantification, and outline future perspectives for development of next-generation biodetection assays employing multicolor alternating-laser excitation (ALEX) fluorescence spectroscopy.

Single-molecule FRET experiments with a red-enhanced custom technology SPAD

Single-molecule fluorescence spectroscopy of freely diffusing molecules in solution is a powerful tool used to investigate the properties of individual molecules. Single-Photon Avalanche Diodes (SPADs) are the detectors of choice for these applications. Recently a new type of SPAD detector was introduced, dubbed red-enhanced SPAD (RE-SPAD), with good sensitivity throughout the visible spectrum and with excellent timing performance. We report a characterization of this new detector for single-molecule fluorescence resonant energy transfer (smFRET) studies on freely diffusing molecules in a confocal geometry and alternating laser excitation (ALEX) scheme. We use a series of doubly-labeled DNA molecules with donor-to-acceptor distances covering the whole range of useful FRET values. Both intensity-based (μs-ALEX) and lifetime-based (ns-ALEX) measurements are presented and compared to identical measurements performed with standard thick SPADs. Our results demonstrate the great potential of this new detector for smFRET measurements and beyond.

8-spot smFRET analysis using two 8-pixel SPAD arrays

Single-molecule Förster resonance energy transfer (smFRET) techniques are now widely used to address outstanding problems in biology and biophysics. In order to study freely diffusing molecules, current approaches consist in exciting a low concentration (<100 pM) sample with a single confocal spot using one or more lasers and detecting the induced single-molecule fluorescence in one or more spectrally- and/or polarization-distinct channels using single-pixel Single-Photon Avalanche Diodes (SPADs). A large enough number of single-molecule bursts must be accumulated in order to compute FRET efficiencies with sufficient statistics. As a result, the minimum timescale of observable phenomena is set by the minimum acquisition time needed for accurate measurements, typically a few minutes or more, limiting this approach mostly to equilibrium studies. Increasing smFRET analysis throughput would allow studying dynamics with shorter timescales. We recently demonstrated a new multi-spot excitation approach, employing a novel multi-pixel SPAD array, using a simplified dual-view setup in which a single 8-pixel SPAD array was used to collect FRET data from 4 independent spots. In this work we extend our results to 8 spots and use two 8-SPAD arrays to collect donor and acceptor photons and demonstrate the capabilities of this system by studying a series of doubly labeled dsDNA samples with different donor-acceptor distances ranging from low to high FRET efficiencies. Our results show that it is possible to enhance the throughput of smFRET measurements in solution by almost one order of magnitude, opening the way for studies of single-molecule dynamics with fast timescale once larger SPAD arrays become available.

Development of new photon-counting detectors for single-molecule fluorescence microscopy

Two optical configurations are commonly used in single-molecule fluorescence microscopy: point-like excitation and detection to study freely diffusing molecules, and wide field illumination and detection to study surface immobilized or slowly diffusing molecules. Both approaches have common features, but also differ in significant aspects. In particular, they use different detectors, which share some requirements but also have major technical differences. Currently, two types of detectors best fulfil the needs of each approach: single-photon-counting avalanche diodes (SPADs) for point-like detection, and electron-multiplying charge-coupled devices (EMCCDs) for wide field detection. However, there is room for improvements in both cases. The first configuration suffers from low throughput owing to the analysis of data from a single location. The second, on the other hand, is limited to relatively low frame rates and loses the benefit of single-photon-counting approaches. During the past few years, new developments in point-like and wide field detectors have started addressing some of these issues. Here, we describe our recent progresses towards increasing the throughput of single-molecule fluorescence spectroscopy in solution using parallel arrays of SPADs. We also discuss our development of large area photon-counting cameras achieving subnanosecond resolution for fluorescence lifetime imaging applications at the single-molecule level.

A 48-pixel array of Single Photon Avalanche Diodes for multispot Single Molecule analysis

In this paper we present an array of 48 Single Photon Avalanche Diodes (SPADs) specifically designed for multispot Single Molecule Analysis. The detectors have been arranged in a 12×4 square geometry with a pitch-to-diameter ratio of ten in order to minimize the collection of the light from non-conjugated excitation spots. In order to explore the trade-offs between the detectors' performance and the optical coupling with the experimental setup, SPADs with an active diameter of 25 and of 50µm have been manufactured. The use of a custom technology, specifically designed for the fabrication of the detectors, allowed us to combine a high photon detection efficiency (peak close to 50% at a wavelength of 550nm) with a low dark count rate compatible with true single molecule detection. In order to allow easy integration into the optical setup for parallel single-molecule analysis, the SPAD array has been incorporated in a compact module containing all the electronics needed for a proper operation of the detectors.

High-quality generation of a multispot pattern using a spatial light modulator with adaptive feedback

We propose and demonstrate high-quality generation of a uniform multispot pattern (MSP) by using a spatial light modulator with adaptive feedback. The method iteratively updates a computer generated hologram (CGH) using correction coefficients to improve the intensity distribution of the generated MSP in the optical system. Thanks to a simple method of determining the correction coefficients, the computational cost for optimizing the CGH is low, while maintaining high uniformity of the generated MSP. We demonstrate the generation of a 28×28 square-aligned MSP with high uniformity. Additionally, the proposed method could generate an MSP with a gradually varying intensity profile, as well as a uniform MSP consisting of more than 1000 spots arranged in an arbitrary pattern.

FPGA implementation of a 32x32 autocorrelator array for analysis of fast image series

With the evolving technology in CMOS integration, new classes of 2D-imaging detectors have recently become available. In particular, single photon avalanche diode (SPAD) arrays allow detection of single photons at high acquisition rates (≥ 100 kfps), which is about two orders of magnitude higher than with currently available cameras. Here we demonstrate the use of a SPAD array for imaging fluorescence correlation spectroscopy (imFCS), a tool to create 2D maps of the dynamics of fluorescent molecules inside living cells. Time-dependent fluorescence fluctuations, due to fluorophores entering and leaving the observed pixels, are evaluated by means of autocorrelation analysis. The multi-τ correlation algorithm is an appropriate choice, as it does not rely on the full data set to be held in memory. Thus, this algorithm can be efficiently implemented in custom logic. We describe a new implementation for massively parallel multi-τ correlation hardware. Our current implementation can calculate 1024 correlation functions at a resolution of 10 μs in real-time and therefore correlate real-time image streams from high speed single photon cameras with thousands of pixels.

Parallel multispot smFRET analysis using an 8-pixel SPAD array

Single-molecule Förster resonance energy transfer (smFRET) is a powerful tool for extracting distance information between two fluorophores (a donor and acceptor dye) on a nanometer scale. This method is commonly used to monitor binding interactions or intra- and intermolecular conformations in biomolecules freely diffusing through a focal volume or immobilized on a surface. The diffusing geometry has the advantage to not interfere with the molecules and to give access to fast time scales. However, separating photon bursts from individual molecules requires low sample concentrations. This results in long acquisition time (several minutes to an hour) to obtain sufficient statistics. It also prevents studying dynamic phenomena happening on time scales larger than the burst duration and smaller than the acquisition time. Parallelization of acquisition overcomes this limit by increasing the acquisition rate using the same low concentrations required for individual molecule burst identification. In this work we present a new two-color smFRET approach using multispot excitation and detection. The donor excitation pattern is composed of 4 spots arranged in a linear pattern. The fluorescent emission of donor and acceptor dyes is then collected and refocused on two separate areas of a custom 8-pixel SPAD array. We report smFRET measurements performed on various DNA samples synthesized with various distances between the donor and acceptor fluorophores. We demonstrate that our approach provides identical FRET efficiency values to a conventional single-spot acquisition approach, but with a reduced acquisition time. Our work thus opens the way to high-throughput smFRET analysis on freely diffusing molecules.

F2Cor: fast 2-stage correlation algorithm for FCS and DLS

We present a new multiple-tau correlation algorithm which is the fastest to date. The resulting curve is identical to that obtained with the conventional multiple-tau algorithm, but the calculation time is much shorter. It combines two approaches. For short values of the lag-time a very simple correlation histogram is used, while for higher lag-time values the traditional multiple-tau bin-and-multiply approach is used. The lag-time limit between these two stages depends on the count rate. The computation time scales linearly with the count rate and is as fast as 0.1 µs/photon.

Four-color alternating-laser excitation single-molecule fluorescence spectroscopy for next-generation biodetection assays

BACKGROUND

Single-molecule detection (SMD) technologies are well suited for clinical diagnostic applications by offering the prospect of minimizing precious patient sample requirements while maximizing clinical information content. Not yet available, however, is a universal SMD-based platform technology that permits multiplexed detection of both nucleic acid and protein targets and that is suitable for automation and integration into the clinical laboratory work flow.

METHODS

We have used a sensitive, specific, quantitative, and cost-effective homogeneous SMD method that has high single-well multiplexing potential and uses alternating-laser excitation (ALEX) fluorescence-aided molecule sorting extended to 4 colors (4c-ALEX). Recognition molecules are tagged with different-color fluorescence dyes, and coincident confocal detection of ≥2 colors constitutes a positive target-detection event. The virtual exclusion of the majority of sources of background noise eliminates washing steps. Sorting molecules with multidimensional probe stoichiometries (S) and single-molecule fluorescence resonance energy transfer efficiencies (E) allows differentiation of numerous targets simultaneously.

RESULTS

We show detection, differentiation, and quantification-in a single well-of (a) 25 different fluorescently labeled DNAs; (b) 8 bacterial genetic markers, including 3 antibiotic drug-resistance determinants found in 11 septicemia-causing Staphylococcus and Enterococcus strains; and (c) 6 tumor markers present in blood.

CONCLUSIONS

The results demonstrate assay utility for clinical molecular diagnostic applications by means of multiplexed detection of nucleic acids and proteins and suggest potential uses for early diagnosis of cancer and infectious and other diseases, as well as for personalized medicine. Future integration of additional technology components to minimize preanalytical sample manipulation while maximizing throughput should allow development of a user-friendly ("sample in, answer out") point-of-care platform for next-generation medical diagnostic tests that offer considerable savings in costs and patient sample.

Video-rate fluorescence lifetime imaging camera with CMOS single-photon avalanche diode arrays and high-speed imaging algorithm

A high-speed and hardware-only algorithm using a center of mass method has been proposed for single-detector fluorescence lifetime sensing applications. This algorithm is now implemented on a field programmable gate array to provide fast lifetime estimates from a 32 × 32 low dark count 0.13 μm complementary metal-oxide-semiconductor single-photon avalanche diode (SPAD) plus time-to-digital converter array. A simple look-up table is included to enhance the lifetime resolvability range and photon economics, making it comparable to the commonly used least-square method and maximum-likelihood estimation based software. To demonstrate its performance, a widefield microscope was adapted to accommodate the SPAD array and image different test samples. Fluorescence lifetime imaging microscopy on fluorescent beads in Rhodamine 6G at a frame rate of 50 fps is also shown.