Data-driven microscopy allows for automated context-specific acquisition of high-fidelity image data

Live Cell Painting: image-based profiling in live cells using Acridine Orange

Image-based profiling has been used to analyze cell health, drug mechanism of action, CRISPR-edited cells, and overall cytotoxicity. Cell Painting is a broadly used image-based assay that uses morphological features to capture how cells respond to treatments. However, this method requires cell fixation for staining, which prevents examining live cells. To address this limitation, here we present Live Cell Painting (LCP), a high-content method based on Acridine orange, a metachromatic dye that labels different organelles and cellular structures. We began by showing that LCP can be applied to follow acidic vesicle redistribution of cells exposed to acidic vesicles inhibitors. Next, we show that LCP can identify subtle changes in cells exposed to silver nanoparticles that are not detected by techniques such as MTT assay. In drug treatments, LCP was helpful in assessing the dose-response relationship and creating profiles that allow clustering of drugs that cause liver injury. Here, we present an affordable and easy-to-use image-based assay capable of assessing overall cell health and showing promise for use in various applications such as assessing drugs and nanoparticles. We envisage the use of Live Cell Painting as an initial screening of overall cell health while providing insights into new biological questions.

The rise of data-driven microscopy powered by machine learning

Optical microscopy is an indispensable tool in life sciences research, but conventional techniques require compromises between imaging parameters like speed, resolution, field of view and phototoxicity. To overcome these limitations, data-driven microscopes incorporate feedback loops between data acquisition and analysis. This review overviews how machine learning enables automated image analysis to optimise microscopy in real time. We first introduce key data-driven microscopy concepts and machine learning methods relevant to microscopy image analysis. Subsequently, we highlight pioneering works and recent advances in integrating machine learning into microscopy acquisition workflows, including optimising illumination, switching modalities and acquisition rates, and triggering targeted experiments. We then discuss the remaining challenges and future outlook. Overall, intelligent microscopes that can sense, analyse and adapt promise to transform optical imaging by opening new experimental possibilities.

Novel tools to study cell-ECM interactions, cell adhesion dynamics and migration

Integrin-mediated cell adhesion is essential for cell migration, mechanotransduction and tissue integrity. In vivo, these processes are regulated by complex physicochemical signals from the extracellular matrix (ECM). These nuanced cues, including molecular composition, rigidity and topology, call for sophisticated systems to faithfully explore cell behaviour. Here, we discuss recent methodological advances in cell-ECM adhesion research and compile a toolbox of techniques that we expect to shape this field in future. We outline methodological breakthroughs facilitating the transition from rigid 2D substrates to more complex and dynamic 3D systems, as well as advances in super-resolution imaging for an in-depth understanding of adhesion nanostructure. Selected methods are exemplified with relevant biological findings to underscore their applicability in cell adhesion research. We expect this new "toolbox" of methods will allow for a closer approximation of in vitro experimental setups to in vivo conditions, providing deeper insights into physiological and pathophysiological processes associated with cell-ECM adhesion.

Photophysical image analysis: Unsupervised probabilistic thresholding for images from electron-multiplying charge-coupled devices

We introduce the concept photophysical image analysis (PIA) and an associated pipeline for unsupervised probabilistic image thresholding for images recorded by electron-multiplying charge-coupled device (EMCCD) cameras. We base our approach on a closed-form analytic expression for the characteristic function (Fourier-transform of the probability mass function) for the image counts recorded in an EMCCD camera, which takes into account both stochasticity in the arrival of photons at the imaging camera and subsequent noise induced by the detection system of the camera. The only assumption in our method is that the background photon arrival to the imaging system is described by a stationary Poisson process (we make no assumption about the photon statistics for the signal). We estimate the background photon statistics parameter, λbg, from an image which contains both background and signal pixels by use of a novel truncated fit procedure with an automatically determined image count threshold. Prior to this, the camera noise model parameters are estimated using a calibration step. Utilizing the estimates for the camera parameters and λbg, we then introduce a probabilistic thresholding method, where, for the first time, the fraction of misclassified pixels can be determined a priori for a general image in an unsupervised way. We use synthetic images to validate our a priori estimates and to benchmark against the Otsu method, which is a popular unsupervised non-probabilistic image thresholding method (no a priori estimates for the error rates are provided). For completeness, we lastly present a simple heuristic general-purpose segmentation method based on the thresholding results, which we apply to segmentation of synthetic images and experimental images of fluorescent beads and lung cell nuclei. Our publicly available software opens up for fully automated, unsupervised, probabilistic photophysical image analysis.

Harnessing artificial intelligence to reduce phototoxicity in live imaging

Fluorescence microscopy is essential for studying living cells, tissues and organisms. However, the fluorescent light that switches on fluorescent molecules also harms the samples, jeopardizing the validity of results - particularly in techniques such as super-resolution microscopy, which demands extended illumination. Artificial intelligence (AI)-enabled software capable of denoising, image restoration, temporal interpolation or cross-modal style transfer has great potential to rescue live imaging data and limit photodamage. Yet we believe the focus should be on maintaining light-induced damage at levels that preserve natural cell behaviour. In this Opinion piece, we argue that a shift in role for AIs is needed - AI should be used to extract rich insights from gentle imaging rather than recover compromised data from harsh illumination. Although AI can enhance imaging, our ultimate goal should be to uncover biological truths, not just retrieve data. It is essential to prioritize minimizing photodamage over merely pushing technical limits. Our approach is aimed towards gentle acquisition and observation of undisturbed living systems, aligning with the essence of live-cell fluorescence microscopy.

Smart lattice light-sheet microscopy for imaging rare and complex cellular events

Light-sheet microscopes enable rapid high-resolution imaging of biological specimens; however, biological processes span spatiotemporal scales. Moreover, long-term phenotypes are often instigated by rare or fleeting biological events that are difficult to capture with a single imaging modality. Here, to overcome this limitation, we present smartLLSM, a microscope that incorporates artificial intelligence-based instrument control to autonomously switch between epifluorescent inverted imaging and lattice light-sheet microscopy (LLSM). We apply this approach to two unique processes: cell division and immune synapse formation. In each context, smartLLSM provides population-level statistics across thousands of cells and autonomously captures multicolor three-dimensional datasets or four-dimensional time-lapse movies of rare events at rates that dramatically exceed human capabilities. From this, we quantify the effects of Taxol dose on spindle structure and kinetochore dynamics in dividing cells and of antigen strength on cytotoxic T lymphocyte engagement and lytic granule polarization at the immune synapse. Overall, smartLLSM efficiently detects rare events within heterogeneous cell populations and records these processes with high spatiotemporal four-dimensional imaging over statistically significant replicates.

Imagining the future of optical microscopy: everything, everywhere, all at once

The optical microscope has revolutionized biology since at least the 17th Century. Since then, it has progressed from a largely observational tool to a powerful bioanalytical platform. However, realizing its full potential to study live specimens is hindered by a daunting array of technical challenges. Here, we delve into the current state of live imaging to explore the barriers that must be overcome and the possibilities that lie ahead. We venture to envision a future where we can visualize and study everything, everywhere, all at once - from the intricate inner workings of a single cell to the dynamic interplay across entire organisms, and a world where scientists could access the necessary microscopy technologies anywhere.