Digital correction of motion artefacts in microscopy image sequences collected from living animals using rigid and nonrigid registration

Digital Image Analysis Tools Developed by the Indiana O'Brien Center

The scale and complexity of images collected in biological microscopy have grown enormously over the past 30 years. The development and commercialization of multiphoton microscopy has promoted a renaissance of intravital microscopy, providing a window into cell biology in vivo. New methods of optical sectioning and tissue clearing now enable biologists to characterize entire organs at subcellular resolution. New methods of multiplexed imaging support simultaneous localization of forty or more probes at a time. Exploiting these exciting new techniques has increasingly required biomedical researchers to master procedures of image analysis that were once the specialized province of imaging experts. A primary goal of the Indiana O'Brien Center has been to develop robust and accessible image analysis tools for biomedical researchers. Here we describe biomedical image analysis software developed by the Indiana O'Brien Center over the past 25 years.

The Indiana O'Brien Center for Advanced Renal Microscopic Analysis

The Indiana O'Brien Center for Advanced Microscopic Analysis is a National Institutes of Health (NIH) P30-funded research center dedicated to the development and dissemination of advanced methods of optical microscopy to support renal researchers throughout the world. The Indiana O'Brien Center was founded in 2002 as an NIH P-50 project with the original goal of helping researchers realize the potential of intravital multiphoton microscopy as a tool for understanding renal physiology and pathophysiology. The center has since expanded into the development and implementation of large-scale, high-content tissue cytometry. The advanced imaging capabilities of the center are made available to renal researchers worldwide via collaborations and a unique fellowship program. Center outreach is accomplished through an enrichment core that oversees a seminar series, an informational website, and a biennial workshop featuring hands-on training from members of the Indiana O'Brien Center and imaging experts from around the world.

Multiphoton intravital microscopy in small animals: motion artefact challenges and technical solutions

Since its invention 29 years ago, two‐photon laser‐scanning microscopy has evolved from a promising imaging technique, to an established widely available imaging modality used throughout the biomedical research community. The establishment of two‐photon microscopy as the preferred method for imaging fluorescently labelled cells and structures in living animals can be attributed to the biophysical mechanism by which the generation of fluorescence is accomplished. The use of powerful lasers capable of delivering infrared light pulses within femtosecond intervals, facilitates the nonlinear excitation of fluorescent molecules only at the focal plane and determines by objective lens position. This offers numerous benefits for studies of biological samples at high spatial and temporal resolutions with limited photo‐damage and superior tissue penetration. Indeed, these attributes have established two‐photon microscopy as the ideal method for live‐animal imaging in several areas of biology and have led to a whole new field of study dedicated to imaging biological phenomena in intact tissues and living organisms. However, despite its appealing features, two‐photon intravital microscopy is inherently limited by tissue motion from heartbeat, respiratory cycles, peristalsis, muscle/vascular tone and physiological functions that change tissue geometry. Because these movements impede temporal and spatial resolution, they must be properly addressed to harness the full potential of two‐photon intravital microscopy and enable accurate data analysis and interpretation. In addition, the sources and features of these motion artefacts are varied, sometimes unpredictable and unique to specific organs and multiple complex strategies have previously been devised to address them. This review will discuss these motion artefacts requirement and technical solutions for their correction and after intravital two‐photon microscopy.

Single-Virus Tracking: From Imaging Methodologies to Virological Applications

Uncovering the mechanisms of virus infection and assembly is crucial for preventing the spread of viruses and treating viral disease. The technique of single-virus tracking (SVT), also known as single-virus tracing, allows one to follow individual viruses at different parts of their life cycle and thereby provides dynamic insights into fundamental processes of viruses occurring in live cells. SVT is typically based on fluorescence imaging and reveals insights into previously unreported infection mechanisms. In this review article, we provide the readers a broad overview of the SVT technique. We first summarize recent advances in SVT, from the choice of fluorescent labels and labeling strategies to imaging implementation and analytical methodologies. We then describe representative applications in detail to elucidate how SVT serves as a valuable tool in virological research. Finally, we present our perspectives regarding the future possibilities and challenges of SVT.

Image-Based Artefact Removal in Laser Scanning Microscopy

Recent developments in laser scanning microscopy have greatly extended its applicability in cancer imaging beyond the visualization of complex biology, and opened up the possibility of quantitative analysis of inherently dynamic biological processes. However, the physics of image acquisition intrinsically means that image quality is subject to a tradeoff between a number of imaging parameters, including resolution, signal-to-noise ratio, and acquisition speed. We address the problem of geometric distortion, in particular, jaggedness artefacts that are caused by the variable motion of the microscope laser, by using a combination of image processing techniques. Image restoration methods have already shown great potential for post-acquisition image analysis. The performance of our proposed image restoration technique was first quantitatively evaluated using phantom data with different textures, and then qualitatively assessed using in vivo biological imaging data. In both cases, the presented method, comprising a combination of image registration and filtering, is demonstrated to have substantial improvement over state-of-the-art microscopy acquisition methods.

Quantitative Kinetic Models from Intravital Microscopy: A Case Study Using Hepatic Transport

The liver performs critical physiological functions, including metabolizing and removing substances, such as toxins and drugs, from the bloodstream. Hepatotoxicity itself is intimately linked to abnormal hepatic transport, and hepatotoxicity remains the primary reason drugs in development fail and approved drugs are withdrawn from the market. For this reason, we propose to analyze, across liver compartments, the transport kinetics of fluorescein-a fluorescent marker used as a proxy for drug molecules-using intravital microscopy data. To resolve the transport kinetics quantitatively from fluorescence data, we account for the effect that different liver compartments (with different chemical properties) have on fluorescein's emission rate. To do so, we develop ordinary differential equation transport models from the data where the kinetics is related to the observable fluorescence levels by "measurement parameters" that vary across different liver compartments. On account of the steep non-linearities in the kinetics and stochasticity inherent to the model, we infer kinetic and measurement parameters by generalizing the method of parameter cascades. For this application, the method of parameter cascades ensures fast and precise parameter estimates from noisy time traces.

Intravital microscopy of the lung: minimizing invasiveness

In vivo microscopy has recently become a gold standard in lung immunology studies involving small animals, largely benefiting from the democratization of multiphoton microscopy allowing for deep tissue imaging. This technology represents currently our only way of exploring the lungs and inferring what happens in human respiratory medicine. The interest of lung in vivo microscopy essentially relies upon its relevance as a study model, fulfilling physiological requirements in comparison with in vitro and ex vivo experiments. However, strategies developed in order to overcome movements of the thorax caused by breathing and heartbeats remain the chief drawback of the technique and a major source of invasiveness. In this context, minimizing invasiveness is an unavoidable prerequisite for any improvement of lung in vivo microscopy. This review puts into perspective the main techniques enabling lung in vivo microscopy, providing pros and cons regarding invasiveness.

IMART software for correction of motion artifacts in images collected in intravital microscopy

Intravital microscopy is a uniquely powerful tool, providing the ability to characterize cell and organ physiology in the natural context of the intact, living animal. With the recent development of high-resolution microscopy techniques such as confocal and multiphoton microscopy, intravital microscopy can now characterize structures at subcellular resolution and capture events at sub-second temporal resolution. However, realizing the potential for high resolution requires remarkable stability in the tissue. Whereas the rigid structure of the skull facilitates high-resolution imaging of the brain, organs of the viscera are free to move with respiration and heartbeat, requiring additional apparatus for immobilization. In our experience, these methods are variably effective, so that many studies are compromised by residual motion artifacts. Here we demonstrate the use of IMART, a software tool for removing motion artifacts from intravital microscopy images collected in time series or in three dimensions.

Long-term time-lapse multimodal intravital imaging of regeneration and bone-marrow-derived cell dynamics in skin

A major challenge for translating cell-based therapies is understanding the dynamics of cells and cell populations in complex in vivo environments. Intravital microscopy has shown great promise for directly visualizing cell behavior in vivo. However, current methods are limited to relatively short imaging times (hours), by ways to track cell and cell population dynamics over extended time-lapse periods (days to weeks to months), and by relatively few imaging contrast mechanisms that persist over extended investigations. We present technology to visualize and quantify complex, multifaceted dynamic changes in natural deformable skin over long time periods using novel multimodal imaging and a non-rigid image registration method. These are demonstrated in green fluorescent protein (GFP) bone marrow (BM) transplanted mice to study dynamic skin regeneration. This technology provides a novel perspective for studying dynamic biological processes and will enable future studies of stem, immune, and tumor cell biology in vivo.

A motion correction framework for time series sequences in microscopy images

With the advent of in vivo laser scanning fluorescence microscopy techniques, time-series and three-dimensional volumes of living tissue and vessels at micron scales can be acquired to firmly analyze vessel architecture and blood flow. Analysis of a large number of image stacks to extract architecture and track blood flow manually is cumbersome and prone to observer bias. Thus, an automated framework to accomplish these analytical tasks is imperative. The first initiative toward such a framework is to compensate for motion artifacts manifest in these microscopy images. Motion artifacts in in vivo microscopy images are caused by respiratory motion, heart beats, and other motions from the specimen. Consequently, the amount of motion present in these images can be large and hinders further analysis of these images. In this article, an algorithmic framework for the correction of time-series images is presented. The automated algorithm is comprised of a rigid and a nonrigid registration step based on shape contexts. The framework performs considerably well on time-series image sequences of the islets of Langerhans and provides for the pivotal step of motion correction in the further automatic analysis of microscopy images.

Intravital microscopy: a practical guide on imaging intracellular structures in live animals

Intravital microscopy is an extremely powerful tool that enables imaging several biological processes in live animals. Recently, the ability to image subcellular structures in several organs combined with the development of sophisticated genetic tools has made possible extending this approach to investigate several aspects of cell biology. Here we provide a general overview of intravital microscopy with the goal of highlighting its potential and challenges. Specifically, this review is geared toward researchers that are new to intravital microscopy and focuses on practical aspects of carrying out imaging in live animals. Here we share the know-how that comes from first-hand experience, including topics such as choosing the right imaging platform and modality, surgery and stabilization techniques, anesthesia and temperature control. Moreover, we highlight some of the approaches that facilitate subcellular imaging in live animals by providing numerous examples of imaging selected organelles and the actin cytoskeleton in multiple organs.