Automatic registration of mass spectrometry imaging data sets to the Allen brain atlas

A multimodal pipeline for image correction and registration of mass spectrometry imaging with microscopy

The integration of matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI MSI) and histology plays a pivotal role in advancing our understanding of complex heterogeneous tissues, which provides a comprehensive description of biological tissue with both wide molecule coverage and high lateral resolution. Herein, we proposed a novel strategy for the correction and registration of MALDI MSI data with hematoxylin & eosin (H&E) staining images. To overcome the challenges of discrepancies in spatial resolution towards the unification of the two imaging modalities, a deep learning-based interpolation algorithm for MALDI MSI data was constructed, which enables spatial coherence and the following orientation matching between images. Coupled with the affine transformation (AT) and the subsequent moving least squares algorithm, the two types of images from one rat brain tissue section were aligned automatically with high accuracy. Moreover, we demonstrated the practicality of the developed pipeline by projecting it to a rat cerebral ischemia-reperfusion injury model, which would help decipher the link between molecular metabolism and pathological interpretation towards microregion. This new approach offers the chance for other types of bioimaging to boost the field of multimodal image fusion.

Unlocking the Hidden Depths: Multi-Modal Integration of Imaging Mass Spectrometry-Based and Molecular Imaging Techniques

Multimodal imaging (MMI) has emerged as a powerful tool in clinical research, combining different imaging modes to acquire comprehensive information and enabling scientists and surgeons to study tissue identification, localization, metabolic activity, and molecular discovery, thus aiding in disease progression analysis. While multimodal instruments are gaining popularity, challenges such as non-standardized characteristics, custom software, inadequate commercial support, and integration issues with other instruments need to be addressed. The field of multimodal imaging or multiplexed imaging allows for simultaneous signal reproduction from multiple imaging strategies. Intraoperatively, MMI can be integrated into frameless stereotactic surgery. Recent developments in medical imaging modalities such as magnetic resonance imaging (MRI), and Positron Emission Topography (PET) have brought new perspectives to multimodal imaging, enabling early cancer detection, molecular tracking, and real-time progression monitoring. Despite the evidence supporting the role of MMI in surgical decision-making, there is a need for comprehensive studies to validate and perform integration at the intersection of multiple imaging technologies. They were integrating mass spectrometry-based technologies (e.g., imaging mass spectrometry (IMS), imaging mass cytometry (IMC), and Ion mobility mass spectrometry ((IM-IM) with medical imaging modalities, offering promising avenues for molecular discovery and clinical applications. This review emphasizes the potential of multi-omics approaches in tissue mapping using MMI integrated into desorption electrospray ionization (DESI) and matrix-assisted laser desorption ionization (MALDI), allowing for sequential analyses of the same section. By addressing existing knowledge gaps, this review encourages future research endeavors toward multi-omics approaches, providing a roadmap for future research and enhancing the value of MMI in molecular pathology for diagnosis.

Localization and Registration of 2D Histological Mouse Brain Images in 3D Atlas Space

To accurately explore the anatomical organization of neural circuits in the brain, it is crucial to map the experimental brain data onto a standardized system of coordinates. Studying 2D histological mouse brain slices remains the standard procedure in many laboratories. Mapping these 2D brain slices is challenging; due to deformations, artifacts, and tilted angles introduced during the standard preparation and slicing process. In addition, analysis of experimental mouse brain slices can be highly dependent on the level of expertise of the human operator. Here we propose a computational tool for Accurate Mouse Brain Image Analysis (AMBIA), to map 2D mouse brain slices on the 3D brain model with minimal human intervention. AMBIA has a modular design that comprises a localization module and a registration module. The localization module is a deep learning-based pipeline that localizes a single 2D slice in the 3D Allen Brain Atlas and generates a corresponding atlas plane. The registration module is built upon the Ardent python package that performs deformable 2D registration between the brain slice to its corresponding atlas. By comparing AMBIA's performance in localization and registration to human ratings, we demonstrate that it performs at a human expert level. AMBIA provides an intuitive and highly efficient way for accurate registration of experimental 2D mouse brain images to 3D digital mouse brain atlas. Our tool provides a graphical user interface and it is designed to be used by researchers with minimal programming knowledge.

Emerging Computational Methods in Mass Spectrometry Imaging

Mass spectrometry imaging (MSI) is a powerful analytical technique that generates maps of hundreds of molecules in biological samples with high sensitivity and molecular specificity. Advanced MSI platforms with capability of high-spatial resolution and high-throughput acquisition generate vast amount of data, which necessitates the development of computational tools for MSI data analysis. In addition, computation-driven MSI experiments have recently emerged as enabling technologies for further improving the MSI capabilities with little or no hardware modification. This review provides a critical summary of computational methods and resources developed for MSI data analysis and interpretation along with computational approaches for improving throughput and molecular coverage in MSI experiments. This review is focused on the recently developed artificial intelligence methods and provides an outlook for a future paradigm shift in MSI with transformative computational methods.

BoutonNet: an automatic method to detect anterogradely labeled presynaptic boutons in brain tissue sections

Neurons emit axons, which form synapses, the fundamental unit of the nervous system. Neuroscientists use genetic anterograde tracing methods to label the synaptic output of specific neuronal subpopulations, but the resulting data sets are too large for manual analysis, and current automated methods have significant limitations in cost and quality. In this paper, we describe a pipeline optimized to identify anterogradely labeled presynaptic boutons in brain tissue sections. Our histologic pipeline labels boutons with high sensitivity and low background. To automatically detect labeled boutons in slide-scanned tissue sections, we developed BoutonNet. This detector uses a two-step approach: an intensity-based method proposes possible boutons, which are checked by a neural network-based confirmation step. BoutonNet was compared to expert annotation on a separate validation data set and achieved a result within human inter-rater variance. This open-source technique will allow quantitative analysis of the fundamental unit of the brain on a whole-brain scale.

Cell and Tissue Imaging by TOF-SIMS and MALDI-TOF: An Overview for Biological and Pharmaceutical Analysis

The potential of mass spectrometry imaging (MSI) has been demonstrated in cell and tissue research since 1970. MSI can reveal the spatial distribution of a wide range of atomic and molecular ions detected from biological sample surfaces, it is a powerful and valuable technique used to monitor and detect diverse chemical and biological compounds, such as drugs, lipids, proteins, and DNA. MSI techniques, notably matrix-assisted laser desorption/ionization time of flight (MALDI-TOF) and time of flight secondary ion mass spectrometry (TOF-SIMS), witnessed a dramatic upsurge in studying and investigating biological samples especially, cells and tissue sections. This advancement is attributed to the submicron lateral resolution, the high sensitivity, the good precision, and the accurate chemical specificity, which make these techniques suitable for decoding and understanding complex mechanisms of certain diseases, as well as monitoring the spatial distribution of specific elements, and compounds. While the application of both techniques for the analysis of cells and tissues is thoroughly discussed, a briefing of MALDI-TOF and TOF-SIMS basis and the adequate sampling before analysis are briefly covered. The importance of MALDI-TOF and TOF-SIMS as diagnostic tools and robust analytical techniques in the medicinal, pharmaceutical, and toxicology fields is highlighted through representative published studies.

An overview of image registration for aligning mass spectrometry imaging with clinically relevant imaging modalities

•

Mass spectrometry imaging (MSI) is a powerful molecular imaging technique.

•

Integration with other imaging modalities is essential in clinical MSI.

•

Image integration is performed by image registration techniques.

•

Technical potential of image registration in MSI has not been fully exploited.

•

Roadmap proposed to improve registration accuracy.

Mass spectrometry imaging (MSI) is used in many aspects of clinical research, including pharmacokinetics, toxicology, personalised medicine, and surgical decision-making. Maximising its potential requires the spatial integration of MSI images with imaging data from existing clinical imaging modalities, such as histology and MRI. To ensure that the information is properly integrated, all contributing images must be accurately aligned. This process is called image registration and is the focus of this review. In light of the ever-increasing spatial resolution of MSI instrumentation and a diversification of multi-modal MSI studies (e.g., spatial omics, 3D-MSI), the accuracy, versatility, and precision of image registration must increase accordingly. We review the application of image registration to align MSI data with different clinically relevant ex vivo and in vivo imaging techniques. Based on this, we identify steps in the current image registration processes where there is potential for improvement. Finally, we propose a roadmap for community efforts to address these challenges in order to increase registration quality and help MSI to fully exploit its multi-modal potential.

Automatic Registration of the Mass Spectrometry Imaging Data of Sagittal Brain Slices to the Reference Atlas

The registration of the mass spectrometry imaging (MSI) data with mouse brain tissue slices from the atlases could perform automatic anatomical interpretation, and the comparison of MSI data in particular brain regions from different mice could be accelerated. However, the current registration of MSI data with mouse brain tissue slices is mainly focused on the coronal. Although the sagittal plane is able to provide more information about brain regions on a single histological slice than the coronal, it is difficult to directly register the complete sagittal brain slices of a mouse as a result of the more significant individualized differences and more positional shifts of brain regions. Herein, by adding the auxiliary line on the two brain regions of central canal (CC) and cerebral peduncle (CP), the registration accuracy of the MSI data with sagittal brain slices has been improved (∼2-5-folds for different brain regions). Moreover, the histological sections with different degrees deformation and different dyeing effects have been used to verify that this pipeline has a certain universality. Our method facilitates the rapid comparison of sagittal plane MSI data from different animals and accelerates the application in the discovery of disease markers.

Experimental and Data Analysis Considerations for Three-Dimensional Mass Spectrometry Imaging in Biomedical Research

Mass spectrometry imaging (MSI) enables the visualization of molecular distributions on complex surfaces. It has been extensively used in the field of biomedical research to investigate healthy and diseased tissues. Most of the MSI studies are conducted in a 2D fashion where only a single slice of the full sample volume is investigated. However, biological processes occur within a tissue volume and would ideally be investigated as a whole to gain a more comprehensive understanding of the spatial and molecular complexity of biological samples such as tissues and cells. Mass spectrometry imaging has therefore been expanded to the 3D realm whereby molecular distributions within a 3D sample can be visualized. The benefit of investigating volumetric data has led to a quick rise in the application of single-sample 3D-MSI investigations. Several experimental and data analysis aspects need to be considered to perform successful 3D-MSI studies. In this review, we discuss these aspects as well as ongoing developments that enable 3D-MSI to be routinely applied to multi-sample studies.

Spatially aware clustering of ion images in mass spectrometry imaging data using deep learning

Computational analysis is crucial to capitalize on the wealth of spatio-molecular information generated by mass spectrometry imaging (MSI) experiments. Currently, the spatial information available in MSI data is often under-utilized, due to the challenges of in-depth spatial pattern extraction. The advent of deep learning has greatly facilitated such complex spatial analysis. In this work, we use a pre-trained neural network to extract high-level features from ion images in MSI data, and test whether this improves downstream data analysis. The resulting neural network interpretation of ion images, coined neural ion images, is used to cluster ion images based on spatial expressions. We evaluate the impact of neural ion images on two ion image clustering pipelines, namely DBSCAN clustering, combined with UMAP-based dimensionality reduction, and k-means clustering. In both pipelines, we compare regular and neural ion images from two different MSI datasets. All tested pipelines could extract underlying spatial patterns, but the neural network-based pipelines provided better assignment of ion images, with more fine-grained clusters, and greater consistency in the spatial structures assigned to individual clusters. Additionally, we introduce the relative isotope ratio metric to quantitatively evaluate clustering quality. The resulting scores show that isotopical m/z values are more often clustered together in the neural network-based pipeline, indicating improved clustering outcomes. The usefulness of neural ion images extends beyond clustering towards a generic framework to incorporate spatial information into any MSI-focused machine learning pipeline, both supervised and unsupervised.

Deep Learning-Based Annotation Transfer between Molecular Imaging Modalities: An Automated Workflow for Multimodal Data Integration

An ever-increasing array of imaging technologies are being used in the study of complex biological samples, each of which provides complementary, occasionally overlapping information at different length scales and spatial resolutions. It is important to understand the information provided by one technique in the context of the other to achieve a more holistic overview of such complex samples. One way to achieve this is to use annotations from one modality to investigate additional modalities. For microscopy-based techniques, these annotations could be manually generated using digital pathology software or automatically generated by machine learning (including deep learning) methods. Here, we present a generic method for using annotations from one microscopy modality to extract information from complementary modalities. We also present a fast, general, multimodal registration workflow [evaluated on multiple mass spectrometry imaging (MSI) modalities, matrix-assisted laser desorption/ionization, desorption electrospray ionization, and rapid evaporative ionization mass spectrometry] for automatic alignment of complex data sets, demonstrating an order of magnitude speed-up compared to previously published work. To demonstrate the power of the annotation transfer and multimodal registration workflows, we combine MSI, histological staining (such as hematoxylin and eosin), and deep learning (automatic annotation of histology images) to investigate a pancreatic cancer mouse model. Neoplastic pancreatic tissue regions, which were histologically indistinguishable from one another, were observed to be metabolically different. We demonstrate the use of the proposed methods to better understand tumor heterogeneity and the tumor microenvironment by transferring machine learning results freely between the two modalities.

Morphometric Cell Classification for Single-Cell MALDI-Mass Spectrometry Imaging

The large-scale and label-free molecular characterization of single cells in their natural tissue habitat remains a major challenge in molecular biology. We present a method that integrates morphometric image analysis to delineate and classify individual cells with their single-cell-specific molecular profiles. This approach provides a new means to study spatial biological processes such as cancer field effects and the relationship between morphometric and molecular features.

Cellular resolution in clinical MALDI mass spectrometry imaging: the latest advancements and current challenges

Mass spectrometry (MS) is the workhorse of metabolomics, proteomics and lipidomics. Mass spectrometry imaging (MSI), its extension to spatially resolved analysis of tissues, is a powerful tool for visualizing molecular information within the histological context of tissue. This review summarizes recent developments in MSI and highlights current challenges that remain to achieve molecular imaging at the cellular level of clinical specimens. We focus on matrix-assisted laser desorption/ionization (MALDI)-MSI. We discuss the current status of each of the analysis steps and remaining challenges to reach the desired level of cellular imaging. Currently, analyte delocalization and degradation, matrix crystal size, laser focus restrictions and detector sensitivity are factors that are limiting spatial resolution. New sample preparation devices and laser optic systems are being developed to push the boundaries of these limitations. Furthermore, we review the processing of cellular MSI data and images, and the systematic integration of these data in the light of available algorithms and databases. We discuss roadblocks in the data analysis pipeline and show how technology from other fields can be used to overcome these. Finally, we conclude with curative and community efforts that are needed to enable contextualization of the information obtained.

Unsupervised machine learning for exploratory data analysis in imaging mass spectrometry

Imaging mass spectrometry (IMS) is a rapidly advancing molecular imaging modality that can map the spatial distribution of molecules with high chemical specificity. IMS does not require prior tagging of molecular targets and is able to measure a large number of ions concurrently in a single experiment. While this makes it particularly suited for exploratory analysis, the large amount and high-dimensional nature of data generated by IMS techniques make automated computational analysis indispensable. Research into computational methods for IMS data has touched upon different aspects, including spectral preprocessing, data formats, dimensionality reduction, spatial registration, sample classification, differential analysis between IMS experiments, and data-driven fusion methods to extract patterns corroborated by both IMS and other imaging modalities. In this work, we review unsupervised machine learning methods for exploratory analysis of IMS data, with particular focus on (a) factorization, (b) clustering, and (c) manifold learning. To provide a view across the various IMS modalities, we have attempted to include examples from a range of approaches including matrix assisted laser desorption/ionization, desorption electrospray ionization, and secondary ion mass spectrometry-based IMS. This review aims to be an entry point for both (i) analytical chemists and mass spectrometry experts who want to explore computational techniques; and (ii) computer scientists and data mining specialists who want to enter the IMS field. © 2019 The Authors. Mass Spectrometry Reviews published by Wiley Periodicals, Inc. Mass SpecRev 00:1-47, 2019.

Structure-Based Intensity Propagation for 3-D Brain Reconstruction With Multilayer Section Microscopy

Microscopy is widely used for brain research because of its high resolution and ability to stain for many different biomarkers. Since whole brains are usually sectioned for tissue staining and imaging, reconstruction of 3D brain volumes from these sections is important for visualization and analysis. Recently developed tissue clearing techniques and advanced confocal microscopy enable multilayer sections to be imaged without compromising the resolution. However, noticeable structure inconsistence occurs if surface layers are used to align these sections. In this paper, a structure-based intensity propagation method is designed for the robust representation of multilayer sections. The 3D structures in reconstructed brains are more consistent using the proposed methods. Experiments are conducted on 367 multilayer sections from 20 mouse brains. The average reconstruction quality measured by the structure consistence index increases by 45% with the tissue flattening method and 29% further with the structure-based intensity propagation.

Automatic 3D Nonlinear Registration of Mass Spectrometry Imaging and Magnetic Resonance Imaging Data

Multimodal integration between mass spectrometry imaging (MSI) and radiology-established modalities such as magnetic resonance imaging (MRI) would allow the investigations of key questions in complex biological systems such as the central nervous system. Such integration would provide complementary multiscale data to bridge the gap between molecular and anatomical phenotypes, potentially revealing new insights into molecular mechanisms underlying anatomical pathologies presented on MRI. Automatic coregistration between 3D MSI/MRI is a computationally challenging process due to dimensional complexity, MSI data sparsity, lack of direct spatial-correspondences, and nonlinear tissue deformation. Here, we present a new computational approach based on stochastic neighbor embedding to nonlinearly align 3D MSI to MRI data, identify and reconstruct biologically relevant molecular patterns in 3D, and fuse the MSI datacube to the MRI space. We demonstrate our method using multimodal high-spectral resolution matrix-assisted laser desorption ionization (MALDI) 9.4 T MSI and 7 T in vivo MRI data, acquired from a patient-derived, xenograft mouse brain model of glioblastoma following administration of the EGFR inhibitor drug of Erlotinib. Results show the distribution of some identified molecular ions of the EGFR inhibitor erlotinib, a phosphatidylcholine lipid, and cholesterol, which were reconstructed in 3D and mapped to the MRI space. The registration quality was evaluated on two normal mouse brains using the Dice coefficient for the regions of brainstem, hippocampus, and cortex. The method is generic and can therefore be applied to hyperspectral images from different mass spectrometers and integrated with other established in vivo imaging modalities such as computed tomography (CT) and positron emission tomography (PET).

Visualized analysis of within-tissue spatial distribution of specialized metabolites in tea (Camellia sinensis) using desorption electrospray ionization imaging mass spectrometry

Although specialized metabolite distributions in different tea (Camellia sinensis) tissues has been studied extensively, little is known about their within-tissue distribution owing to the lack of nondestructive methodology. In this study, desorption electrospray ionization imaging mass spectrometry was used to investigate the within-tissue spatial distributions of specialized metabolites in tea. To overcome the negative effects of the large amount of wax on tea leaves, several sample preparation methods were compared, with a Teflon-imprint method established for tea leaves. Polyphenols are characteristic metabolites in tea leaves. Epicatechin gallate/catechin gallate, epigallocatechin gallate/gallocatechin gallate, and gallic acid were evenly distributed on both sides of the leaves, while epicatechin/catechin, epigallocatechin/gallocatechin, and assamicain A were distributed near the leaf vein. L-Theanine was mainly accumulated in tea roots. L-Theanine and valinol were distributed around the outer root cross-section. The results will advance our understanding of the precise localizations and in-vivo biosyntheses of specialized metabolites in tea.

Mass Spectrometry Imaging and Integration with Other Imaging Modalities for Greater Molecular Understanding of Biological Tissues

Over the last two decades, mass spectrometry imaging (MSI) has been increasingly employed to investigate the spatial distribution of a wide variety of molecules in complex biological samples. MSI has demonstrated its potential in numerous applications from drug discovery, disease state evaluation through proteomic and/or metabolomic studies. Significant technological and methodological advancements have addressed natural limitations of the techniques, i.e., increased spatial resolution, increased detection sensitivity especially for large molecules, higher throughput analysis and data management. One of the next major evolutions of MSI is linked to the introduction of imaging mass cytometry (IMC). IMC is a multiplexed method for tissue phenotyping, imaging signalling pathway or cell marker assessment, at sub-cellular resolution (1 μm). It uses MSI to simultaneously detect and quantify up to 30 different antibodies within a tissue section. The combination of MSI with other molecular imaging techniques can also provide highly relevant complementary information to explore new scientific fields. Traditionally, classical histology (especially haematoxylin and eosin–stained sections) is overlaid with molecular profiles obtained by MSI. Thus, MSI-based molecular histology provides a snapshot of a tissue microenvironment and enables the correlation of drugs, metabolites, lipids, peptides or proteins with histological/pathological features or tissue substructures. Recently, many examples combining MSI with other imaging modalities such as fluorescence, confocal Raman spectroscopy and MRI have emerged. For instance, brain pathophysiology has been studied using both MRI and MSI, establishing correlations between in and ex vivo molecular imaging techniques. Endogenous metabolite and small peptide modulation were evaluated depending on disease state. Here, we review advanced ‘hot topics’ in MSI development and explore the combination of MSI with established molecular imaging techniques to improve our understanding of biological and pathophysiological processes.

Mapping Histological Slice Sequences to the Allen Mouse Brain Atlas Without 3D Reconstruction

Histological brain slices are widely used in neuroscience to study the anatomical organization of neural circuits. Systematic and accurate comparisons of anatomical data from multiple brains, especially from different studies, can benefit tremendously from registering histological slices onto a common reference atlas. Most existing methods rely on an initial reconstruction of the volume before registering it to a reference atlas. Because these slices are prone to distortions during the sectioning process and often sectioned with non-standard angles, reconstruction is challenging and often inaccurate. Here we describe a framework that maps each slice to its corresponding plane in the Allen Mouse Brain Atlas (2015) to build a plane-wise mapping and then perform 2D nonrigid registration to build a pixel-wise mapping. We use the L2 norm of the histogram of oriented gradients difference of two patches as the similarity metric for both steps and a Markov random field formulation that incorporates tissue coherency to compute the nonrigid registration. To fix significantly distorted regions that are misshaped or much smaller than the control grids, we train a context-aggregation network to segment and warp them to their corresponding regions with thin plate spline. We have shown that our method generates results comparable to an expert neuroscientist and is significantly better than reconstruction-first approaches. Code and sample dataset are available at sites.google.com/view/brain-mapping.

Advanced Registration and Analysis of MALDI Imaging Mass Spectrometry Measurements through Autofluorescence Microscopy

The correlation of imaging mass spectrometry (IMS) with histopathology can help relate novel molecular findings obtained through IMS to the well-characterized and validated histopathology knowledge base. The quality of correlation between these two modalities is limited by the quality of the spatial mapping that is obtained by registration of the two image types. In this work, we develop novel workflows for MALDI IMS-to-microscopy data registration and analysis using nondestructive IMS-compatible wide field autofluorescence (AF) microscopy combined with computational image registration. First, a substantially automated procedure for high-accuracy registration between IMS and microscopy data of the same section is described that explicitly links the MALDI laser ablation pattern imaged by microscopy to its corresponding IMS pixel. Subsequent examination of the registered data allows for high-confidence colocalization of image features between the two modalities, down to single-cell scales within tissue. Building on this IMS-microscopy spatial mapping, we furthermore demonstrate the automated spatial correlation between IMS measurements from serial sections. This AF-registration-driven inter-section analysis, using a combination of nonlinear AF-to-AF and IMS-to-AF image registrations, can be applied to tissue sections that are prepared and imaged with different sample preparations (e.g., lipids vs proteins) and/or that are measured using different spatial resolutions. Importantly, all registrations, whether within a single section or across serial sections, are entirely independent of the IMS intensity signal content and thus unbiased by it.

Integrated Brain Atlas for Unbiased Mapping of Nervous System Effects Following Liraglutide Treatment

Light Sheet Fluorescence Microscopy (LSFM) of whole organs, in particular the brain, offers a plethora of biological data imaged in 3D. This technique is however often hindered by cumbersome non-automated analysis methods. Here we describe an approach to fully automate the analysis by integrating with data from the Allen Institute of Brain Science (AIBS), to provide precise assessment of the distribution and action of peptide-based pharmaceuticals in the brain. To illustrate this approach, we examined the acute central nervous system effects of the glucagon-like peptide-1 (GLP-1) receptor agonist liraglutide. Peripherally administered liraglutide accessed the hypothalamus and brainstem, and led to activation in several brain regions of which most were intersected by projections from neurons in the lateral parabrachial nucleus. Collectively, we provide a rapid and unbiased analytical framework for LSFM data which enables quantification and exploration based on data from AIBS to support basic and translational discovery.

Fourier Transform Infrared Microscopy Enables Guidance of Automated Mass Spectrometry Imaging to Predefined Tissue Morphologies

Multimodal imaging combines complementary platforms for spatially resolved tissue analysis that are poised for application in life science and personalized medicine. Unlike established clinical in vivo multimodality imaging, automated workflows for in-depth multimodal molecular ex vivo tissue analysis that combine the speed and ease of spectroscopic imaging with molecular details provided by mass spectrometry imaging (MSI) are lagging behind. Here, we present an integrated approach that utilizes non-destructive Fourier transform infrared (FTIR) microscopy and matrix assisted laser desorption/ionization (MALDI) MSI for analysing single-slide tissue specimen. We show that FTIR microscopy can automatically guide high-resolution MSI data acquisition and interpretation without requiring prior histopathological tissue annotation, thus circumventing potential human-annotation-bias while achieving >90% reductions of data load and acquisition time. We apply FTIR imaging as an upstream modality to improve accuracy of tissue-morphology detection and to retrieve diagnostic molecular signatures in an automated, unbiased and spatially aware manner. We show the general applicability of multimodal FTIR-guided MALDI-MSI by demonstrating precise tumor localization in mouse brain bearing glioma xenografts and in human primary gastrointestinal stromal tumors. Finally, the presented multimodal tissue analysis method allows for morphology-sensitive lipid signature retrieval from brains of mice suffering from lipidosis caused by Niemann-Pick type C disease.

Postmortem MRI and histology demonstrate differential iron accumulation and cortical myelin organization in early- and late-onset Alzheimer's disease

Previous MRI studies reported cortical iron accumulation in early-onset (EOAD) compared to late-onset (LOAD) Alzheimer disease patients. However, the pattern and origin of iron accumulation is poorly understood. This study investigated the histopathological correlates of MRI contrast in both EOAD and LOAD. T2*-weighted MRI was performed on postmortem frontal cortex of controls, EOAD, and LOAD. Images were ordinally scored using predefined criteria followed by histology. Nonlinear histology-MRI registration was used to calculate pixel-wise spatial correlations based on the signal intensity. EOAD and LOAD were distinguishable based on 7T MRI from controls and from each other. Histology-MRI correlation analysis of the pixel intensities showed that the MRI contrast is best explained by increased iron accumulation and changes in cortical myelin, whereas amyloid and tau showed less spatial correspondence with T2*-weighted MRI. Neuropathologically, subtypes of Alzheimer's disease showed different patterns of iron accumulation and cortical myelin changes independent of amyloid and tau that may be detected by high-field susceptibility-based MRI.

Whole-Brain Microscopy Meets In Vivo Neuroimaging: Techniques, Benefits, and Limitations

Magnetic resonance imaging, positron emission tomography, and optical imaging have emerged as key tools to understand brain function and neurological disorders in preclinical mouse models. They offer the unique advantage of monitoring individual structural and functional changes over time. What remained unsolved until recently was to generate whole-brain microscopy data which can be correlated to the 3D in vivo neuroimaging data. Conventional histological sections are inappropriate especially for neuronal tracing or the unbiased screening for molecular targets through the whole brain. As part of the European Society for Molecular Imaging (ESMI) meeting 2016 in Utrecht, the Netherlands, we addressed this issue in the Molecular Neuroimaging study group meeting. Presentations covered new brain clearing methods, light sheet microscopes for large samples, and automatic registration of microscopy to in vivo imaging data. In this article, we summarize the discussion; give an overview of the novel techniques; and discuss the practical needs, benefits, and limitations.

ViCAR: An Adaptive and Landmark-Free Registration of Time Lapse Image Data from Microfluidics Experiments

In order to understand gene function in bacterial life cycles, time lapse bioimaging is applied in combination with different marker protocols in so called microfluidics chambers (i.e., a multi-well plate). In one experiment, a series of T images is recorded for one visual field, with a pixel resolution of 60 nm/px. Any (semi-)automatic analysis of the data is hampered by a strong image noise, low contrast and, last but not least, considerable irregular shifts during the acquisition. Image registration corrects such shifts enabling next steps of the analysis (e.g., feature extraction or tracking). Image alignment faces two obstacles in this microscopic context: (a) highly dynamic structural changes in the sample (i.e., colony growth) and (b) an individual data set-specific sample environment which makes the application of landmarks-based alignments almost impossible. We present a computational image registration solution, we refer to as ViCAR: (Vi)sual (C)ues based (A)daptive (R)egistration, for such microfluidics experiments, consisting of (1) the detection of particular polygons (outlined and segmented ones, referred to as visual cues), (2) the adaptive retrieval of three coordinates throughout different sets of frames, and finally (3) an image registration based on the relation of these points correcting both rotation and translation. We tested ViCAR with different data sets and have found that it provides an effective spatial alignment thereby paving the way to extract temporal features pertinent to each resulting bacterial colony. By using ViCAR, we achieved an image registration with 99.9% of image closeness, based on the average rmsd of 4.10⁻² pixels, and superior results compared to a state of the art algorithm.

Brain transcriptome atlases: a computational perspective

The immense complexity of the mammalian brain is largely reflected in the underlying molecular signatures of its billions of cells. Brain transcriptome atlases provide valuable insights into gene expression patterns across different brain areas throughout the course of development. Such atlases allow researchers to probe the molecular mechanisms which define neuronal identities, neuroanatomy, and patterns of connectivity. Despite the immense effort put into generating such atlases, to answer fundamental questions in neuroscience, an even greater effort is needed to develop methods to probe the resulting high-dimensional multivariate data. We provide a comprehensive overview of the various computational methods used to analyze brain transcriptome atlases.

Connecting imaging mass spectrometry and magnetic resonance imaging-based anatomical atlases for automated anatomical interpretation and differential analysis

Imaging mass spectrometry (IMS) is a molecular imaging technology that can measure thousands of biomolecules concurrently without prior tagging, making it particularly suitable for exploratory research. However, the data size and dimensionality often makes thorough extraction of relevant information impractical. To help guide and accelerate IMS data analysis, we recently developed a framework that integrates IMS measurements with anatomical atlases, opening up opportunities for anatomy-driven exploration of IMS data. One example is the automated anatomical interpretation of ion images, where empirically measured ion distributions are automatically decomposed into their underlying anatomical structures. While offering significant potential, IMS-atlas integration has thus far been restricted to the Allen Mouse Brain Atlas (AMBA) and mouse brain samples. Here, we expand the applicability of this framework by extending towards new animal species and a new set of anatomical atlases retrieved from the Scalable Brain Atlas (SBA). Furthermore, as many SBA atlases are based on magnetic resonance imaging (MRI) data, a new registration pipeline was developed that enables direct non-rigid IMS-to-MRI registration. These developments are demonstrated on protein-focused FTICR IMS measurements from coronal brain sections of a Parkinson's disease (PD) rat model. The measurements are integrated with an MRI-based rat brain atlas from the SBA. The new rat-focused IMS-atlas integration is used to perform automated anatomical interpretation and to find differential ions between healthy and diseased tissue. IMS-atlas integration can serve as an important accelerator in IMS data exploration, and with these new developments it can now be applied to a wider variety of animal species and modalities. This article is part of a Special Issue entitled: MALDI Imaging, edited by Dr. Corinna Henkel and Prof. Peter Hoffmann.

Clinical applications of MALDI imaging technologies in cancer and neurodegenerative diseases

Matrix-assisted laser desorption/ionization (MALDI) time-of-flight (TOF) imaging mass spectrometry (IMS) enables localization of analytes of interest along with histology. More specifically, MALDI-IMS identifies the distributions of proteins, peptides, small molecules, lipids, and drugs and their metabolites in tissues, with high spatial resolution. This unique capacity to directly analyze tissue samples without the need for lengthy sample preparation reduces technical variability and renders MALDI-IMS ideal for the identification of potential diagnostic and prognostic biomarkers and disease gradation. MALDI-IMS has evolved rapidly over the last decade and has been successfully used in both medical and basic research by scientists worldwide. In this review, we explore the clinical applications of MALDI-IMS, focusing on the major cancer types and neurodegenerative diseases. In particular, we re-emphasize the diagnostic potential of IMS and the challenges that must be confronted when conducting MALDI-IMS in clinical settings. This article is part of a Special Issue entitled: MALDI Imaging, edited by Dr. Corinna Henkel and Prof. Peter Hoffmann.

Mass Spectrometry Imaging in Oncology Drug Discovery

Over the last decade mass spectrometry imaging (MSI) has been integrated in to many areas of drug discovery and development. It can have significant impact in oncology drug discovery as it allows efficacy and safety of compounds to be assessed against the backdrop of the complex tumour microenvironment. We will discuss the roles of MSI in investigating compound and metabolite biodistribution and defining pharmacokinetic -pharmacodynamic relationships, analysis that is applicable to all drug discovery projects. We will then look more specifically at how MSI can be used to understand tumour metabolism and other applications specific to oncology research. This will all be described alongside the challenges of applying MSI to industry research with increased use of metrology for MSI.

Animal models of monogenic migraine

Migraine is a highly prevalent and disabling neurological disorder with a strong genetic component. Rare monogenic forms of migraine, or syndromes in which migraine frequently occurs, help scientists to unravel pathogenetic mechanisms of migraine and its comorbidities. Transgenic mouse models for rare monogenic mutations causing familial hemiplegic migraine (FHM), cerebral autosomal dominant arteriopathy with subcortical infarcts and leukoencephalopathy (CADASIL), and familial advanced sleep-phase syndrome (FASPS), have been created. Here, we review the current state of research using these mutant mice. We also discuss how currently available experimental approaches, including epigenetic studies, biomolecular analysis and optogenetic technologies, can be used for characterization of migraine genes to further unravel the functional and molecular pathways involved in migraine.

3D Reconstructed Cyto-, Muscarinic M2 Receptor, and Fiber Architecture of the Rat Brain Registered to the Waxholm Space Atlas

High-resolution multiscale and multimodal 3D models of the brain are essential tools to understand its complex structural and functional organization. Neuroimaging techniques addressing different aspects of brain organization should be integrated in a reference space to enable topographically correct alignment and subsequent analysis of the various datasets and their modalities. The Waxholm Space (http://software.incf.org/software/waxholm-space) is a publicly available 3D coordinate-based standard reference space for the mapping and registration of neuroanatomical data in rodent brains. This paper provides a newly developed pipeline combining imaging and reconstruction steps with a novel registration strategy to integrate new neuroimaging modalities into the Waxholm Space atlas. As a proof of principle, we incorporated large scale high-resolution cyto-, muscarinic M2 receptor, and fiber architectonic images of rat brains into the 3D digital MRI based atlas of the Sprague Dawley rat in Waxholm Space. We describe the whole workflow, from image acquisition to reconstruction and registration of these three modalities into the Waxholm Space rat atlas. The registration of the brain sections into the atlas is performed by using both linear and non-linear transformations. The validity of the procedure is qualitatively demonstrated by visual inspection, and a quantitative evaluation is performed by measurement of the concordance between representative atlas-delineated regions and the same regions based on receptor or fiber architectonic data. This novel approach enables for the first time the generation of 3D reconstructed volumes of nerve fibers and fiber tracts, or of muscarinic M2 receptor density distributions, in an entire rat brain. Additionally, our pipeline facilitates the inclusion of further neuroimaging datasets, e.g., 3D reconstructed volumes of histochemical stainings or of the regional distributions of multiple other receptor types, into the Waxholm Space. Thereby, a multiscale and multimodal rat brain model was created in the Waxholm Space atlas of the rat brain. Since the registration of these multimodal high-resolution datasets into the same coordinate system is an indispensable requisite for multi-parameter analyses, this approach enables combined studies on receptor and cell distributions as well as fiber densities in the same anatomical structures at microscopic scales for the first time.

Spatio-Temporal Metabolite Profiling of the Barley Germination Process by MALDI MS Imaging

MALDI mass spectrometry imaging was performed to localize metabolites during the first seven days of the barley germination. Up to 100 mass signals were detected of which 85 signals were identified as 48 different metabolites with highly tissue-specific localizations. Oligosaccharides were observed in the endosperm and in parts of the developed embryo. Lipids in the endosperm co-localized in dependency on their fatty acid compositions with changes in the distributions of diacyl phosphatidylcholines during germination. 26 potentially antifungal hordatines were detected in the embryo with tissue-specific localizations of their glycosylated, hydroxylated, and O-methylated derivates. In order to reveal spatio-temporal patterns in local metabolite compositions, multiple MSI data sets from a time series were analyzed in one batch. This requires a new preprocessing strategy to achieve comparability between data sets as well as a new strategy for unsupervised clustering. The resulting spatial segmentation for each time point sample is visualized in an interactive cluster map and enables simultaneous interactive exploration of all time points. Using this new analysis approach and visualization tool germination-dependent developments of metabolite patterns with single MS position accuracy were discovered. This is the first study that presents metabolite profiling of a cereals' germination process over time by MALDI MSI with the identification of a large number of peaks of agronomically and industrially important compounds such as oligosaccharides, lipids and antifungal agents. Their detailed localization as well as the MS cluster analyses for on-tissue metabolite profile mapping revealed important information for the understanding of the germination process, which is of high scientific interest.

Optimized Protocol To Analyze Changes in the Lipidome of Xenografts after Treatment with 2-Hydroxyoleic Acid

Xenografts are a popular model for the study of the action of new antitumor drugs. However, xenografts are highly heterogeneous structures, and therefore it is sometimes difficult to evaluate the effects of the compounds on tumor metabolism. In this context, imaging mass spectrometry (IMS) may yield the required information, due to its inherent characteristics of sensitivity and spatial resolution. To the best of our knowledge, there is still no clear analysis protocol to properly evaluate the changes between samples due to the treatment. Here we present a protocol for the evaluation of the effect of 2-hydroxyoleic acid (2-OHOA), an antitumor compound, on xenografts lipidome based on IMS. Direct treated/control comparison did not show conclusive results. As we will demonstrate, a more sophisticated protocol was required to evaluate these changes including the following: (1) identification of different areas in the xenograft, (2) classification of these areas (necrotic/viable) to compare similar types of tissues, (3) suppression of the effect of the variation of adduct formation between samples, and (4) normalization of the variables using the standard deviation to eliminate the excessive impact of the stronger peaks in the statistical analysis. In this way, the 36 lipid species that experienced the largest changes between treated and control were identified. Furthermore, incorporation of 2-hydroxyoleic acid to a sphinganine base was also confirmed by MS/MS. Comparison of the changes observed here with previous results obtained with different techniques demonstrates the validity of the protocol.

Imaging mass spectrometry: Instrumentation, applications, and combination with other visualization techniques

Imaging Mass Spectrometry (IMS) is strengthening its position as a valuable analytical tool. It has unique ability to identify structures and to unravel molecular changes that occur in the precisely defined part of the sample. These unique features open new possibilities in the field of various aspects of biological research. In this review we briefly discuss the main imaging mass spectrometry techniques, as well as the nature of biological samples and molecules, which might be analyzed by such methodology. Moreover, a novel approach, where different analytical techniques might be combined with the results of IMS study, is emphasized and discussed. With such a fast development of IMS and related methods, we can foresee the promising future of this technique.

Large-scale mass spectrometry imaging investigation of consequences of cortical spreading depression in a transgenic mouse model of migraine

Cortical spreading depression (CSD) is the electrophysiological correlate of migraine aura. Transgenic mice carrying the R192Q missense mutation in the Cacna1a gene, which in patients causes familial hemiplegic migraine type 1 (FHM1), exhibit increased propensity to CSD. Herein, mass spectrometry imaging (MSI) was applied for the first time to an animal cohort of transgenic and wild type mice to study the biomolecular changes following CSD in the brain. Ninety-six coronal brain sections from 32 mice were analyzed by MALDI-MSI. All MSI datasets were registered to the Allen Brain Atlas reference atlas of the mouse brain so that the molecular signatures of distinct brain regions could be compared. A number of metabolites and peptides showed substantial changes in the brain associated with CSD. Among those, different mass spectral features showed significant (t-test, P < 0.05) changes in the cortex, 146 and 377 Da, and in the thalamus, 1820 and 1834 Da, of the CSD-affected hemisphere of FHM1 R192Q mice. Our findings reveal CSD- and genotype-specific molecular changes in the brain of FHM1 transgenic mice that may further our understanding about the role of CSD in migraine pathophysiology. The results also demonstrate the utility of aligning MSI datasets to a common reference atlas for large-scale MSI investigations.

Precise Anatomic Localization of Accumulated Lipids in Mfp2 Deficient Murine Brains Through Automated Registration of SIMS Images to the Allen Brain Atlas

Mass spectrometry imaging (MSI) is a powerful tool for the molecular characterization of specific tissue regions. Histochemical staining provides anatomic information complementary to MSI data. The combination of both modalities has been proven to be beneficial. However, direct comparison of histology based and mass spectrometry-based molecular images can become problematic because of potential tissue damages or changes caused by different sample preparation. Curated atlases such as the Allen Brain Atlas (ABA) offer a collection of highly detailed and standardized anatomic information. Direct comparison of MSI brain data to the ABA allows for conclusions to be drawn on precise anatomic localization of the molecular signal. Here we applied secondary ion mass spectrometry imaging at high spatial resolution to study brains of knock-out mouse models with impaired peroxisomal β-oxidation. Murine models were lacking D-multifunctional protein (MFP2), which is involved in degradation of very long chain fatty acids. SIMS imaging revealed deposits of fatty acids within distinct brain regions. Manual comparison of the MSI data with the histologic stains did not allow for an unequivocal anatomic identification of the fatty acids rich regions. We further employed an automated pipeline for co-registration of the SIMS data to the ABA. The registration enabled precise anatomic annotation of the brain structures with the revealed lipid deposits. The precise anatomic localization allowed for a deeper insight into the pathology of Mfp2 deficient mouse models.

Imaging and Mapping of Tissue Constituents at the Single-Cell Level Using MALDI MSI and Quantitative Laser Scanning Cytometry

For nearly a century, histopathology involved the laborious morphological analyses of tissues stained with broad-spectrum dyes (i.e., eosin to label proteins). With the advent of antibody-labeling, immunostaining (fluorescein and rhodamine for fluorescent labeling) and immunohistochemistry (DAB and hematoxylin), it became possible to identify specific immunological targets in cells and tissue preparations. Technical advances, including the development of monoclonal antibody technology, led to an ever-increasing palate of dyes, both fluorescent and chromatic. This provides an incredibly rich menu of molecular entities that can be visualized and quantified in cells-giving rise to the new discipline of Molecular Pathology. We describe the evolution of two analytical techniques, cytometry and mass spectrometry, which complement histopathological visual analysis by providing automated, cellular-resolution constituent maps. For the first time, laser scanning cytometry (LSC) and matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI-MSI) are combined for the analysis of tissue sections. The utility of the marriage of these techniques is demonstrated by analyzing mouse brains with neuron-specific, genetically encoded, fluorescent proteins. We present a workflow that: (1) can be used with or without expensive matrix deposition methods, (2) uses LSC images to reveal the diverse landscape of neural tissue as well as the matrix, and (3) uses a tissue fixation method compatible with a DNA stain. The proposed workflow can be adapted for a variety of sample preparation and matrix deposition methods.

Automated anatomical interpretation of ion distributions in tissue: linking imaging mass spectrometry to curated atlases

Imaging mass spectrometry (IMS) has become a prime tool for studying the distribution of biomolecules in tissue. Although IMS data sets can become very large, computational methods have made it practically feasible to search these experiments for relevant findings. However, these methods lack access to an important source of information that many human interpretations rely upon: anatomical insight. In this work, we address this need by (1) integrating a curated anatomical data source with an empirically acquired IMS data source, establishing an algorithm-accessible link between them and (2) demonstrating the potential of such an IMS-anatomical atlas link by applying it toward automated anatomical interpretation of ion distributions in tissue. The concept is demonstrated in mouse brain tissue, using the Allen Mouse Brain Atlas as the curated anatomical data source that is linked to MALDI-based IMS experiments. We first develop a method to spatially map the anatomical atlas to the IMS data sets using nonrigid registration techniques. Once a mapping is established, a second computational method, called correlation-based querying, gives an elementary demonstration of the link by delivering basic insight into relationships between ion images and anatomical structures. Finally, a third algorithm moves further beyond both registration and correlation by providing automated anatomical interpretation of ion images. This task is approached as an optimization problem that deconstructs ion distributions as combinations of known anatomical structures. We demonstrate that establishing a link between an IMS experiment and an anatomical atlas enables automated anatomical annotation, which can serve as an important accelerator both for human and machine-guided exploration of IMS experiments.

Automatic generic registration of mass spectrometry imaging data to histology using nonlinear stochastic embedding

The combination of mass spectrometry imaging and histology has proven a powerful approach for obtaining molecular signatures from specific cells/tissues of interest, whether to identify biomolecular changes associated with specific histopathological entities or to determine the amount of a drug in specific organs/compartments. Currently there is no software that is able to explicitly register mass spectrometry imaging data spanning different ionization techniques or mass analyzers. Accordingly, the full capabilities of mass spectrometry imaging are at present underexploited. Here we present a fully automated generic approach for registering mass spectrometry imaging data to histology and demonstrate its capabilities for multiple mass analyzers, multiple ionization sources, and multiple tissue types.