Integrating imaging and omics data: A review

Current best practices and future opportunities for reproducible findings using large-scale neuroimaging in psychiatry

Research into the brain basis of psychopathology is challenging due to the heterogeneity of psychiatric disorders, extensive comorbidities, underdiagnosis or overdiagnosis, multifaceted interactions with genetics and life experiences, and the highly multivariate nature of neural correlates. Therefore, increasingly larger datasets that measure more variables in larger cohorts are needed to gain insights. In this review, we present current "best practice" approaches for using existing databases, collecting and sharing new repositories for big data analyses, and future directions for big data in neuroimaging and psychiatry with an emphasis on contributing to collaborative efforts and the challenges of multi-study data analysis.

Digital twins for health: a scoping review

The use of digital twins (DTs) has proliferated across various fields and industries, with a recent surge in the healthcare sector. The concept of digital twin for health (DT4H) holds great promise to revolutionize the entire healthcare system, including management and delivery, disease treatment and prevention, and health well-being maintenance, ultimately improving human life. The rapid growth of big data and continuous advancement in data science (DS) and artificial intelligence (AI) have the potential to significantly expedite DT research and development by providing scientific expertise, essential data, and robust cybertechnology infrastructure. Although various DT initiatives have been underway in the industry, government, and military, DT4H is still in its early stages. This paper presents an overview of the current applications of DTs in healthcare, examines consortium research centers and their limitations, and surveys the current landscape of emerging research and development opportunities in healthcare. We envision the emergence of a collaborative global effort among stakeholders to enhance healthcare and improve the quality of life for millions of individuals worldwide through pioneering research and development in the realm of DT technology.

Prediction of moment-by-moment heart rate and skin conductance changes in the context of varying emotional arousal

Autonomic nervous system (ANS) responses such as heart rate (HR) and galvanic skin responses (GSR) have been linked with cerebral activity in the context of emotion. Although much work has focused on the summative effect of emotions on ANS responses, their interaction in a continuously changing context is less clear. Here, we used a multimodal data set of human affective states, which includes electroencephalogram (EEG) and peripheral physiological signals of participants' moment-by-moment reactions to emotional provoking video clips and modeled HR and GSR changes using machine learning techniques, specifically, long short-term memory (LSTM), decision tree (DT), and linear regression (LR). We found that LSTM achieved a significantly lower error rate compared with DT and LR due to its inherent ability to handle sequential data. Importantly, the prediction error was significantly reduced for DT and LR when used together with particle swarm optimization to select relevant/important features for these algorithms. Unlike summative analysis, and contrary to expectations, we found a significantly lower error rate when the prediction was made across different participants than within a participant. Moreover, the predictive selected features suggest that the patterns predictive of HR and GSR were substantially different across electrode sites and frequency bands. Overall, these results indicate that specific patterns of cerebral activity track autonomic body responses. Although individual cerebral differences are important, they might not be the only factors influencing the moment-by-moment changes in ANS responses.

An introduction to representation learning for single-cell data analysis

Single-cell-resolved systems biology methods, including omics- and imaging-based measurement modalities, generate a wealth of high-dimensional data characterizing the heterogeneity of cell populations. Representation learning methods are routinely used to analyze these complex, high-dimensional data by projecting them into lower-dimensional embeddings. This facilitates the interpretation and interrogation of the structures, dynamics, and regulation of cell heterogeneity. Reflecting their central role in analyzing diverse single-cell data types, a myriad of representation learning methods exist, with new approaches continually emerging. Here, we contrast general features of representation learning methods spanning statistical, manifold learning, and neural network approaches. We consider key steps involved in representation learning with single-cell data, including data pre-processing, hyperparameter optimization, downstream analysis, and biological validation. Interdependencies and contingencies linking these steps are also highlighted. This overview is intended to guide researchers in the selection, application, and optimization of representation learning strategies for current and future single-cell research applications.

Explainable machine learning approach to predict and explain the relationship between task-based fMRI and individual differences in cognition

Despite decades of costly research, we still cannot accurately predict individual differences in cognition from task-based functional magnetic resonance imaging (fMRI). Moreover, aiming for methods with higher prediction is not sufficient. To understand brain-cognition relationships, we need to explain how these methods draw brain information to make the prediction. Here we applied an explainable machine-learning (ML) framework to predict cognition from task-based fMRI during the n-back working-memory task, using data from the Adolescent Brain Cognitive Development (n = 3,989). We compared 9 predictive algorithms in their ability to predict 12 cognitive abilities. We found better out-of-sample prediction from ML algorithms over the mass-univariate and ordinary least squares (OLS) multiple regression. Among ML algorithms, Elastic Net, a linear and additive algorithm, performed either similar to or better than nonlinear and interactive algorithms. We explained how these algorithms drew information, using SHapley Additive explanation, eNetXplorer, Accumulated Local Effects, and Friedman's H-statistic. These explainers demonstrated benefits of ML over the OLS multiple regression. For example, ML provided some consistency in variable importance with a previous study and consistency with the mass-univariate approach in the directionality of brain-cognition relationships at different regions. Accordingly, our explainable-ML framework predicted cognition from task-based fMRI with boosted prediction and explainability over standard methodologies.

Biomarkers of diagnosis, prognosis, pathogenesis, response to therapy: Convergence or divergence? Lessons from Alzheimer's disease and synucleinopathies

Alzheimer's disease (AD) is the most common disorder associated with cognitive impairment. Recent observations emphasize the pathogenic role of multiple factors inside and outside the central nervous system, supporting the notion that AD is a syndrome of many etiologies rather than a "heterogeneous" but ultimately unifying disease entity. Moreover, the defining pathology of amyloid and tau coexists with many others, such as α-synuclein, TDP-43, and others, as a rule, not an exception. Thus, an effort to shift our AD paradigm as an amyloidopathy must be reconsidered. Along with amyloid accumulation in its insoluble state, β-amyloid is becoming depleted in its soluble, normal states, as a result of biological, toxic, and infectious triggers, requiring a shift from convergence to divergence in our approach to neurodegeneration. These aspects are reflected-in vivo-by biomarkers, which have become increasingly strategic in dementia. Similarly, synucleinopathies are primarily characterized by abnormal deposition of misfolded α-synuclein in neurons and glial cells and, in the process, depleting the levels of the normal, soluble α-synuclein that the brain needs for many physiological functions. The soluble to insoluble conversion also affects other normal brain proteins, such as TDP-43 and tau, accumulating in their insoluble states in both AD and dementia with Lewy bodies (DLB). The two diseases have been distinguished by the differential burden and distribution of insoluble proteins, with neocortical phosphorylated tau deposition more typical of AD and neocortical α-synuclein deposition peculiar to DLB. We propose a reappraisal of the diagnostic approach to cognitive impairment from convergence (based on clinicopathologic criteria) to divergence (based on what differs across individuals affected) as a necessary step for the launch of precision medicine.

Towards the characterization of the tumor microenvironment through dictionary learning-based interpretable classification of multiplexed immunofluorescence images

Objective.Histology image analysis is a crucial diagnostic step in staging and treatment planning, especially for cancerous lesions. With the increasing adoption of computational methods for image analysis, significant strides are being made to improve the performance metrics of image segmentation and classification frameworks. However, many developed frameworks effectively function as black boxes, granting minimal context to the decision-making process. Thus, there is a need to develop methods that offer reasonable discriminatory power and a biologically-informed intuition to the decision-making process.Approach.In this study, we utilized and modified a discriminative feature-based dictionary learning (DFDL) paradigm to generate a classification framework that allows for discrimination between two distinct clinical histologies. This framework allows us (i) to discriminate between 2 clinically distinct diseases or histologies and (ii) provides interpretable group-specific representative dictionary image patches, or 'atoms', generated during classifier training. This implementation is performed on multiplexed immunofluorescence images from two separate patient cohorts- a pancreatic cohort consisting of cancerous and non-cancerous tissues and a metastatic non-small cell lung cancer (mNSCLC) cohort of responders and non-responders to an immunotherapeutic treatment regimen. The analysis was done at both the image-level and subject-level. Five cell types were selected, namely, epithelial cells, cytotoxic lymphocytes, antigen presenting cells, HelperT cells, and T-regulatory cells, as our phenotypes of interest.Results.We showed that DFDL had significant discriminant capabilities for both the pancreatic pathologies cohort (subject-level AUC-0.8878) and the mNSCLC immunotherapy response cohort (subject-level AUC-0.7221). The secondary analysis also showed that more than 50% of the obtained dictionary atoms from the classifier contained biologically relevant information.Significance.Our method shows that the generated dictionary features can help distinguish patients presenting two different histologies with strong sensitivity and specificity metrics. These features allow for an additional layer of model interpretability, a highly desirable element in clinical applications for identifying novel biological phenomena.

A Review of Fusion Methods for Omics and Imaging Data

The development of omics data and biomedical images has greatly advanced the progress of precision medicine in diagnosis, treatment, and prognosis. The fusion of omics and imaging data, i.e., omics-imaging fusion, offers a new strategy for understanding complex diseases. However, due to a variety of issues such as the limited number of samples, high dimensionality of features, and heterogeneity of different data types, efficiently learning complementary or associated discriminative fusion information from omics and imaging data remains a challenge. Recently, numerous machine learning methods have been proposed to alleviate these problems. In this review, from the perspective of fusion levels and fusion methods, we first provide an overview of preprocessing and feature extraction methods for omics and imaging data, and comprehensively analyze and summarize the basic forms and variations of commonly used and newly emerging fusion methods, along with their advantages, disadvantages and the applicable scope. We then describe public datasets and compare experimental results of various fusion methods on the ADNI and TCGA datasets. Finally, we discuss future prospects and highlight remaining challenges in the field.

Community Detection in Protein-Protein Interaction Networks and Applications

The ability to identify and characterize not only the protein-protein interactions but also their internal modular organization through network analysis is fundamental for understanding the mechanisms of biological processes at the molecular level. Indeed, the detection of the network communities can enhance our understanding of the molecular basis of disease pathology, and promote drug discovery and disease treatment in personalized medicine. This work gives an overview of recent computational methods for the detection of protein complexes and functional modules in protein-protein interaction networks, also providing a focus on some of its applications. We propose a systematic reformulation of frequently adopted taxonomies for these methods, also proposing new categories to keep up with the most recent research. We review the literature of the last five years (2017-2021) and provide links to existing data and software resources. Finally, we survey recent works exploiting module identification and analysis, in the context of a variety of disease processes for biomarker identification and therapeutic target detection. Our review provides the interested reader with an up-to-date and self-contained view of the existing research, with links to state-of-the-art literature and resources, as well as hints on open issues and future research directions in complex detection and its applications.

Radiomics in veterinary medicine: Overview, methods, and applications

Radiomics, or quantitative image analysis from radiographic image data, borrows the suffix from other emerging -omics fields of study, such as genomics, proteomics, and metabolomics. This report provides an overview of the general principles of how radiomic features are computed, describes major types of morphological, first order, and texture features, and the applications, challenges, and opportunities of radiomics as applied in veterinary medicine. Some advantages radiomics has over traditional semantic radiological features include standardized methodology in computing semantic features, the ability to compute features in multi-dimensional images, their newfound associations with genomic and pathological abnormalities, and the number of perceptible and imperceptible features available for regression or classification modeling. Some challenges in deploying radiomics in a clinical setting include sensitivity to image acquisition settings and image artifacts, pre- and post-image reconstruction and calculation settings, variability in feature estimates stemming from inter- and intra-observer contouring errors, and challenges with software and data harmonization and generalizability of findings given the challenges of small sample size and patient selection bias in veterinary medicine. Despite this, radiomics has enormous potential in patient-centric diagnostics, prognosis, and theragnostics. Fully leveraging the utility of radiomics in veterinary medicine will require inter-institutional collaborations, data harmonization, and data sharing strategies amongst institutions, transparent and robust model development, and multi-disciplinary efforts within and outside the veterinary medical imaging community.

Combining Neuroimaging and Omics Datasets for Disease Classification Using Graph Neural Networks

Both neuroimaging and genomics datasets are often gathered for the detection of neurodegenerative diseases. Huge dimensionalities of neuroimaging data as well as omics data pose tremendous challenge for methods integrating multiple modalities. There are few existing solutions that can combine both multi-modal imaging and multi-omics datasets to derive neurological insights. We propose a deep neural network architecture that combines both structural and functional connectome data with multi-omics data for disease classification. A graph convolution layer is used to model functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI) data simultaneously to learn compact representations of the connectome. A separate set of graph convolution layers are then used to model multi-omics datasets, expressed in the form of population graphs, and combine them with latent representations of the connectome. An attention mechanism is used to fuse these outputs and provide insights on which omics data contributed most to the model's classification decision. We demonstrate our methods for Parkinson's disease (PD) classification by using datasets from the Parkinson's Progression Markers Initiative (PPMI). PD has been shown to be associated with changes in the human connectome and it is also known to be influenced by genetic factors. We combine DTI and fMRI data with multi-omics data from RNA Expression, Single Nucleotide Polymorphism (SNP), DNA Methylation and non-coding RNA experiments. A Matthew Correlation Coefficient of greater than 0.8 over many combinations of multi-modal imaging data and multi-omics data was achieved with our proposed architecture. To address the paucity of paired multi-modal imaging data and the problem of imbalanced data in the PPMI dataset, we compared the use of oversampling against using CycleGAN on structural and functional connectomes to generate missing imaging modalities. Furthermore, we performed ablation studies that offer insights into the importance of each imaging and omics modality for the prediction of PD. Analysis of the generated attention matrices revealed that DNA Methylation and SNP data were the most important omics modalities out of all the omics datasets considered. Our work motivates further research into imaging genetics and the creation of more multi-modal imaging and multi-omics datasets to study PD and other complex neurodegenerative diseases.

Multiomics Analysis of Structural Magnetic Resonance Imaging of the Brain and Cerebrospinal Fluid Metabolomics in Cognitively Normal and Impaired Adults

INTRODUCTION

Integrating brain imaging with large scale omics data may identify novel mechanisms of mild cognitive impairment (MCI) and early Alzheimer's disease (AD). We integrated and analyzed brain magnetic resonance imaging (MRI) with cerebrospinal fluid (CSF) metabolomics to elucidate metabolic mechanisms and create a "metabolic map" of the brain in prodromal AD.

METHODS

In 145 subjects (85 cognitively normal controls and 60 with MCI), we derived voxel-wise gray matter volume via whole-brain structural MRI and conducted high-resolution untargeted metabolomics on CSF. Using a data-driven approach consisting of partial least squares discriminant analysis, a multiomics network clustering algorithm, and metabolic pathway analysis, we described dysregulated metabolic pathways in CSF mapped to brain regions associated with MCI in our cohort.

RESULTS

The multiomics network algorithm clustered metabolites with contiguous imaging voxels into seven distinct communities corresponding to the following brain regions: hippocampus/parahippocampal gyrus (three distinct clusters), thalamus, posterior thalamus, parietal cortex, and occipital lobe. Metabolic pathway analysis indicated dysregulated metabolic activity in the urea cycle, and many amino acids (arginine, histidine, lysine, glycine, tryptophan, methionine, valine, glutamate, beta-alanine, and purine) was significantly associated with those regions (P < 0.05).

CONCLUSION

By integrating CSF metabolomics data with structural MRI data, we linked specific AD-susceptible brain regions to disrupted metabolic pathways involving nitrogen excretion and amino acid metabolism critical for cognitive function. Our findings and analytical approach may extend drug and biomarker research toward more multiomics approaches.

Computational Methods for Single-Cell Imaging and Omics Data Integration

Integrating single cell omics and single cell imaging allows for a more effective characterisation of the underlying mechanisms that drive a phenotype at the tissue level, creating a comprehensive profile at the cellular level. Although the use of imaging data is well established in biomedical research, its primary application has been to observe phenotypes at the tissue or organ level, often using medical imaging techniques such as MRI, CT, and PET. These imaging technologies complement omics-based data in biomedical research because they are helpful for identifying associations between genotype and phenotype, along with functional changes occurring at the tissue level. Single cell imaging can act as an intermediary between these levels. Meanwhile new technologies continue to arrive that can be used to interrogate the genome of single cells and its related omics datasets. As these two areas, single cell imaging and single cell omics, each advance independently with the development of novel techniques, the opportunity to integrate these data types becomes more and more attractive. This review outlines some of the technologies and methods currently available for generating, processing, and analysing single-cell omics- and imaging data, and how they could be integrated to further our understanding of complex biological phenomena like ageing. We include an emphasis on machine learning algorithms because of their ability to identify complex patterns in large multidimensional data.

Using dual-network-analyser for communities detecting in dual networks

BACKGROUND

Representations of the relationships among data using networks are widely used in several research fields such as computational biology, medical informatics and social network mining. Recently, complex networks have been introduced to better capture the insights of the modelled scenarios. Among others, dual networks (DNs) consist of mapping information as pairs of networks containing the same set of nodes but with different edges: one, called physical network, has unweighted edges, while the other, called conceptual network, has weighted edges.

RESULTS

We focus on DNs and we propose a tool to find common subgraphs (aka communities) in DNs with particular properties. The tool, called Dual-Network-Analyser, is based on the identification of communities that induce optimal modular subgraphs in the conceptual network and connected subgraphs in the physical one. It includes the Louvain algorithm applied to the considered case. The Dual-Network-Analyser can be used to study DNs, to find common modular communities. We report results on using the tool to identify communities on synthetic DNs as well as real cases in social networks and biological data.

CONCLUSION

The proposed method has been tested by using synthetic and biological networks. Results demonstrate that it is well able to detect meaningful information from DNs.

Analyzing host-viral interactome of SARS-CoV-2 for identifying vulnerable host proteins during COVID-19 pathogenesis

The development of therapeutic targets for COVID-19 relies on understanding the molecular mechanism of pathogenesis. Identifying genes or proteins involved in the infection mechanism is the key to shedding light on the complex molecular mechanisms. The combined effort of many laboratories distributed throughout the world has produced protein and genetic interactions. We integrated available results and obtained a host protein-protein interaction network composed of 1432 human proteins. Next, we performed network centrality analysis to identify critical proteins in the derived network. Finally, we performed a functional enrichment analysis of central proteins. We observed that the identified proteins are primarily associated with several crucial pathways, including cellular process, signaling transduction, neurodegenerative diseases. We focused on the proteins that are involved in human respiratory tract diseases. We highlighted many potential therapeutic targets, including RBX1, HSPA5, ITCH, RAB7A, RAB5A, RAB8A, PSMC5, CAPZB, CANX, IGF2R, and HSPA1A, which are central and also associated with multiple diseases.

Omics sciences for systems biology in Alzheimer's disease: State-of-the-art of the evidence

Alzheimer's disease (AD) is characterized by non-linear, genetic-driven pathophysiological dynamics with high heterogeneity in biological alterations and disease spatial-temporal progression. Human in-vivo and post-mortem studies point out a failure of multi-level biological networks underlying AD pathophysiology, including proteostasis (amyloid-β and tau), synaptic homeostasis, inflammatory and immune responses, lipid and energy metabolism, oxidative stress. Therefore, a holistic, systems-level approach is needed to fully capture AD multi-faceted pathophysiology. Omics sciences - genomics, epigenomics, transcriptomics, proteomics, metabolomics, lipidomics - embedded in the systems biology (SB) theoretical and computational framework can generate explainable readouts describing the entire biological continuum of a disease. Such path in Neurology is encouraged by the promising results of omics sciences and SB approaches in Oncology, where stage-driven pathway-based therapies have been developed in line with the precision medicine paradigm. Multi-omics data integrated in SB network approaches will help detect and chart AD upstream pathomechanistic alterations and downstream molecular effects occurring in preclinical stages. Finally, integrating omics and neuroimaging data - i.e., neuroimaging-omics - will identify multi-dimensional biological signatures essential to track the clinical-biological trajectories, at the subpopulation or even individual level.

A review in radiomics: Making personalized medicine a reality via routine imaging

Radiomics is the quantitative analysis of standard-of-care medical imaging; the information obtained can be applied within clinical decision support systems to create diagnostic, prognostic, and/or predictive models. Radiomics analysis can be performed by extracting hand-crafted radiomics features or via deep learning algorithms. Radiomics has evolved tremendously in the last decade, becoming a bridge between imaging and precision medicine. Radiomics exploits sophisticated image analysis tools coupled with statistical elaboration to extract the wealth of information hidden inside medical images, such as computed tomography (CT), magnetic resonance (MR), and/or Positron emission tomography (PET) scans, routinely performed in the everyday clinical practice. Many efforts have been devoted in recent years to the standardization and validation of radiomics approaches, to demonstrate their usefulness and robustness beyond any reasonable doubts. However, the booming of publications and commercial applications of radiomics approaches warrant caution and proper understanding of all the factors involved to avoid "scientific pollution" and overly enthusiastic claims by researchers and clinicians alike. For these reasons the present review aims to be a guidebook of sorts, describing the process of radiomics, its pitfalls, challenges, and opportunities, along with its ability to improve clinical decision-making, from oncology and respiratory medicine to pharmacological and genotyping studies.

Transpathology: molecular imaging-based pathology

Pathology is the medical specialty concerned with the study of the disease nature and causes, playing a key role in bridging basic researches and clinical medicine. In the course of development, pathology has significantly expanded our understanding of disease, and exerted enormous impact on the management of patients. However, challenges facing pathology, the inherent invasiveness of pathological practice and the persistent concerns on the sample representativeness, constitute its limitations. Molecular imaging is a noninvasive technique to visualize, characterize, and measure biological processes at the molecular level in living subjects. With the continuous development of equipment and probes, molecular imaging has enabled an increasingly precise evaluation of pathophysiological changes. A new pathophysiology visualization system based on molecular imaging is forming and shows the great potential to reform the pathological practice. Several improvements in "trans-," including trans-scale, transparency, and translation, would be driven by this new kind of pathological practice. Pathological changes could be evaluated in a trans-scale imaging mode; tissues could be transparentized to better present the underlying pathophysiological information; and the translational processes of basic research to the clinical practice would be better facilitated. Thus, transpathology would greatly facilitate in deciphering the pathophysiological events in a multiscale perspective, and supporting the precision medicine in the future.

Data science in unveiling COVID-19 pathogenesis and diagnosis: evolutionary origin to drug repurposing

MOTIVATION

The outbreak of novel severe acute respiratory syndrome coronavirus (SARS-CoV-2, also known as COVID-19) in Wuhan has attracted worldwide attention. SARS-CoV-2 causes severe inflammation, which can be fatal. Consequently, there has been a massive and rapid growth in research aimed at throwing light on the mechanisms of infection and the progression of the disease. With regard to this data science is playing a pivotal role in in silico analysis to gain insights into SARS-CoV-2 and the outbreak of COVID-19 in order to forecast, diagnose and come up with a drug to tackle the virus. The availability of large multiomics, radiological, bio-molecular and medical datasets requires the development of novel exploratory and predictive models, or the customisation of existing ones in order to fit the current problem. The high number of approaches generates the need for surveys to guide data scientists and medical practitioners in selecting the right tools to manage their clinical data.

RESULTS

Focusing on data science methodologies, we conduct a detailed study on the state-of-the-art of works tackling the current pandemic scenario. We consider various current COVID-19 data analytic domains such as phylogenetic analysis, SARS-CoV-2 genome identification, protein structure prediction, host-viral protein interactomics, clinical imaging, epidemiological research and drug discovery. We highlight data types and instances, their generation pipelines and the data science models currently in use. The current study should give a detailed sketch of the road map towards handling COVID-19 like situations by leveraging data science experts in choosing the right tools. We also summarise our review focusing on prime challenges and possible future research directions.

CONTACT

hguzzi@unicz.it, sroy01@cus.ac.in.

Novel Secondary Ion Mass Spectrometry Methods for the Examination of Metabolic Effects at the Cellular and Subcellular Levels

The behavior of an animal has substantial effects on its metabolism. Such effects, including changes in the lipid composition of different organs, or changes in the turnover of the proteins, have typically been observed using liquid mass spectrometry methods, averaging the effect of animal behavior across tissue samples containing multiple cells. These methods have provided the scientific community with valuable information, but have limited resolution, making it difficult if not impossible to examine metabolic effects at the cellular and subcellular levels. Recent advances in the field of secondary ion mass spectrometry (SIMS) have made it possible to examine the metabolic effects of animal behavior with high resolution at the nanoscale, enabling the analysis of the metabolic effects of behavior on individual cells. In this review we summarize and present these emerging methods, beginning with an overview of the SIMS technique. We then discuss the specific application of nanoscale SIMS (NanoSIMS) to examine cell behavior. This often requires the use of isotope labeling to highlight specific sections of the cell for analysis, an approach that is presented at length in this review article. We also present SIMS applications concerning animal and cell behavior, from development and aging to changes in the cellular activity programs. We conclude that the emerging group of SIMS technologies represents an exciting set of tools for the study of animal behavior and of its effects on internal metabolism at the smallest possible scales.

What scans we will read: imaging instrumentation trends in clinical oncology

Oncological diseases account for a significant portion of the burden on public healthcare systems with associated costs driven primarily by complex and long-lasting therapies. Through the visualization of patient-specific morphology and functional-molecular pathways, cancerous tissue can be detected and characterized non-invasively, so as to provide referring oncologists with essential information to support therapy management decisions. Following the onset of stand-alone anatomical and functional imaging, we witness a push towards integrating molecular image information through various methods, including anato-metabolic imaging (e.g., PET/CT), advanced MRI, optical or ultrasound imaging.This perspective paper highlights a number of key technological and methodological advances in imaging instrumentation related to anatomical, functional, molecular medicine and hybrid imaging, that is understood as the hardware-based combination of complementary anatomical and molecular imaging. These include novel detector technologies for ionizing radiation used in CT and nuclear medicine imaging, and novel system developments in MRI and optical as well as opto-acoustic imaging. We will also highlight new data processing methods for improved non-invasive tissue characterization. Following a general introduction to the role of imaging in oncology patient management we introduce imaging methods with well-defined clinical applications and potential for clinical translation. For each modality, we report first on the status quo and, then point to perceived technological and methodological advances in a subsequent status go section. Considering the breadth and dynamics of these developments, this perspective ends with a critical reflection on where the authors, with the majority of them being imaging experts with a background in physics and engineering, believe imaging methods will be in a few years from now.Overall, methodological and technological medical imaging advances are geared towards increased image contrast, the derivation of reproducible quantitative parameters, an increase in volume sensitivity and a reduction in overall examination time. To ensure full translation to the clinic, this progress in technologies and instrumentation is complemented by advances in relevant acquisition and image-processing protocols and improved data analysis. To this end, we should accept diagnostic images as "data", and - through the wider adoption of advanced analysis, including machine learning approaches and a "big data" concept - move to the next stage of non-invasive tumour phenotyping. The scans we will be reading in 10 years from now will likely be composed of highly diverse multi-dimensional data from multiple sources, which mandate the use of advanced and interactive visualization and analysis platforms powered by Artificial Intelligence (AI) for real-time data handling by cross-specialty clinical experts with a domain knowledge that will need to go beyond that of plain imaging.

Brain Imaging Genomics: Integrated Analysis and Machine Learning

Brain imaging genomics is an emerging data science field, where integrated analysis of brain imaging and genomics data, often combined with other biomarker, clinical and environmental data, is performed to gain new insights into the phenotypic, genetic and molecular characteristics of the brain as well as their impact on normal and disordered brain function and behavior. It has enormous potential to contribute significantly to biomedical discoveries in brain science. Given the increasingly important role of statistical and machine learning in biomedicine and rapidly growing literature in brain imaging genomics, we provide an up-to-date and comprehensive review of statistical and machine learning methods for brain imaging genomics, as well as a practical discussion on method selection for various biomedical applications.

Radiomics in stratification of pancreatic cystic lesions: Machine learning in action

Pancreatic cystic lesions (PCLs) are well-known precursors of pancreatic cancer. Their diagnosis can be challenging as their behavior varies from benign to malignant disease. Precise and timely management of malignant pancreatic cysts might prevent transformation to pancreatic cancer. However, the current consensus guidelines, which rely on standard imaging features to predict cyst malignancy potential, are conflicting and unclear. This has led to an increased interest in radiomics, a high-throughput extraction of comprehensible data from standard of care images. Radiomics can be used as a diagnostic and prognostic tool in personalized medicine. It utilizes quantitative image analysis to extract features in conjunction with machine learning and artificial intelligence (AI) methods like support vector machines, random forest, and convolutional neural network for feature selection and classification. Selected features can then serve as imaging biomarkers to predict high-risk PCLs. Radiomics studies conducted heretofore on PCLs have shown promising results. This cost-effective approach would help us to differentiate benign PCLs from malignant ones and potentially guide clinical decision-making leading to better utilization of healthcare resources. In this review, we discuss the process of radiomics, its myriad applications such as diagnosis, prognosis, and prediction of therapy response. We also discuss the outcomes of studies involving radiomic analysis of PCLs and pancreatic cancer, and challenges associated with this novel field along with possible solutions. Although these studies highlight the potential benefit of radiomics in the prevention and optimal treatment of pancreatic cancer, further studies are warranted before incorporating radiomics into the clinical decision support system.