Novel Approach Using Echo State Networks for Microscopic Cellular Image Segmentation

3D-integrated multilayered physical reservoir array for learning and forecasting time-series information

A wide reservoir computing system is an advanced architecture composed of multiple reservoir layers in parallel, which enables more complex and diverse internal dynamics for multiple time-series information processing. However, its hardware implementation has not yet been realized due to the lack of a high-performance physical reservoir and the complexity of fabricating multiple stacks. Here, we achieve a proof-of-principle demonstration of such hardware made of a multilayered three-dimensional stacked 3 × 10 × 10 tungsten oxide memristive crossbar array, with which we further realize a wide physical reservoir computing for efficient learning and forecasting of multiple time-series data. Because a three-layer structure allows the seamless and effective extraction of intricate three-dimensional local features produced by various temporal inputs, it can readily outperform two-dimensional based approaches extensively studied previously. Our demonstration paves the way for wide physical reservoir computing systems capable of efficiently processing multiple dynamic time-series information.

PDE-guided reservoir computing for image denoising with small data

While network-based techniques have shown outstanding performance in image denoising in the big data regime requiring massive datasets and expensive computation, mathematical understanding of their working principles is very limited. Not to mention, their relevance to traditional mathematical approaches has not attracted much attention. Therefore, we suggest how reservoir computing networks can be strengthened in combination with conventional partial differential equation (PDE) methods for image denoising, especially in the small data regime. Given image data, PDEs generate sequential datasets enhancing desired image features, which provide the network with a better guideline for training in reservoir computing. The proposed procedure, reservoir computing in collaboration with PDEs (RCPDE), offers a synergetic combination of data-driven network-based methods and mathematically well-established PDE methods. It turns out that RCPDE outperforms both the usual reservoir computing and existing PDE approaches in image denoising. Furthermore, RCPDE also excels deep neural networks such as a convolutional neural network both in quality and in time in the small data regime. We believe that RCPDE reveals the great potential of reservoir computing in collaboration with various mathematically justifiable dynamics for better performance as well as for better mathematical understanding.

Spatio-temporal feature learning with reservoir computing for T-cell segmentation in live-cell [Formula: see text] fluorescence microscopy

Advances in high-resolution live-cell [Formula: see text] imaging enabled subcellular localization of early [Formula: see text] signaling events in T-cells and paved the way to investigate the interplay between receptors and potential target channels in [Formula: see text] release events. The huge amount of acquired data requires efficient, ideally automated image processing pipelines, with cell localization/segmentation as central tasks. Automated segmentation in live-cell cytosolic [Formula: see text] imaging data is, however, challenging due to temporal image intensity fluctuations, low signal-to-noise ratio, and photo-bleaching. Here, we propose a reservoir computing (RC) framework for efficient and temporally consistent segmentation. Experiments were conducted with Jurkat T-cells and anti-CD3 coated beads used for T-cell activation. We compared the RC performance with a standard U-Net and a convolutional long short-term memory (LSTM) model. The RC-based models (1) perform on par in terms of segmentation accuracy with the deep learning models for cell-only segmentation, but show improved temporal segmentation consistency compared to the U-Net; (2) outperform the U-Net for two-emission wavelengths image segmentation and differentiation of T-cells and beads; and (3) perform on par with the convolutional LSTM for single-emission wavelength T-cell/bead segmentation and differentiation. In turn, RC models contain only a fraction of the parameters of the baseline models and reduce the training time considerably.