Comparison of electrical microstimulation artifact removal methods for high-channel-count prostheses

BACKGROUND

Neuroprostheses are used to electrically stimulate the brain, modulate neural activity and restore sensory and motor function following injury or disease, such as blindness, paralysis, and other movement and psychiatric disorders. Recordings are often made simultaneously with stimulation, allowing the monitoring of neural signals and closed-loop control of devices. However, stimulation-evoked artifacts may obscure neural activity, particularly when stimulation and recording sites are nearby. Several methods have been developed to remove stimulation artifacts, but it remains challenging to validate and compare these methods because the 'ground-truth' of the neuronal signals may be contaminated by artifacts.

NEW METHOD

Here, we delivered stimulation to the visual cortex via a high-channel-count prosthesis while recording neuronal activity and stimulation artifacts. We quantified the waveforms and temporal properties of stimulation artifacts from the cortical visual prosthesis (CVP) and used them to build a dataset, in which we simulated the neuronal activity and the stimulation artifacts. We illustrate how to use the simulated data to evaluate the performance of six software-based artifact removal methods (Template subtraction, Linear interpolation, Polynomial fitting, Exponential fitting, SALPA and ERAASR) in a CVP application scenario.

RESULTS

We here focused on stimulation artifacts caused by electrical stimulation through a high-channel-count cortical prosthesis device. We find that the Polynomial fitting and Exponential fitting methods outperform the other methods in recovering spikes and multi-unit activity. Linear interpolation and Template subtraction recovered the local-field potentials.

CONCLUSION

Polynomial fitting and Exponential fitting provided a good trade-off between the quality of the recovery of spikes and multi-unit activity (MUA) and the computational complexity for a cortical prosthesis.

Neural manifolds in V1 change with top-down signals from V4 targeting the foveal region

High-dimensional brain activity is often organized into lower-dimensional neural manifolds. However, the neural manifolds of the visual cortex remain understudied. Here, we study large-scale multi-electrode electrophysiological recordings of macaque (Macaca mulatta) areas V1, V4, and DP with a high spatiotemporal resolution. We find that the population activity of V1 contains two separate neural manifolds, which correlate strongly with eye closure (eyes open/closed) and have distinct dimensionalities. Moreover, we find strong top-down signals from V4 to V1, particularly to the foveal region of V1, which are significantly stronger during the eyes-open periods. Finally, in silico simulations of a balanced spiking neuron network qualitatively reproduce the experimental findings. Taken together, our analyses and simulations suggest that top-down signals modulate the population activity of V1. We postulate that the top-down modulation during the eyes-open periods prepares V1 for fast and efficient visual responses, resulting in a type of visual stand-by state.

Flexible Polymer Electrodes for Stable Prosthetic Visual Perception in Mice

Brain interfaces that can stimulate neurons, cause minimal damage, and work for a long time will be central for future neuroprosthetics. Here, the long-term performance of highly flexible, thin polyimide shanks with several small (<15 µm) electrodes during electrical microstimulation of the visual cortex, is reported. The electrodes exhibit a remarkable stability when several billions of electrical pulses are applied in vitro. When the devices are implanted in the primary visual cortex (area V1) of mice and the animals are trained to detect electrical microstimulation, it is found that the perceptual thresholds are 2-20 microamperes (µA), which is far below the maximal currents that the electrodes can withstand. The long-term functionality of the devices in vivo is excellent, with stable performance for up to more than a year and little damage to the brain tissue. These results demonstrate the potential of thin floating electrodes for the long-term restoration of lost sensory functions.

Noninvasive imaging-guided ultrasonic neurostimulation with arbitrary 2D patterns and its application for high-quality vision restoration

Retinal degeneration, a leading cause of irreversible low vision and blindness globally, can be partially addressed by retina prostheses which stimulate remaining neurons in the retina. However, existing electrode-based treatments are invasive, posing substantial risks to patients and healthcare providers. Here, we introduce a completely noninvasive ultrasonic retina prosthesis, featuring a customized ultrasound two-dimensional array which allows for simultaneous imaging and stimulation. With synchronous three-dimensional imaging guidance and auto-alignment technology, ultrasonic retina prosthesis can generate programmed ultrasound waves to dynamically and precisely form arbitrary wave patterns on the retina. Neuron responses in the brain's visual center mirrored these patterns, evidencing successful artificial vision creation, which was further corroborated in behavior experiments. Quantitative analysis of the spatial-temporal resolution and field of view demonstrated advanced performance of ultrasonic retina prosthesis and elucidated the biophysical mechanism of retinal stimulation. As a noninvasive blindness prosthesis, ultrasonic retina prosthesis could lead to a more effective, widely acceptable treatment for blind patients. Its real-time imaging-guided stimulation strategy with a single ultrasound array, could also benefit ultrasound neurostimulation in other diseases.

Volumetric mesoscopic electrophysiology: a new imaging modality for the non-human primate

The primate brain is a densely interconnected organ whose function is best understood by recording from the entire structure in parallel, rather than parts of it in sequence. However, available methods either have limited temporal resolution (functional magnetic resonance imaging), limited spatial resolution (macroscopic electroencephalography), or a limited field of view (microscopic electrophysiology). To address this need, we developed a volumetric, mesoscopic recording approach ( MePhys ) by tessellating the volume of a monkey hemisphere with 992 electrode contacts that were distributed across 62 chronically implanted multi-electrode shafts. We showcase the scientific promise of MePhys by describing the functional interactions of local field potentials between the more than 300,000 simultaneously recorded pairs of electrodes. We find that a subanesthetic dose of ketamine -believed to mimic certain aspects of psychosis- can create a pronounced state of functional disconnection and prevent the formation of stable large-scale intrinsic states. We conclude that MePhys provides a new and fundamentally distinct window into brain function whose unique profile of strengths and weaknesses complements existing approaches in synergistic ways.

Gaze-contingent processing improves mobility, scene recognition and visual search in simulated head-steered prosthetic vision

Objective.The enabling technology of visual prosthetics for the blind is making rapid progress. However, there are still uncertainties regarding the functional outcomes, which can depend on many design choices in the development. In visual prostheses with a head-mounted camera, a particularly challenging question is how to deal with the gaze-locked visual percept associated with spatial updating conflicts in the brain. The current study investigates a recently proposed compensation strategy based on gaze-contingent image processing with eye-tracking. Gaze-contingent processing is expected to reinforce natural-like visual scanning and reestablished spatial updating based on eye movements. The beneficial effects remain to be investigated for daily life activities in complex visual environments.Approach.The current study evaluates the benefits of gaze-contingent processing versus gaze-locked and gaze-ignored simulations in the context of mobility, scene recognition and visual search, using a virtual reality simulated prosthetic vision paradigm with sighted subjects.Main results.Compared to gaze-locked vision, gaze-contingent processing was consistently found to improve the speed in all experimental tasks, as well as the subjective quality of vision. Similar or further improvements were found in a control condition that ignores gaze-dependent effects, a simulation that is unattainable in the clinical reality.Significance.Our results suggest that gaze-locked vision and spatial updating conflicts can be debilitating for complex visually-guided activities of daily living such as mobility and orientation. Therefore, for prospective users of head-steered prostheses with an unimpaired oculomotor system, the inclusion of a compensatory eye-tracking system is strongly endorsed.

Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex

Objective. Intracortical microstimulation (ICMS) can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site.Approach. Different microstimulation frequencies were investigatedin vivoon Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging.Main results. Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies.Significance. These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by ICMS and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.

Axonal stimulation affects the linear summation of single-point perception in three Argus II users

Objective.Retinal implants use electrical stimulation to elicit perceived flashes of light ('phosphenes'). Single-electrode phosphene shape has been shown to vary systematically with stimulus parameters and the retinal location of the stimulating electrode, due to incidental activation of passing nerve fiber bundles. However, this knowledge has yet to be extended to paired-electrode stimulation.Approach.We retrospectively analyzed 3548 phosphene drawings made by three blind participants implanted with an Argus II Retinal Prosthesis. Phosphene shape (characterized by area, perimeter, major and minor axis length) and number of perceived phosphenes were averaged across trials and correlated with the corresponding single-electrode parameters. In addition, the number of phosphenes was correlated with stimulus amplitude and neuroanatomical parameters: electrode-retina and electrode-fovea distance as well as the electrode-electrode distance to ('between-axon') and along axon bundles ('along-axon'). Statistical analyses were conducted using linear regression and partial correlation analysis.Main results.Simple regression revealed that each paired-electrode shape descriptor could be predicted by the sum of the two corresponding single-electrode shape descriptors (p < .001). Multiple regression revealed that paired-electrode phosphene shape was primarily predicted by stimulus amplitude and electrode-fovea distance (p < .05). Interestingly, the number of elicited phosphenes tended to increase with between-axon distance (p < .05), but not with along-axon distance, in two out of three participants.Significance.The shape of phosphenes elicited by paired-electrode stimulation was well predicted by the shape of their corresponding single-electrode phosphenes, suggesting that two-point perception can be expressed as the linear summation of single-point perception. The impact of the between-axon distance on the perceived number of phosphenes provides further evidence in support of the axon map model for epiretinal stimulation. These findings contribute to the growing literature on phosphene perception and have important implications for the design of future retinal prostheses.

Towards biologically plausible phosphene simulation for the differentiable optimization of visual cortical prostheses

Blindness affects millions of people around the world. A promising solution to restoring a form of vision for some individuals are cortical visual prostheses, which bypass part of the impaired visual pathway by converting camera input to electrical stimulation of the visual system. The artificially induced visual percept (a pattern of localized light flashes, or 'phosphenes') has limited resolution, and a great portion of the field's research is devoted to optimizing the efficacy, efficiency, and practical usefulness of the encoding of visual information. A commonly exploited method is non-invasive functional evaluation in sighted subjects or with computational models by using simulated prosthetic vision (SPV) pipelines. An important challenge in this approach is to balance enhanced perceptual realism, biologically plausibility, and real-time performance in the simulation of cortical prosthetic vision. We present a biologically plausible, PyTorch-based phosphene simulator that can run in real-time and uses differentiable operations to allow for gradient-based computational optimization of phosphene encoding models. The simulator integrates a wide range of clinical results with neurophysiological evidence in humans and non-human primates. The pipeline includes a model of the retinotopic organization and cortical magnification of the visual cortex. Moreover, the quantitative effects of stimulation parameters and temporal dynamics on phosphene characteristics are incorporated. Our results demonstrate the simulator's suitability for both computational applications such as end-to-end deep learning-based prosthetic vision optimization as well as behavioral experiments. The modular and open-source software provides a flexible simulation framework for computational, clinical, and behavioral neuroscientists working on visual neuroprosthetics.

An actor-model framework for visual sensory encoding

A fundamental challenge in neuroengineering is determining a proper artificial input to a sensory system that yields the desired perception. In neuroprosthetics, this process is known as artificial sensory encoding, and it holds a crucial role in prosthetic devices restoring sensory perception in individuals with disabilities. For example, in visual prostheses, one key aspect of artificial image encoding is to downsample images captured by a camera to a size matching the number of inputs and resolution of the prosthesis. Here, we show that downsampling an image using the inherent computation of the retinal network yields better performance compared to learning-free downsampling methods. We have validated a learning-based approach (actor-model framework) that exploits the signal transformation from photoreceptors to retinal ganglion cells measured in explanted mouse retinas. The actor-model framework generates downsampled images eliciting a neuronal response in-silico and ex-vivo with higher neuronal reliability than the one produced by a learning-free approach. During the learning process, the actor network learns to optimize contrast and the kernel's weights. This methodological approach might guide future artificial image encoding strategies for visual prostheses. Ultimately, this framework could be applicable for encoding strategies in other sensory prostheses such as cochlear or limb.

Activation and depression of neural and hemodynamic responses induced by the intracortical microstimulation and visual stimulation in the mouse visual cortex

Objective . Intracortical microstimulation can be an effective method for restoring sensory perception in contemporary brain-machine interfaces. However, the mechanisms underlying better control of neuronal responses remain poorly understood, as well as the relationship between neuronal activity and other concomitant phenomena occurring around the stimulation site. Approach . Different microstimulation frequencies were investigated in vivo on Thy1-GCaMP6s mice using widefield and two-photon imaging to evaluate the evoked excitatory neural responses across multiple spatial scales as well as the induced hemodynamic responses. Specifically, we quantified stimulation-induced neuronal activation and depression in the mouse visual cortex and measured hemodynamic oxyhemoglobin and deoxyhemoglobin signals using mesoscopic-scale widefield imaging. Main results . Our calcium imaging findings revealed a preference for lower-frequency stimulation in driving stronger neuronal activation. A depressive response following the neural activation preferred a slightly higher frequency stimulation compared to the activation. Hemodynamic signals exhibited a comparable spatial spread to neural calcium signals. Oxyhemoglobin concentration around the stimulation site remained elevated during the post-activation (depression) period. Somatic and neuropil calcium responses measured by two-photon microscopy showed similar dependence on stimulation parameters, although the magnitudes measured in soma was greater than in neuropil. Furthermore, higher-frequency stimulation induced a more pronounced activation in soma compared to neuropil, while depression was predominantly induced in soma irrespective of stimulation frequencies. Significance . These results suggest that the mechanism underlying depression differs from activation, requiring ample oxygen supply, and affecting neurons. Our findings provide a novel understanding of evoked excitatory neuronal activity induced by intracortical microstimulation and offer insights into neuro-devices that utilize both activation and depression phenomena to achieve desired neural responses.

Axonal stimulation affects the linear summation of single-point perception in three Argus II users

Purpose

Retinal implants use electrical stimulation to elicit perceived flashes of light ("phosphenes"). Single-electrode phosphene shape has been shown to vary systematically with stimulus parameters and the retinal location of the stimulating electrode, due to incidental activation of passing nerve fiber bundles. However, this knowledge has yet to be extended to paired-electrode stimulation.

Methods

We retrospectively analyzed 3548 phosphene drawings made by three blind participants implanted with an Argus II Retinal Prosthesis. Phosphene shape (characterized by area, perimeter, major and minor axis length) and number of perceived phosphenes were averaged across trials and correlated with the corresponding single-electrode parameters. In addition, the number of phosphenes was correlated with stimulus amplitude and neuroanatomical parameters: electrode-retina and electrode-fovea distance as well as the electrode-electrode distance to ("between-axon") and along axon bundles ("along-axon"). Statistical analyses were conducted using linear regression and partial correlation analysis.

Results

Simple regression revealed that each paired-electrode shape descriptor could be predicted by the sum of the two corresponding single-electrode shape descriptors (p < .001). Multiple regression revealed that paired-electrode phosphene shape was primarily predicted by stimulus amplitude and electrode-fovea distance (p < .05). Interestingly, the number of elicited phosphenes tended to increase with between-axon distance (p < .05), but not with along-axon distance, in two out of three participants.

Conclusions

The shape of phosphenes elicited by paired-electrode stimulation was well predicted by the shape of their corresponding single-electrode phosphenes, suggesting that two-point perception can be expressed as the linear summation of single-point perception. The notable impact of the between-axon distance on the perceived number of phosphenes provides further evidence in support of the axon map model for epiretinal stimulation. These findings contribute to the growing literature on phosphene perception and have important implications for the design of future retinal prostheses.

Assessment of visual function in blind mice and monkeys with subretinally implanted nanowire arrays as artificial photoreceptors

Retinal prostheses could restore image-forming vision in conditions of photoreceptor degeneration. However, contrast sensitivity and visual acuity are often insufficient. Here we report the performance, in mice and monkeys with induced photoreceptor degeneration, of subretinally implanted gold-nanoparticle-coated titania nanowire arrays providing a spatial resolution of 77.5 μm and a temporal resolution of 3.92 Hz in ex vivo retinas (as determined by patch-clamp recording of retinal ganglion cells). In blind mice, the arrays allowed for the detection of drifting gratings and flashing objects at light-intensity thresholds of 15.70-18.09 μW mm-2, and offered visual acuities of 0.3-0.4 cycles per degree, as determined by recordings of visually evoked potentials and optomotor-response tests. In monkeys, the arrays were stable for 54 weeks, allowed for the detection of a 10-μW mm-2 beam of light (0.5° in beam angle) in visually guided saccade experiments, and induced plastic changes in the primary visual cortex, as indicated by long-term in vivo calcium imaging. Nanomaterials as artificial photoreceptors may ameliorate visual deficits in patients with photoreceptor degeneration.

Fabrication of a photo-crosslinkable fluoropolymer-passivated flexible neural probe and acute recording and stimulation performances in vivo

Herein, we fabricated fluorine-containing, polymer-based, flexible neural probes with fluorinated ethylene propylene (FEP) films as the substrates and photo-crosslinkable fluoropolymers as the passivation material. For fabrication, metal-free Au layer formation on the FEP film, the simultaneous photo-adhesion and photo-patterning technique, and the pulsed-laser scanning probe shaping technique were combined, followed by Au electrode surface modification. The resultant probes achieved a charge injection limit equal to 5.18 mC cm-2 by implementing iridium oxide-modified nanoporous Au (IrOx/NPG) structures. We performed simultaneous in vivo micro-stimulations of the Schaffer collateral fibres and recorded the evoked field excitatory postsynaptic potentials (fEPSPs) in the stratum radiatum layer of the hippocampal Cornu Ammonis 1 region using a single probe. Inducing the fEPSP at very low charge per pulse settings (3.2-3.6 nC/pulse) indicates the efficient charge injection capability of the IrOx/NPG electrode, thereby enabling safe, prolonged, and thrifty micro-stimulations. Furthermore, the single probe-induced and recorded long-term potentiation persisted for periods longer than 60 min following theta-burst stimulation. The materials used in this study are all biocompatible and chemically robust. The fabricated neural probes can be applied in chronic clinical trials in vivo.

Optogenetic activation of visual thalamus generates artificial visual percepts

The lateral geniculate nucleus (LGN), a retinotopic relay center where visual inputs from the retina are processed and relayed to the visual cortex, has been proposed as a potential target for artificial vision. At present, it is unknown whether optogenetic LGN stimulation is sufficient to elicit behaviorally relevant percepts, and the properties of LGN neural responses relevant for artificial vision have not been thoroughly characterized. Here, we demonstrate that tree shrews pretrained on a visual detection task can detect optogenetic LGN activation using an AAV2-CamKIIα-ChR2 construct and readily generalize from visual to optogenetic detection. Simultaneous recordings of LGN spiking activity and primary visual cortex (V1) local field potentials (LFPs) during optogenetic LGN stimulation show that LGN neurons reliably follow optogenetic stimulation at frequencies up to 60 Hz and uncovered a striking phase locking between the V1 LFP and the evoked spiking activity in LGN. These phase relationships were maintained over a broad range of LGN stimulation frequencies, up to 80 Hz, with spike field coherence values favoring higher frequencies, indicating the ability to relay temporally precise information to V1 using light activation of the LGN. Finally, V1 LFP responses showed sensitivity values to LGN optogenetic activation that were similar to the animal's behavioral performance. Taken together, our findings confirm the LGN as a potential target for visual prosthetics in a highly visual mammal closely related to primates.

A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision

Objective.We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm.Approach.Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task.Main results.Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task.Significance.The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses.

Attitudes of potential recipients toward emerging visual prosthesis technologies

With the advent of multiple visual prosthesis devices to treat blindness, the question of how potential patients view such interventions becomes important in order to understand the levels of expectation and acceptance, and the perceived risk-reward balance across the different device approaches. Building on previous work on single device approaches done with blind individuals in Chicago and Detroit, USA, Melbourne, Australia, and Bejing, China, we investigated attitudes in blind individuals in Athens, Greece with coverage expanded to three of the contemporary approaches, Retinal, Thalamic, and Cortical. We presented an informational lecture on the approaches, had potential participants fill out a preliminary Questionnaire 1, then organized selected subjects into focus groups for guided discussion on visual prostheses, and finally had these subjects fill out a more detailed Questionnaire 2. We report here the first quantitative data that compares multiple prosthesis approaches. Our primary findings are that for these potential patients, perceived risk continues to outweigh perceived benefits, with the Retinal approach having the least negative overall impression and the Cortical approach the most negative. Concerns about the quality of restored vision were primary. Factors that drove the choice of hypothetical participation in a clinical trial were age and years of blindness. Secondary factors focused on positive clinical outcomes. The focus groups served to swing the impressions of each approach from neutrality toward the extremes of a Likert scale, and shifted the overall willingness to participate in a clinical trial from neutral to negative. These results, coupled with informal assessment of audience questions after the informational lecture, suggest that a substantial improvement in performance over currently available devices will be necessary before visual prostheses gain wide acceptance.

Electrical stimulation thresholds differ between V1 and V2

Cortical visual prostheses are designed to treat blindness by restoring visual perceptions through artificial electrical stimulation of the primary visual cortex (V1). Intracortical microelectrodes produce the smallest visual percepts and thus higher resolution vision - like a higher density of pixels on a monitor. However, intracortical microelectrodes must maintain a minimum spacing to preserve tissue integrity. One solution to increase the density of percepts is to implant and stimulate multiple visual areas, such as V1 and V2, although the properties of microstimulation in V2 remain largely unexplored. We provide a direct comparison of V1 and V2 microstimulation in two common marmoset monkeys. We find similarities in response trends between V1 and V2 but differences in threshold, neural activity duration, and spread of activity at the threshold current. This has implications for using multi-area stimulation to increase the resolution of cortical visual prostheses.

Utilization of brain scans to create realistic phosphene maps for cortical visual prosthesis simulation studies

It has been shown that we can restore sensations of light by stimulating the visual cortex. Cortical prosthetic vision consists of light perception in the visual field named phosphenes. Phosphenes are like pixels on a monitor which we can control to form the desired perception. However, the locations of phosphenes evoked vary between individuals. One of the biggest challenges is how to utilize phosphenes to present recognizable patterns that represent real-world scenes. Because of the difficulties of recruiting participants, and the risks of neurosurgery, researchers have used computer simulations to investigate the outcome of cortical visual prostheses. Previous simulations used regular phosphene maps, which may overestimate the visual ability cortical visual prosthesis can provide. This study aims to develop a more realistic simulation for cortical visual prostheses. We derived realistic phosphene maps using an existing cortical retinotopy dataset and decided implant placement by considering neurosurgery restrictions. We rendered some visual stimuli to evaluate the usability of those phosphene maps. The results indicate that presenting information on phosphenes maps may be more challenging than previously estimated.

Chronic stability of a neuroprosthesis comprising multiple adjacent Utah arrays in monkeys

Objective. Electrical stimulation of visual cortex via a neuroprosthesis induces the perception of dots of light ('phosphenes'), potentially allowing recognition of simple shapes even after decades of blindness. However, restoration of functional vision requires large numbers of electrodes, and chronic, clinical implantation of intracortical electrodes in the visual cortex has only been achieved using devices of up to 96 channels. We evaluated the efficacy and stability of a 1024-channel neuroprosthesis system in non-human primates (NHPs) over more than 3 years to assess its suitability for long-term vision restoration.Approach.We implanted 16 microelectrode arrays (Utah arrays) consisting of 8 × 8 electrodes with iridium oxide tips in the primary visual cortex (V1) and visual area 4 (V4) of two sighted macaques. We monitored the animals' health and measured electrode impedances and neuronal signal quality by calculating signal-to-noise ratios of visually driven neuronal activity, peak-to-peak voltages of the waveforms of action potentials, and the number of channels with high-amplitude signals. We delivered cortical microstimulation and determined the minimum current that could be perceived, monitoring the number of channels that successfully yielded phosphenes. We also examined the influence of the implant on a visual task after 2-3 years of implantation and determined the integrity of the brain tissue with a histological analysis 3-3.5 years post-implantation.Main results. The monkeys remained healthy throughout the implantation period and the device retained its mechanical integrity and electrical conductivity. However, we observed decreasing signal quality with time, declining numbers of phosphene-evoking electrodes, decreases in electrode impedances, and impaired performance on a visual task at visual field locations corresponding to implanted cortical regions. Current thresholds increased with time in one of the two animals. The histological analysis revealed encapsulation of arrays and cortical degeneration. Scanning electron microscopy on one array revealed degradation of IrOxcoating and higher impedances for electrodes with broken tips.Significance. Long-term implantation of a high-channel-count device in NHP visual cortex was accompanied by deformation of cortical tissue and decreased stimulation efficacy and signal quality over time. We conclude that improvements in device biocompatibility and/or refinement of implantation techniques are needed before future clinical use is feasible.

Learning in a sensory cortical microstimulation task is associated with elevated representational stability

Sensory cortical representations can be highly dynamic, raising the question of how representational stability impacts learning. We train mice to discriminate the number of photostimulation pulses delivered to opsin-expressing pyramidal neurons in layer 2/3 of primary vibrissal somatosensory cortex. We simultaneously track evoked neural activity across learning using volumetric two-photon calcium imaging. In well-trained animals, trial-to-trial fluctuations in the amount of photostimulus-evoked activity predicted animal choice. Population activity levels declined rapidly across training, with the most active neurons showing the largest declines in responsiveness. Mice learned at varied rates, with some failing to learn the task in the time provided. The photoresponsive population showed greater instability both within and across behavioral sessions among animals that failed to learn. Animals that failed to learn also exhibited a faster deterioration in stimulus decoding. Thus, greater stability in the stimulus response is associated with learning in a sensory cortical microstimulation task.

Low-threshold, high-resolution, chronically stable intracortical microstimulation by ultraflexible electrodes

Intracortical microstimulation (ICMS) enables applications ranging from neuroprosthetics to causal circuit manipulations. However, the resolution, efficacy, and chronic stability of neuromodulation are often compromised by adverse tissue responses to the indwelling electrodes. Here we engineer ultraflexible stim-nanoelectronic threads (StimNETs) and demonstrate low activation threshold, high resolution, and chronically stable ICMS in awake, behaving mouse models. In vivo two-photon imaging reveals that StimNETs remain seamlessly integrated with the nervous tissue throughout chronic stimulation periods and elicit stable, focal neuronal activation at low currents of 2 μA. Importantly, StimNETs evoke longitudinally stable behavioral responses for over 8 months at a markedly low charge injection of 0.25 nC/phase. Quantified histological analyses show that chronic ICMS by StimNETs induces no neuronal degeneration or glial scarring. These results suggest that tissue-integrated electrodes provide a path for robust, long-lasting, spatially selective neuromodulation at low currents, which lessens risk of tissue damage or exacerbation of off-target side effects.

Emerging Penetrating Neural Electrodes: In Pursuit of Large Scale and Longevity

Penetrating neural electrodes provide a powerful approach to decipher brain circuitry by allowing for time-resolved electrical detections of individual action potentials. This unique capability has contributed tremendously to basic and translational neuroscience, enabling both fundamental understandings of brain functions and applications of human prosthetic devices that restore crucial sensations and movements. However, conventional approaches are limited by the scarce number of available sensing channels and compromised efficacy over long-term implantations. Recording longevity and scalability have become the most sought-after improvements in emerging technologies. In this review, we discuss the technological advances in the past 5-10 years that have enabled larger-scale, more detailed, and longer-lasting recordings of neural circuits at work than ever before. We present snapshots of the latest advances in penetration electrode technology, showcase their applications in animal models and humans, and outline the underlying design principles and considerations to fuel future technological development.

BMI 2.0: Toward a technological interface with brainwide networks

The field of brain machine interface has long sought a technology for brainwide interaction. In this issue of Neuron, Kim et al.1 present a novel method for dynamic, patterned, and precise optogenetic stimulation of mouse cortex in ultra-high-field MRI that portends such an interface.

Human acute microelectrode array recordings with broad cortical access, single-unit resolution, and parallel behavioral monitoring

There are vast gaps in our understanding of the organization and operation of the human nervous system at the level of individual neurons and their networks. Here, we report reliable and robust acute multichannel recordings using planar microelectrode arrays (MEAs) implanted intracortically in awake brain surgery with open craniotomies that grant access to large parts of the cortical hemisphere. We obtained high-quality extracellular neuronal activity at the microcircuit, local field potential level and at the cellular, single-unit level. Recording from the parietal association cortex, a region rarely explored in human single-unit studies, we demonstrate applications on these complementary spatial scales and describe traveling waves of oscillatory activity as well as single-neuron and neuronal population responses during numerical cognition, including operations with uniquely human number symbols. Intraoperative MEA recordings are practicable and can be scaled up to explore cellular and microcircuit mechanisms of a wide range of human brain functions.

Dynamic amplitude modulation of microstimulation evokes biomimetic onset and offset transients and reduces depression of evoked calcium responses in sensory cortices

BACKGROUND

Intracortical microstimulation (ICMS) is an emerging approach to restore sensation to people with neurological injury or disease. Biomimetic microstimulation, or stimulus trains that mimic neural activity in the brain through encoding of onset and offset transients, could improve the utility of ICMS for brain-computer interface (BCI) applications, but how biomimetic microstimulation affects neural activation is not understood. Current "biomimetic" ICMS trains aim to reproduce the strong onset and offset transients evoked in the brain by sensory input through dynamic modulation of stimulus parameters. Stimulus induced depression of neural activity (decreases in evoked intensity over time) is also a potential barrier to clinical implementation of sensory feedback, and dynamic microstimulation may reduce this effect.

OBJECTIVE

We evaluated how bio-inspired ICMS trains with dynamic modulation of amplitude and/or frequency change the calcium response, spatial distribution, and depression of neurons in the somatosensory and visual cortices.

METHODS

Calcium responses of neurons were measured in Layer 2/3 of visual and somatosensory cortices of anesthetized GCaMP6s mice in response to ICMS trains with fixed amplitude and frequency (Fixed) and three dynamic ICMS trains that increased the stimulation intensity during the onset and offset of stimulation by modulating the amplitude (DynAmp), frequency (DynFreq), or amplitude and frequency (DynBoth). ICMS was provided for either 1-s with 4-s breaks (Short) or for 30-s with 15-s breaks (Long).

RESULTS

DynAmp and DynBoth trains evoked distinct onset and offset transients in recruited neural populations, while DynFreq trains evoked population activity similar to Fixed trains. Individual neurons had heterogeneous responses primarily based on how quickly they depressed to ICMS, where neurons farther from the electrode depressed faster and a small subpopulation (1-5%) were modulated by DynFreq trains. Neurons that depressed to Short trains were also more likely to depress to Long trains, but Long trains induced more depression overall due to the increased stimulation length. Increasing the amplitude during the hold phase resulted in an increase in recruitment and intensity which resulted in more depression and reduced offset responses. Dynamic amplitude modulation reduced stimulation induced depression by 14.6 ± 0.3% for Short and 36.1 ± 0.6% for Long trains. Ideal observers were 0.031 ± 0.009 s faster for onset detection and 1.33 ± 0.21 s faster for offset detection with dynamic amplitude encoding.

CONCLUSIONS

Dynamic amplitude modulation evokes distinct onset and offset transients, reduces depression of neural calcium activity, and decreases total charge injection for sensory feedback in BCIs by lowering recruitment of neurons during long maintained periods of ICMS. In contrast, dynamic frequency modulation evokes distinct onset and offset transients in a small subpopulation of neurons but also reduces depression in recruited neurons by reducing the rate of activation.

Multilayer Arrays for Neurotechnology Applications (MANTA): Chronically Stable Thin-Film Intracortical Implants

Flexible implantable neurointerfaces show great promise in addressing one of the major challenges of implantable neurotechnology, namely the loss of signal connected to unfavorable probe tissue interaction. The authors here show how multilayer polyimide probes allow high-density intracortical recordings to be combined with a reliable long-term stable tissue interface, thereby progressing toward chronic stability of implantable neurotechnology. The probes could record 10-60 single units over 5 months with a consistent peak-to-peak voltage at dimensions that ensure robust handling and insulation longevity. Probes that remain in intimate contact with the signaling tissue over months to years are a game changer for neuroscience and, importantly, open up for broader clinical translation of systems relying on neurotechnology to interface the human brain.

Philosophical foundation of the right to mental integrity in the age of neurotechnologies

Neurotechnologies broadly understood are tools that have the capability to read, record and modify our mental activity by acting on its brain correlates. The emergence of increasingly powerful and sophisticated techniques has given rise to the proposal to introduce new rights specifically directed to protect mental privacy, freedom of thought, and mental integrity. These rights, also proposed as basic human rights, are conceived in direct relation to tools that threaten mental privacy, freedom of thought, mental integrity, and personal identity. In this paper, our goal is to give a philosophical foundation to a specific right that we will call right to mental integrity. It encapsulates both the classical concepts of privacy and non-interference in our mind/brain. Such a philosophical foundation refers to certain features of the mind that hitherto could not be reached directly from the outside: intentionality, first-person perspective, personal autonomy in moral choices and in the construction of one's narrative, and relational identity. A variety of neurotechnologies or other tools, including artificial intelligence, alone or in combination can, by their very availability, threaten our mental integrity. Therefore, it is necessary to posit a specific right and provide it with a theoretical foundation and justification. It will be up to a subsequent treatment to define the moral and legal boundaries of such a right and its application.

Low-threshold, high-resolution, chronically stable intracortical microstimulation by ultraflexible electrodes

Intracortical microstimulation (ICMS) enables applications ranging from neuroprosthetics to causal circuit manipulations. However, the resolution, efficacy, and chronic stability of neuromodulation is often compromised by the adverse tissue responses to the indwelling electrodes. Here we engineer ultraflexible stim-Nanoelectronic Threads (StimNETs) and demonstrate low activation threshold, high resolution, and chronically stable ICMS in awake, behaving mouse models. In vivo two-photon imaging reveals that StimNETs remain seamlessly integrated with the nervous tissue throughout chronic stimulation periods and elicit stable, focal neuronal activation at low currents of 2 μA. Importantly, StimNETs evoke longitudinally stable behavioral responses for over eight months at markedly low charge injection of 0.25 nC/phase. Quantified histological analysis show that chronic ICMS by StimNETs induce no neuronal degeneration or glial scarring. These results suggest that tissue-integrated electrodes provide a path for robust, long-lasting, spatially-selective neuromodulation at low currents which lessen risks of tissue damage or exacerbation of off-target side-effects.

Future regenerative medicine developments and their therapeutic applications

Although the currently available pharmacological assays can cure most pathological disorders, they have limited therapeutic value in relieving certain disorders like myocardial infarct, peripheral vascular disease, amputated limbs, or organ failure (e.g. renal failure). Pilot studies to overcome such problems using regenerative medicine (RM) delivered promising data. Comprehensive investigations of RM in zebrafish or reptilians are necessary for better understanding. However, the precise mechanisms remain poorly understood despite the tremendous amount of data obtained using the zebrafish model investigating the exact mechanisms behind their regenerative capability. Indeed, understanding such mechanisms and their application to humans can save millions of lives from dying due to potentially life-threatening events. Recent studies have launched a revolution in replacing damaged human organs via different approaches in the last few decades. The newly established branch of medicine (known as Regenerative Medicine aims to enhance natural repair mechanisms. This can be done through the application of several advanced broad-spectrum technologies such as organ transplantation, tissue engineering, and application of Scaffolds technology (support vascularization using an extracellular matrix), stem cell therapy, miRNA treatment, development of 3D mini-organs (organoids), and the construction of artificial tissues using nanomedicine and 3D bio-printers. Moreover, in the next few decades, revolutionary approaches in regenerative medicine will be applied based on artificial intelligence and wireless data exchange, soft intelligence biomaterials, nanorobotics, and even living robotics capable of self-repair. The present work presents a comprehensive overview that summarizes the new and future advances in the field of RM.

Nanomaterial-based microelectrode arrays for in vitro bidirectional brain-computer interfaces: a review

A bidirectional in vitro brain-computer interface (BCI) directly connects isolated brain cells with the surrounding environment, reads neural signals and inputs modulatory instructions. As a noninvasive BCI, it has clear advantages in understanding and exploiting advanced brain function due to the simplified structure and high controllability of ex vivo neural networks. However, the core of ex vivo BCIs, microelectrode arrays (MEAs), urgently need improvements in the strength of signal detection, precision of neural modulation and biocompatibility. Notably, nanomaterial-based MEAs cater to all the requirements by converging the multilevel neural signals and simultaneously applying stimuli at an excellent spatiotemporal resolution, as well as supporting long-term cultivation of neurons. This is enabled by the advantageous electrochemical characteristics of nanomaterials, such as their active atomic reactivity and outstanding charge conduction efficiency, improving the performance of MEAs. Here, we review the fabrication of nanomaterial-based MEAs applied to bidirectional in vitro BCIs from an interdisciplinary perspective. We also consider the decoding and coding of neural activity through the interface and highlight the various usages of MEAs coupled with the dissociated neural cultures to benefit future developments of BCIs.

Modulating Brain Activity with Invasive Brain-Computer Interface: A Narrative Review

Brain-computer interface (BCI) can be used as a real-time bidirectional information gateway between the brain and machines. In particular, rapid progress in invasive BCI, propelled by recent developments in electrode materials, miniature and power-efficient electronics, and neural signal decoding technologies has attracted wide attention. In this review, we first introduce the concepts of neuronal signal decoding and encoding that are fundamental for information exchanges in BCI. Then, we review the history and recent advances in invasive BCI, particularly through studies using neural signals for controlling external devices on one hand, and modulating brain activity on the other hand. Specifically, regarding modulating brain activity, we focus on two types of techniques, applying electrical stimulation to cortical and deep brain tissues, respectively. Finally, we discuss the related ethical issues concerning the clinical application of this emerging technology.

Transcranial Nongenetic Neuromodulation via Bioinspired Vesicle-Enabled Precise NIR-II Optical Stimulation

Regulating the activity of specific neurons is essentially important in neurocircuit dissection and neuropathy therapy. As a recently developed strategy, nanomaterial-enabled nongenetic neuromodulations that realize remote physical stimuli have made vast progress and shown great clinical potential. However, minimal invasiveness and high spatiotemporal resolution are still challenging for nongenetic neuromodulation. Herein, a second near-infrared (NIR-II)-light-induced transcranial nongenetic neurostimulation via bioinspired nanovesicles is reported. The rationally designed vesicles are obtained from vesicle-membrane-confined enzymatic reactions. This study demonstrates that the vesicle-enabled NIR-II photothermal stimuli can elicit neuronal signaling dynamics with precise spatiotemporal control and thus evoke defined neural circuits in nontransgenic mice. Moreover, the vesicle-mediated NIR-II optical stimulation can regulate mouse motor behaviors with minimal invasiveness by eliminating light-emitting implants. Furthermore, the biological modulation is integrated with photoacoustic brain imaging, realizing navigational, and efficient neuromodulation. Such transcranial and precise NIR-II optical neuromodulation mediated by bioinspired vesicles shows the potential for the optical-theranostics of neurological diseases in nontransgenic organisms.

Learning in a closed-loop brain-machine interface with distributed optogenetic cortical feedback

Objective.Distributed microstimulations at the cortical surface can efficiently deliver feedback to a subject during the manipulation of a prosthesis through a brain-machine interface (BMI). Such feedback can convey vast amounts of information to the prosthesis user and may be key to obtain an accurate control and embodiment of the prosthesis. However, so far little is known of the physiological constraints on the decoding of such patterns. Here, we aimed to test a rotary optogenetic feedback that was designed to encode efficiently the 360° movements of the robotic actuators used in prosthetics. We sought to assess its use by mice that controlled a prosthesis joint through a closed-loop BMI.Approach.We tested the ability of mice to optimize the trajectory of a virtual prosthesis joint in order to solve a rewarded reaching task. They could control the speed of the joint by modulating the activity of individual neurons in the primary motor cortex. During the task, the patterned optogenetic stimulation projected on the primary somatosensory cortex continuously delivered information to the mouse about the position of the joint.Main results.We showed that mice are able to exploit the continuous, rotating cortical feedback in the active behaving context of the task. Mice achieved better control than in the absence of feedback by detecting reward opportunities more often, and also by moving the joint faster towards the reward angular zone, and by maintaining it longer in the reward zone. Mice controlling acceleration rather than speed of the joint failed to improve motor control.Significance.These findings suggest that in the context of a closed-loop BMI, distributed cortical feedback with optimized shapes and topology can be exploited to control movement. Our study has direct applications on the closed-loop control of rotary joints that are frequently encountered in robotic prostheses.

Microscale multicircuit brain stimulation: Achieving real-time brain state control for novel applications

Neurological and psychiatric disorders typically result from dysfunction across multiple neural circuits. Most of these disorders lack a satisfactory neuromodulation treatment. However, deep brain stimulation (DBS) has been successful in a limited number of disorders; DBS typically targets one or two brain areas with single contacts on relatively large electrodes, allowing for only coarse modulation of circuit function. Because of the dysfunction in distributed neural circuits - each requiring fine, tailored modulation - that characterizes most neuropsychiatric disorders, this approach holds limited promise. To develop the next generation of neuromodulation therapies, we will have to achieve fine-grained, closed-loop control over multiple neural circuits. Recent work has demonstrated spatial and frequency selectivity using microstimulation with many small, closely-spaced contacts, mimicking endogenous neural dynamics. Using custom electrode design and stimulation parameters, it should be possible to achieve bidirectional control over behavioral outcomes, such as increasing or decreasing arousal during central thalamic stimulation. Here, we discuss one possible approach, which we term microscale multicircuit brain stimulation (MMBS). We discuss how machine learning leverages behavioral and neural data to find optimal stimulation parameters across multiple contacts, to drive the brain towards desired states associated with behavioral goals. We expound a mathematical framework for MMBS, where behavioral and neural responses adjust the model in real-time, allowing us to adjust stimulation in real-time. These technologies will be critical to the development of the next generation of neurostimulation therapies, which will allow us to treat problems like disorders of consciousness and cognition.

Thin flexible arrays for long-term multi-electrode recordings in macaque primary visual cortex

Objective.Basic, translational and clinical neuroscience are increasingly focusing on large-scale invasive recordings of neuronal activity. However, in large animals such as nonhuman primates and humans-in which the larger brain size with sulci and gyri imposes additional challenges compared to rodents, there is a huge unmet need to record from hundreds of neurons simultaneously anywhere in the brain for long periods of time. Here, we tested the electrical and mechanical properties of thin, flexible multi-electrode arrays (MEAs) inserted into the primary visual cortex of two macaque monkeys, and assessed their magnetic resonance imaging (MRI) compatibility and their capacity to record extracellular activity over a period of 1 year.Approach.To allow insertion of the floating arrays into the visual cortex, the 20 by 100µm²shafts were temporarily strengthened by means of a resorbable poly(lactic-co-glycolic acid) coating.Main results. After manual insertion of the arrays, theex vivoandin vivoMRI compatibility of the arrays proved to be excellent. We recorded clear single-unit activity from up to 50% of the electrodes, and multi-unit activity (MUA) on 60%-100% of the electrodes, which allowed detailed measurements of the receptive fields and the orientation selectivity of the neurons. Even 1 year after insertion, we obtained significant MUA responses on 70%-100% of the electrodes, while the receptive fields remained remarkably stable over the entire recording period.Significance.Thus, the thin and flexible MEAs we tested offer several crucial advantages compared to existing arrays, most notably in terms of brain tissue compliance, scalability, and brain coverage. Future brain-machine interface applications in humans may strongly benefit from this new generation of chronically implanted MEAs.

Visualizing advances in the future of primate neuroscience research

Future neuroscience and biomedical projects involving non-human primates (NHPs) remain essential in our endeavors to understand the complexities and functioning of the mammalian central nervous system. In so doing, the NHP neuroscience researcher must be allowed to incorporate state-of-the-art technologies, including the use of novel viral vectors, gene therapy and transgenic approaches to answer continuing and emerging research questions that can only be addressed in NHP research models. This perspective piece captures these emerging technologies and some specific research questions they can address. At the same time, we highlight some current caveats to global NHP research and collaborations including the lack of common ethical and regulatory frameworks for NHP research, the limitations involving animal transportation and exports, and the ongoing influence of activist groups opposed to NHP research.

Toward a personalized closed-loop stimulation of the visual cortex: Advances and challenges

Current cortical visual prosthesis approaches are primarily unidirectional and do not consider the feed-back circuits that exist in just about every part of the nervous system. Herein, we provide a brief overview of some recent developments for better controlling brain stimulation and present preliminary human data indicating that closed-loop strategies could considerably enhance the effectiveness, safety, and long-term stability of visual cortex stimulation. We propose that the development of improved closed-loop strategies may help to enhance our capacity to communicate with the brain.

Restored vision-augmented vision: arguments for a cybernetic vision

In this paper, we present some thoughts about the recent developments, made possible by technological advances and miniaturisation of connected visual prostheses, linked to the visual system, operating at different level of this one, on the retina as well as in the visual cortex. While these objects represent a great hope for people with impaired vision to recover partial vision, we show how this technology could also act on the functional vision of well sighted persons to improve or increase their visual performance. In addition to the impact on our cognitive and attentional mechanisms, such an operation when it originates outside the natural real visual field (e.g. cybernetics) raises a number of questions about the development and use of such implants or prostheses in the future.

Towards aSmart Bionic Eye: AI-powered artificial vision for the treatment of incurable blindness

Objective.How can we return a functional form of sight to people who are living with incurable blindness? Despite recent advances in the development of visual neuroprostheses, the quality of current prosthetic vision is still rudimentary and does not differ much across different device technologies.Approach.Rather than aiming to represent the visual scene as naturally as possible, aSmart Bionic Eyecould provide visual augmentations through the means of artificial intelligence-based scene understanding, tailored to specific real-world tasks that are known to affect the quality of life of people who are blind, such as face recognition, outdoor navigation, and self-care.Main results.Complementary to existing research aiming to restore natural vision, we propose a patient-centered approach to incorporate deep learning-based visual augmentations into the next generation of devices.Significance.The ability of a visual prosthesis to support everyday tasks might make the difference between abandoned technology and a widely adopted next-generation neuroprosthetic device.

An Energy-Efficient and High-Data-Rate IR-UWB Transmitter for Intracortical Neural Sensing Interfaces

This paper presents an implantable impulse-radio ultra-wideband (IR-UWB) wireless telemetry system for intracortical neural sensing interfaces. A 3-dimensional (3-D) hybrid impulse modulation that comprises phase shift keying (PSK), pulse position modulation (PPM) and pulse amplitude modulation (PAM) is proposed to increase modulation order without significantly increasing the demodulation requirement, thus leading to a high data rate of 1.66 Gbps and an increased air-transmission range. Operating in 6 - 9 GHz UWB band, the presented transmitter (TX) supports the proposed hybrid modulation with a high energy efficiency of 5.8 pJ/bit and modulation quality (EVM< -21 dB). A low-noise injection-locked ring oscillator supports 8-PSK with a phase error of 2.6°. A calibration free delay generator realizes a 4-PPM with only 115 μW and avoids potential cross-modulation between PPM and PSK. A switch-cap power amplifier with an asynchronous pulse-shaping performs 4-PAM with high energy efficiency and linearity. The TX is implemented in 28 nm CMOS technology, occupying 0.155mm² core area. The wireless module including a printed monopole antenna has a module area of only 1.05 cm². The transmitter consumes in total 9.7 mW when transmitting -41.3 dBm/MHz output power. The wireless telemetry module has been validated ex-vivo with a 15-mm multi-layer porcine tissue, and achieves a communication (air) distance up to 15 cm, leading to at least 16× improvement in distance-moralized energy efficiency of 45 pJ/bit/meter compared to state-of-the-art.

Ultrasound Retinal Stimulation: A Mini-Review of Recent Developments

Ultrasound neuromodulation is an emerging technology. A significant amount of effort has been devoted to investigating the feasibility of noninvasive ultrasound retinal stimulation. Recent studies have shown that ultrasound can activate neurons in healthy and degenerated retinas. Specifically, high-frequency ultrasound can evoke localized neuron responses and generate patterns in visual circuits. In this review, we recapitulate pilot studies on ultrasound retinal stimulation, compare it with other neuromodulation technologies, and discuss its advantages and limitations. An overview of the opportunities and challenges to develop a noninvasive retinal prosthesis using high-frequency ultrasound is also provided.

Identification of visual cortex cell types and species differences using single-cell RNA sequencing

The primate neocortex exerts high cognitive ability and strong information processing capacity. Here, we establish a single-cell RNA sequencing dataset of 133,454 macaque visual cortical cells. It covers major cortical cell classes including 25 excitatory neuron types, 37 inhibitory neuron types and all glial cell types. We identified layer-specific markers including HPCAL1 and NXPH4, and also identified two cell types, an NPY-expressing excitatory neuron type that expresses the dopamine receptor D3 gene; and a primate specific activity-dependent OSTN + sensory neuron type. Comparisons of our dataset with humans and mice show that the gene expression profiles differ between species in relation to genes that are implicated in the synaptic plasticity and neuromodulation of excitatory neurons. The comparisons also revealed that glutamatergic neurons may be more diverse across species than GABAergic neurons and non-neuronal cells. These findings pave the way for understanding how the primary cortex fulfills the high-cognitive functions.

Implications of Neural Plasticity in Retinal Prosthesis

Retinal degenerative diseases such as retinitis pigmentosa cause a progressive loss of photoreceptors that eventually prevents the affected person from perceiving visual sensations. The absence of a visual input produces a neural rewiring cascade that propagates along the visual system. This remodeling occurs first within the retina. Then, subsequent neuroplastic changes take place at higher visual centers in the brain, produced by either the abnormal neural encoding of the visual inputs delivered by the diseased retina or as the result of an adaptation to visual deprivation. While retinal implants can activate the surviving retinal neurons by delivering electric current, the unselective activation patterns of the different neural populations that exist in the retinal layers differ substantially from those in physiologic vision. Therefore, artificially induced neural patterns are being delivered to a brain that has already undergone important neural reconnections. Whether or not the modulation of this neural rewiring can improve the performance for retinal prostheses remains a critical question whose answer may be the enabler of improved functional artificial vision and more personalized neurorehabilitation strategies.

Significantly improved cell affinity of polydimethylsiloxane enabled by a surface-modified strategy with chemical coupling

Polydimethylsiloxane (PDMS) is a commonly used insulation/packaging material for implantable neural electrodes. Nevertheless, the PDMS-initiated tissue response would lead to the deterioration of the electrode performances post-implantation, owing to its intrinsic hydrophobic and cell-repellent surface. The conventional physical coatings by hydrophilic hydrogels or bioactive molecules are unable to maintain during the long-term implantation due to their low stability by physical adhesion. In this work, we first anchor both hydrophilic polyethylene glycol (PEG) and bioactive molecule poly-L-lysine (PLL) on the PDMS surface by chemical coupling to change the PDMS surface from hydrophobic and cell-repellent to hydrophilic and cell-adhesive. XPS tests indicate the chemically coupled modification layers are stable on the PDMS surface after experiencing a harsh rinse process. Contact angle measurements show that the use of PEG 600 with the moderate molecular weight results in the highest hydrophilicity for the resulting PDMS-PEG-PLL. PC12 cell evaluation results exhibit that the PDMS-PEG-PLL with PEG 600 leads to significantly larger cell adhesion area, more neurite number, and longer neurite length than the PDMS. The PDMS-PEG-PLL with PEG 600 featuring stable modification layers, high hydrophilicity, and superior cell affinity has great potential in stabilizing the neural electrode-tissue interface for the long-term implantation. Graphical abstract.

Multichannel stimulation module as a tool for animal studies on cortical neural prostheses

Intracortical microstimulation to the visual cortex is thought to be a feasible technique for inducing localized phosphenes in patients with acquired blindness, and thereby for visual prosthesis. In order to design effective stimuli for the prosthesis, it is important to elucidate relationships between the spatio-temporal patterns of stimuli and the resulting neural responses and phosphenes through pre-clinical animal studies. However, the physiological basis of effective spatial patterns of the stimuli for the prosthesis has been little investigated in the literature, at least partly because that the previously developed multi-channel stimulation systems were designed specifically for the clinical use. In the present, a 64-channel stimulation module was developed as a scalable tool for animal experiments. The operations of the module were verified by not only dry-bench tests but also physiological animal experiments in vivo. The results demonstrated its usefulness for examining the stimulus-response relationships in a quantitative manner, and for inducing the multi-site neural excitations with a multi-electrode array. In addition, this stimulation module could be used to generate spatially patterned stimuli with up to 4,096 channels in a dynamic way, in which the stimulus patterns can be updated at a certain frame rate in accordance with the incoming visual scene. The present study demonstrated that our stimulation module is applicable to the physiological and other future studies in animals on the cortical prostheses.

Phosphene Attributes Depend on Frequency and Intensity of Retinal tACS

Phosphene is the experience of light without natural visual stimulation. It can be induced by electrical stimulation of the retina, optic nerve or cortex. Induction of phosphenes can be potentially used in assistive devices for the blind. Analysis of phosphene might be beneficial for practical reasons such as adjustment of transcranial alternating current stimulation (tACS) frequency and intensity to eliminate phosphene perception (e.g., tACS studies using verum tACS group and sham group) or, on the contrary, to maximize perception of phosphenes in order to be more able to study their dynamics. In this study, subjective reports of 50 healthy subjects exposed to different intensities of retinal tACS at 4 different frequencies (6, 10, 20 and 40 Hz) were analyzed. The effectiveness of different tACS frequencies in inducing phosphenes was at least 92 %. Subject reported 41 different phosphene types; the most common were light flashes and light circles. Changing the intensity of stimulation often induced a change in phosphene attributes. Up to nine phosphene attributes changed when the tACS intensity was changed. Significant positive correlation was observed between number of a different phosphene types and tACS frequency. Based on these findings, it can be concluded that tACS is effective in eliciting phosphenes whose type and attributes change depending on the frequency and intensity of tACS. The presented results open new questions for future research.

Clinical Progress and Optimization of Information Processing in Artificial Visual Prostheses

Visual prostheses, used to assist in restoring functional vision to the visually impaired, convert captured external images into corresponding electrical stimulation patterns that are stimulated by implanted microelectrodes to induce phosphenes and eventually visual perception. Detecting and providing useful visual information to the prosthesis wearer under limited artificial vision has been an important concern in the field of visual prosthesis. Along with the development of prosthetic device design and stimulus encoding methods, researchers have explored the possibility of the application of computer vision by simulating visual perception under prosthetic vision. Effective image processing in computer vision is performed to optimize artificial visual information and improve the ability to restore various important visual functions in implant recipients, allowing them to better achieve their daily demands. This paper first reviews the recent clinical implantation of different types of visual prostheses, summarizes the artificial visual perception of implant recipients, and especially focuses on its irregularities, such as dropout and distorted phosphenes. Then, the important aspects of computer vision in the optimization of visual information processing are reviewed, and the possibilities and shortcomings of these solutions are discussed. Ultimately, the development direction and emphasis issues for improving the performance of visual prosthesis devices are summarized.