Entropy of Badminton Strike Positions

The aim of the current study was twofold: (i) to investigate the distribution of the strike positions of badminton players while quantifying the corresponding standard entropy and using an alternative metric (spatial entropy) related to winning and losing points and random positions; and (ii) to evaluate the standard entropy of the receiving positions. With the datasets of 259 badminton matches, we focused on the positions of players’ strokes and the outcome of each point. First, we identified those regions of the court from which hits were most likely to be struck. Second, we computed the standard entropy of stroke positions, and then the spatial entropy, which also considers the order and clustering of the hitting locations in a two-dimensional Euclidean space. Both entropy quantifiers revealed high uncertainty in the striking position; however, specific court locations (i.e., the four corners) are preferred over the rest. When the outcome of each point was taken into account, we observed that the hitting patterns with lower entropy were associated with higher probabilities of winning points. On the contrary, players striking from more random positions were more prone to losing the points.

Semiotic Aggregation in Deep Learning

Convolutional neural networks utilize a hierarchy of neural network layers. The statistical aspects of information concentration in successive layers can bring an insight into the feature abstraction process. We analyze the saliency maps of these layers from the perspective of semiotics, also known as the study of signs and sign-using behavior. In computational semiotics, this aggregation operation (known as superization) is accompanied by a decrease of spatial entropy: signs are aggregated into supersign. Using spatial entropy, we compute the information content of the saliency maps and study the superization processes which take place between successive layers of the network. In our experiments, we visualize the superization process and show how the obtained knowledge can be used to explain the neural decision model. In addition, we attempt to optimize the architecture of the neural model employing a semiotic greedy technique. To the extent of our knowledge, this is the first application of computational semiotics in the analysis and interpretation of deep neural networks.

Spatial and Temporal Entropies in the Spanish Football League: A Network Science Perspective

We quantified the spatial and temporal entropy related to football teams and their players by means of a pass-based interaction. First, we calculated the spatial entropy associated to the positions of all passes made by a football team during a match, obtaining a spatial entropy ranking of Spanish teams during the 2017/2018 season. Second, we investigated how the player’s average location in the field is related to the amount of entropy of his passes. Next, we constructed the temporal passing networks of each team and computed the deviation of their network parameters along the match. For each network parameter, we obtained the permutation entropy and the statistical complexity of its temporal fluctuations. Finally, we investigated how the permutation entropy (and statistical complexity) of the network parameters was related to the total number of passes made by a football team. Our results show that (i) spatial entropy changes according to the position of players in the field, and (ii) the organization of passing networks change during a match and its evolution can be captured measuring the permutation entropy and statistical complexity of the network parameters, allowing to identify what parameters evolve more randomly.

Astrocytic Coverage of Dendritic Spines, Dendritic Shafts, and Axonal Boutons in Hippocampal Neuropil

Distal astrocytic processes have a complex morphology, reminiscent of branchlets and leaflets. Astrocytic branchlets are rod-like processes containing mitochondria and endoplasmic reticulum, capable of generating inositol-3-phosphate (IP₃)-dependent Ca²⁺ signals. Leaflets are small and flat processes that protrude from branchlets and fill the space between synapses. Here we use three-dimensional (3D) reconstructions from serial section electron microscopy (EM) of rat CA1 hippocampal neuropil to determine the astrocytic coverage of dendritic spines, shafts and axonal boutons. The distance to the maximum of the astrocyte volume fraction (VF) correlated with the size of the spine when calculated from the center of mass of the postsynaptic density (PSD) or from the edge of the PSD, but not from the spine surface. This suggests that the astrocytic coverage of small and larger spines is similar in hippocampal neuropil. Diffusion simulations showed that such synaptic microenvironment favors glutamate spillover and extrasynaptic receptor activation at smaller spines. We used complexity and entropy measures to characterize astrocytic branchlets and leaflets. The 2D projections of astrocytic branchlets had smaller spatial complexity and entropy than leaflets, consistent with the higher structural complexity and less organized distribution of leaflets. The VF of astrocytic leaflets was highest around dendritic spines, lower around axonal boutons and lowest around dendritic shafts. In contrast, the VF of astrocytic branchlets was similarly low around these three neuronal compartments. Taken together, these results suggest that astrocytic leaflets preferentially contact synapses as opposed to the dendritic shaft, an arrangement that might favor neurotransmitter spillover and extrasynaptic receptor activation along dendritic shafts.

Astrocytic Atrophy Following Status Epilepticus Parallels Reduced Ca2+ Activity and Impaired Synaptic Plasticity in the Rat Hippocampus

Epilepsy is a group of neurological disorders commonly associated with the neuronal malfunction leading to generation of seizures. Recent reports point to a possible contribution of astrocytes into this pathology. We used the lithium-pilocarpine model of status epilepticus (SE) in rats to monitor changes in astrocytes. Experiments were performed in acute hippocampal slices 2-4 weeks after SE induction. Nissl staining revealed significant neurodegeneration in the pyramidal cell layers of hippocampal CA1, CA3 areas, and the hilus, but not in the granular cell layer of the dentate gyrus. A significant increase in the density of astrocytes stained with an astrocyte-specific marker, sulforhodamine 101, was observed in CA1 stratum (str.) radiatum. Astrocytes in this area were also whole-cell loaded with a morphological tracer, Alexa Fluor 594, for two-photon excitation imaging. Sholl analyses showed no changes in the size of the astrocytic domain or in the number of primary astrocytic branches, but a significant reduction in the number of distal branches that are resolved with diffraction-limited light microscopy (and are thought to contain Ca2+ stores, such as mitochondria and endoplasmic reticulum). The atrophy of astrocytic branches correlated with the reduced size, but not overall frequency of Ca2+ events. The volume tissue fraction of nanoscopic (beyond the diffraction limit) astrocytic leaflets showed no difference between control and SE animals. The results of spatial entropy-complexity spectrum analysis were also consistent with changes in ratio of astrocytic branches vs. leaflets. In addition, we observed uncoupling of astrocytes through the gap-junctions, which was suggested as a mechanism for reduced K+ buffering. However, no significant difference in time-course of synaptically induced K+ currents in patch-clamped astrocytes argued against possible alterations in K+ clearance by astrocytes. The magnitude of long-term-potentiation (LTP) was reduced after SE. Exogenous D-serine, a co-agonist of NMDA receptors, has rescued the initial phase of LTP. This suggests that the reduced Ca2+-dependent release of D-serine by astrocytes impairs initiation of synaptic plasticity. However, it does not explain the failure of LTP maintenance which may be responsible for cognitive decline associated with epilepsy.

Spatial Mutual Information as Similarity Measure for 3-D Brain Image Registration

Information theoretic-based similarity measures, in particular mutual information, are widely used for intermodal/intersubject 3-D brain image registration. However, conventional mutual information does not consider spatial dependency between adjacent voxels in images, thus reducing its efficacy as a similarity measure in image registration. This paper first presents a review of the existing attempts to incorporate spatial dependency into the computation of mutual information (MI). Then, a recently introduced spatially dependent similarity measure, named spatial MI, is extended to 3-D brain image registration. This extension also eliminates its artifact for translational misregistration. Finally, the effectiveness of the proposed 3-D spatial MI as a similarity measure is compared with three existing MI measures by applying controlled levels of noise degradation to 3-D simulated brain images.

Thermodynamic and Differential Entropy under a Change of Variables

The differential Shannon entropy of information theory can change under a change of variables (coordinates), but the thermodynamic entropy of a physical system must be invariant under such a change. This difference is puzzling, because the Shannon and Gibbs entropies have the same functional form. We show that a canonical change of variables can, indeed, alter the spatial component of the thermodynamic entropy just as it alters the differential Shannon entropy. However, there is also a momentum part of the entropy, which turns out to undergo an equal and opposite change when the coordinates are transformed, so that the total thermodynamic entropy remains invariant. We furthermore show how one may correctly write the change in total entropy for an isothermal physical process in any set of spatial coordinates.