Information entropy, information distances, and complexity in atoms

Information theoretic measures for interacting bosons in optical lattice

This work reports the different information theoretic measures, i.e., Shannon information entropy, order, disorder, complexity, and their dynamical measure for the interacting bosons in an optical lattice with both commensurate and incommensurate filling factor. We solve the many-body Schrödinger equation from first principles by multiconfigurational time-dependent Hartree method which calculates all the measures with high level of accuracy. We find for both relaxed state as well as quenched state the López-Ruiz-Mancini-Calbet (LMC) measure of complexity is the most efficient depictor of superfluid (SF) to Mott-insulator transition. In the quench dynamics, the distinct structure of LMC complexity can be used as a "figure of merit" to obtain the timescale of SF to Mott state entry, Mott holding time, and the Mott state to SF state entry in the successive cycles. We also find that fluctuations in the dynamics of LMC complexity measure for incommensurate filling clearly establish that superfluid to Mott-insulator transition is incomplete. We overall conclude that distinct structure in the complexity makes it more sensitive than the standard use of Shannon information entropy.

α-Geodesical Skew Divergence

The asymmetric skew divergence smooths one of the distributions by mixing it, to a degree determined by the parameter λ, with the other distribution. Such divergence is an approximation of the KL divergence that does not require the target distribution to be absolutely continuous with respect to the source distribution. In this paper, an information geometric generalization of the skew divergence called the α-geodesical skew divergence is proposed, and its properties are studied.

Statistics and Machine Learning Experiments in English and Romanian Poetry

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

Statistics and Machine Learning Experiments in English and Romanian Poetry

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

On a Generalization of the Jensen-Shannon Divergence and the Jensen-Shannon Centroid

The Jensen–Shannon divergence is a renown bounded symmetrization of the Kullback–Leibler divergence which does not require probability densities to have matching supports. In this paper, we introduce a vector-skew generalization of the scalar α-Jensen–Bregman divergences and derive thereof the vector-skew α-Jensen–Shannon divergences. We prove that the vector-skew α-Jensen–Shannon divergences are f-divergences and study the properties of these novel divergences. Finally, we report an iterative algorithm to numerically compute the Jensen–Shannon-type centroids for a set of probability densities belonging to a mixture family: This includes the case of the Jensen–Shannon centroid of a set of categorical distributions or normalized histograms.

Shannon, Rényi, Tsallis Entropies and Onicescu Information Energy for Low-Lying Singly Excited States of Helium

Knowledge of the electronic structures of atomic and molecular systems deepens our understanding of the desired system. In particular, several information-theoretic quantities, such as Shannon entropy, have been applied to quantify the extent of electron delocalization for the ground state of various systems. To explore excited states, we calculated Shannon entropy and two of its one-parameter generalizations, Rényi entropy of order α and Tsallis entropy of order α , and Onicescu Information Energy of order α for four low-lying singly excited states (1s2s 1 S e , 1s2s 3 S e , 1s3s 1 S e , and 1s3s 3 S e states) of helium. This paper compares the behavior of these three quantities of order 0.5 to 9 for the ground and four excited states. We found that, generally, a higher excited state had a larger Rényi entropy, larger Tsallis entropy, and smaller Onicescu information energy. However, this trend was not definite and the singlet–triplet reversal occurred for Rényi entropy, Tsallis entropy and Onicescu information energy at a certain range of order α .

Link between generalized nonidempotency and complexity measures

The nonidempotency measure of Löwdin is found to be proportional to the disequilibrium. It is shown that there exists a simple relationship between the LMC (López-Ruiz-Mancini-Calbet) and the generalized statistical complexities and the generalized nonidempotency measure of Löwdin. Results are illustrated for an exactly solvable two-electron model atom.

Predominant information quality scheme for the essential amino acids: an information-theoretical analysis

In this work we undertake a pioneer information-theoretical analysis of 18 selected amino acids extracted from a natural protein, bacteriorhodopsin (1C3W). The conformational structures of each amino acid are analyzed by use of various quantum chemistry methodologies at high levels of theory: HF, M062X and CISD(Full). The Shannon entropy, Fisher information and disequilibrium are determined to grasp the spatial spreading features of delocalizability, order and uniformity of the optimized structures. These three entropic measures uniquely characterize all amino acids through a predominant information-theoretic quality scheme (PIQS), which gathers all chemical families by means of three major spreading features: delocalization, narrowness and uniformity. This scheme recognizes four major chemical families: aliphatic (delocalized), aromatic (delocalized), electro-attractive (narrowed) and tiny (uniform). All chemical families recognized by the existing energy-based classifications are embraced by this entropic scheme. Finally, novel chemical patterns are shown in the information planes associated with the PIQS entropic measures.

Complexity measure and quantum shape-phase transitions in the two-dimensional limit of the vibron model

We obtain a characterization of quantum shape-phase transitions in the terms of complexity measures in the two-dimensional limit of the vibron model based on the spectrum generating algebra U(3). Complexity measures (in terms of the Rényi entropies) have been calculated for different values of the control parameter for the ground state of this model giving sharp signatures of the quantum shape-phase transition from linear to bent molecules.

Controlling the shannon entropy of quantum systems

This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking.

Generalized complexity measures and chaotic maps

The logistic and Tinkerbell maps are studied with the recently introduced generalized complexity measure. The generalized complexity detects periodic windows. Moreover, it recognizes the intersection of periodic branches of the bifurcation diagram. It also reflects the fractal character of the chaotic dynamics. There are cases where the complexity plot shows changes that cannot be seen in the bifurcation diagram.

Statistical measure of complexity and correlated behavior of Fermi systems

We apply the statistical measure of complexity, introduced by López-Ruiz, Mancini, and Calbet (LMC), to uniform Fermi systems. We investigate the connection between information and complexity measures with the strongly correlated behavior of various Fermi systems as nuclear matter, electron gas, and liquid helium. We examine the possibility that LMC complexity can serve as an index quantifying correlations in the specific system and to which extent could be related with experimental quantities. Moreover, we concentrate on thermal effects on the complexity of ideal Fermi systems. We find that complexity behaves, both at low and high values of temperature, in a similar way as the specific heat.

Information entropies for eigendensities of homogeneous potentials

For homogeneous potentials, the sum S(T), of position and momentum Shannon information entropies Sr and Sp is shown to be independent of the coupling strength scaling. The other commonly used uncertainty like products also follow similar behavior. The ramifications of this scaling property in the cases of hydrogenlike, harmonic oscillator, Morse, and Poeschl-Teller potentials are discussed with the example of S(T).

Mutual information and electron correlation in momentum space

Mutual information and information entropies in momentum space are proposed as measures of the nonlocal aspects of information. Singlet and triplet state members of the helium isoelectronic series are employed to examine Coulomb and Fermi correlations, and their manifestations, in both the position and momentum space mutual information measures. The triplet state measures exemplify that the magnitude of the spatial correlations relative to the momentum correlations depends on and may be controlled by the strength of the electronic correlation. The examination of one- and two-electron Shannon entropies in the triplet state series yields a crossover point, which is characterized by a localized momentum density. The mutual information density in momentum space illustrates that this localization is accompanied by strong correlation at small values of p.