NASA Astrophysics Data System (ADS)
Brustein, R.
I review some basic facts about entropy bounds in general and about cosmological entropy bounds. Then I review the causal entropy bound, the conditions for its validity and its application to the study of cosmological singularities. This article is based on joint work with Gabriele Veneziano and subsequent related research.
Fundamental limits on quantum dynamics based on entropy change
NASA Astrophysics Data System (ADS)
Das, Siddhartha; Khatri, Sumeet; Siopsis, George; Wilde, Mark M.
2018-01-01
It is well known in the realm of quantum mechanics and information theory that the entropy is non-decreasing for the class of unital physical processes. However, in general, the entropy does not exhibit monotonic behavior. This has restricted the use of entropy change in characterizing evolution processes. Recently, a lower bound on the entropy change was provided in the work of Buscemi, Das, and Wilde [Phys. Rev. A 93(6), 062314 (2016)]. We explore the limit that this bound places on the physical evolution of a quantum system and discuss how these limits can be used as witnesses to characterize quantum dynamics. In particular, we derive a lower limit on the rate of entropy change for memoryless quantum dynamics, and we argue that it provides a witness of non-unitality. This limit on the rate of entropy change leads to definitions of several witnesses for testing memory effects in quantum dynamics. Furthermore, from the aforementioned lower bound on entropy change, we obtain a measure of non-unitarity for unital evolutions.
Entropy bounds in terms of the w parameter
NASA Astrophysics Data System (ADS)
Abreu, Gabriel; Barceló, Carlos; Visser, Matt
2011-12-01
In a pair of recent articles [PRL 105 (2010) 041302; JHEP 1103 (2011) 056] two of the current authors have developed an entropy bound for equilibrium uncollapsed matter using only classical general relativity, basic thermodynamics, and the Unruh effect. An odd feature of that bound, [InlineMediaObject not available: see fulltext.], was that the proportionality constant, 1/2 , was weaker than that expected from black hole thermodynamics, 1/4 . In the current article we strengthen the previous results by obtaining a bound involving the (suitably averaged) w parameter. Simple causality arguments restrict this averaged < w> parameter to be ≤ 1. When equality holds, the entropy bound saturates at the value expected based on black hole thermodynamics. We also add some clarifying comments regarding the (net) positivity of the chemical potential. Overall, we find that even in the absence of any black hole region, we can nevertheless get arbitrarily close to the Bekenstein entropy.
Entropy-Based Bounds On Redundancies Of Huffman Codes
NASA Technical Reports Server (NTRS)
Smyth, Padhraic J.
1992-01-01
Report presents extension of theory of redundancy of binary prefix code of Huffman type which includes derivation of variety of bounds expressed in terms of entropy of source and size of alphabet. Recent developments yielded bounds on redundancy of Huffman code in terms of probabilities of various components in source alphabet. In practice, redundancies of optimal prefix codes often closer to 0 than to 1.
Coherence and entanglement measures based on Rényi relative entropies
NASA Astrophysics Data System (ADS)
Zhu, Huangjun; Hayashi, Masahito; Chen, Lin
2017-11-01
We study systematically resource measures of coherence and entanglement based on Rényi relative entropies, which include the logarithmic robustness of coherence, geometric coherence, and conventional relative entropy of coherence together with their entanglement analogues. First, we show that each Rényi relative entropy of coherence is equal to the corresponding Rényi relative entropy of entanglement for any maximally correlated state. By virtue of this observation, we establish a simple operational connection between entanglement measures and coherence measures based on Rényi relative entropies. We then prove that all these coherence measures, including the logarithmic robustness of coherence, are additive. Accordingly, all these entanglement measures are additive for maximally correlated states. In addition, we derive analytical formulas for Rényi relative entropies of entanglement of maximally correlated states and bipartite pure states, which reproduce a number of classic results on the relative entropy of entanglement and logarithmic robustness of entanglement in a unified framework. Several nontrivial bounds for Rényi relative entropies of coherence (entanglement) are further derived, which improve over results known previously. Moreover, we determine all states whose relative entropy of coherence is equal to the logarithmic robustness of coherence. As an application, we provide an upper bound for the exact coherence distillation rate, which is saturated for pure states.
NASA Astrophysics Data System (ADS)
Huang, Feimin; Li, Tianhong; Yu, Huimin; Yuan, Difan
2018-06-01
We are concerned with the global existence and large time behavior of entropy solutions to the one-dimensional unipolar hydrodynamic model for semiconductors in the form of Euler-Poisson equations in a bounded interval. In this paper, we first prove the global existence of entropy solution by vanishing viscosity and compensated compactness framework. In particular, the solutions are uniformly bounded with respect to space and time variables by introducing modified Riemann invariants and the theory of invariant region. Based on the uniform estimates of density, we further show that the entropy solution converges to the corresponding unique stationary solution exponentially in time. No any smallness condition is assumed on the initial data and doping profile. Moreover, the novelty in this paper is about the unform bound with respect to time for the weak solutions of the isentropic Euler-Poisson system.
Computing a Non-trivial Lower Bound on the Joint Entropy between Two Images
DOE Office of Scientific and Technical Information (OSTI.GOV)
Perumalla, Kalyan S.
In this report, a non-trivial lower bound on the joint entropy of two non-identical images is developed, which is greater than the individual entropies of the images. The lower bound is the least joint entropy possible among all pairs of images that have the same histograms as those of the given images. New algorithms are presented to compute the joint entropy lower bound with a computation time proportional to S log S where S is the number of histogram bins of the images. This is faster than the traditional methods of computing the exact joint entropy with a computation timemore » that is quadratic in S .« less
Universal bounds on the time evolution of entanglement entropy.
Avery, Steven G; Paulos, Miguel F
2014-12-05
Using relative entropy, we derive bounds on the time rate of change of geometric entanglement entropy for any relativistic quantum field theory in any dimension. The bounds apply to both mixed and pure states, and may be extended to curved space. We illustrate the bounds in a few examples and comment on potential applications and future extensions.
Entropy bound of local quantum field theory with generalized uncertainty principle
NASA Astrophysics Data System (ADS)
Kim, Yong-Wan; Lee, Hyung Won; Myung, Yun Soo
2009-03-01
We study the entropy bound for local quantum field theory (LQFT) with generalized uncertainty principle. The generalized uncertainty principle provides naturally a UV cutoff to the LQFT as gravity effects. Imposing the non-gravitational collapse condition as the UV-IR relation, we find that the maximal entropy of a bosonic field is limited by the entropy bound A 3 / 4 rather than A with A the boundary area.
Quantile based Tsallis entropy in residual lifetime
NASA Astrophysics Data System (ADS)
Khammar, A. H.; Jahanshahi, S. M. A.
2018-02-01
Tsallis entropy is a generalization of type α of the Shannon entropy, that is a nonadditive entropy unlike the Shannon entropy. Shannon entropy may be negative for some distributions, but Tsallis entropy can always be made nonnegative by choosing appropriate value of α. In this paper, we derive the quantile form of this nonadditive's entropy function in the residual lifetime, namely the residual quantile Tsallis entropy (RQTE) and get the bounds for it, depending on the Renyi's residual quantile entropy. Also, we obtain relationship between RQTE and concept of proportional hazards model in the quantile setup. Based on the new measure, we propose a stochastic order and aging classes, and study its properties. Finally, we prove characterizations theorems for some well known lifetime distributions. It is shown that RQTE uniquely determines the parent distribution unlike the residual Tsallis entropy.
Lower and upper bounds for entanglement of Rényi-α entropy.
Song, Wei; Chen, Lin; Cao, Zhuo-Liang
2016-12-23
Entanglement Rényi-α entropy is an entanglement measure. It reduces to the standard entanglement of formation when α tends to 1. We derive analytical lower and upper bounds for the entanglement Rényi-α entropy of arbitrary dimensional bipartite quantum systems. We also demonstrate the application our bound for some concrete examples. Moreover, we establish the relation between entanglement Rényi-α entropy and some other entanglement measures.
Local conditions for the generalized covariant entropy bound
NASA Astrophysics Data System (ADS)
Gao, Sijie; Lemos, José P.
2005-04-01
A set of sufficient conditions for the generalized covariant entropy bound given by Strominger and Thompson is as follows: Suppose that the entropy of matter can be described by an entropy current sa. Let ka be any null vector along L and s≡-kasa. Then the generalized bound can be derived from the following conditions: (i) s'≤2πTabkakb, where s'=ka∇as and Tab is the stress-energy tensor; (ii) on the initial 2-surface B, s(0)≤-1/4θ(0), where θ is the expansion of ka. We prove that condition (ii) alone can be used to divide a spacetime into two regions: The generalized entropy bound holds for all light sheets residing in the region where s<-1/4θ and fails for those in the region where s>-1/4θ. We check the validity of these conditions in FRW flat universe and a scalar field spacetime. Some apparent violations of the entropy bounds in the two spacetimes are discussed. These holographic bounds are important in the formulation of the holographic principle.
Universal bounds on current fluctuations.
Pietzonka, Patrick; Barato, Andre C; Seifert, Udo
2016-05-01
For current fluctuations in nonequilibrium steady states of Markovian processes, we derive four different universal bounds valid beyond the Gaussian regime. Different variants of these bounds apply to either the entropy change or any individual current, e.g., the rate of substrate consumption in a chemical reaction or the electron current in an electronic device. The bounds vary with respect to their degree of universality and tightness. A universal parabolic bound on the generating function of an arbitrary current depends solely on the average entropy production. A second, stronger bound requires knowledge both of the thermodynamic forces that drive the system and of the topology of the network of states. These two bounds are conjectures based on extensive numerics. An exponential bound that depends only on the average entropy production and the average number of transitions per time is rigorously proved. This bound has no obvious relation to the parabolic bound but it is typically tighter further away from equilibrium. An asymptotic bound that depends on the specific transition rates and becomes tight for large fluctuations is also derived. This bound allows for the prediction of the asymptotic growth of the generating function. Even though our results are restricted to networks with a finite number of states, we show that the parabolic bound is also valid for three paradigmatic examples of driven diffusive systems for which the generating function can be calculated using the additivity principle. Our bounds provide a general class of constraints for nonequilibrium systems.
Maximum Relative Entropy of Coherence: An Operational Coherence Measure.
Bu, Kaifeng; Singh, Uttam; Fei, Shao-Ming; Pati, Arun Kumar; Wu, Junde
2017-10-13
The operational characterization of quantum coherence is the cornerstone in the development of the resource theory of coherence. We introduce a new coherence quantifier based on maximum relative entropy. We prove that the maximum relative entropy of coherence is directly related to the maximum overlap with maximally coherent states under a particular class of operations, which provides an operational interpretation of the maximum relative entropy of coherence. Moreover, we show that, for any coherent state, there are examples of subchannel discrimination problems such that this coherent state allows for a higher probability of successfully discriminating subchannels than that of all incoherent states. This advantage of coherent states in subchannel discrimination can be exactly characterized by the maximum relative entropy of coherence. By introducing a suitable smooth maximum relative entropy of coherence, we prove that the smooth maximum relative entropy of coherence provides a lower bound of one-shot coherence cost, and the maximum relative entropy of coherence is equivalent to the relative entropy of coherence in the asymptotic limit. Similar to the maximum relative entropy of coherence, the minimum relative entropy of coherence has also been investigated. We show that the minimum relative entropy of coherence provides an upper bound of one-shot coherence distillation, and in the asymptotic limit the minimum relative entropy of coherence is equivalent to the relative entropy of coherence.
Maximum and minimum entropy states yielding local continuity bounds
NASA Astrophysics Data System (ADS)
Hanson, Eric P.; Datta, Nilanjana
2018-04-01
Given an arbitrary quantum state (σ), we obtain an explicit construction of a state ρɛ * ( σ ) [respectively, ρ * , ɛ ( σ ) ] which has the maximum (respectively, minimum) entropy among all states which lie in a specified neighborhood (ɛ-ball) of σ. Computing the entropy of these states leads to a local strengthening of the continuity bound of the von Neumann entropy, i.e., the Audenaert-Fannes inequality. Our bound is local in the sense that it depends on the spectrum of σ. The states ρɛ * ( σ ) and ρ * , ɛ (σ) depend only on the geometry of the ɛ-ball and are in fact optimizers for a larger class of entropies. These include the Rényi entropy and the minimum- and maximum-entropies, providing explicit formulas for certain smoothed quantities. This allows us to obtain local continuity bounds for these quantities as well. In obtaining this bound, we first derive a more general result which may be of independent interest, namely, a necessary and sufficient condition under which a state maximizes a concave and Gâteaux-differentiable function in an ɛ-ball around a given state σ. Examples of such a function include the von Neumann entropy and the conditional entropy of bipartite states. Our proofs employ tools from the theory of convex optimization under non-differentiable constraints, in particular Fermat's rule, and majorization theory.
Device-Independent Tests of Entropy
NASA Astrophysics Data System (ADS)
Chaves, Rafael; Brask, Jonatan Bohr; Brunner, Nicolas
2015-09-01
We show that the entropy of a message can be tested in a device-independent way. Specifically, we consider a prepare-and-measure scenario with classical or quantum communication, and develop two different methods for placing lower bounds on the communication entropy, given observable data. The first method is based on the framework of causal inference networks. The second technique, based on convex optimization, shows that quantum communication provides an advantage over classical communication, in the sense of requiring a lower entropy to reproduce given data. These ideas may serve as a basis for novel applications in device-independent quantum information processing.
Tsirelson's bound from a generalized data processing inequality
NASA Astrophysics Data System (ADS)
Dahlsten, Oscar C. O.; Lercher, Daniel; Renner, Renato
2012-06-01
The strength of quantum correlations is bounded from above by Tsirelson's bound. We establish a connection between this bound and the fact that correlations between two systems cannot increase under local operations, a property known as the data processing inequality (DPI). More specifically, we consider arbitrary convex probabilistic theories. These can be equipped with an entropy measure that naturally generalizes the von Neumann entropy, as shown recently in Short and Wehner (2010 New J. Phys. 12 033023) and Barnum et al (2010 New J. Phys. 12 033024). We prove that if the DPI holds with respect to this generalized entropy measure then the underlying theory necessarily respects Tsirelson's bound. We, moreover, generalize this statement to any entropy measure satisfying certain minimal requirements. A consequence of our result is that not all the entropic relations used for deriving Tsirelson's bound via information causality in Pawlowski et al (2009 Nature 461 1101-4) are necessary.
NASA Astrophysics Data System (ADS)
Mouloudakis, K.; Kominis, I. K.
2017-02-01
Radical-ion-pair reactions, central for understanding the avian magnetic compass and spin transport in photosynthetic reaction centers, were recently shown to be a fruitful paradigm of the new synthesis of quantum information science with biological processes. We show here that the master equation so far constituting the theoretical foundation of spin chemistry violates fundamental bounds for the entropy of quantum systems, in particular the Ozawa bound. In contrast, a recently developed theory based on quantum measurements, quantum coherence measures, and quantum retrodiction, thus exemplifying the paradigm of quantum biology, satisfies the Ozawa bound as well as the Lanford-Robinson bound on information extraction. By considering Groenewold's information, the quantum information extracted during the reaction, we reproduce the known and unravel other magnetic-field effects not conveyed by reaction yields.
Distance-Based Configurational Entropy of Proteins from Molecular Dynamics Simulations
Fogolari, Federico; Corazza, Alessandra; Fortuna, Sara; Soler, Miguel Angel; VanSchouwen, Bryan; Brancolini, Giorgia; Corni, Stefano; Melacini, Giuseppe; Esposito, Gennaro
2015-01-01
Estimation of configurational entropy from molecular dynamics trajectories is a difficult task which is often performed using quasi-harmonic or histogram analysis. An entirely different approach, proposed recently, estimates local density distribution around each conformational sample by measuring the distance from its nearest neighbors. In this work we show this theoretically well grounded the method can be easily applied to estimate the entropy from conformational sampling. We consider a set of systems that are representative of important biomolecular processes. In particular: reference entropies for amino acids in unfolded proteins are obtained from a database of residues not participating in secondary structure elements;the conformational entropy of folding of β2-microglobulin is computed from molecular dynamics simulations using reference entropies for the unfolded state;backbone conformational entropy is computed from molecular dynamics simulations of four different states of the EPAC protein and compared with order parameters (often used as a measure of entropy);the conformational and rototranslational entropy of binding is computed from simulations of 20 tripeptides bound to the peptide binding protein OppA and of β2-microglobulin bound to a citrate coated gold surface. This work shows the potential of the method in the most representative biological processes involving proteins, and provides a valuable alternative, principally in the shown cases, where other approaches are problematic. PMID:26177039
Distance-Based Configurational Entropy of Proteins from Molecular Dynamics Simulations.
Fogolari, Federico; Corazza, Alessandra; Fortuna, Sara; Soler, Miguel Angel; VanSchouwen, Bryan; Brancolini, Giorgia; Corni, Stefano; Melacini, Giuseppe; Esposito, Gennaro
2015-01-01
Estimation of configurational entropy from molecular dynamics trajectories is a difficult task which is often performed using quasi-harmonic or histogram analysis. An entirely different approach, proposed recently, estimates local density distribution around each conformational sample by measuring the distance from its nearest neighbors. In this work we show this theoretically well grounded the method can be easily applied to estimate the entropy from conformational sampling. We consider a set of systems that are representative of important biomolecular processes. In particular: reference entropies for amino acids in unfolded proteins are obtained from a database of residues not participating in secondary structure elements;the conformational entropy of folding of β2-microglobulin is computed from molecular dynamics simulations using reference entropies for the unfolded state;backbone conformational entropy is computed from molecular dynamics simulations of four different states of the EPAC protein and compared with order parameters (often used as a measure of entropy);the conformational and rototranslational entropy of binding is computed from simulations of 20 tripeptides bound to the peptide binding protein OppA and of β2-microglobulin bound to a citrate coated gold surface. This work shows the potential of the method in the most representative biological processes involving proteins, and provides a valuable alternative, principally in the shown cases, where other approaches are problematic.
Strong majorization entropic uncertainty relations
NASA Astrophysics Data System (ADS)
Rudnicki, Łukasz; Puchała, Zbigniew; Życzkowski, Karol
2014-05-01
We analyze entropic uncertainty relations in a finite-dimensional Hilbert space and derive several strong bounds for the sum of two entropies obtained in projective measurements with respect to any two orthogonal bases. We improve the recent bounds by Coles and Piani [P. Coles and M. Piani, Phys. Rev. A 89, 022112 (2014), 10.1103/PhysRevA.89.022112], which are known to be stronger than the well-known result of Maassen and Uffink [H. Maassen and J. B. M. Uffink, Phys. Rev. Lett. 60, 1103 (1988), 10.1103/PhysRevLett.60.1103]. Furthermore, we find a bound based on majorization techniques, which also happens to be stronger than the recent results involving the largest singular values of submatrices of the unitary matrix connecting both bases. The first set of bounds gives better results for unitary matrices close to the Fourier matrix, while the second one provides a significant improvement in the opposite sectors. Some results derived admit generalization to arbitrary mixed states, so that corresponding bounds are increased by the von Neumann entropy of the measured state. The majorization approach is finally extended to the case of several measurements.
Bounds on the entanglement entropy of droplet states in the XXZ spin chain
NASA Astrophysics Data System (ADS)
Beaud, V.; Warzel, S.
2018-01-01
We consider a class of one-dimensional quantum spin systems on the finite lattice Λ ⊂Z , related to the XXZ spin chain in its Ising phase. It includes in particular the so-called droplet Hamiltonian. The entanglement entropy of energetically low-lying states over a bipartition Λ = B ∪ Bc is investigated and proven to satisfy a logarithmic bound in terms of min{n, |B|, |Bc|}, where n denotes the maximal number of down spins in the considered state. Upon addition of any (positive) random potential, the bound becomes uniformly constant on average, thereby establishing an area law. The proof is based on spectral methods: a deterministic bound on the local (many-body integrated) density of states is derived from an energetically motivated Combes-Thomas estimate.
NASA Astrophysics Data System (ADS)
Bialas, A.; Czyz, W.; Zalewski, K.
2006-10-01
A model-independent lower bound on the entropy S of the multi-particle system produced in high energy collisions, provided by the measurable Rényi entropy H2, is shown to be very effective. Estimates show that the ratio H2/S remains close to one half for all realistic values of the parameters.
Entropic bounds on currents in Langevin systems
NASA Astrophysics Data System (ADS)
Dechant, Andreas; Sasa, Shin-ichi
2018-06-01
We derive a bound on generalized currents for Langevin systems in terms of the total entropy production in the system and its environment. For overdamped dynamics, any generalized current is bounded by the total rate of entropy production. We show that this entropic bound on the magnitude of generalized currents imposes power-efficiency tradeoff relations for ratchets in contact with a heat bath: Maximum efficiency—Carnot efficiency for a Smoluchowski-Feynman ratchet and unity for a flashing or rocking ratchet—can only be reached at vanishing power output. For underdamped dynamics, while there may be reversible currents that are not bounded by the entropy production rate, we show that the output power and heat absorption rate are irreversible currents and thus obey the same bound. As a consequence, a power-efficiency tradeoff relation holds not only for underdamped ratchets but also for periodically driven heat engines. For weak driving, the bound results in additional constraints on the Onsager matrix beyond those imposed by the second law. Finally, we discuss the connection between heat and entropy in a nonthermal situation where the friction and noise intensity are state dependent.
Relating quantum coherence and correlations with entropy-based measures.
Wang, Xiao-Li; Yue, Qiu-Ling; Yu, Chao-Hua; Gao, Fei; Qin, Su-Juan
2017-09-21
Quantum coherence and quantum correlations are important quantum resources for quantum computation and quantum information. In this paper, using entropy-based measures, we investigate the relationships between quantum correlated coherence, which is the coherence between subsystems, and two main kinds of quantum correlations as defined by quantum discord as well as quantum entanglement. In particular, we show that quantum discord and quantum entanglement can be well characterized by quantum correlated coherence. Moreover, we prove that the entanglement measure formulated by quantum correlated coherence is lower and upper bounded by the relative entropy of entanglement and the entanglement of formation, respectively, and equal to the relative entropy of entanglement for all the maximally correlated states.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Pradhan, P., E-mail: pppradhan77@gmail.com
We derive various important thermodynamic relations of the inner and outer horizons in the background of the Taub–NUT (Newman–Unti–Tamburino) black hole in four-dimensional Lorentzian geometry. We compare these properties with the properties of the Reissner–Nordström black hole. We compute the area product, area sum, area subtraction, and area division of black hole horizons. We show that they all are not universal quantities. Based on these relations, we compute the area bound of all horizons. From the area bound, we derive an entropy bound and an irreducible mass bound for both horizons. We further study the stability of such black holesmore » by computing the specific heat for both horizons. It is shown that due to the negative specific heat, the black hole is thermodynamically unstable. All these calculations might be helpful in understanding the nature of the black hole entropy (both interior and exterior) at the microscopic level.« less
A bound on holographic entanglement entropy from inverse mean curvature flow
NASA Astrophysics Data System (ADS)
Fischetti, Sebastian; Wiseman, Toby
2017-06-01
Entanglement entropies are notoriously difficult to compute. Large-N strongly-coupled holographic CFTs are an important exception, where the AdS/CFT dictionary gives the entanglement entropy of a CFT region in terms of the area of an extremal bulk surface anchored to the AdS boundary. Using this prescription, we show—for quite general states of (2 + 1)-dimensional such CFTs—that the renormalized entanglement entropy of any region of the CFT is bounded from above by a weighted local energy density. The key ingredient in this construction is the inverse mean curvature (IMC) flow, which we suitably generalize to flows of surfaces anchored to the AdS boundary. Our bound can then be thought of as a ‘subregion’ Penrose inequality in asymptotically locally AdS spacetimes, similar to the Penrose inequalities obtained from IMC flows in asymptotically flat spacetimes. Combining the result with positivity of relative entropy, we argue that our bound is valid perturbatively in 1/N, and conjecture that a restricted version of it holds in any CFT.
NASA Astrophysics Data System (ADS)
Hertz, Anaelle; Vanbever, Luc; Cerf, Nicolas J.
2018-01-01
The uncertainty relation for continuous variables due to Byałinicki-Birula and Mycielski [I. Białynicki-Birula and J. Mycielski, Commun. Math. Phys. 44, 129 (1975), 10.1007/BF01608825] expresses the complementarity between two n -tuples of canonically conjugate variables (x1,x2,...,xn) and (p1,p2,...,pn) in terms of Shannon differential entropy. Here we consider the generalization to variables that are not canonically conjugate and derive an entropic uncertainty relation expressing the balance between any two n -variable Gaussian projective measurements. The bound on entropies is expressed in terms of the determinant of a matrix of commutators between the measured variables. This uncertainty relation also captures the complementarity between any two incompatible linear canonical transforms, the bound being written in terms of the corresponding symplectic matrices in phase space. Finally, we extend this uncertainty relation to Rényi entropies and also prove a covariance-based uncertainty relation which generalizes the Robertson relation.
Center for Quantum Algorithms and Complexity
2014-05-12
precisely, it asserts that for any subset L of particles, the entanglement entropy between L and L̄ is bounded by the surface area of L (the area is...ground states of gapped local Hamiltonians. Roughly, it says that the entanglement in such states is very local, and the entanglement entropy scales...the theorem states that the entanglement entropy is bounded by exp(X), where X = log(d/?). Hastingss result implies that ground states of gapped 1D
2013-01-01
Here we present a novel, end-point method using the dead-end-elimination and A* algorithms to efficiently and accurately calculate the change in free energy, enthalpy, and configurational entropy of binding for ligand–receptor association reactions. We apply the new approach to the binding of a series of human immunodeficiency virus (HIV-1) protease inhibitors to examine the effect ensemble reranking has on relative accuracy as well as to evaluate the role of the absolute and relative ligand configurational entropy losses upon binding in affinity differences for structurally related inhibitors. Our results suggest that most thermodynamic parameters can be estimated using only a small fraction of the full configurational space, and we see significant improvement in relative accuracy when using an ensemble versus single-conformer approach to ligand ranking. We also find that using approximate metrics based on the single-conformation enthalpy differences between the global minimum energy configuration in the bound as well as unbound states also correlates well with experiment. Using a novel, additive entropy expansion based on conditional mutual information, we also analyze the source of ligand configurational entropy loss upon binding in terms of both uncoupled per degree of freedom losses as well as changes in coupling between inhibitor degrees of freedom. We estimate entropic free energy losses of approximately +24 kcal/mol, 12 kcal/mol of which stems from loss of translational and rotational entropy. Coupling effects contribute only a small fraction to the overall entropy change (1–2 kcal/mol) but suggest differences in how inhibitor dihedral angles couple to each other in the bound versus unbound states. The importance of accounting for flexibility in drug optimization and design is also discussed. PMID:24250277
Jaeken, Laurent; Vasilievich Matveev, Vladimir
2012-01-01
Observations of coherent cellular behavior cannot be integrated into widely accepted membrane (pump) theory (MT) and its steady state energetics because of the thermal noise of assumed ordinary cell water and freely soluble cytoplasmic K+. However, Ling disproved MT and proposed an alternative based on coherence, showing that rest (R) and action (A) are two different phases of protoplasm with different energy levels. The R-state is a coherent metastable low-entropy state as water and K+ are bound to unfolded proteins. The A-state is the higher-entropy state because water and K+ are free. The R-to-A phase transition is regarded as a mechanism to release energy for biological work, replacing the classical concept of high-energy bonds. Subsequent inactivation during the endergonic A-to-R phase transition needs an input of metabolic energy to restore the low entropy R-state. Matveev’s native aggregation hypothesis allows to integrate the energetic details of globular proteins into this view. PMID:23264833
Lai, Hsin-Hua; Yang, Kun; Bonesteel, N E
2013-11-22
We show the violation of the entanglement area law for bosonic systems with Bose surfaces. For bosonic systems with gapless factorized energy dispersions on an N(d) Cartesian lattice in d dimensions, e.g., the exciton Bose liquid in two dimensions, we explicitly show that a belt subsystem with width L preserving translational symmetry along d-1 Cartesian axes has leading entanglement entropy (N(d-1)/3)lnL. Using this result, the strong subadditivity inequality, and lattice symmetries, we bound the entanglement entropy of a rectangular subsystem from below and above showing a logarithmic violation of the area law. For subsystems with a single flat boundary, we also bound the entanglement entropy from below showing a logarithmic violation, and argue that the entanglement entropy of subsystems with arbitrary smooth boundaries are similarly bounded.
Time evolution of Rényi entropy under the Lindblad equation.
Abe, Sumiyoshi
2016-08-01
In recent years, the Rényi entropy has repeatedly been discussed for characterization of quantum critical states and entanglement. Here, time evolution of the Rényi entropy is studied. A compact general formula is presented for the lower bound on the entropy rate.
The limit behavior of the evolution of the Tsallis entropy in self-gravitating systems
NASA Astrophysics Data System (ADS)
Zheng, Yahui; Du, Jiulin; Liang, Faku
2017-06-01
In this letter, we study the limit behavior of the evolution of the Tsallis entropy in self-gravitating systems. The study is carried out under two different situations, drawing the same conclusion. No matter in the energy transfer process or in the mass transfer process inside the system, when the nonextensive parameter q is more than unity, the total entropy is bounded; on the contrary, when this parameter is less than unity, the total entropy is unbounded. There are proofs in both theory and observation that the q is always more than unity. So the Tsallis entropy in self-gravitating systems generally exhibits a bounded property. This indicates the existence of a global maximum of the Tsallis entropy. It is possible for self-gravitating systems to evolve to thermodynamically stable states.
Deciphering the nonlocal entanglement entropy of fracton topological orders
NASA Astrophysics Data System (ADS)
Shi, Bowen; Lu, Yuan-Ming
2018-04-01
The ground states of topological orders condense extended objects and support topological excitations. This nontrivial property leads to nonzero topological entanglement entropy Stopo for conventional topological orders. Fracton topological order is an exotic class of models which is beyond the description of TQFT. With some assumptions about the condensates and the topological excitations, we derive a lower bound of the nonlocal entanglement entropy Snonlocal (a generalization of Stopo). The lower bound applies to Abelian stabilizer models including conventional topological orders as well as type-I and type-II fracton models, and it could be used to distinguish them. For fracton models, the lower bound shows that Snonlocal could obtain geometry-dependent values, and Snonlocal is extensive for certain choices of subsystems, including some choices which always give zero for TQFT. The stability of the lower bound under local perturbations is discussed.
Entropy production of doubly stochastic quantum channels
DOE Office of Scientific and Technical Information (OSTI.GOV)
Müller-Hermes, Alexander, E-mail: muellerh@posteo.net; Department of Mathematical Sciences, University of Copenhagen, 2100 Copenhagen; Stilck França, Daniel, E-mail: dsfranca@mytum.de
2016-02-15
We study the entropy increase of quantum systems evolving under primitive, doubly stochastic Markovian noise and thus converging to the maximally mixed state. This entropy increase can be quantified by a logarithmic-Sobolev constant of the Liouvillian generating the noise. We prove a universal lower bound on this constant that stays invariant under taking tensor-powers. Our methods involve a new comparison method to relate logarithmic-Sobolev constants of different Liouvillians and a technique to compute logarithmic-Sobolev inequalities of Liouvillians with eigenvectors forming a projective representation of a finite abelian group. Our bounds improve upon similar results established before and as an applicationmore » we prove an upper bound on continuous-time quantum capacities. In the last part of this work we study entropy production estimates of discrete-time doubly stochastic quantum channels by extending the framework of discrete-time logarithmic-Sobolev inequalities to the quantum case.« less
Lower bounds on entropy for polymer chains on a square and a cubic lattice
NASA Astrophysics Data System (ADS)
Gujrati, P. D.
1982-07-01
Rigorous lower bounds on the entropy per particle as a function of the fraction g of the gauche bonds of a system of semiflexible polymer chains is obtained in the thermodynamic limit. Only square and cubic lattices are considered. For the case of a single chain having l monomers, the bound is obtained for all g⩽g=2/3. For the case of p>1 chains, each having l monomers, where l is a multiple of 4, the bound is obtained for all g⩽g'=13/90. In both cases, it is shown that the entropy is always nonzero for all 0< g
DOE Office of Scientific and Technical Information (OSTI.GOV)
Zachos, C. K.; High Energy Physics
Following ref [1], a classical upper bound for quantum entropy is identified and illustrated, 0 {le} S{sub q} {le} ln (e{sigma}{sup 2}/2{h_bar}), involving the variance {sigma}{sup 2} in phase space of the classical limit distribution of a given system. A fortiori, this further bounds the corresponding information-theoretical generalizations of the quantum entropy proposed by Renyi.
Relative entropy of steering: on its definition and properties
NASA Astrophysics Data System (ADS)
Kaur, Eneet; Wilde, Mark M.
2017-11-01
In Gallego and Aolita (2015 Phys. Rev. X 5 041008), the authors proposed a definition for the relative entropy of steering and showed that the resulting quantity is a convex steering monotone. Here we advocate for a different definition for relative entropy of steering, based on well grounded concerns coming from quantum Shannon theory. We prove that this modified relative entropy of steering is a convex steering monotone. Furthermore, we establish that it is uniformly continuous and faithful, in both cases giving quantitative bounds that should be useful in applications. We also consider a restricted relative entropy of steering which is relevant for the case in which the free operations in the resource theory of steering have a more restricted form (the restricted operations could be more relevant in practical scenarios). The restricted relative entropy of steering is convex, monotone with respect to these restricted operations, uniformly continuous, and faithful.
NASA Astrophysics Data System (ADS)
Zingan, Valentin Nikolaevich
This work develops a discontinuous Galerkin finite element discretization of non- linear hyperbolic conservation equations with efficient and robust high order stabilization built on an entropy-based artificial viscosity approximation. The solutions of equations are represented by elementwise polynomials of an arbitrary degree p > 0 which are continuous within each element but discontinuous on the boundaries. The discretization of equations in time is done by means of high order explicit Runge-Kutta methods identified with respective Butcher tableaux. To stabilize a numerical solution in the vicinity of shock waves and simultaneously preserve the smooth parts from smearing, we add some reasonable amount of artificial viscosity in accordance with the physical principle of entropy production in the interior of shock waves. The viscosity coefficient is proportional to the local size of the residual of an entropy equation and is bounded from above by the first-order artificial viscosity defined by a local wave speed. Since the residual of an entropy equation is supposed to be vanishingly small in smooth regions (of the order of the Local Truncation Error) and arbitrarily large in shocks, the entropy viscosity is almost zero everywhere except the shocks, where it reaches the first-order upper bound. One- and two-dimensional benchmark test cases are presented for nonlinear hyperbolic scalar conservation laws and the system of compressible Euler equations. These tests demonstrate the satisfactory stability properties of the method and optimal convergence rates as well. All numerical solutions to the test problems agree well with the reference solutions found in the literature. We conclude that the new method developed in the present work is a valuable alternative to currently existing techniques of viscous stabilization.
Quantum key distribution with finite resources: Secret key rates via Renyi entropies
DOE Office of Scientific and Technical Information (OSTI.GOV)
Abruzzo, Silvestre; Kampermann, Hermann; Mertz, Markus
A realistic quantum key distribution (QKD) protocol necessarily deals with finite resources, such as the number of signals exchanged by the two parties. We derive a bound on the secret key rate which is expressed as an optimization problem over Renyi entropies. Under the assumption of collective attacks by an eavesdropper, a computable estimate of our bound for the six-state protocol is provided. This bound leads to improved key rates in comparison to previous results.
Optimization and large scale computation of an entropy-based moment closure
NASA Astrophysics Data System (ADS)
Kristopher Garrett, C.; Hauck, Cory; Hill, Judith
2015-12-01
We present computational advances and results in the implementation of an entropy-based moment closure, MN, in the context of linear kinetic equations, with an emphasis on heterogeneous and large-scale computing platforms. Entropy-based closures are known in several cases to yield more accurate results than closures based on standard spectral approximations, such as PN, but the computational cost is generally much higher and often prohibitive. Several optimizations are introduced to improve the performance of entropy-based algorithms over previous implementations. These optimizations include the use of GPU acceleration and the exploitation of the mathematical properties of spherical harmonics, which are used as test functions in the moment formulation. To test the emerging high-performance computing paradigm of communication bound simulations, we present timing results at the largest computational scales currently available. These results show, in particular, load balancing issues in scaling the MN algorithm that do not appear for the PN algorithm. We also observe that in weak scaling tests, the ratio in time to solution of MN to PN decreases.
Optimization and large scale computation of an entropy-based moment closure
Hauck, Cory D.; Hill, Judith C.; Garrett, C. Kristopher
2015-09-10
We present computational advances and results in the implementation of an entropy-based moment closure, M N, in the context of linear kinetic equations, with an emphasis on heterogeneous and large-scale computing platforms. Entropy-based closures are known in several cases to yield more accurate results than closures based on standard spectral approximations, such as P N, but the computational cost is generally much higher and often prohibitive. Several optimizations are introduced to improve the performance of entropy-based algorithms over previous implementations. These optimizations include the use of GPU acceleration and the exploitation of the mathematical properties of spherical harmonics, which aremore » used as test functions in the moment formulation. To test the emerging high-performance computing paradigm of communication bound simulations, we present timing results at the largest computational scales currently available. Lastly, these results show, in particular, load balancing issues in scaling the M N algorithm that do not appear for the P N algorithm. We also observe that in weak scaling tests, the ratio in time to solution of M N to P N decreases.« less
Bellomo, Guido; Bosyk, Gustavo M; Holik, Federico; Zozor, Steeve
2017-11-07
Based on the problem of quantum data compression in a lossless way, we present here an operational interpretation for the family of quantum Rényi entropies. In order to do this, we appeal to a very general quantum encoding scheme that satisfies a quantum version of the Kraft-McMillan inequality. Then, in the standard situation, where one is intended to minimize the usual average length of the quantum codewords, we recover the known results, namely that the von Neumann entropy of the source bounds the average length of the optimal codes. Otherwise, we show that by invoking an exponential average length, related to an exponential penalization over large codewords, the quantum Rényi entropies arise as the natural quantities relating the optimal encoding schemes with the source description, playing an analogous role to that of von Neumann entropy.
Calculation of Cyclodextrin Binding Affinities: Energy, Entropy, and Implications for Drug Design
Chen, Wei; Chang, Chia-En; Gilson, Michael K.
2004-01-01
The second generation Mining Minima method yields binding affinities accurate to within 0.8 kcal/mol for the associations of α-, β-, and γ-cyclodextrin with benzene, resorcinol, flurbiprofen, naproxen, and nabumetone. These calculations require hours to a day on a commodity computer. The calculations also indicate that the changes in configurational entropy upon binding oppose association by as much as 24 kcal/mol and result primarily from a narrowing of energy wells in the bound versus the free state, rather than from a drop in the number of distinct low-energy conformations on binding. Also, the configurational entropy is found to vary substantially among the bound conformations of a given cyclodextrin-guest complex. This result suggests that the configurational entropy must be accounted for to reliably rank docked conformations in both host-guest and ligand-protein complexes. In close analogy with the common experimental observation of entropy-enthalpy compensation, the computed entropy changes show a near-linear relationship with the changes in mean potential plus solvation energy. PMID:15339804
NASA Astrophysics Data System (ADS)
Liu, Yong; Shu, Chi-Wang; Zhang, Mengping
2018-02-01
We present a discontinuous Galerkin (DG) scheme with suitable quadrature rules [15] for ideal compressible magnetohydrodynamic (MHD) equations on structural meshes. The semi-discrete scheme is analyzed to be entropy stable by using the symmetrizable version of the equations as introduced by Godunov [32], the entropy stable DG framework with suitable quadrature rules [15], the entropy conservative flux in [14] inside each cell and the entropy dissipative approximate Godunov type numerical flux at cell interfaces to make the scheme entropy stable. The main difficulty in the generalization of the results in [15] is the appearance of the non-conservative "source terms" added in the modified MHD model introduced by Godunov [32], which do not exist in the general hyperbolic system studied in [15]. Special care must be taken to discretize these "source terms" adequately so that the resulting DG scheme satisfies entropy stability. Total variation diminishing / bounded (TVD/TVB) limiters and bound-preserving limiters are applied to control spurious oscillations. We demonstrate the accuracy and robustness of this new scheme on standard MHD examples.
Spread of entanglement and causality
NASA Astrophysics Data System (ADS)
Casini, Horacio; Liu, Hong; Mezei, Márk
2016-07-01
We investigate causality constraints on the time evolution of entanglement entropy after a global quench in relativistic theories. We first provide a general proof that the so-called tsunami velocity is bounded by the speed of light. We then generalize the free particle streaming model of [1] to general dimensions and to an arbitrary entanglement pattern of the initial state. In more than two spacetime dimensions the spread of entanglement in these models is highly sensitive to the initial entanglement pattern, but we are able to prove an upper bound on the normalized rate of growth of entanglement entropy, and hence the tsunami velocity. The bound is smaller than what one gets for quenches in holographic theories, which highlights the importance of interactions in the spread of entanglement in many-body systems. We propose an interacting model which we believe provides an upper bound on the spread of entanglement for interacting relativistic theories. In two spacetime dimensions with multiple intervals, this model and its variations are able to reproduce intricate results exhibited by holographic theories for a significant part of the parameter space. For higher dimensions, the model bounds the tsunami velocity at the speed of light. Finally, we construct a geometric model for entanglement propagation based on a tensor network construction for global quenches.
Entropy bounds, acceleration radiation, and the generalized second law
NASA Astrophysics Data System (ADS)
Unruh, William G.; Wald, Robert M.
1983-05-01
We calculate the net change in generalized entropy occurring when one attempts to empty the contents of a thin box into a black hole in the manner proposed recently by Bekenstein. The case of a "thick" box also is treated. It is shown that, as in our previous analysis, the effects of acceleration radiation prevent a violation of the generalized second law of thermodynamics. Thus, in this example, the validity of the generalized second law is shown to rest only on the validity of the ordinary second law and the existence of acceleration radiation. No additional assumptions concerning entropy bounds on the contents of the box need to be made.
Quantum engine efficiency bound beyond the second law of thermodynamics.
Niedenzu, Wolfgang; Mukherjee, Victor; Ghosh, Arnab; Kofman, Abraham G; Kurizki, Gershon
2018-01-11
According to the second law, the efficiency of cyclic heat engines is limited by the Carnot bound that is attained by engines that operate between two thermal baths under the reversibility condition whereby the total entropy does not increase. Quantum engines operating between a thermal and a squeezed-thermal bath have been shown to surpass this bound. Yet, their maximum efficiency cannot be determined by the reversibility condition, which may yield an unachievable efficiency bound above unity. Here we identify the fraction of the exchanged energy between a quantum system and a bath that necessarily causes an entropy change and derive an inequality for this change. This inequality reveals an efficiency bound for quantum engines energised by a non-thermal bath. This bound does not imply reversibility, unless the two baths are thermal. It cannot be solely deduced from the laws of thermodynamics.
Chai, Rifai; Naik, Ganesh R; Nguyen, Tuan Nghia; Ling, Sai Ho; Tran, Yvonne; Craig, Ashley; Nguyen, Hung T
2017-05-01
This paper presents a two-class electroencephal-ography-based classification for classifying of driver fatigue (fatigue state versus alert state) from 43 healthy participants. The system uses independent component by entropy rate bound minimization analysis (ERBM-ICA) for the source separation, autoregressive (AR) modeling for the features extraction, and Bayesian neural network for the classification algorithm. The classification results demonstrate a sensitivity of 89.7%, a specificity of 86.8%, and an accuracy of 88.2%. The combination of ERBM-ICA (source separator), AR (feature extractor), and Bayesian neural network (classifier) provides the best outcome with a p-value < 0.05 with the highest value of area under the receiver operating curve (AUC-ROC = 0.93) against other methods such as power spectral density as feature extractor (AUC-ROC = 0.81). The results of this study suggest the method could be utilized effectively for a countermeasure device for driver fatigue identification and other adverse event applications.
Entanglement Entropy of Eigenstates of Quantum Chaotic Hamiltonians.
Vidmar, Lev; Rigol, Marcos
2017-12-01
In quantum statistical mechanics, it is of fundamental interest to understand how close the bipartite entanglement entropy of eigenstates of quantum chaotic Hamiltonians is to maximal. For random pure states in the Hilbert space, the average entanglement entropy is known to be nearly maximal, with a deviation that is, at most, a constant. Here we prove that, in a system that is away from half filling and divided in two equal halves, an upper bound for the average entanglement entropy of random pure states with a fixed particle number and normally distributed real coefficients exhibits a deviation from the maximal value that grows with the square root of the volume of the system. Exact numerical results for highly excited eigenstates of a particle number conserving quantum chaotic model indicate that the bound is saturated with increasing system size.
Quantum Discord for d⊗2 Systems
Ma, Zhihao; Chen, Zhihua; Fanchini, Felipe Fernandes; Fei, Shao-Ming
2015-01-01
We present an analytical solution for classical correlation, defined in terms of linear entropy, in an arbitrary system when the second subsystem is measured. We show that the optimal measurements used in the maximization of the classical correlation in terms of linear entropy, when used to calculate the quantum discord in terms of von Neumann entropy, result in a tight upper bound for arbitrary systems. This bound agrees with all known analytical results about quantum discord in terms of von Neumann entropy and, when comparing it with the numerical results for 106 two-qubit random density matrices, we obtain an average deviation of order 10−4. Furthermore, our results give a way to calculate the quantum discord for arbitrary n-qubit GHZ and W states evolving under the action of the amplitude damping noisy channel. PMID:26036771
Evaluating convex roof entanglement measures.
Tóth, Géza; Moroder, Tobias; Gühne, Otfried
2015-04-24
We show a powerful method to compute entanglement measures based on convex roof constructions. In particular, our method is applicable to measures that, for pure states, can be written as low order polynomials of operator expectation values. We show how to compute the linear entropy of entanglement, the linear entanglement of assistance, and a bound on the dimension of the entanglement for bipartite systems. We discuss how to obtain the convex roof of the three-tangle for three-qubit states. We also show how to calculate the linear entropy of entanglement and the quantum Fisher information based on partial information or device independent information. We demonstrate the usefulness of our method by concrete examples.
Valence bond and von Neumann entanglement entropy in Heisenberg ladders.
Kallin, Ann B; González, Iván; Hastings, Matthew B; Melko, Roger G
2009-09-11
We present a direct comparison of the recently proposed valence bond entanglement entropy and the von Neumann entanglement entropy on spin-1/2 Heisenberg systems using quantum Monte Carlo and density-matrix renormalization group simulations. For one-dimensional chains we show that the valence bond entropy can be either less or greater than the von Neumann entropy; hence, it cannot provide a bound on the latter. On ladder geometries, simulations with up to seven legs are sufficient to indicate that the von Neumann entropy in two dimensions obeys an area law, even though the valence bond entanglement entropy has a multiplicative logarithmic correction.
The viscosity to entropy ratio: From string theory motivated bounds to warm dense matter
Faussurier, G.; Libby, S. B.; Silvestrelli, P. L.
2014-07-04
Here, we study the ratio of viscosity to entropy density in Yukawa one-component plasmas as a function of coupling parameter at fixed screening, and in realistic warm dense matter models as a function of temperature at fixed density. In these two situations, the ratio is minimized for values of the coupling parameters that depend on screening, and for temperatures that in turn depend on density and material. In this context, we also examine Rosenfeld arguments relating transport coefficients to excess reduced entropy for Yukawa one-component plasmas. For these cases we show that this ratio is always above the lower-bound conjecturemore » derived from string theory ideas.« less
Entropic (de)stabilization of surface-bound peptides conjugated with polymers
NASA Astrophysics Data System (ADS)
Carmichael, Scott P.; Shell, M. Scott
2015-12-01
In many emerging biotechnologies, functional proteins must maintain their native structures on or near interfaces (e.g., tethered peptide arrays, protein coated nanoparticles, and amphiphilic peptide micelles). Because the presence of a surface is known to dramatically alter the thermostability of tethered proteins, strategies to stabilize surface-bound proteins are highly sought. Here, we show that polymer conjugation allows for significant control over the secondary structure and thermostability of a model surface-tethered peptide. We use molecular dynamics simulations to examine the folding behavior of a coarse-grained helical peptide that is conjugated to polymers of various lengths and at various conjugation sites. These polymer variations reveal surprisingly diverse behavior, with some stabilizing and some destabilizing the native helical fold. We show that ideal-chain polymer entropies explain these varied effects and can quantitatively predict shifts in folding temperature. We then develop a generic theoretical model, based on ideal-chain entropies, that predicts critical lengths for conjugated polymers to effect changes in the folding of a surface-bound protein. These results may inform new design strategies for the stabilization of surface-associated proteins important for a range technological applications.
Entropic (de)stabilization of surface-bound peptides conjugated with polymers.
Carmichael, Scott P; Shell, M Scott
2015-12-28
In many emerging biotechnologies, functional proteins must maintain their native structures on or near interfaces (e.g., tethered peptide arrays, protein coated nanoparticles, and amphiphilic peptide micelles). Because the presence of a surface is known to dramatically alter the thermostability of tethered proteins, strategies to stabilize surface-bound proteins are highly sought. Here, we show that polymer conjugation allows for significant control over the secondary structure and thermostability of a model surface-tethered peptide. We use molecular dynamics simulations to examine the folding behavior of a coarse-grained helical peptide that is conjugated to polymers of various lengths and at various conjugation sites. These polymer variations reveal surprisingly diverse behavior, with some stabilizing and some destabilizing the native helical fold. We show that ideal-chain polymer entropies explain these varied effects and can quantitatively predict shifts in folding temperature. We then develop a generic theoretical model, based on ideal-chain entropies, that predicts critical lengths for conjugated polymers to effect changes in the folding of a surface-bound protein. These results may inform new design strategies for the stabilization of surface-associated proteins important for a range technological applications.
Deconfinement as an entropic self-destruction: A solution for the quarkonium suppression puzzle?
Kharzeev, Dmitri E.
2014-10-02
The entropic approach to dissociation of bound states immersed in strongly coupled systems is developed. In such systems, the excitations of the bound state are often delocalized and characterized by a large entropy, so that the bound state is strongly entangled with the rest of the statistical system. If this entropy S increases with the separation r between the constituents of the bound state, S=S(r), then the resulting entropic force F=T ∂S/∂r (T is temperature) can drive the dissociation process. As a specific example, we consider the case of heavy quarkonium in strongly coupled quark-gluon plasma, where lattice QCD indicatesmore » a large amount of entropy associated with the heavy quark pair at temperatures 0.9T c ≤ T ≤ 1.5T c (T c is the deconfinement temperature); this entropy S(r) grows with the interquark distance r. We argue that the entropic mechanism results in an anomalously strong quarkonium suppression in the temperature range near T c. This entropic self-destruction may thus explain why the experimentally measured quarkonium nuclear modification factor at RHIC (lower energy density) is smaller than at LHC (higher energy density), possibly resolving the “quarkonium suppression puzzle”—all of the previously known mechanisms of quarkonium dissociation operate more effectively at higher energy densities, and this contradicts the data. As a result, we find that near T c the entropic force leads to delocalization of the bound hadron states; we argue that this delocalization may be the mechanism underlying deconfinement.« less
An Onsager Singularity Theorem for Turbulent Solutions of Compressible Euler Equations
NASA Astrophysics Data System (ADS)
Drivas, Theodore D.; Eyink, Gregory L.
2017-12-01
We prove that bounded weak solutions of the compressible Euler equations will conserve thermodynamic entropy unless the solution fields have sufficiently low space-time Besov regularity. A quantity measuring kinetic energy cascade will also vanish for such Euler solutions, unless the same singularity conditions are satisfied. It is shown furthermore that strong limits of solutions of compressible Navier-Stokes equations that are bounded and exhibit anomalous dissipation are weak Euler solutions. These inviscid limit solutions have non-negative anomalous entropy production and kinetic energy dissipation, with both vanishing when solutions are above the critical degree of Besov regularity. Stationary, planar shocks in Euclidean space with an ideal-gas equation of state provide simple examples that satisfy the conditions of our theorems and which demonstrate sharpness of our L 3-based conditions. These conditions involve space-time Besov regularity, but we show that they are satisfied by Euler solutions that possess similar space regularity uniformly in time.
Direct measurement of weakly nonequilibrium system entropy is consistent with Gibbs–Shannon form
2017-01-01
Stochastic thermodynamics extends classical thermodynamics to small systems in contact with one or more heat baths. It can account for the effects of thermal fluctuations and describe systems far from thermodynamic equilibrium. A basic assumption is that the expression for Shannon entropy is the appropriate description for the entropy of a nonequilibrium system in such a setting. Here we measure experimentally this function in a system that is in local but not global equilibrium. Our system is a micron-scale colloidal particle in water, in a virtual double-well potential created by a feedback trap. We measure the work to erase a fraction of a bit of information and show that it is bounded by the Shannon entropy for a two-state system. Further, by measuring directly the reversibility of slow protocols, we can distinguish unambiguously between protocols that can and cannot reach the expected thermodynamic bounds. PMID:29073017
Transfer Entropy and Transient Limits of Computation
Prokopenko, Mikhail; Lizier, Joseph T.
2014-01-01
Transfer entropy is a recently introduced information-theoretic measure quantifying directed statistical coherence between spatiotemporal processes, and is widely used in diverse fields ranging from finance to neuroscience. However, its relationships to fundamental limits of computation, such as Landauer's limit, remain unknown. Here we show that in order to increase transfer entropy (predictability) by one bit, heat flow must match or exceed Landauer's limit. Importantly, we generalise Landauer's limit to bi-directional information dynamics for non-equilibrium processes, revealing that the limit applies to prediction, in addition to retrodiction (information erasure). Furthermore, the results are related to negentropy, and to Bremermann's limit and the Bekenstein bound, producing, perhaps surprisingly, lower bounds on the computational deceleration and information loss incurred during an increase in predictability about the process. The identified relationships set new computational limits in terms of fundamental physical quantities, and establish transfer entropy as a central measure connecting information theory, thermodynamics and theory of computation. PMID:24953547
NASA Astrophysics Data System (ADS)
Pozsgay, Victor; Hirsch, Flavien; Branciard, Cyril; Brunner, Nicolas
2017-12-01
We introduce Bell inequalities based on covariance, one of the most common measures of correlation. Explicit examples are discussed, and violations in quantum theory are demonstrated. A crucial feature of these covariance Bell inequalities is their nonlinearity; this has nontrivial consequences for the derivation of their local bound, which is not reached by deterministic local correlations. For our simplest inequality, we derive analytically tight bounds for both local and quantum correlations. An interesting application of covariance Bell inequalities is that they can act as "shared randomness witnesses": specifically, the value of the Bell expression gives device-independent lower bounds on both the dimension and the entropy of the shared random variable in a local model.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Zozor, Steeve; Portesi, Mariela; Sanchez-Moreno, Pablo
The position-momentum uncertainty-like inequality based on moments of arbitrary order for d-dimensional quantum systems, which is a generalization of the celebrated Heisenberg formulation of the uncertainty principle, is improved here by use of the Renyi-entropy-based uncertainty relation. The accuracy of the resulting lower bound is physico-computationally analyzed for the two main prototypes in d-dimensional physics: the hydrogenic and oscillator-like systems.
Dynamical noise filter and conditional entropy analysis in chaos synchronization.
Wang, Jiao; Lai, C-H
2006-06-01
It is shown that, in a chaotic synchronization system whose driving signal is exposed to channel noise, the estimation of the drive system states can be greatly improved by applying the dynamical noise filtering to the response system states. If the noise is bounded in a certain range, the estimation errors, i.e., the difference between the filtered responding states and the driving states, can be made arbitrarily small. This property can be used in designing an alternative digital communication scheme. An analysis based on the conditional entropy justifies the application of dynamical noise filtering in generating quality synchronization.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Guha, Saikat; Shapiro, Jeffrey H.; Erkmen, Baris I.
Previous work on the classical information capacities of bosonic channels has established the capacity of the single-user pure-loss channel, bounded the capacity of the single-user thermal-noise channel, and bounded the capacity region of the multiple-access channel. The latter is a multiple-user scenario in which several transmitters seek to simultaneously and independently communicate to a single receiver. We study the capacity region of the bosonic broadcast channel, in which a single transmitter seeks to simultaneously and independently communicate to two different receivers. It is known that the tightest available lower bound on the capacity of the single-user thermal-noise channel is thatmore » channel's capacity if, as conjectured, the minimum von Neumann entropy at the output of a bosonic channel with additive thermal noise occurs for coherent-state inputs. Evidence in support of this minimum output entropy conjecture has been accumulated, but a rigorous proof has not been obtained. We propose a minimum output entropy conjecture that, if proved to be correct, will establish that the capacity region of the bosonic broadcast channel equals the inner bound achieved using a coherent-state encoding and optimum detection. We provide some evidence that supports this conjecture, but again a full proof is not available.« less
A Theoretical Basis for Entropy-Scaling Effects in Human Mobility Patterns.
Osgood, Nathaniel D; Paul, Tuhin; Stanley, Kevin G; Qian, Weicheng
2016-01-01
Characterizing how people move through space has been an important component of many disciplines. With the advent of automated data collection through GPS and other location sensing systems, researchers have the opportunity to examine human mobility at spatio-temporal resolution heretofore impossible. However, the copious and complex data collected through these logging systems can be difficult for humans to fully exploit, leading many researchers to propose novel metrics for encapsulating movement patterns in succinct and useful ways. A particularly salient proposed metric is the mobility entropy rate of the string representing the sequence of locations visited by an individual. However, mobility entropy rate is not scale invariant: entropy rate calculations based on measurements of the same trajectory at varying spatial or temporal granularity do not yield the same value, limiting the utility of mobility entropy rate as a metric by confounding inter-experimental comparisons. In this paper, we derive a scaling relationship for mobility entropy rate of non-repeating straight line paths from the definition of Lempel-Ziv compression. We show that the resulting formulation predicts the scaling behavior of simulated mobility traces, and provides an upper bound on mobility entropy rate under certain assumptions. We further show that this formulation has a maximum value for a particular sampling rate, implying that optimal sampling rates for particular movement patterns exist.
Relations between work and entropy production for general information-driven, finite-state engines
NASA Astrophysics Data System (ADS)
Merhav, Neri
2017-02-01
We consider a system model of a general finite-state machine (ratchet) that simultaneously interacts with three kinds of reservoirs: a heat reservoir, a work reservoir, and an information reservoir, the latter being taken to be a running digital tape whose symbols interact sequentially with the machine. As has been shown in earlier work, this finite-state machine can act as a demon (with memory), which creates a net flow of energy from the heat reservoir into the work reservoir (thus extracting useful work) at the price of increasing the entropy of the information reservoir. Under very few assumptions, we propose a simple derivation of a family of inequalities that relate the work extraction with the entropy production. These inequalities can be seen as either upper bounds on the extractable work or as lower bounds on the entropy production, depending on the point of view. Many of these bounds are relatively easy to calculate and they are tight in the sense that equality can be approached arbitrarily closely. In their basic forms, these inequalities are applicable to any finite number of cycles (and not only asymptotically), and for a general input information sequence (possibly correlated), which is not necessarily assumed even stationary. Several known results are obtained as special cases.
Positive gravitational subsystem energies from CFT cone relative entropies
NASA Astrophysics Data System (ADS)
Neuenfeld, Dominik; Saraswat, Krishan; Van Raamsdonk, Mark
2018-06-01
The positivity of relative entropy for spatial subsystems in a holographic CFT implies the positivity of certain quantities in the dual gravitational theory. In this note, we consider CFT subsystems whose boundaries lie on the lightcone of a point p. We show that the positive gravitational quantity which corresponds to the relative entropy for such a subsystem A is a novel notion of energy associated with a gravitational subsystem bounded by the minimal area extremal surface à associated with A and by the AdS boundary region  corresponding to the part of the lightcone from p bounded by ∂ A. This generalizes the results of arXiv:1605.01075 for ball-shaped regions by making use of the recent results in arXiv:1703.10656 for the vacuum modular Hamiltonian of regions bounded on lightcones. As part of our analysis, we give an analytic expression for the extremal surface in pure AdS associated with any such region A. We note that its form immediately implies the Markov property of the CFT vacuum (saturation of strong subadditivity) for regions bounded on the same lightcone. This gives a holographic proof of the result proven for general CFTs in arXiv:1703.10656. A similar holographic proof shows the Markov property for regions bounded on a lightsheet for non-conformal holographic theories defined by relevant perturbations of a CFT.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Arima, Takashi, E-mail: tks@stat.nitech.ac.jp; Mentrelli, Andrea, E-mail: andrea.mentrelli@unibo.it; Ruggeri, Tommaso, E-mail: tommaso.ruggeri@unibo.it
Molecular extended thermodynamics of rarefied polyatomic gases is characterized by two hierarchies of equations for moments of a suitable distribution function in which the internal degrees of freedom of a molecule is taken into account. On the basis of physical relevance the truncation orders of the two hierarchies are proven to be not independent on each other, and the closure procedures based on the maximum entropy principle (MEP) and on the entropy principle (EP) are proven to be equivalent. The characteristic velocities of the emerging hyperbolic system of differential equations are compared to those obtained for monatomic gases and themore » lower bound estimate for the maximum equilibrium characteristic velocity established for monatomic gases (characterized by only one hierarchy for moments with truncation order of moments N) by Boillat and Ruggeri (1997) (λ{sub (N)}{sup E,max})/(c{sub 0}) ⩾√(6/5 (N−1/2 )),(c{sub 0}=√(5/3 k/m T)) is proven to hold also for rarefied polyatomic gases independently from the degrees of freedom of a molecule. -- Highlights: •Molecular extended thermodynamics of rarefied polyatomic gases is studied. •The relation between two hierarchies of equations for moments is derived. •The equivalence of maximum entropy principle and entropy principle is proven. •The characteristic velocities are compared to those of monatomic gases. •The lower bound of the maximum characteristic velocity is estimated.« less
Furrer, F; Franz, T; Berta, M; Leverrier, A; Scholz, V B; Tomamichel, M; Werner, R F
2012-09-07
We provide a security analysis for continuous variable quantum key distribution protocols based on the transmission of two-mode squeezed vacuum states measured via homodyne detection. We employ a version of the entropic uncertainty relation for smooth entropies to give a lower bound on the number of secret bits which can be extracted from a finite number of runs of the protocol. This bound is valid under general coherent attacks, and gives rise to keys which are composably secure. For comparison, we also give a lower bound valid under the assumption of collective attacks. For both scenarios, we find positive key rates using experimental parameters reachable today.
On Landauer's Principle and Bound for Infinite Systems
NASA Astrophysics Data System (ADS)
Longo, Roberto
2018-04-01
Landauer's principle provides a link between Shannon's information entropy and Clausius' thermodynamical entropy. Here we set up a basic formula for the incremental free energy of a quantum channel, possibly relative to infinite systems, naturally arising by an Operator Algebraic point of view. By the Tomita-Takesaki modular theory, we can indeed describe a canonical evolution associated with a quantum channel state transfer. Such evolution is implemented both by a modular Hamiltonian and a physical Hamiltonian, the latter being determined by its functoriality properties. This allows us to make an intrinsic analysis, extending our QFT index formula, but without any a priori given dynamics; the associated incremental free energy is related to the logarithm of the Jones index and is thus quantised. This leads to a general lower bound for the incremental free energy of an irreversible quantum channel which is half of the Landauer bound, and to further bounds corresponding to the discrete series of the Jones index. In the finite dimensional context, or in the case of DHR charges in QFT, where the dimension is a positive integer, our lower bound agrees with Landauer's bound.
Viscosity bound versus the universal relaxation bound
NASA Astrophysics Data System (ADS)
Hod, Shahar
2017-10-01
For gauge theories with an Einstein gravity dual, the AdS/CFT correspondence predicts a universal value for the ratio of the shear viscosity to the entropy density, η / s = 1 / 4 π. The holographic calculations have motivated the formulation of the celebrated KSS conjecture, according to which all fluids conform to the lower bound η / s ≥ 1 / 4 π. The bound on η / s may be regarded as a lower bound on the relaxation properties of perturbed fluids and it has been the focus of much recent attention. In particular, it was argued that for a class of field theories with Gauss-Bonnet gravity dual, the shear viscosity to entropy density ratio, η / s, could violate the conjectured KSS bound. In the present paper we argue that the proposed violations of the KSS bound are strongly constrained by Bekenstein's generalized second law (GSL) of thermodynamics. In particular, it is shown that physical consistency of the Gauss-Bonnet theory with the GSL requires its coupling constant to be bounded by λGB ≲ 0 . 063. We further argue that the genuine physical bound on the relaxation properties of physically consistent fluids is ℑω(k > 2 πT) > πT, where ω and k are respectively the proper frequency and the wavenumber of a perturbation mode in the fluid.
Black hole thermodynamics under the microscope
NASA Astrophysics Data System (ADS)
Falls, Kevin; Litim, Daniel F.
2014-04-01
A coarse-grained version of the effective action is used to study the thermodynamics of black holes, interpolating from largest to smallest masses. The physical parameters of the black hole are linked to the running couplings by thermodynamics, and the corresponding equation of state includes quantum corrections for temperature, specific heat, and entropy. If quantum gravity becomes asymptotically safe, the state function predicts conformal scaling in the limit of small horizon area and bounds on black hole mass and temperature. A metric-based derivation for the equation of state and quantum corrections to the thermodynamical, statistical, and phenomenological definition of entropy are also given. Further implications and limitations of our study are discussed.
Security and composability of randomness expansion from Bell inequalities
NASA Astrophysics Data System (ADS)
Fehr, Serge; Gelles, Ran; Schaffner, Christian
2013-01-01
The nonlocal behavior of quantum mechanics can be used to generate guaranteed fresh randomness from an untrusted device that consists of two nonsignalling components; since the generation process requires some initial fresh randomness to act as a catalyst, one also speaks of randomness expansion. R. Colbeck and A. Kent [J. Phys. A1751-811310.1088/1751-8113/44/9/095305 44, 095305 (2011)] proposed the first method for generating randomness from untrusted devices, but without providing a rigorous analysis. This was addressed subsequently by S. Pironio [Nature (London)NATUAS0028-083610.1038/nature09008 464, 1021 (2010)], who aimed at deriving a lower bound on the min-entropy of the data extracted from an untrusted device based only on the observed nonlocal behavior of the device. Although that article succeeded in developing important tools for reaching the stated goal, the proof itself contained a bug, and the given formal claim on the guaranteed amount of min-entropy needs to be revisited. In this paper we build on the tools provided by Pironio and obtain a meaningful lower bound on the min-entropy of the data produced by an untrusted device based on the observed nonlocal behavior of the device. Our main result confirms the essence of the (improperly formulated) claims of Pironio and puts them on solid ground. We also address the question of composability and show that different untrusted devices can be composed in an alternating manner under the assumption that they are not entangled. This enables superpolynomial randomness expansion based on two untrusted yet unentangled devices.
Critical evaluation of methods to incorporate entropy loss upon binding in high-throughput docking.
Salaniwal, Sumeet; Manas, Eric S; Alvarez, Juan C; Unwalla, Rayomand J
2007-02-01
Proper accounting of the positional/orientational/conformational entropy loss associated with protein-ligand binding is important to obtain reliable predictions of binding affinity. Herein, we critically examine two simplified statistical mechanics-based approaches, namely a constant penalty per rotor method, and a more rigorous method, referred to here as the partition function-based scoring (PFS) method, to account for such entropy losses in high-throughput docking calculations. Our results on the estrogen receptor beta and dihydrofolate reductase proteins demonstrate that, while the constant penalty method over-penalizes molecules for their conformational flexibility, the PFS method behaves in a more "DeltaG-like" manner by penalizing different rotors differently depending on their residual entropy in the bound state. Furthermore, in contrast to no entropic penalty or the constant penalty approximation, the PFS method does not exhibit any bias towards either rigid or flexible molecules in the hit list. Preliminary enrichment studies using a lead-like random molecular database suggest that an accurate representation of the "true" energy landscape of the protein-ligand complex is critical for reliable predictions of relative binding affinities by the PFS method. Copyright 2006 Wiley-Liss, Inc.
Alexandrescu, A. T.; Rathgeb-Szabo, K.; Rumpel, K.; Jahnke, W.; Schulthess, T.; Kammerer, R. A.
1998-01-01
Backbone 15N relaxation parameters (R1, R2, 1H-15N NOE) have been measured for a 22-residue recombinant variant of the S-peptide in its free and S-protein bound forms. NMR relaxation data were analyzed using the "model-free" approach (Lipari & Szabo, 1982). Order parameters obtained from "model-free" simulations were used to calculate 1H-15N bond vector entropies using a recently described method (Yang & Kay, 1996), in which the form of the probability density function for bond vector fluctuations is derived from a diffusion-in-a-cone motional model. The average change in 1H-15N bond vector entropies for residues T3-S15, which become ordered upon binding of the S-peptide to the S-protein, is -12.6+/-1.4 J/mol.residue.K. 15N relaxation data suggest a gradient of decreasing entropy values moving from the termini toward the center of the free peptide. The difference between the entropies of the terminal and central residues is about -12 J/mol residue K, a value comparable to that of the average entropy change per residue upon complex formation. Similar entropy gradients are evident in NMR relaxation studies of other denatured proteins. Taken together, these observations suggest denatured proteins may contain entropic contributions from non-local interactions. Consequently, calculations that model the entropy of a residue in a denatured protein as that of a residue in a di- or tri-peptide, might over-estimate the magnitude of entropy changes upon folding. PMID:9521116
Does horizon entropy satisfy a quantum null energy conjecture?
NASA Astrophysics Data System (ADS)
Fu, Zicao; Marolf, Donald
2016-12-01
A modern version of the idea that the area of event horizons gives 4G times an entropy is the Hubeny-Rangamani causal holographic information (CHI) proposal for holographic field theories. Given a region R of a holographic QFTs, CHI computes A/4G on a certain cut of an event horizon in the gravitational dual. The result is naturally interpreted as a coarse-grained entropy for the QFT. CHI is known to be finitely greater than the fine-grained Hubeny-Rangamani-Takayanagi (HRT) entropy when \\partial R lies on a Killing horizon of the QFT spacetime, and in this context satisfies other non-trivial properties expected of an entropy. Here we present evidence that it also satisfies the quantum null energy condition (QNEC), which bounds the second derivative of the entropy of a quantum field theory on one side of a non-expanding null surface by the flux of stress-energy across the surface. In particular, we show CHI to satisfy the QNEC in 1 + 1 holographic CFTs when evaluated in states dual to conical defects in AdS3. This surprising result further supports the idea that CHI defines a useful notion of coarse-grained holographic entropy, and suggests unprecedented bounds on the rate at which bulk horizon generators emerge from a caustic. To supplement our motivation, we include an appendix deriving a corresponding coarse-grained generalized second law for 1 + 1 holographic CFTs perturbatively coupled to dilaton gravity.
A Theoretical Basis for Entropy-Scaling Effects in Human Mobility Patterns
2016-01-01
Characterizing how people move through space has been an important component of many disciplines. With the advent of automated data collection through GPS and other location sensing systems, researchers have the opportunity to examine human mobility at spatio-temporal resolution heretofore impossible. However, the copious and complex data collected through these logging systems can be difficult for humans to fully exploit, leading many researchers to propose novel metrics for encapsulating movement patterns in succinct and useful ways. A particularly salient proposed metric is the mobility entropy rate of the string representing the sequence of locations visited by an individual. However, mobility entropy rate is not scale invariant: entropy rate calculations based on measurements of the same trajectory at varying spatial or temporal granularity do not yield the same value, limiting the utility of mobility entropy rate as a metric by confounding inter-experimental comparisons. In this paper, we derive a scaling relationship for mobility entropy rate of non-repeating straight line paths from the definition of Lempel-Ziv compression. We show that the resulting formulation predicts the scaling behavior of simulated mobility traces, and provides an upper bound on mobility entropy rate under certain assumptions. We further show that this formulation has a maximum value for a particular sampling rate, implying that optimal sampling rates for particular movement patterns exist. PMID:27571423
Directionality theory and the evolution of body size.
Demetrius, L
2000-12-07
Directionality theory, a dynamic theory of evolution that integrates population genetics with demography, is based on the concept of evolutionary entropy, a measure of the variability in the age of reproducing individuals in a population. The main tenets of the theory are three principles relating the response to the ecological constraints a population experiences, with trends in entropy as the population evolves under mutation and natural selection. (i) Stationary size or fluctuations around a stationary size (bounded growth): a unidirectional increase in entropy; (ii) prolonged episodes of exponential growth (unbounded growth), large population size: a unidirectional decrease in entropy; and (iii) prolonged episodes of exponential growth (unbounded growth), small population size: random, non-directional change in entropy. We invoke these principles, together with an allometric relationship between entropy, and the morphometric variable body size, to provide evolutionary explanations of three empirical patterns pertaining to trends in body size, namely (i) Cope's rule, the tendency towards size increase within phyletic lineages; (ii) the island rule, which pertains to changes in body size that occur as species migrate from mainland populations to colonize island habitats; and (iii) Bergmann's rule, the tendency towards size increase with increasing latitude. The observation that these ecotypic patterns can be explained in terms of the directionality principles for entropy underscores the significance of evolutionary entropy as a unifying concept in forging a link between micro-evolution, the dynamics of gene frequency change, and macro-evolution, dynamic changes in morphometric variables.
Some New Properties of Quantum Correlations
NASA Astrophysics Data System (ADS)
Liu, Feng; Li, Fei; Wei, Yunxia
2017-02-01
Quantum coherence measures the correlation between different measurement results in a single-system, while entanglement and quantum discord measure the correlation among different subsystems in a multipartite system. In this paper, we focus on the relative entropy form of them, and obtain three new properties of them as follows: 1) General forms of maximally coherent states for the relative entropy coherence, 2) Linear monogamy of the relative entropy entanglement, and 3) Subadditivity of quantum discord. Here, the linear monogamy is defined as there is a small constant as the upper bound on the sum of the relative entropy entanglement in subsystems.
Efficient optimization of the quantum relative entropy
NASA Astrophysics Data System (ADS)
Fawzi, Hamza; Fawzi, Omar
2018-04-01
Many quantum information measures can be written as an optimization of the quantum relative entropy between sets of states. For example, the relative entropy of entanglement of a state is the minimum relative entropy to the set of separable states. The various capacities of quantum channels can also be written in this way. We propose a unified framework to numerically compute these quantities using off-the-shelf semidefinite programming solvers, exploiting the approximation method proposed in Fawzi, Saunderson and Parrilo (2017 arXiv: 1705.00812). As a notable application, this method allows us to provide numerical counterexamples for a proposed lower bound on the quantum conditional mutual information in terms of the relative entropy of recovery.
Global Existence Analysis of Cross-Diffusion Population Systems for Multiple Species
NASA Astrophysics Data System (ADS)
Chen, Xiuqing; Daus, Esther S.; Jüngel, Ansgar
2018-02-01
The existence of global-in-time weak solutions to reaction-cross-diffusion systems for an arbitrary number of competing population species is proved. The equations can be derived from an on-lattice random-walk model with general transition rates. In the case of linear transition rates, it extends the two-species population model of Shigesada, Kawasaki, and Teramoto. The equations are considered in a bounded domain with homogeneous Neumann boundary conditions. The existence proof is based on a refined entropy method and a new approximation scheme. Global existence follows under a detailed balance or weak cross-diffusion condition. The detailed balance condition is related to the symmetry of the mobility matrix, which mirrors Onsager's principle in thermodynamics. Under detailed balance (and without reaction) the entropy is nonincreasing in time, but counter-examples show that the entropy may increase initially if detailed balance does not hold.
The Thermodynamics of Black Holes.
Wald, Robert M
2001-01-01
We review the present status of black hole thermodynamics. Our review includes discussion of classical black hole thermodynamics, Hawking radiation from black holes, the generalized second law, and the issue of entropy bounds. A brief survey also is given of approaches to the calculation of black hole entropy. We conclude with a discussion of some unresolved open issues.
Entropy bound of horizons for accelerating, rotating and charged Plebanski–Demianski black hole
DOE Office of Scientific and Technical Information (OSTI.GOV)
Debnath, Ujjal, E-mail: ujjaldebnath@yahoo.com
We first review the accelerating, rotating and charged Plebanski–Demianski (PD) black hole, which includes the Kerr–Newman rotating black hole and the Taub-NUT spacetime. The main feature of this black hole is that it has 4 horizons like event horizon, Cauchy horizon and two accelerating horizons. In the non-extremal case, the surface area, entropy, surface gravity, temperature, angular velocity, Komar energy and irreducible mass on the event horizon and Cauchy horizon are presented for PD black hole. The entropy product, temperature product, Komar energy product and irreducible mass product have been found for event horizon and Cauchy horizon. Also their sumsmore » are found for both horizons. All these relations are dependent on the mass of the PD black hole and other parameters. So all the products are not universal for PD black hole. The entropy and area bounds for two horizons have been investigated. Also we found the Christodoulou–Ruffini mass for extremal PD black hole. Finally, using first law of thermodynamics, we also found the Smarr relation for PD black hole.« less
Rényi-Fisher entropy product as a marker of topological phase transitions
NASA Astrophysics Data System (ADS)
Bolívar, J. C.; Nagy, Ágnes; Romera, Elvira
2018-05-01
The combined Rényi-Fisher entropy product of electrons plus holes displays a minimum at the charge neutrality points. The Stam-Rényi difference and the Stam-Rényi uncertainty product of the electrons plus holes, show maxima at the charge neutrality points. Topological quantum numbers capable of detecting the topological insulator and the band insulator phases, are defined. Upper and lower bounds for the position and momentum space Rényi-Fisher entropy products are derived.
Secure self-calibrating quantum random-bit generator
DOE Office of Scientific and Technical Information (OSTI.GOV)
Fiorentino, M.; Santori, C.; Spillane, S. M.
2007-03-15
Random-bit generators (RBGs) are key components of a variety of information processing applications ranging from simulations to cryptography. In particular, cryptographic systems require 'strong' RBGs that produce high-entropy bit sequences, but traditional software pseudo-RBGs have very low entropy content and therefore are relatively weak for cryptography. Hardware RBGs yield entropy from chaotic or quantum physical systems and therefore are expected to exhibit high entropy, but in current implementations their exact entropy content is unknown. Here we report a quantum random-bit generator (QRBG) that harvests entropy by measuring single-photon and entangled two-photon polarization states. We introduce and implement a quantum tomographicmore » method to measure a lower bound on the 'min-entropy' of the system, and we employ this value to distill a truly random-bit sequence. This approach is secure: even if an attacker takes control of the source of optical states, a secure random sequence can be distilled.« less
An estimator for the relative entropy rate of path measures for stochastic differential equations
DOE Office of Scientific and Technical Information (OSTI.GOV)
Opper, Manfred, E-mail: manfred.opper@tu-berlin.de
2017-02-01
We address the problem of estimating the relative entropy rate (RER) for two stochastic processes described by stochastic differential equations. For the case where the drift of one process is known analytically, but one has only observations from the second process, we use a variational bound on the RER to construct an estimator.
NASA Astrophysics Data System (ADS)
Kosugi, Takahiro; Hayashi, Shigehiko
2011-01-01
Psychrophilic α-amylase from the antarctic bacterium pseudoalteromonashaloplanktis (AHA) and its mesophilic homologue, porcine pancreatic α-amylase (PPA) are theoretically investigated with molecular dynamics (MD) simulations. We carried out 240-ns MD simulations for four systems, AHA and PPA with/without the bound substrate, and examined protein conformational entropy changes upon the substrate binding. We developed an analysis that decomposes the entropy changes into contributions of individual amino acids, and successfully identified protein regions responsible for the entropy changes. The results provide a molecular insight into the structural flexibilities of those enzymes related to the temperature dependences of the enzymatic activity.
Most energetic passive states.
Perarnau-Llobet, Martí; Hovhannisyan, Karen V; Huber, Marcus; Skrzypczyk, Paul; Tura, Jordi; Acín, Antonio
2015-10-01
Passive states are defined as those states that do not allow for work extraction in a cyclic (unitary) process. Within the set of passive states, thermal states are the most stable ones: they maximize the entropy for a given energy, and similarly they minimize the energy for a given entropy. Here we find the passive states lying in the other extreme, i.e., those that maximize the energy for a given entropy, which we show also minimize the entropy when the energy is fixed. These extremal properties make these states useful to obtain fundamental bounds for the thermodynamics of finite-dimensional quantum systems, which we show in several scenarios.
Entropy production in a photovoltaic cell
NASA Astrophysics Data System (ADS)
Ansari, Mohammad H.
2017-05-01
We evaluate entropy production in a photovoltaic cell that is modeled by four electronic levels resonantly coupled to thermally populated field modes at different temperatures. We use a formalism recently proposed, the so-called multiple parallel worlds, to consistently address the nonlinearity of entropy in terms of density matrix. Our result shows that entropy production is the difference between two flows: a semiclassical flow that linearly depends on occupational probabilities, and another flow that depends nonlinearly on quantum coherence and has no semiclassical analog. We show that entropy production in the cells depends on environmentally induced decoherence time and energy detuning. We characterize regimes where reversal flow of information takes place from a cold to hot bath. Interestingly, we identify a lower bound on entropy production, which sets limitations on the statistics of dissipated heat in the cells.
NASA Astrophysics Data System (ADS)
Brask, Jonatan Bohr; Martin, Anthony; Esposito, William; Houlmann, Raphael; Bowles, Joseph; Zbinden, Hugo; Brunner, Nicolas
2017-05-01
An approach to quantum random number generation based on unambiguous quantum state discrimination is developed. We consider a prepare-and-measure protocol, where two nonorthogonal quantum states can be prepared, and a measurement device aims at unambiguously discriminating between them. Because the states are nonorthogonal, this necessarily leads to a minimal rate of inconclusive events whose occurrence must be genuinely random and which provide the randomness source that we exploit. Our protocol is semi-device-independent in the sense that the output entropy can be lower bounded based on experimental data and a few general assumptions about the setup alone. It is also practically relevant, which we demonstrate by realizing a simple optical implementation, achieving rates of 16.5 Mbits /s . Combining ease of implementation, a high rate, and a real-time entropy estimation, our protocol represents a promising approach intermediate between fully device-independent protocols and commercial quantum random number generators.
Multi-agent fare optimization model of two modes problem and its analysis based on edge of chaos
NASA Astrophysics Data System (ADS)
Li, Xue-yan; Li, Xue-mei; Li, Xue-wei; Qiu, He-ting
2017-03-01
This paper proposes a new framework of fare optimization & game model for studying the competition between two travel modes (high speed railway and civil aviation) in which passengers' group behavior is taken into consideration. The small-world network is introduced to construct the multi-agent model of passengers' travel mode choice. The cumulative prospect theory is adopted to depict passengers' bounded rationality, the heterogeneity of passengers' reference point is depicted using the idea of group emotion computing. The conceptions of "Langton parameter" and "evolution entropy" in the theory of "edge of chaos" are introduced to create passengers' "decision coefficient" and "evolution entropy of travel mode choice" which are used to quantify passengers' group behavior. The numerical simulation and the analysis of passengers' behavior show that (1) the new model inherits the features of traditional model well and the idea of self-organizing traffic flow evolution fully embodies passengers' bounded rationality, (2) compared with the traditional model (logit model), when passengers are in the "edge of chaos" state, the total profit of the transportation system is higher.
Quantum discord bounds the amount of distributed entanglement.
Chuan, T K; Maillard, J; Modi, K; Paterek, T; Paternostro, M; Piani, M
2012-08-17
The ability to distribute quantum entanglement is a prerequisite for many fundamental tests of quantum theory and numerous quantum information protocols. Two distant parties can increase the amount of entanglement between them by means of quantum communication encoded in a carrier that is sent from one party to the other. Intriguingly, entanglement can be increased even when the exchanged carrier is not entangled with the parties. However, in light of the defining property of entanglement stating that it cannot increase under classical communication, the carrier must be quantum. Here we show that, in general, the increase of relative entropy of entanglement between two remote parties is bounded by the amount of nonclassical correlations of the carrier with the parties as quantified by the relative entropy of discord. We study implications of this bound, provide new examples of entanglement distribution via unentangled states, and put further limits on this phenomenon.
Bao, Ning; Nezami, Sepehr; Ooguri, Hirosi; ...
2015-09-21
We initiate a systematic enumeration and classification of entropy inequalities satisfied by the Ryu-Takayanagi formula for conformal field theory states with smooth holographic dual geometries. For 2, 3, and 4 regions, we prove that the strong subadditivity and the monogamy of mutual information give the complete set of inequalities. This is in contrast to the situation for generic quantum systems, where a complete set of entropy inequalities is not known for 4 or more regions. We also find an infinite new family of inequalities applicable to 5 or more regions. The set of all holographic entropy inequalities bounds the phasemore » space of Ryu-Takayanagi entropies, defining the holographic entropy cone. We characterize this entropy cone by reducing geometries to minimal graph models that encode the possible cutting and gluing relations of minimal surfaces. We find that, for a fixed number of regions, there are only finitely many independent entropy inequalities. To establish new holographic entropy inequalities, we introduce a combinatorial proof technique that may also be of independent interest in Riemannian geometry and graph theory.« less
Dynamical maps, quantum detailed balance, and the Petz recovery map
NASA Astrophysics Data System (ADS)
Alhambra, Álvaro M.; Woods, Mischa P.
2017-08-01
Markovian master equations (formally known as quantum dynamical semigroups) can be used to describe the evolution of a quantum state ρ when in contact with a memoryless thermal bath. This approach has had much success in describing the dynamics of real-life open quantum systems in the laboratory. Such dynamics increase the entropy of the state ρ and the bath until both systems reach thermal equilibrium, at which point entropy production stops. Our main result is to show that the entropy production at time t is bounded by the relative entropy between the original state and the state at time 2 t . The bound puts strong constraints on how quickly a state can thermalize, and we prove that the factor of 2 is tight. The proof makes use of a key physically relevant property of these dynamical semigroups, detailed balance, showing that this property is intimately connected with the field of recovery maps from quantum information theory. We envisage that the connections made here between the two fields will have further applications. We also use this connection to show that a similar relation can be derived when the fixed point is not thermal.
NASA Astrophysics Data System (ADS)
Goon, Garrett
2017-01-01
We study the effects of heavy fields on 4D spacetimes with flat, de Sitter and anti-de Sitter asymptotics. At low energies, matter generates specific, calculable higher derivative corrections to the GR action which perturbatively alter the Schwarzschild-( A) dS family of solutions. The effects of massive scalars, Dirac spinors and gauge fields are each considered. The six-derivative operators they produce, such as ˜ R 3 terms, generate the leading corrections. The induced changes to horizon radii, Hawking temperatures and entropies are found. Modifications to the energy of large AdS black holes are derived by imposing the first law. An explicit demonstration of the replica trick is provided, as it is used to derive black hole and cosmological horizon entropies. Considering entropy bounds, it's found that scalars and fermions increase the entropy one can store inside a region bounded by a sphere of fixed size, but vectors lead to a decrease, oddly. We also demonstrate, however, that many of the corrections fall below the resolving power of the effective field theory and are therefore untrustworthy. Defining properties of black holes, such as the horizon area and Hawking temperature, prove to be remarkably robust against higher derivative gravitational corrections.
Entropy Methods For Univariate Distributions in Decision Analysis
NASA Astrophysics Data System (ADS)
Abbas, Ali E.
2003-03-01
One of the most important steps in decision analysis practice is the elicitation of the decision-maker's belief about an uncertainty of interest in the form of a representative probability distribution. However, the probability elicitation process is a task that involves many cognitive and motivational biases. Alternatively, the decision-maker may provide other information about the distribution of interest, such as its moments, and the maximum entropy method can be used to obtain a full distribution subject to the given moment constraints. In practice however, decision makers cannot readily provide moments for the distribution, and are much more comfortable providing information about the fractiles of the distribution of interest or bounds on its cumulative probabilities. In this paper we present a graphical method to determine the maximum entropy distribution between upper and lower probability bounds and provide an interpretation for the shape of the maximum entropy distribution subject to fractile constraints, (FMED). We also discuss the problems with the FMED in that it is discontinuous and flat over each fractile interval. We present a heuristic approximation to a distribution if in addition to its fractiles, we also know it is continuous and work through full examples to illustrate the approach.
Hierarchical Polygamy Inequality for Entanglement of Tsallis q-Entropy
NASA Astrophysics Data System (ADS)
Luo, Yu; Li, Yong-Ming
2018-05-01
In this paper, we study the polygamy inequality of quantum entanglement in terms of Tsallis q-entropy. We first give a lower bound of Tsallis q-entropy entanglement of assistance (TOA) in the 2 ⊗ d systems. The relation-ships between Tsallis q-entropy entanglement (TEE) and TOA are also given. Furthermore, we prove TOA follows a hierarchical polygamy inequality in a 2 ⊗ 2 ⊗ 2 N‑2 systems. Supported by the National Natural Science Foundation of China under Grant No. 11671244, the Higher School Doctoral Subject Foun- dation of Ministry of Education of China under Grant No. 20130202110001, and Fundamental Research Funds for the Central Universities under Grants Nos. 2016TS060 and 2016CBY003
Entropy Production in Chemical Reactors
NASA Astrophysics Data System (ADS)
Kingston, Diego; Razzitte, Adrián C.
2017-06-01
We have analyzed entropy production in chemically reacting systems and extended previous results to the two limiting cases of ideal reactors, namely continuous stirred tank reactor (CSTR) and plug flow reactor (PFR). We have found upper and lower bounds for the entropy production in isothermal systems and given expressions for non-isothermal operation and analyzed the influence of pressure and temperature in entropy generation minimization in reactors with a fixed volume and production. We also give a graphical picture of entropy production in chemical reactions subject to constant volume, which allows us to easily assess different options. We show that by dividing a reactor into two smaller ones, operating at different temperatures, the entropy production is lowered, going as near as 48 % less in the case of a CSTR and PFR in series, and reaching 58 % with two CSTR. Finally, we study the optimal pressure and temperature for a single isothermal PFR, taking into account the irreversibility introduced by a compressor and a heat exchanger, decreasing the entropy generation by as much as 30 %.
NASA Astrophysics Data System (ADS)
DeVore, Matthew S.; Gull, Stephen F.; Johnson, Carey K.
2013-08-01
We analyzed single molecule FRET burst measurements using Bayesian nested sampling. The MultiNest algorithm produces accurate FRET efficiency distributions from single-molecule data. FRET efficiency distributions recovered by MultiNest and classic maximum entropy are compared for simulated data and for calmodulin labeled at residues 44 and 117. MultiNest compares favorably with maximum entropy analysis for simulated data, judged by the Bayesian evidence. FRET efficiency distributions recovered for calmodulin labeled with two different FRET dye pairs depended on the dye pair and changed upon Ca2+ binding. We also looked at the FRET efficiency distributions of calmodulin bound to the calcium/calmodulin dependent protein kinase II (CaMKII) binding domain. For both dye pairs, the FRET efficiency distribution collapsed to a single peak in the case of calmodulin bound to the CaMKII peptide. These measurements strongly suggest that consideration of dye-protein interactions is crucial in forming an accurate picture of protein conformations from FRET data.
DeVore, Matthew S.; Gull, Stephen F.; Johnson, Carey K.
2013-01-01
We analyze single molecule FRET burst measurements using Bayesian nested sampling. The MultiNest algorithm produces accurate FRET efficiency distributions from single-molecule data. FRET efficiency distributions recovered by MultiNest and classic maximum entropy are compared for simulated data and for calmodulin labeled at residues 44 and 117. MultiNest compares favorably with maximum entropy analysis for simulated data, judged by the Bayesian evidence. FRET efficiency distributions recovered for calmodulin labeled with two different FRET dye pairs depended on the dye pair and changed upon Ca2+ binding. We also looked at the FRET efficiency distributions of calmodulin bound to the calcium/calmodulin dependent protein kinase II (CaMKII) binding domain. For both dye pairs, the FRET efficiency distribution collapsed to a single peak in the case of calmodulin bound to the CaMKII peptide. These measurements strongly suggest that consideration of dye-protein interactions is crucial in forming an accurate picture of protein conformations from FRET data. PMID:24223465
Devore, Matthew S; Gull, Stephen F; Johnson, Carey K
2013-08-30
We analyze single molecule FRET burst measurements using Bayesian nested sampling. The MultiNest algorithm produces accurate FRET efficiency distributions from single-molecule data. FRET efficiency distributions recovered by MultiNest and classic maximum entropy are compared for simulated data and for calmodulin labeled at residues 44 and 117. MultiNest compares favorably with maximum entropy analysis for simulated data, judged by the Bayesian evidence. FRET efficiency distributions recovered for calmodulin labeled with two different FRET dye pairs depended on the dye pair and changed upon Ca 2+ binding. We also looked at the FRET efficiency distributions of calmodulin bound to the calcium/calmodulin dependent protein kinase II (CaMKII) binding domain. For both dye pairs, the FRET efficiency distribution collapsed to a single peak in the case of calmodulin bound to the CaMKII peptide. These measurements strongly suggest that consideration of dye-protein interactions is crucial in forming an accurate picture of protein conformations from FRET data.
Global a priori estimates for the inhomogeneous Landau equation with moderately soft potentials
NASA Astrophysics Data System (ADS)
Cameron, Stephen; Silvestre, Luis; Snelson, Stanley
2018-05-01
We establish a priori upper bounds for solutions to the spatially inhomogeneous Landau equation in the case of moderately soft potentials, with arbitrary initial data, under the assumption that mass, energy and entropy densities stay under control. Our pointwise estimates decay polynomially in the velocity variable. We also show that if the initial data satisfies a Gaussian upper bound, this bound is propagated for all positive times.
Beyond the classical theory of heat conduction: a perspective view of future from entropy
Lai, Xiang; Zhu, Pingan
2016-01-01
Energy is conserved by the first law of thermodynamics; its quality degrades constantly due to entropy generation, by the second law of thermodynamics. It is thus important to examine the entropy generation regarding the way to reduce its magnitude and the limit of entropy generation as time tends to infinity regarding whether it is bounded or not. This work initiates such an analysis with one-dimensional heat conduction. The work not only offers some fundamental insights of universe and its future, but also builds up the relation between the second law of thermodynamics and mathematical inequalities via developing the latter of either new or classical nature. A concise review of entropy is also included for the interest of performing the analysis in this work and the similar analysis for other processes in the future. PMID:27843400
Mapping current fluctuations of stochastic pumps to nonequilibrium steady states.
Rotskoff, Grant M
2017-03-01
We show that current fluctuations in a stochastic pump can be robustly mapped to fluctuations in a corresponding time-independent nonequilibrium steady state. We thus refine a recently proposed mapping so that it ensures equivalence of not only the averages, but also optimal representation of fluctuations in currents and density. Our mapping leads to a natural decomposition of the entropy production in stochastic pumps similar to the "housekeeping" heat. As a consequence of the decomposition of entropy production, the current fluctuations in weakly perturbed stochastic pumps are shown to satisfy a universal bound determined by the steady state entropy production.
Bekenstein bounds, Penrose inequalities, and black hole formation
NASA Astrophysics Data System (ADS)
Jaracz, Jaroslaw S.; Khuri, Marcus A.
2018-06-01
A universal geometric inequality for bodies relating energy, size, angular momentum, and charge is naturally implied by Bekenstein's entropy bounds. We establish versions of this inequality for axisymmetric bodies satisfying appropriate energy conditions, thus lending credence to the most general form of Bekenstein's bound. Similar techniques are then used to prove a Penrose-like inequality in which the ADM energy is bounded from below in terms of horizon area, angular momentum, and charge. Lastly, new criteria for the formation of black holes is presented involving concentration of angular momentum, charge, and nonelectromagnetic matter energy.
Frenetic Bounds on the Entropy Production
NASA Astrophysics Data System (ADS)
Maes, Christian
2017-10-01
We give a systematic derivation of positive lower bounds for the expected entropy production (EP) rate in classical statistical mechanical systems obeying a dynamical large deviation principle. The logic is the same for the return to thermodynamic equilibrium as it is for steady nonequilibria working under the condition of local detailed balance. We recover there recently studied "uncertainty" relations for the EP, appearing in studies about the effectiveness of mesoscopic machines. In general our refinement of the positivity of the expected EP rate is obtained in terms of a positive and even function of the expected current(s) which measures the dynamical activity in the system, a time-symmetric estimate of the changes in the system's configuration. Also underdamped diffusions can be included in the analysis.
Conditional quantum entropy power inequality for d-level quantum systems
NASA Astrophysics Data System (ADS)
Jeong, Kabgyun; Lee, Soojoon; Jeong, Hyunseok
2018-04-01
We propose an extension of the quantum entropy power inequality for finite dimensional quantum systems, and prove a conditional quantum entropy power inequality by using the majorization relation as well as the concavity of entropic functions also given by Audenaert et al (2016 J. Math. Phys. 57 052202). Here, we make particular use of the fact that a specific local measurement after a partial swap operation (or partial swap quantum channel) acting only on finite dimensional bipartite subsystems does not affect the majorization relation for the conditional output states when a separable ancillary subsystem is involved. We expect our conditional quantum entropy power inequality to be useful, and applicable in bounding and analyzing several capacity problems for quantum channels.
Rényi squashed entanglement, discord, and relative entropy differences
NASA Astrophysics Data System (ADS)
Seshadreesan, Kaushik P.; Berta, Mario; Wilde, Mark M.
2015-10-01
The squashed entanglement quantifies the amount of entanglement in a bipartite quantum state, and it satisfies all of the axioms desired for an entanglement measure. The quantum discord is a measure of quantum correlations that are different from those due to entanglement. What these two measures have in common is that they are both based upon the conditional quantum mutual information. In Berta et al (2015 J. Math. Phys. 56 022205), we recently proposed Rényi generalizations of the conditional quantum mutual information of a tripartite state on ABC (with C being the conditioning system), which were shown to satisfy some properties that hold for the original quantity, such as non-negativity, duality, and monotonicity with respect to local operations on the system B (with it being left open to show that the Rényi quantity is monotone with respect to local operations on system A). Here we define a Rényi squashed entanglement and a Rényi quantum discord based on a Rényi conditional quantum mutual information and investigate these quantities in detail. Taking as a conjecture that the Rényi conditional quantum mutual information is monotone with respect to local operations on both systems A and B, we prove that the Rényi squashed entanglement and the Rényi quantum discord satisfy many of the properties of the respective original von Neumann entropy based quantities. In our prior work (Berta et al 2015 Phys. Rev. A 91 022333), we also detailed a procedure to obtain Rényi generalizations of any quantum information measure that is equal to a linear combination of von Neumann entropies with coefficients chosen from the set \\{-1,0,1\\}. Here, we extend this procedure to include differences of relative entropies. Using the extended procedure and a conjectured monotonicity of the Rényi generalizations in the Rényi parameter, we discuss potential remainder terms for well known inequalities such as monotonicity of the relative entropy, joint convexity of the relative entropy, and the Holevo bound.
Chirikjian, Gregory S.
2011-01-01
Proteins fold from a highly disordered state into a highly ordered one. Traditionally, the folding problem has been stated as one of predicting ‘the’ tertiary structure from sequential information. However, new evidence suggests that the ensemble of unfolded forms may not be as disordered as once believed, and that the native form of many proteins may not be described by a single conformation, but rather an ensemble of its own. Quantifying the relative disorder in the folded and unfolded ensembles as an entropy difference may therefore shed light on the folding process. One issue that clouds discussions of ‘entropy’ is that many different kinds of entropy can be defined: entropy associated with overall translational and rotational Brownian motion, configurational entropy, vibrational entropy, conformational entropy computed in internal or Cartesian coordinates (which can even be different from each other), conformational entropy computed on a lattice; each of the above with different solvation and solvent models; thermodynamic entropy measured experimentally, etc. The focus of this work is the conformational entropy of coil/loop regions in proteins. New mathematical modeling tools for the approximation of changes in conformational entropy during transition from unfolded to folded ensembles are introduced. In particular, models for computing lower and upper bounds on entropy for polymer models of polypeptide coils both with and without end constraints are presented. The methods reviewed here include kinematics (the mathematics of rigid-body motions), classical statistical mechanics and information theory. PMID:21187223
Properties of an entropy-based signal receiver with an application to ultrasonic molecular imaging.
Hughes, M S; McCarthy, J E; Marsh, J N; Arbeit, J M; Neumann, R G; Fuhrhop, R W; Wallace, K D; Znidersic, D R; Maurizi, B N; Baldwin, S L; Lanza, G M; Wickline, S A
2007-06-01
Qualitative and quantitative properties of the finite part, H(f), of the Shannon entropy of a continuous waveform f(t) in the continuum limit are derived in order to illuminate its use for waveform characterization. Simple upper and lower bounds on H(f), based on features of f(t), are defined. Quantitative criteria for a priori estimation of the average-case variation of H(f) and log E(f), where E(f) is the signal energy of f(t) are also derived. These provide relative sensitivity estimates that could be used to prospectively choose optimal imaging strategies in real-time ultrasonic imaging machines, where system bandwidth is often pushed to its limits. To demonstrate the utility of these sensitivity relations for this application, a study designed to assess the feasibility of identification of angiogenic neovasculature targeted with perfluorocarbon nanoparticles that specifically bind to alpha(v)beta3-integrin expression in tumors was performed. The outcome of this study agrees with the prospective sensitivity estimates that were used for the two receivers. Moreover, these data demonstrate the ability of entropy-based signal receivers when used in conjunction with targeted nanoparticles to elucidate the presence of alpha(v)beta3 integrins in primordial neovasculature, particularly in acoustically unfavorable environments.
Thermodynamic properties of Kehagias-Sfetsos black hole and KS/CFT correspondence
NASA Astrophysics Data System (ADS)
Pradhan, Parthapratim
2017-11-01
We speculate on various thermodynamic features of the inner horizon ({\\mathcal H}-) and outer horizons ({\\mathcal H}+) of Kehagias-Sfetsos (KS) black hole (BH) in the background of the Hořava-Lifshitz gravity. We compute particularly the area product, area sum, area minus and area division of the BH horizons. We find that they all are not showing universal behavior whereas the product is a universal quantity (PRADHAN P., Phys. Lett. B, 747 (2015) 64). Based on these relations, we derive the area bound of all horizons. From the area bound we derive the entropy bound and irreducible mass bound for all the horizons ({\\mathcal H}+/-) . We also observe that the first law of BH thermodynamics and Smarr-Gibbs-Duhem relations do not hold for this BH. The underlying reason behind this failure is due to the scale invariance of the coupling constant. Moreover, we compute the Cosmic-Censorship-Inequality for this BH which gives the lower bound for the total mass of the spacetime and it is supported by the cosmic cencorship conjecture. Finally, we discuss the KS/CFT correspondence via a thermodynamic procedure.
Ensemble-based characterization of unbound and bound states on protein energy landscape
Ruvinsky, Anatoly M; Kirys, Tatsiana; Tuzikov, Alexander V; Vakser, Ilya A
2013-01-01
Physicochemical description of numerous cell processes is fundamentally based on the energy landscapes of protein molecules involved. Although the whole energy landscape is difficult to reconstruct, increased attention to particular targets has provided enough structures for mapping functionally important subspaces associated with the unbound and bound protein structures. The subspace mapping produces a discrete representation of the landscape, further called energy spectrum. We compiled and characterized ensembles of bound and unbound conformations of six small proteins and explored their spectra in implicit solvent. First, the analysis of the unbound-to-bound changes points to conformational selection as the binding mechanism for four proteins. Second, results show that bound and unbound spectra often significantly overlap. Moreover, the larger the overlap the smaller the root mean square deviation (RMSD) between the bound and unbound conformational ensembles. Third, the center of the unbound spectrum has a higher energy than the center of the corresponding bound spectrum of the dimeric and multimeric states for most of the proteins. This suggests that the unbound states often have larger entropy than the bound states. Fourth, the exhaustively long minimization, making small intrarotamer adjustments (all-atom RMSD ≤ 0.7 Å), dramatically reduces the distance between the centers of the bound and unbound spectra as well as the spectra extent. It condenses unbound and bound energy levels into a thin layer at the bottom of the energy landscape with the energy spacing that varies between 0.8–4.6 and 3.5–10.5 kcal/mol for the unbound and bound states correspondingly. Finally, the analysis of protein energy fluctuations showed that protein vibrations itself can excite the interstate transitions, including the unbound-to-bound ones. PMID:23526684
Jia, Husen; Liggins, John R; Chow, Wah Soon
2014-02-24
According to the Second Law of Thermodynamics, an overall increase of entropy contributes to the driving force for any physicochemical process, but entropy has seldom been investigated in biological systems. Here, for the first time, we apply Isothermal Titration Calorimetry (ITC) to investigate the Mg(2+)-induced spontaneous stacking of photosynthetic membranes isolated from spinach leaves. After subtracting a large endothermic interaction of MgCl₂ with membranes, unrelated to stacking, we demonstrate that the enthalpy change (heat change at constant pressure) is zero or marginally positive or negative. This first direct experimental evidence strongly suggests that an entropy increase significantly drives membrane stacking in this ordered biological structure. Possible mechanisms for the entropy increase include: (i) the attraction between discrete oppositely-charged areas, releasing counterions; (ii) the release of loosely-bound water molecules from the inter-membrane gap; (iii) the increased orientational freedom of previously-aligned water dipoles; and (iv) the lateral rearrangement of membrane components.
Jia, Husen; Liggins, John R.; Chow, Wah Soon
2014-01-01
According to the Second Law of Thermodynamics, an overall increase of entropy contributes to the driving force for any physicochemical process, but entropy has seldom been investigated in biological systems. Here, for the first time, we apply Isothermal Titration Calorimetry (ITC) to investigate the Mg2+-induced spontaneous stacking of photosynthetic membranes isolated from spinach leaves. After subtracting a large endothermic interaction of MgCl2 with membranes, unrelated to stacking, we demonstrate that the enthalpy change (heat change at constant pressure) is zero or marginally positive or negative. This first direct experimental evidence strongly suggests that an entropy increase significantly drives membrane stacking in this ordered biological structure. Possible mechanisms for the entropy increase include: (i) the attraction between discrete oppositely-charged areas, releasing counterions; (ii) the release of loosely-bound water molecules from the inter-membrane gap; (iii) the increased orientational freedom of previously-aligned water dipoles; and (iv) the lateral rearrangement of membrane components. PMID:24561561
Two distinct DNA sequences recognized by transcription factors represent enthalpy and entropy optima
Yin, Yimeng; Das, Pratyush K; Jolma, Arttu; Zhu, Fangjie; Popov, Alexander; Xu, You; Nilsson, Lennart
2018-01-01
Most transcription factors (TFs) can bind to a population of sequences closely related to a single optimal site. However, some TFs can bind to two distinct sequences that represent two local optima in the Gibbs free energy of binding (ΔG). To determine the molecular mechanism behind this effect, we solved the structures of human HOXB13 and CDX2 bound to their two optimal DNA sequences, CAATAAA and TCGTAAA. Thermodynamic analyses by isothermal titration calorimetry revealed that both sites were bound with similar ΔG. However, the interaction with the CAA sequence was driven by change in enthalpy (ΔH), whereas the TCG site was bound with similar affinity due to smaller loss of entropy (ΔS). This thermodynamic mechanism that leads to at least two local optima likely affects many macromolecular interactions, as ΔG depends on two partially independent variables ΔH and ΔS according to the central equation of thermodynamics, ΔG = ΔH - TΔS. PMID:29638214
DOE Office of Scientific and Technical Information (OSTI.GOV)
Dehesa, J.S.; Martinez-Finkelshtein, A.; Sorokin, V.N.
The asymptotics of the Boltzmann-Shannon information entropy as well as the Renyi entropy for the quantum probability density of a single-particle system with a confining (i.e., bounded below) power-type potential V(x)=x{sup 2k} with k is a member of N and x is a member of R, is investigated in the position and momentum spaces within the semiclassical (WKB) approximation. It is found that for highly excited states both physical entropies, as well as their sum, have a logarithmic dependence on its quantum number not only when k=1 (harmonic oscillator), but also for any fixed k. As a by-product, the extremalmore » case k{yields}{infinity} (the infinite well potential) is also rigorously analyzed. It is shown that not only the position-space entropy has the same constant value for all quantum states, which is a known result, but also that the momentum-space entropy is constant for highly excited states.« less
Contour entropy: a new determinant of perceiving ground or a hole.
Gillam, Barbara J; Grove, Philip M
2011-06-01
Figure-ground perception is typically described as seeing one surface occluding another. Figure properties, not ground properties, are considered the significant factors. In scenes, however, a near surface will often occlude multiple contours and surfaces, often at different depths, producing alignments that are improbable except under conditions of occlusion. We thus hypothesized that unrelated (high entropy) lines would tend to appear as ground in a figure-ground paradigm more often than similarly aligned ordered (low entropy) lines. We further hypothesized that for lines spanning a closed area, high line entropy should increase the hole-like appearance of that area. These predictions were confirmed in three experiments. The probability that patterned rectangles were seen as ground when alternated with blank rectangles increased with pattern entropy. A single rectangular shape appeared more hole-like when the entropy of the enclosed contours increased. Furthermore, these same contours, with the outline shape removed, gave rise to bounding illusory contours whose strength increased with contour entropy. We conclude that figure-ground and hole perception can be determined by properties of ground in the absence of any figural shape, or surround, factors.
NASA Astrophysics Data System (ADS)
Renes, Joseph M.
2017-10-01
We extend the recent bounds of Sason and Verdú relating Rényi entropy and Bayesian hypothesis testing (arXiv:1701.01974.) to the quantum domain and show that they have a number of different applications. First, we obtain a sharper bound relating the optimal probability of correctly distinguishing elements of an ensemble of states to that of the pretty good measurement, and an analogous bound for optimal and pretty good entanglement recovery. Second, we obtain bounds relating optimal guessing and entanglement recovery to the fidelity of the state with a product state, which then leads to tight tripartite uncertainty and monogamy relations.
The entropic cost of quantum generalized measurements
NASA Astrophysics Data System (ADS)
Mancino, Luca; Sbroscia, Marco; Roccia, Emanuele; Gianani, Ilaria; Somma, Fabrizia; Mataloni, Paolo; Paternostro, Mauro; Barbieri, Marco
2018-03-01
Landauer's principle introduces a symmetry between computational and physical processes: erasure of information, a logically irreversible operation, must be underlain by an irreversible transformation dissipating energy. Monitoring micro- and nano-systems needs to enter into the energetic balance of their control; hence, finding the ultimate limits is instrumental to the development of future thermal machines operating at the quantum level. We report on the experimental investigation of a lower bound to the irreversible entropy associated to generalized quantum measurements on a quantum bit. We adopted a quantum photonics gate to implement a device interpolating from the weakly disturbing to the fully invasive and maximally informative regime. Our experiment prompted us to introduce a bound taking into account both the classical result of the measurement and the outcoming quantum state; unlike previous investigation, our entropic bound is based uniquely on measurable quantities. Our results highlight what insights the information-theoretic approach provides on building blocks of quantum information processors.
On variational expressions for quantum relative entropies
NASA Astrophysics Data System (ADS)
Berta, Mario; Fawzi, Omar; Tomamichel, Marco
2017-12-01
Distance measures between quantum states like the trace distance and the fidelity can naturally be defined by optimizing a classical distance measure over all measurement statistics that can be obtained from the respective quantum states. In contrast, Petz showed that the measured relative entropy, defined as a maximization of the Kullback-Leibler divergence over projective measurement statistics, is strictly smaller than Umegaki's quantum relative entropy whenever the states do not commute. We extend this result in two ways. First, we show that Petz' conclusion remains true if we allow general positive operator-valued measures. Second, we extend the result to Rényi relative entropies and show that for non-commuting states the sandwiched Rényi relative entropy is strictly larger than the measured Rényi relative entropy for α \\in (1/2, \\infty ) and strictly smaller for α \\in [0,1/2). The latter statement provides counterexamples for the data processing inequality of the sandwiched Rényi relative entropy for α < 1/2. Our main tool is a new variational expression for the measured Rényi relative entropy, which we further exploit to show that certain lower bounds on quantum conditional mutual information are superadditive.
Mapping current fluctuations of stochastic pumps to nonequilibrium steady states.
NASA Astrophysics Data System (ADS)
Rotskoff, Grant
We show that current fluctuations in stochastic pumps can be robustly mapped to fluctuations in a corresponding time-independent non-equilibrium steady state. We thus refine a recently proposed mapping so that it ensures equivalence of not only the averages, but also the optimal representation of fluctuations in currents and density. Our mapping leads to a natural decomposition of the entropy production in stochastic pumps, similar to the ``housekeeping'' heat. As a consequence of the decomposition of entropy production, the current fluctuations in weakly perturbed stochastic pumps satisfy a universal bound determined by the steady state entropy production. National Science Foundation Graduate Research Fellowship.
Rigid Residue Scan Simulations Systematically Reveal Residue Entropic Roles in Protein Allostery
Liu, Jin
2016-01-01
Intra-protein information is transmitted over distances via allosteric processes. This ubiquitous protein process allows for protein function changes due to ligand binding events. Understanding protein allostery is essential to understanding protein functions. In this study, allostery in the second PDZ domain (PDZ2) in the human PTP1E protein is examined as model system to advance a recently developed rigid residue scan method combining with configurational entropy calculation and principal component analysis. The contributions from individual residues to whole-protein dynamics and allostery were systematically assessed via rigid body simulations of both unbound and ligand-bound states of the protein. The entropic contributions of individual residues to whole-protein dynamics were evaluated based on covariance-based correlation analysis of all simulations. The changes of overall protein entropy when individual residues being held rigid support that the rigidity/flexibility equilibrium in protein structure is governed by the La Châtelier’s principle of chemical equilibrium. Key residues of PDZ2 allostery were identified with good agreement with NMR studies of the same protein bound to the same peptide. On the other hand, the change of entropic contribution from each residue upon perturbation revealed intrinsic differences among all the residues. The quasi-harmonic and principal component analyses of simulations without rigid residue perturbation showed a coherent allosteric mode from unbound and bound states, respectively. The projection of simulations with rigid residue perturbation onto coherent allosteric modes demonstrated the intrinsic shifting of ensemble distributions supporting the population-shift theory of protein allostery. Overall, the study presented here provides a robust and systematic approach to estimate the contribution of individual residue internal motion to overall protein dynamics and allostery. PMID:27115535
Measurement Uncertainty Relations for Discrete Observables: Relative Entropy Formulation
NASA Astrophysics Data System (ADS)
Barchielli, Alberto; Gregoratti, Matteo; Toigo, Alessandro
2018-02-01
We introduce a new information-theoretic formulation of quantum measurement uncertainty relations, based on the notion of relative entropy between measurement probabilities. In the case of a finite-dimensional system and for any approximate joint measurement of two target discrete observables, we define the entropic divergence as the maximal total loss of information occurring in the approximation at hand. For fixed target observables, we study the joint measurements minimizing the entropic divergence, and we prove the general properties of its minimum value. Such a minimum is our uncertainty lower bound: the total information lost by replacing the target observables with their optimal approximations, evaluated at the worst possible state. The bound turns out to be also an entropic incompatibility degree, that is, a good information-theoretic measure of incompatibility: indeed, it vanishes if and only if the target observables are compatible, it is state-independent, and it enjoys all the invariance properties which are desirable for such a measure. In this context, we point out the difference between general approximate joint measurements and sequential approximate joint measurements; to do this, we introduce a separate index for the tradeoff between the error of the first measurement and the disturbance of the second one. By exploiting the symmetry properties of the target observables, exact values, lower bounds and optimal approximations are evaluated in two different concrete examples: (1) a couple of spin-1/2 components (not necessarily orthogonal); (2) two Fourier conjugate mutually unbiased bases in prime power dimension. Finally, the entropic incompatibility degree straightforwardly generalizes to the case of many observables, still maintaining all its relevant properties; we explicitly compute it for three orthogonal spin-1/2 components.
NASA Astrophysics Data System (ADS)
Petrov, Pavel
In this thesis we study the properties of strongly-coupled large-N conformal field theories (CFT's) using AdS/CFT correspondence. Chapter 1 serves as an introduction. In Chapter 2 we study the shear viscosity of strongly-coupled large-N conformal field theories. We find that it is affected by R2 corrections to the AdS action and present an example of 4D theory in which the the conjectured universal lower bound on viscosity-to-entropy ratio η/s > 1/4π is violated by 1/N corrections. This fact proves that there is no universal lower bound of 1/4π on viscosity-to-entropy ratio and may be relevant for the studies of QCD quark-gluon plasma for which this ratio is experimentally found to be close to 1/4π. In Chapter 3 we study the formation of the electron star in 4D AdS space. We show that in a gravity theory with charged fermions a layer of charged fermion fluid may form at a finite distance from the charged black hole. We show that these “electron stars” are candidate gravity duals for strongly interacting fermion systems at finite density and finite temperature. Entropy density for such systems scales as s ˜ T2/z at low temperatures as expected from IR criticality of electron stars solutions.
r-process nucleosynthesis in the high-entropy supernova bubble
NASA Technical Reports Server (NTRS)
Meyer, B. S.; Mathews, G. J.; Howard, W. M.; Woosley, S. E.; Hoffman, R. D.
1992-01-01
We show that the high-temperature, high-entropy evacuated region outside the recent neutron star in a core-collapse supernova may be an ideal r-process site. In this high-entropy environment it is possible that most nucleons are in the form of free neutrons or bound into alpha particles. Thus, there can be many neutrons per seed nucleus even though the material is not particularly neutron rich. The predicted amount of r-process material ejected per event from this environment agrees well with that required by simple galactic evolution arguments. When averaged over regions of different neutron excess in the supernova ejecta, the calculated r-process abundance curve can give a good representation of the solar-system r-process abundances as long as the entropy per baryon is sufficiently high. Neutrino irradiation may aid in smoothing the final abundance distribution.
Multivariate quadrature for representing cloud condensation nuclei activity of aerosol populations
Fierce, Laura; McGraw, Robert L.
2017-07-26
Here, sparse representations of atmospheric aerosols are needed for efficient regional- and global-scale chemical transport models. Here we introduce a new framework for representing aerosol distributions, based on the quadrature method of moments. Given a set of moment constraints, we show how linear programming, combined with an entropy-inspired cost function, can be used to construct optimized quadrature representations of aerosol distributions. The sparse representations derived from this approach accurately reproduce cloud condensation nuclei (CCN) activity for realistically complex distributions simulated by a particleresolved model. Additionally, the linear programming techniques described in this study can be used to bound key aerosolmore » properties, such as the number concentration of CCN. Unlike the commonly used sparse representations, such as modal and sectional schemes, the maximum-entropy approach described here is not constrained to pre-determined size bins or assumed distribution shapes. This study is a first step toward a particle-based aerosol scheme that will track multivariate aerosol distributions with sufficient computational efficiency for large-scale simulations.« less
Multivariate quadrature for representing cloud condensation nuclei activity of aerosol populations
DOE Office of Scientific and Technical Information (OSTI.GOV)
Fierce, Laura; McGraw, Robert L.
Here, sparse representations of atmospheric aerosols are needed for efficient regional- and global-scale chemical transport models. Here we introduce a new framework for representing aerosol distributions, based on the quadrature method of moments. Given a set of moment constraints, we show how linear programming, combined with an entropy-inspired cost function, can be used to construct optimized quadrature representations of aerosol distributions. The sparse representations derived from this approach accurately reproduce cloud condensation nuclei (CCN) activity for realistically complex distributions simulated by a particleresolved model. Additionally, the linear programming techniques described in this study can be used to bound key aerosolmore » properties, such as the number concentration of CCN. Unlike the commonly used sparse representations, such as modal and sectional schemes, the maximum-entropy approach described here is not constrained to pre-determined size bins or assumed distribution shapes. This study is a first step toward a particle-based aerosol scheme that will track multivariate aerosol distributions with sufficient computational efficiency for large-scale simulations.« less
Burton, Donald E.; Morgan, Nathaniel Ray; Charest, Marc Robert Joseph; ...
2017-11-22
From the very origins of numerical hydrodynamics in the Lagrangian work of von Neumann and Richtmyer [83], the issue of total energy conservation as well as entropy production has been problematic. Because of well known problems with mesh deformation, Lagrangian schemes have evolved into Arbitrary Lagrangian–Eulerian (ALE) methods [39] that combine the best properties of Lagrangian and Eulerian methods. Energy issues have persisted for this class of methods. We believe that fundamental issues of energy conservation and entropy production in ALE require further examination. The context of the paper is an ALE scheme that is extended in the sense thatmore » it permits cyclic or periodic remap of data between grids of the same or differing connectivity. The principal design goals for a remap method then consist of total energy conservation, bounded internal energy, and compatibility of kinetic energy and momentum. We also have secondary objectives of limiting velocity and stress in a non-directional manner, keeping primitive variables monotone, and providing a higher than second order reconstruction of remapped variables. Particularly, the new contributions fall into three categories associated with: energy conservation and entropy production, reconstruction and bounds preservation of scalar and tensor fields, and conservative remap of nonlinear fields. Our paper presents a derivation of the methods, details of implementation, and numerical results for a number of test problems. The methods requires volume integration of polynomial functions in polytopal cells with planar facets, and the requisite expressions are derived for arbitrary order.« less
NASA Astrophysics Data System (ADS)
Burton, D. E.; Morgan, N. R.; Charest, M. R. J.; Kenamond, M. A.; Fung, J.
2018-02-01
From the very origins of numerical hydrodynamics in the Lagrangian work of von Neumann and Richtmyer [83], the issue of total energy conservation as well as entropy production has been problematic. Because of well known problems with mesh deformation, Lagrangian schemes have evolved into Arbitrary Lagrangian-Eulerian (ALE) methods [39] that combine the best properties of Lagrangian and Eulerian methods. Energy issues have persisted for this class of methods. We believe that fundamental issues of energy conservation and entropy production in ALE require further examination. The context of the paper is an ALE scheme that is extended in the sense that it permits cyclic or periodic remap of data between grids of the same or differing connectivity. The principal design goals for a remap method then consist of total energy conservation, bounded internal energy, and compatibility of kinetic energy and momentum. We also have secondary objectives of limiting velocity and stress in a non-directional manner, keeping primitive variables monotone, and providing a higher than second order reconstruction of remapped variables. In particular, the new contributions fall into three categories associated with: energy conservation and entropy production, reconstruction and bounds preservation of scalar and tensor fields, and conservative remap of nonlinear fields. The paper presents a derivation of the methods, details of implementation, and numerical results for a number of test problems. The methods requires volume integration of polynomial functions in polytopal cells with planar facets, and the requisite expressions are derived for arbitrary order.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Burton, Donald E.; Morgan, Nathaniel Ray; Charest, Marc Robert Joseph
From the very origins of numerical hydrodynamics in the Lagrangian work of von Neumann and Richtmyer [83], the issue of total energy conservation as well as entropy production has been problematic. Because of well known problems with mesh deformation, Lagrangian schemes have evolved into Arbitrary Lagrangian–Eulerian (ALE) methods [39] that combine the best properties of Lagrangian and Eulerian methods. Energy issues have persisted for this class of methods. We believe that fundamental issues of energy conservation and entropy production in ALE require further examination. The context of the paper is an ALE scheme that is extended in the sense thatmore » it permits cyclic or periodic remap of data between grids of the same or differing connectivity. The principal design goals for a remap method then consist of total energy conservation, bounded internal energy, and compatibility of kinetic energy and momentum. We also have secondary objectives of limiting velocity and stress in a non-directional manner, keeping primitive variables monotone, and providing a higher than second order reconstruction of remapped variables. Particularly, the new contributions fall into three categories associated with: energy conservation and entropy production, reconstruction and bounds preservation of scalar and tensor fields, and conservative remap of nonlinear fields. Our paper presents a derivation of the methods, details of implementation, and numerical results for a number of test problems. The methods requires volume integration of polynomial functions in polytopal cells with planar facets, and the requisite expressions are derived for arbitrary order.« less
NASA Astrophysics Data System (ADS)
Hu, Yong; Wu, Feifei; Ma, Yongli; He, Jizhou; Wang, Jianhui; Hernández, A. Calvo; Roco, J. M. M.
2013-12-01
We study the coefficient of performance (COP) and its bounds for a Carnot-like refrigerator working between two heat reservoirs at constant temperatures Th and Tc, under two optimization criteria χ and Ω. In view of the fact that an “adiabatic” process usually takes finite time and is nonisentropic, the nonadiabatic dissipation and the finite time required for the adiabatic processes are taken into account by assuming low dissipation. For given optimization criteria, we find that the lower and upper bounds of the COP are the same as the corresponding ones obtained from the previous idealized models where any adiabatic process is undergone instantaneously with constant entropy. To describe some particular models with very fast adiabatic transitions, we also consider the influence of the nonadiabatic dissipation on the bounds of the COP, under the assumption that the irreversible entropy production in the adiabatic process is constant and independent of time. Our theoretical predictions match the observed COPs of real refrigerators more closely than the ones derived in the previous models, providing a strong argument in favor of our approach.
Time dependence of Hawking radiation entropy
NASA Astrophysics Data System (ADS)
Page, Don N.
2013-09-01
If a black hole starts in a pure quantum state and evaporates completely by a unitary process, the von Neumann entropy of the Hawking radiation initially increases and then decreases back to zero when the black hole has disappeared. Here numerical results are given for an approximation to the time dependence of the radiation entropy under an assumption of fast scrambling, for large nonrotating black holes that emit essentially only photons and gravitons. The maximum of the von Neumann entropy then occurs after about 53.81% of the evaporation time, when the black hole has lost about 40.25% of its original Bekenstein-Hawking (BH) entropy (an upper bound for its von Neumann entropy) and then has a BH entropy that equals the entropy in the radiation, which is about 59.75% of the original BH entropy 4πM02, or about 7.509M02 ≈ 6.268 × 1076(M0/Msolar)2, using my 1976 calculations that the photon and graviton emission process into empty space gives about 1.4847 times the BH entropy loss of the black hole. Results are also given for black holes in initially impure states. If the black hole starts in a maximally mixed state, the von Neumann entropy of the Hawking radiation increases from zero up to a maximum of about 119.51% of the original BH entropy, or about 15.018M02 ≈ 1.254 × 1077(M0/Msolar)2, and then decreases back down to 4πM02 = 1.049 × 1077(M0/Msolar)2.
Another short and elementary proof of strong subadditivity of quantum entropy
NASA Astrophysics Data System (ADS)
Ruskai, Mary Beth
2007-08-01
A short and elementary proof of the joint convexity of relative entropy is presented, using nothing beyond linear algebra. The key ingredients are an easily verified integral representation and the strategy used to prove the Cauchy-Schwarz inequality in elementary courses. Several consequences are proved in a way which allows an elementary proof of strong subadditivity in a few more lines. Some expository material on Schwarz inequalities for operators and the Holevo bound for partial measurements is also included.
Contraction coefficients for noisy quantum channels
DOE Office of Scientific and Technical Information (OSTI.GOV)
Hiai, Fumio, E-mail: hiai.fumio@gmail.com; Ruskai, Mary Beth, E-mail: ruskai@member.ams.org
Generalized relative entropy, monotone Riemannian metrics, geodesic distance, and trace distance are all known to decrease under the action of quantum channels. We give some new bounds on, and relationships between, the maximal contraction for these quantities.
Experimental Detection of Quantum Channel Capacities.
Cuevas, Álvaro; Proietti, Massimiliano; Ciampini, Mario Arnolfo; Duranti, Stefano; Mataloni, Paolo; Sacchi, Massimiliano F; Macchiavello, Chiara
2017-09-08
We present an efficient experimental procedure that certifies nonvanishing quantum capacities for qubit noisy channels. Our method is based on the use of a fixed bipartite entangled state, where the system qubit is sent to the channel input. A particular set of local measurements is performed at the channel output and the ancilla qubit mode, obtaining lower bounds to the quantum capacities for any unknown channel with no need of quantum process tomography. The entangled qubits have a Bell state configuration and are encoded in photon polarization. The lower bounds are found by estimating the Shannon and von Neumann entropies at the output using an optimized basis, whose statistics is obtained by measuring only the three observables σ_{x}⊗σ_{x}, σ_{y}⊗σ_{y}, and σ_{z}⊗σ_{z}.
A MATLAB implementation of the minimum relative entropy method for linear inverse problems
NASA Astrophysics Data System (ADS)
Neupauer, Roseanna M.; Borchers, Brian
2001-08-01
The minimum relative entropy (MRE) method can be used to solve linear inverse problems of the form Gm= d, where m is a vector of unknown model parameters and d is a vector of measured data. The MRE method treats the elements of m as random variables, and obtains a multivariate probability density function for m. The probability density function is constrained by prior information about the upper and lower bounds of m, a prior expected value of m, and the measured data. The solution of the inverse problem is the expected value of m, based on the derived probability density function. We present a MATLAB implementation of the MRE method. Several numerical issues arise in the implementation of the MRE method and are discussed here. We present the source history reconstruction problem from groundwater hydrology as an example of the MRE implementation.
NASA Astrophysics Data System (ADS)
Emre, Baris; Yüce, Süheyla; Stern-Taulats, Enric; Planes, Antoni; Fabbrici, Simone; Albertini, Franca; Mañosa, Lluís
2013-06-01
Calorimetry under magnetic field has been used to study the inverse magnetocaloric effect in Ni-Co-Mn-Ga-In magnetic shape memory alloys. It is shown that the energy dissipated during a complete transformation loop only represents a small fraction (5% to 7%) of the latent heat of the martensitic transition. It is found that the entropy values obtained from isofield temperature scans agree well with those obtained from isothermal magnetic field scans. The reproducibility of the magnetocaloric effect has been studied from isothermal measurements. Reproducible entropy values under field cycling have been found within a temperature interval bounded by the start temperature of the forward transition at zero field and the start temperature of the reverse transition under applied field. Large reversible entropy changes around 11 J/kg K have been found for fields up to 6 T.
Do `negative' temperatures exist?
NASA Astrophysics Data System (ADS)
Lavenda, B. H.
1999-06-01
A modification of the second law is required for a system with a bounded density of states and not the introduction of a `negative' temperature scale. The ascending and descending branches of the entropy versus energy curve describe particle and hole states, having thermal equations of state that are given by the Fermi and logistic distributions, respectively. Conservation of energy requires isentropic states to be isothermal. The effect of adiabatically reversing the field is entirely mechanical because the only difference between the two states is their energies. The laws of large and small numbers, leading to the normal and Poisson approximations, characterize statistically the states of infinite and zero temperatures, respectively. Since the heat capacity also vanishes in the state of maximum disorder, the third law can be generalized in systems with a bounded density of states: the entropy tends to a constant as the temperature tends to either zero or infinity.
Improved one-dimensional area law for frustration-free systems
NASA Astrophysics Data System (ADS)
Arad, Itai; Landau, Zeph; Vazirani, Umesh
2012-05-01
We present a new proof for the 1D area law for frustration-free systems with a constant gap, which exponentially improves the entropy bound in Hastingsâ 1D area law and which is tight to within a polynomial factor. For particles of dimension d, spectral gap ɛ>0, and interaction strength at most J, our entropy bound is S1D≤O(1)·X3log8X, where X=def(Jlogd)/ɛ. Our proof is completely combinatorial, combining the detectability lemma with basic tools from approximation theory. In higher dimensions, when the bipartitioning area is |∂L|, we use additional local structure in the proof and show that S≤O(1)·|∂L|2log6|∂L|·X3log8X. This is at the cusp of being nontrivial in the 2D case, in the sense that any further improvement would yield a subvolume law.
Time dependence of Hawking radiation entropy
DOE Office of Scientific and Technical Information (OSTI.GOV)
Page, Don N., E-mail: profdonpage@gmail.com
2013-09-01
If a black hole starts in a pure quantum state and evaporates completely by a unitary process, the von Neumann entropy of the Hawking radiation initially increases and then decreases back to zero when the black hole has disappeared. Here numerical results are given for an approximation to the time dependence of the radiation entropy under an assumption of fast scrambling, for large nonrotating black holes that emit essentially only photons and gravitons. The maximum of the von Neumann entropy then occurs after about 53.81% of the evaporation time, when the black hole has lost about 40.25% of its originalmore » Bekenstein-Hawking (BH) entropy (an upper bound for its von Neumann entropy) and then has a BH entropy that equals the entropy in the radiation, which is about 59.75% of the original BH entropy 4πM{sub 0}{sup 2}, or about 7.509M{sub 0}{sup 2} ≈ 6.268 × 10{sup 76}(M{sub 0}/M{sub s}un){sup 2}, using my 1976 calculations that the photon and graviton emission process into empty space gives about 1.4847 times the BH entropy loss of the black hole. Results are also given for black holes in initially impure states. If the black hole starts in a maximally mixed state, the von Neumann entropy of the Hawking radiation increases from zero up to a maximum of about 119.51% of the original BH entropy, or about 15.018M{sub 0}{sup 2} ≈ 1.254 × 10{sup 77}(M{sub 0}/M{sub s}un){sup 2}, and then decreases back down to 4πM{sub 0}{sup 2} = 1.049 × 10{sup 77}(M{sub 0}/M{sub s}un){sup 2}.« less
Using heteroclinic orbits to quantify topological entropy in fluid flows
NASA Astrophysics Data System (ADS)
Sattari, Sulimon; Chen, Qianting; Mitchell, Kevin A.
2016-03-01
Topological approaches to mixing are important tools to understand chaotic fluid flows, ranging from oceanic transport to the design of micro-mixers. Typically, topological entropy, the exponential growth rate of material lines, is used to quantify topological mixing. Computing topological entropy from the direct stretching rate is computationally expensive and sheds little light on the source of the mixing. Earlier approaches emphasized that topological entropy could be viewed as generated by the braiding of virtual, or "ghost," rods stirring the fluid in a periodic manner. Here, we demonstrate that topological entropy can also be viewed as generated by the braiding of ghost rods following heteroclinic orbits instead. We use the machinery of homotopic lobe dynamics, which extracts symbolic dynamics from finite-length pieces of stable and unstable manifolds attached to fixed points of the fluid flow. As an example, we focus on the topological entropy of a bounded, chaotic, two-dimensional, double-vortex cavity flow. Over a certain parameter range, the topological entropy is primarily due to the braiding of a period-three orbit. However, this orbit does not explain the topological entropy for parameter values where it does not exist, nor does it explain the excess of topological entropy for the entire range of its existence. We show that braiding by heteroclinic orbits provides an accurate computation of topological entropy when the period-three orbit does not exist, and that it provides an explanation for some of the excess topological entropy when the period-three orbit does exist. Furthermore, the computation of symbolic dynamics using heteroclinic orbits has been automated and can be used to compute topological entropy for a general 2D fluid flow.
A bound particle coupled to two thermostats
NASA Astrophysics Data System (ADS)
Fogedby, Hans C.; Imparato, Alberto
2011-05-01
We consider a harmonically bound Brownian particle coupled to two distinct heat reservoirs at different temperatures. We show that the presence of a harmonic trap does not change the large deviation function from the case of a free Brownian particle discussed by Derrida and Brunet and Visco. Likewise, the Gallavotti-Cohen fluctuation theorem related to the entropy production at the heat sources remains in force. We support the analytical results with numerical simulations.
Maximum-entropy probability distributions under Lp-norm constraints
NASA Technical Reports Server (NTRS)
Dolinar, S.
1991-01-01
Continuous probability density functions and discrete probability mass functions are tabulated which maximize the differential entropy or absolute entropy, respectively, among all probability distributions with a given L sub p norm (i.e., a given pth absolute moment when p is a finite integer) and unconstrained or constrained value set. Expressions for the maximum entropy are evaluated as functions of the L sub p norm. The most interesting results are obtained and plotted for unconstrained (real valued) continuous random variables and for integer valued discrete random variables. The maximum entropy expressions are obtained in closed form for unconstrained continuous random variables, and in this case there is a simple straight line relationship between the maximum differential entropy and the logarithm of the L sub p norm. Corresponding expressions for arbitrary discrete and constrained continuous random variables are given parametrically; closed form expressions are available only for special cases. However, simpler alternative bounds on the maximum entropy of integer valued discrete random variables are obtained by applying the differential entropy results to continuous random variables which approximate the integer valued random variables in a natural manner. All the results are presented in an integrated framework that includes continuous and discrete random variables, constraints on the permissible value set, and all possible values of p. Understanding such as this is useful in evaluating the performance of data compression schemes.
Universal bound on the efficiency of molecular motors
NASA Astrophysics Data System (ADS)
Pietzonka, Patrick; Barato, Andre C.; Seifert, Udo
2016-12-01
The thermodynamic uncertainty relation provides an inequality relating any mean current, the associated dispersion and the entropy production rate for arbitrary non-equilibrium steady states. Applying it here to a general model of a molecular motor running against an external force or torque, we show that the thermodynamic efficiency of such motors is universally bounded by an expression involving only experimentally accessible quantities. For motors pulling cargo through a viscous fluid, a universal bound for the corresponding Stokes efficiency follows as a variant. A similar result holds if mechanical force is used to synthesize molecules of high chemical potential. Crucially, no knowledge of the detailed underlying mechano-chemical mechanism is required for applying these bounds.
Nonequilibrium thermodynamics and information theory: basic concepts and relaxing dynamics
NASA Astrophysics Data System (ADS)
Altaner, Bernhard
2017-11-01
Thermodynamics is based on the notions of energy and entropy. While energy is the elementary quantity governing physical dynamics, entropy is the fundamental concept in information theory. In this work, starting from first principles, we give a detailed didactic account on the relations between energy and entropy and thus physics and information theory. We show that thermodynamic process inequalities, like the second law, are equivalent to the requirement that an effective description for physical dynamics is strongly relaxing. From the perspective of information theory, strongly relaxing dynamics govern the irreversible convergence of a statistical ensemble towards the maximally non-commital probability distribution that is compatible with thermodynamic equilibrium parameters. In particular, Markov processes that converge to a thermodynamic equilibrium state are strongly relaxing. Our framework generalizes previous results to arbitrary open and driven systems, yielding novel thermodynamic bounds for idealized and real processes. , which features invited work from the best early-career researchers working within the scope of J. Phys. A. This project is part of the Journal of Physics series’ 50th anniversary celebrations in 2017. Bernhard Altaner was selected by the Editorial Board of J. Phys. A as an Emerging Talent.
On Entropy Production in the Madelung Fluid and the Role of Bohm's Potential in Classical Diffusion
NASA Astrophysics Data System (ADS)
Heifetz, Eyal; Tsekov, Roumen; Cohen, Eliahu; Nussinov, Zohar
2016-07-01
The Madelung equations map the non-relativistic time-dependent Schrödinger equation into hydrodynamic equations of a virtual fluid. While the von Neumann entropy remains constant, we demonstrate that an increase of the Shannon entropy, associated with this Madelung fluid, is proportional to the expectation value of its velocity divergence. Hence, the Shannon entropy may grow (or decrease) due to an expansion (or compression) of the Madelung fluid. These effects result from the interference between solutions of the Schrödinger equation. Growth of the Shannon entropy due to expansion is common in diffusive processes. However, in the latter the process is irreversible while the processes in the Madelung fluid are always reversible. The relations between interference, compressibility and variation of the Shannon entropy are then examined in several simple examples. Furthermore, we demonstrate that for classical diffusive processes, the "force" accelerating diffusion has the form of the positive gradient of the quantum Bohm potential. Expressing then the diffusion coefficient in terms of the Planck constant reveals the lower bound given by the Heisenberg uncertainty principle in terms of the product between the gas mean free path and the Brownian momentum.
Holographic entropy and real-time dynamics of quarkonium dissociation in non-Abelian plasma
Iatrakis, Ioannis; Kharzeev, Dmitri E.
2016-04-26
The peak of the heavy quark pair entropy at the deconfinement transition, observed in lattice QCD, suggests that the transition is effectively driven by the increase of the entropy of bound states. The growth of the entropy with the interquark distance leads to the emergent entropic force that induces dissociation of quarkonium states. Since the quark-gluon plasma around the transition point is a strongly coupled system, we use the gauge-gravity duality to study the entropy of heavy quarkonium and the real-time dynamics of its dissociation. In particular, we employ the improved holographic QCD model as a dual description of largemore » N c Yang-Mills theory. Studying the dynamics of the fundamental string between the quarks placed on the boundary, we find that the entropy peaks at the transition point. We also study the real-time dynamics of the system by considering the holographic string falling in the black hole horizon where it equilibrates. As a result, in the vicinity of the deconfinement transition, the dissociation time is found to be less than a fermi, suggesting that the entropic destruction is the dominant dissociation mechanism in this temperature region.« less
Enthalpy-entropy compensation: the role of solvation.
Dragan, Anatoliy I; Read, Christopher M; Crane-Robinson, Colyn
2017-05-01
Structural modifications to interacting systems frequently lead to changes in both the enthalpy (heat) and entropy of the process that compensate each other, so that the Gibbs free energy is little changed: a major barrier to the development of lead compounds in drug discovery. The conventional explanation for such enthalpy-entropy compensation (EEC) is that tighter contacts lead to a more negative enthalpy but increased molecular constraints, i.e., a compensating conformational entropy reduction. Changes in solvation can also contribute to EEC but this contribution is infrequently discussed. We review long-established and recent cases of EEC and conclude that the large fluctuations in enthalpy and entropy observed are too great to be a result of only conformational changes and must result, to a considerable degree, from variations in the amounts of water immobilized or released on forming complexes. Two systems exhibiting EEC show a correlation between calorimetric entropies and local mobilities, interpreted to mean conformational control of the binding entropy/free energy. However, a substantial contribution from solvation gives the same effect, as a consequence of a structural link between the amount of bound water and the protein flexibility. Only by assuming substantial changes in solvation-an intrinsically compensatory process-can a more complete understanding of EEC be obtained. Faced with such large, and compensating, changes in the enthalpies and entropies of binding, the best approach to engineering elevated affinities must be through the addition of ionic links, as they generate increased entropy without affecting the enthalpy.
Optimal attacks on qubit-based Quantum Key Recycling
NASA Astrophysics Data System (ADS)
Leermakers, Daan; Škorić, Boris
2018-03-01
Quantum Key Recycling (QKR) is a quantum cryptographic primitive that allows one to reuse keys in an unconditionally secure way. By removing the need to repeatedly generate new keys, it improves communication efficiency. Škorić and de Vries recently proposed a QKR scheme based on 8-state encoding (four bases). It does not require quantum computers for encryption/decryption but only single-qubit operations. We provide a missing ingredient in the security analysis of this scheme in the case of noisy channels: accurate upper bounds on the required amount of privacy amplification. We determine optimal attacks against the message and against the key, for 8-state encoding as well as 4-state and 6-state conjugate coding. We provide results in terms of min-entropy loss as well as accessible (Shannon) information. We show that the Shannon entropy analysis for 8-state encoding reduces to the analysis of quantum key distribution, whereas 4-state and 6-state suffer from additional leaks that make them less effective. From the optimal attacks we compute the required amount of privacy amplification and hence the achievable communication rate (useful information per qubit) of qubit-based QKR. Overall, 8-state encoding yields the highest communication rates.
The covariant entropy conjecture and concordance cosmological models
NASA Astrophysics Data System (ADS)
He, Song; Zhang, Hongbao
2008-10-01
Recently a covariant entropy conjecture has been proposed for dynamical horizons. We apply this conjecture to concordance cosmological models, namely, those cosmological models filled with perfect fluids, in the presence of a positive cosmological constant. As a result, we find that this conjecture has a severe constraint power. Not only does this conjecture rule out those cosmological models disfavored by the anthropic principle, but also it imposes an upper bound 10-60 on the cosmological constant for our own universe, which thus provides an alternative macroscopic perspective for understanding the long-standing cosmological constant problem.
Holographic entanglement entropy conjecture for general spacetimes
NASA Astrophysics Data System (ADS)
Sanches, Fabio; Weinberg, Sean J.
2016-10-01
We present a natural generalization of holographic entanglement entropy proposals beyond the scope of AdS /CFT by anchoring extremal surfaces to holographic screens. Holographic screens are a natural extension of the AdS boundary to arbitrary spacetimes and are preferred codimension-1 surfaces from the viewpoint of the covariant entropy bound. A broad class of screens have a unique preferred foliation into codimension-2 surfaces called leaves. Our proposal is to find the areas of extremal surfaces anchored to the boundaries of regions in leaves. We show that the properties of holographic screens are sufficient to prove, under generic conditions, that extremal surfaces anchored in this way always lie within a causal region associated with a given leaf. Within this causal region, a maximin construction similar to that of Wall proves that our proposed quantity satisfies standard properties of entanglement entropy like strong subadditivity. We conjecture that our prescription computes entanglement entropies in quantum states that holographically define arbitrary spacetimes, including those in a cosmological setting with no obvious boundary on which to anchor extremal surfaces.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Sattari, Sulimon, E-mail: ssattari2@ucmerced.edu; Chen, Qianting, E-mail: qchen2@ucmerced.edu; Mitchell, Kevin A., E-mail: kmitchell@ucmerced.edu
Topological approaches to mixing are important tools to understand chaotic fluid flows, ranging from oceanic transport to the design of micro-mixers. Typically, topological entropy, the exponential growth rate of material lines, is used to quantify topological mixing. Computing topological entropy from the direct stretching rate is computationally expensive and sheds little light on the source of the mixing. Earlier approaches emphasized that topological entropy could be viewed as generated by the braiding of virtual, or “ghost,” rods stirring the fluid in a periodic manner. Here, we demonstrate that topological entropy can also be viewed as generated by the braiding ofmore » ghost rods following heteroclinic orbits instead. We use the machinery of homotopic lobe dynamics, which extracts symbolic dynamics from finite-length pieces of stable and unstable manifolds attached to fixed points of the fluid flow. As an example, we focus on the topological entropy of a bounded, chaotic, two-dimensional, double-vortex cavity flow. Over a certain parameter range, the topological entropy is primarily due to the braiding of a period-three orbit. However, this orbit does not explain the topological entropy for parameter values where it does not exist, nor does it explain the excess of topological entropy for the entire range of its existence. We show that braiding by heteroclinic orbits provides an accurate computation of topological entropy when the period-three orbit does not exist, and that it provides an explanation for some of the excess topological entropy when the period-three orbit does exist. Furthermore, the computation of symbolic dynamics using heteroclinic orbits has been automated and can be used to compute topological entropy for a general 2D fluid flow.« less
Outlier Resistant Predictive Source Encoding for a Gaussian Stationary Nominal Source.
1987-09-18
breakdown point and influence function . The proposed sequence of predictive encoders attains strictly positive breakdown point and uniformly bounded... influence function , at the expense of increased mean difference-squared distortion and differential entropy, at the Gaussian nominal source.
Marginally trapped surfaces and AdS/CFT
NASA Astrophysics Data System (ADS)
Grado-White, Brianna; Marolf, Donald
2018-02-01
It has been proposed that the areas of marginally trapped or anti-trapped surfaces (also known as leaves of holographic screens) may encode some notion of entropy. To connect this to AdS/CFT, we study the case of marginally trapped surfaces anchored to an AdS boundary. We establish that such boundary-anchored leaves lie between the causal and extremal surfaces defined by the anchor and that they have area bounded below by that of the minimal extremal surface. This suggests that the area of any leaf represents a coarse-grained von Neumann entropy for the associated region of the dual CFT. We further demonstrate that the leading area-divergence of a boundary-anchored marginally trapped surface agrees with that for the associated extremal surface, though subleading divergences generally differ. Finally, we generalize an argument of Bousso and Engelhardt to show that holographic screens with all leaves anchored to the same boundary set have leaf-areas that increase monotonically along the screen, and we describe a construction through which this monotonicity can take the more standard form of requiring entropy to increase with boundary time. This construction is related to what one might call future causal holographic information, which in such cases also provides an upper bound on the area of the associated leaves.
An Entropy-Based Approach to Nonlinear Stability
NASA Technical Reports Server (NTRS)
Merriam, Marshal L.
1989-01-01
Many numerical methods used in computational fluid dynamics (CFD) incorporate an artificial dissipation term to suppress spurious oscillations and control nonlinear instabilities. The same effect can be accomplished by using upwind techniques, sometimes augmented with limiters to form Total Variation Diminishing (TVD) schemes. An analysis based on numerical satisfaction of the second law of thermodynamics allows many such methods to be compared and improved upon. A nonlinear stability proof is given for discrete scalar equations arising from a conservation law. Solutions to such equations are bounded in the L sub 2 norm if the second law of thermodynamics is satisfied in a global sense over a periodic domain. It is conjectured that an analogous statement is true for discrete equations arising from systems of conservation laws. Analysis and numerical experiments suggest that a more restrictive condition, a positive entropy production rate in each cell, is sufficient to exclude unphysical phenomena such as oscillations and expansion shocks. Construction of schemes which satisfy this condition is demonstrated for linear and nonlinear wave equations and for the one-dimensional Euler equations.
Faithful Squashed Entanglement
NASA Astrophysics Data System (ADS)
Brandão, Fernando G. S. L.; Christandl, Matthias; Yard, Jon
2011-09-01
Squashed entanglement is a measure for the entanglement of bipartite quantum states. In this paper we present a lower bound for squashed entanglement in terms of a distance to the set of separable states. This implies that squashed entanglement is faithful, that is, it is strictly positive if and only if the state is entangled. We derive the lower bound on squashed entanglement from a lower bound on the quantum conditional mutual information which is used to define squashed entanglement. The quantum conditional mutual information corresponds to the amount by which strong subadditivity of von Neumann entropy fails to be saturated. Our result therefore sheds light on the structure of states that almost satisfy strong subadditivity with equality. The proof is based on two recent results from quantum information theory: the operational interpretation of the quantum mutual information as the optimal rate for state redistribution and the interpretation of the regularised relative entropy of entanglement as an error exponent in hypothesis testing. The distance to the set of separable states is measured in terms of the LOCC norm, an operationally motivated norm giving the optimal probability of distinguishing two bipartite quantum states, each shared by two parties, using any protocol formed by local quantum operations and classical communication (LOCC) between the parties. A similar result for the Frobenius or Euclidean norm follows as an immediate consequence. The result has two applications in complexity theory. The first application is a quasipolynomial-time algorithm solving the weak membership problem for the set of separable states in LOCC or Euclidean norm. The second application concerns quantum Merlin-Arthur games. Here we show that multiple provers are not more powerful than a single prover when the verifier is restricted to LOCC operations thereby providing a new characterisation of the complexity class QMA.
Bounding species distribution models
Stohlgren, T.J.; Jarnevich, C.S.; Esaias, W.E.; Morisette, J.T.
2011-01-01
Species distribution models are increasing in popularity for mapping suitable habitat for species of management concern. Many investigators now recognize that extrapolations of these models with geographic information systems (GIS) might be sensitive to the environmental bounds of the data used in their development, yet there is no recommended best practice for "clamping" model extrapolations. We relied on two commonly used modeling approaches: classification and regression tree (CART) and maximum entropy (Maxent) models, and we tested a simple alteration of the model extrapolations, bounding extrapolations to the maximum and minimum values of primary environmental predictors, to provide a more realistic map of suitable habitat of hybridized Africanized honey bees in the southwestern United States. Findings suggest that multiple models of bounding, and the most conservative bounding of species distribution models, like those presented here, should probably replace the unbounded or loosely bounded techniques currently used. ?? 2011 Current Zoology.
Bounding Species Distribution Models
NASA Technical Reports Server (NTRS)
Stohlgren, Thomas J.; Jarnevich, Cahterine S.; Morisette, Jeffrey T.; Esaias, Wayne E.
2011-01-01
Species distribution models are increasing in popularity for mapping suitable habitat for species of management concern. Many investigators now recognize that extrapolations of these models with geographic information systems (GIS) might be sensitive to the environmental bounds of the data used in their development, yet there is no recommended best practice for "clamping" model extrapolations. We relied on two commonly used modeling approaches: classification and regression tree (CART) and maximum entropy (Maxent) models, and we tested a simple alteration of the model extrapolations, bounding extrapolations to the maximum and minimum values of primary environmental predictors, to provide a more realistic map of suitable habitat of hybridized Africanized honey bees in the southwestern United States. Findings suggest that multiple models of bounding, and the most conservative bounding of species distribution models, like those presented here, should probably replace the unbounded or loosely bounded techniques currently used [Current Zoology 57 (5): 642-647, 2011].
Entropic uncertainty from effective anticommutators
NASA Astrophysics Data System (ADS)
Kaniewski, Jedrzej; Tomamichel, Marco; Wehner, Stephanie
2014-07-01
We investigate entropic uncertainty relations for two or more binary measurements, for example, spin-1/2 or polarization measurements. We argue that the effective anticommutators of these measurements, i.e., the anticommutators evaluated on the state prior to measuring, are an expedient measure of measurement incompatibility. Based on the knowledge of pairwise effective anticommutators we derive a class of entropic uncertainty relations in terms of conditional Rényi entropies. Our uncertainty relations are formulated in terms of effective measures of incompatibility, which can be certified in a device-independent fashion. Consequently, we discuss potential applications of our findings to device-independent quantum cryptography. Moreover, to investigate the tightness of our analysis we consider the simplest (and very well studied) scenario of two measurements on a qubit. We find that our results outperform the celebrated bound due to Maassen and Uffink [Phys. Rev. Lett. 60, 1103 (1988), 10.1103/PhysRevLett.60.1103] and provide an analytical expression for the minimum uncertainty which also outperforms some recent bounds based on majorization.
NASA Technical Reports Server (NTRS)
Bernstein, R. B.; Levine, R. D.
1972-01-01
Optimal means of characterizing the distribution of product energy states resulting from reactive collisions of molecules with restricted distributions of initial states are considered, along with those for characterizing the particular reactant state distribution which yields a given set of product states at a specified total energy. It is suggested to represent the energy-dependence of global-type results in the form of square-faced bar plots, and of data for specific-type experiments as triangular-faced prismatic plots. The essential parameters defining the internal state distribution are isolated, and the information content of such a distribution is put on a quantitative basis. The relationship between the information content, the surprisal, and the entropy of the continuous distribution is established. The concept of an entropy deficiency, which characterizes the specificity of product state formation, is suggested as a useful measure of the deviance from statistical behavior. The degradation of information by experimental averaging is considered, leading to bounds on the entropy deficiency.
Gustafsson, Mats G; Wallman, Mikael; Wickenberg Bolin, Ulrika; Göransson, Hanna; Fryknäs, M; Andersson, Claes R; Isaksson, Anders
2010-06-01
Successful use of classifiers that learn to make decisions from a set of patient examples require robust methods for performance estimation. Recently many promising approaches for determination of an upper bound for the error rate of a single classifier have been reported but the Bayesian credibility interval (CI) obtained from a conventional holdout test still delivers one of the tightest bounds. The conventional Bayesian CI becomes unacceptably large in real world applications where the test set sizes are less than a few hundred. The source of this problem is that fact that the CI is determined exclusively by the result on the test examples. In other words, there is no information at all provided by the uniform prior density distribution employed which reflects complete lack of prior knowledge about the unknown error rate. Therefore, the aim of the study reported here was to study a maximum entropy (ME) based approach to improved prior knowledge and Bayesian CIs, demonstrating its relevance for biomedical research and clinical practice. It is demonstrated how a refined non-uniform prior density distribution can be obtained by means of the ME principle using empirical results from a few designs and tests using non-overlapping sets of examples. Experimental results show that ME based priors improve the CIs when employed to four quite different simulated and two real world data sets. An empirically derived ME prior seems promising for improving the Bayesian CI for the unknown error rate of a designed classifier. Copyright 2010 Elsevier B.V. All rights reserved.
Quantifying non-Gaussianity for quantum information
NASA Astrophysics Data System (ADS)
Genoni, Marco G.; Paris, Matteo G. A.
2010-11-01
We address the quantification of non-Gaussianity (nG) of states and operations in continuous-variable systems and its use in quantum information. We start by illustrating in detail the properties and the relationships of two recently proposed measures of nG based on the Hilbert-Schmidt distance and the quantum relative entropy (QRE) between the state under examination and a reference Gaussian state. We then evaluate the non-Gaussianities of several families of non-Gaussian quantum states and show that the two measures have the same basic properties and also share the same qualitative behavior in most of the examples taken into account. However, we also show that they introduce a different relation of order; that is, they are not strictly monotone to each other. We exploit the nG measures for states in order to introduce a measure of nG for quantum operations, to assess Gaussification and de-Gaussification protocols, and to investigate in detail the role played by nG in entanglement-distillation protocols. Besides, we exploit the QRE-based nG measure to provide different insight on the extremality of Gaussian states for some entropic quantities such as conditional entropy, mutual information, and the Holevo bound. We also deal with parameter estimation and present a theorem connecting the QRE nG to the quantum Fisher information. Finally, since evaluation of the QRE nG measure requires the knowledge of the full density matrix, we derive some experimentally friendly lower bounds to nG for some classes of states and by considering the possibility of performing on the states only certain efficient or inefficient measurements.
Extreme Entropy-Enthalpy Compensation in a Drug Resistant Variant of HIV-1 Protease
King, Nancy M.; Prabu-Jeyabalan, Moses; Bandaranayake, Rajintha M.; Nalam, Madhavi N. L.; Nalivaika, Ellen A.; Özen, Ayşegül; Haliloglu, Türkan; Yılmaz, Neşe Kurt; Schiffer, Celia A.
2012-01-01
The development of HIV-1 protease inhibitors has been the historic paradigm of rational structure-based drug design, where structural and thermodynamic analyses have assisted in the discovery of novel inhibitors. While the total enthalpy and entropy change upon binding determine the affinity, often the thermodynamics are considered in terms of inhibitor properties only. In the current study, profound changes are observed in the binding thermodynamics of a drug resistant variant compared to wild-type HIV-1 protease, irrespective of the inhibitor bound. This variant (Flap+) has a combination of flap and active site mutations and exhibits extremely large entropy-enthalpy compensation compared to wild-type protease, 5–15 kcal/mol, while losing only 1–3 kcal/mol in total binding free energy for any of six FDA approved inhibitors. Although entropy-enthalpy compensation has been previously observed for a variety of systems, never have changes of this magnitude been reported. The co-crystal structures of Flap+ protease with four of the inhibitors were determined and compared with complexes of both the wildtype protease and another drug resistant variant that does not exhibit this energetic compensation. Structural changes conserved across the Flap+ complexes, which are more pronounced for the flaps covering the active site, likely contribute to the thermodynamic compensation. The finding that drug resistant mutations can profoundly modulate the relative thermodynamic properties of a therapeutic target independent of the inhibitor presents a new challenge for rational drug design. PMID:22712830
Solomentsev, Gleb; Diehl, Carl; Akke, Mikael
2018-03-06
FKBP12 (FK506 binding protein 12 kDa) is an important drug target. Nuclear magnetic resonance (NMR) order parameters, describing amplitudes of motion on the pico- to nanosecond time scale, can provide estimates of changes in conformational entropy upon ligand binding. Here we report backbone and methyl-axis order parameters of the apo and FK506-bound forms of FKBP12, based on 15 N and 2 H NMR relaxation. Binding of FK506 to FKBP12 results in localized changes in order parameters, notably for the backbone of residues E54 and I56 and the side chains of I56, I90, and I91, all positioned in the binding site. The order parameters increase slightly upon FK506 binding, indicating an unfavorable entropic contribution to binding of TΔ S = -18 ± 2 kJ/mol at 293 K. Molecular dynamics simulations indicate a change in conformational entropy, associated with all dihedral angles, of TΔ S = -26 ± 9 kJ/mol. Both these values are significant compared to the total entropy of binding determined by isothermal titration calorimetry and referenced to a reactant concentration of 1 mM ( TΔ S = -29 ± 1 kJ/mol). Our results reveal subtle differences in the response to ligand binding compared to that of the previously studied rapamycin-FKBP12 complex, despite the high degree of structural homology between the two complexes and their nearly identical ligand-FKBP12 interactions. These results highlight the delicate dependence of protein dynamics on drug interactions, which goes beyond the view provided by static structures, and reinforce the notion that protein conformational entropy can make important contributions to the free energy of ligand binding.
Andrade-Santos, Felipe; Jones, Christine; Forman, William R.; ...
2015-04-22
Here, we present results from Chandra, XMM-Newton, and ROSAT observations of the Planck SZ-detected cluster A3716 (PLCKG345.40-39.34-G345). We show that G345 is, in fact, two subclusters separated on the sky by 400 kpc. We measure the subclusters' gas temperatures (~2–3 keV), total (~1–2 × 10 14more » $${{M}_{\\odot }}$$) and gas (~1–2 × 10 13 $${{M}_{\\odot }}$$) masses, gas mass fraction within r500, entropy profiles, and X-ray luminosities (~10 43 erg s -1). Using the gas density and temperature profiles for both subclusters, we show that there is good (0.8σ) agreement between the expected Sunyaev–Zel'dovich signal predicted from the X-ray data and that measured from the Planck mission, and better agreement within 0.6σ when we re-computed the Planck value assuming a two component cluster model, with relative amplitudes fixed based on the X-ray data. Dynamical analysis shows that the two galaxy subclusters are very likely ($$\\gt 97\\%$$ probability) gravitationally bound, and in the most likely scenario, the subclusters will undergo core passage in 500 ± 200 Myr. The northern subcluster is centrally peaked and has a low entropy core, while the southern subcluster has a high central entropy. Finally, the high central entropy in the southern subcluster can be explained either by the mergers of several groups, as suggested by the presence of five giant ellipticals or by active galactic nucleus energy injection, as suggested by the presence of a strong radio source in one of its massive elliptical galaxies, or by a combination of both processes.« less
Existence regimes for shocks in inhomogeneous magneto-plasmas having entropy
NASA Astrophysics Data System (ADS)
Iqbal, Javed; Yaqub Khan, M.
2018-04-01
The finding of connection of plasma density and temperature with entropy gives an incitement to study different plasma models with respect to entropy. Nonlinear dissipative one- and two-dimensional structures (shocks) are investigated in nonuniform magnetized plasma with respect to entropy. The dissipation comes in the medium through ion-neutral collisions. The linear dispersion relation is derived. The Korteweg-deVries-Burgers and Kadomtsev-Petviashvili-Burgers equations are derived for nonlinear drift waves in 1-D and 2-D by employing the drift approximation. It is found that vd/u ( vd is the diamagnetic drift velocity and u is the velocity of nonlinear structure) plays a significant role in the shock formation. It is also found that entropy has a significant effect on the strength of shocks. It is noticed that v d/u determines the rarefactive and compressive nature of the shocks. It is observed that upper and lower bounds exist for the shock velocity. It is also observed that the existing regimes for both one- and two-dimensional shocks for kappa distributed electrons are different from shocks with Cairns distributed electrons. Both rarefactive and compressive shocks are found for the 1-D drift waves with kappa distributed electrons. Interestingly, it is noticed that entropy enhances the strength of one- and two-dimensional shocks.
Entropy, materials, and posterity
Cloud, P.
1977-01-01
Materials and energy are the interdependent feedstocks of economic systems, and thermodynamics is their moderator. It costs energy to transform the dispersed minerals of Earth's crust into ordered materials and structures. And it costs materials to collect and focus the energy to perform work - be it from solar, fossil fuel, nuclear, or other sources. The greater the dispersal of minerals sought, the more energy is required to collect them into ordered states. But available energy can be used once only. And the ordered materials of industrial economies become disordered with time. They may be partially reordered and recycled, but only at further costs in energy. Available energy everywhere degrades to bound states and order to disorder - for though entropy may be juggled it always increases. Yet industry is utterly dependent on low entropy states of matter and energy, while decreasing grades of ore require ever higher inputs of energy to convert them to metals, with ever increasing growth both of entropy and environmental hazard. Except as we may prize a thing for its intrinsic qualities - beauty, leisure, love, or gold - low-entropy is the only thing of real value. It is worth whatever the market will bear, and it becomes more valuable as entropy increases. It would be foolish of suppliers to sell it more cheaply or in larger amounts than their own enjoyment of life requires, whatever form it may take. For this reason, and because of physical constraints on the availability of all low-entropy states, the recent energy crises is only the first of a sequence of crises to be expected in energy and materials as long as current trends continue. The apportioning of low-entropy states in a modern industrial society is achieved more or less according to the theory of competitive markets. But the rational powers of this theory suffer as the world grows increasingly polarized into rich, over-industrialized nations with diminishing resource bases and poor, supplier nations with little industry. The theory also discounts posterity, the more so as population density and percapita rates of consumption continue to grow. A new social, economic, and ecologic norm that leads to population control, conservation, and an apportionment of low-entropy states across the generations is needed to assure to posterity the options that properly belong to it as an important but voiceless constituency of the collectivity we call mankind. ?? 1977 Ferdinand Enke Verlag Stuttgart.
Algorithmic cooling in liquid-state nuclear magnetic resonance
NASA Astrophysics Data System (ADS)
Atia, Yosi; Elias, Yuval; Mor, Tal; Weinstein, Yossi
2016-01-01
Algorithmic cooling is a method that employs thermalization to increase qubit purification level; namely, it reduces the qubit system's entropy. We utilized gradient ascent pulse engineering, an optimal control algorithm, to implement algorithmic cooling in liquid-state nuclear magnetic resonance. Various cooling algorithms were applied onto the three qubits of C132-trichloroethylene, cooling the system beyond Shannon's entropy bound in several different ways. In particular, in one experiment a carbon qubit was cooled by a factor of 4.61. This work is a step towards potentially integrating tools of NMR quantum computing into in vivo magnetic-resonance spectroscopy.
Fuzzy geometry, entropy, and image information
NASA Technical Reports Server (NTRS)
Pal, Sankar K.
1991-01-01
Presented here are various uncertainty measures arising from grayness ambiguity and spatial ambiguity in an image, and their possible applications as image information measures. Definitions are given of an image in the light of fuzzy set theory, and of information measures and tools relevant for processing/analysis e.g., fuzzy geometrical properties, correlation, bound functions and entropy measures. Also given is a formulation of algorithms along with management of uncertainties for segmentation and object extraction, and edge detection. The output obtained here is both fuzzy and nonfuzzy. Ambiguity in evaluation and assessment of membership function are also described.
Distinguishability of generic quantum states
NASA Astrophysics Data System (ADS)
Puchała, Zbigniew; Pawela, Łukasz; Życzkowski, Karol
2016-06-01
Properties of random mixed states of dimension N distributed uniformly with respect to the Hilbert-Schmidt measure are investigated. We show that for large N , due to the concentration of measure, the trace distance between two random states tends to a fixed number D ˜=1 /4 +1 /π , which yields the Helstrom bound on their distinguishability. To arrive at this result, we apply free random calculus and derive the symmetrized Marchenko-Pastur distribution, which is shown to describe numerical data for the model of coupled quantum kicked tops. Asymptotic value for the root fidelity between two random states, √{F }=3/4 , can serve as a universal reference value for further theoretical and experimental studies. Analogous results for quantum relative entropy and Chernoff quantity provide other bounds on the distinguishablity of both states in a multiple measurement setup due to the quantum Sanov theorem. We study also mean entropy of coherence of random pure and mixed states and entanglement of a generic mixed state of a bipartite system.
Entropy of spatial network ensembles
NASA Astrophysics Data System (ADS)
Coon, Justin P.; Dettmann, Carl P.; Georgiou, Orestis
2018-04-01
We analyze complexity in spatial network ensembles through the lens of graph entropy. Mathematically, we model a spatial network as a soft random geometric graph, i.e., a graph with two sources of randomness, namely nodes located randomly in space and links formed independently between pairs of nodes with probability given by a specified function (the "pair connection function") of their mutual distance. We consider the general case where randomness arises in node positions as well as pairwise connections (i.e., for a given pair distance, the corresponding edge state is a random variable). Classical random geometric graph and exponential graph models can be recovered in certain limits. We derive a simple bound for the entropy of a spatial network ensemble and calculate the conditional entropy of an ensemble given the node location distribution for hard and soft (probabilistic) pair connection functions. Under this formalism, we derive the connection function that yields maximum entropy under general constraints. Finally, we apply our analytical framework to study two practical examples: ad hoc wireless networks and the US flight network. Through the study of these examples, we illustrate that both exhibit properties that are indicative of nearly maximally entropic ensembles.
Entanglement on linked boundaries in Chern-Simons theory with generic gauge groups
NASA Astrophysics Data System (ADS)
Dwivedi, Siddharth; Singh, Vivek Kumar; Dhara, Saswati; Ramadevi, P.; Zhou, Yang; Joshi, Lata Kh
2018-02-01
We study the entanglement for a state on linked torus boundaries in 3 d Chern-Simons theory with a generic gauge group and present the asymptotic bounds of Rényi entropy at two different limits: (i) large Chern-Simons coupling k, and (ii) large rank r of the gauge group. These results show that the Rényi entropies cannot diverge faster than ln k and ln r, respectively. We focus on torus links T (2 , 2 n) with topological linking number n. The Rényi entropy for these links shows a periodic structure in n and vanishes whenever n = 0 (mod p), where the integer p is a function of coupling k and rank r. We highlight that the refined Chern-Simons link invariants can remove such a periodic structure in n.
Fluctuation Theorem for Many-Body Pure Quantum States.
Iyoda, Eiki; Kaneko, Kazuya; Sagawa, Takahiro
2017-09-08
We prove the second law of thermodynamics and the nonequilibrium fluctuation theorem for pure quantum states. The entire system obeys reversible unitary dynamics, where the initial state of the heat bath is not the canonical distribution but is a single energy eigenstate that satisfies the eigenstate-thermalization hypothesis. Our result is mathematically rigorous and based on the Lieb-Robinson bound, which gives the upper bound of the velocity of information propagation in many-body quantum systems. The entanglement entropy of a subsystem is shown connected to thermodynamic heat, highlighting the foundation of the information-thermodynamics link. We confirmed our theory by numerical simulation of hard-core bosons, and observed dynamical crossover from thermal fluctuations to bare quantum fluctuations. Our result reveals a universal scenario that the second law emerges from quantum mechanics, and can be experimentally tested by artificial isolated quantum systems such as ultracold atoms.
Constrained signal reconstruction from wavelet transform coefficients
DOE Office of Scientific and Technical Information (OSTI.GOV)
Brislawn, C.M.
1991-12-31
A new method is introduced for reconstructing a signal from an incomplete sampling of its Discrete Wavelet Transform (DWT). The algorithm yields a minimum-norm estimate satisfying a priori upper and lower bounds on the signal. The method is based on a finite-dimensional representation theory for minimum-norm estimates of bounded signals developed by R.E. Cole. Cole`s work has its origins in earlier techniques of maximum-entropy spectral estimation due to Lang and McClellan, which were adapted by Steinhardt, Goodrich and Roberts for minimum-norm spectral estimation. Cole`s extension of their work provides a representation for minimum-norm estimates of a class of generalized transformsmore » in terms of general correlation data (not just DFT`s of autocorrelation lags, as in spectral estimation). One virtue of this great generality is that it includes the inverse DWT. 20 refs.« less
Fluctuation Theorem for Many-Body Pure Quantum States
NASA Astrophysics Data System (ADS)
Iyoda, Eiki; Kaneko, Kazuya; Sagawa, Takahiro
2017-09-01
We prove the second law of thermodynamics and the nonequilibrium fluctuation theorem for pure quantum states. The entire system obeys reversible unitary dynamics, where the initial state of the heat bath is not the canonical distribution but is a single energy eigenstate that satisfies the eigenstate-thermalization hypothesis. Our result is mathematically rigorous and based on the Lieb-Robinson bound, which gives the upper bound of the velocity of information propagation in many-body quantum systems. The entanglement entropy of a subsystem is shown connected to thermodynamic heat, highlighting the foundation of the information-thermodynamics link. We confirmed our theory by numerical simulation of hard-core bosons, and observed dynamical crossover from thermal fluctuations to bare quantum fluctuations. Our result reveals a universal scenario that the second law emerges from quantum mechanics, and can be experimentally tested by artificial isolated quantum systems such as ultracold atoms.
Measures and limits of models of fixation selection.
Wilming, Niklas; Betz, Torsten; Kietzmann, Tim C; König, Peter
2011-01-01
Models of fixation selection are a central tool in the quest to understand how the human mind selects relevant information. Using this tool in the evaluation of competing claims often requires comparing different models' relative performance in predicting eye movements. However, studies use a wide variety of performance measures with markedly different properties, which makes a comparison difficult. We make three main contributions to this line of research: First we argue for a set of desirable properties, review commonly used measures, and conclude that no single measure unites all desirable properties. However the area under the ROC curve (a classification measure) and the KL-divergence (a distance measure of probability distributions) combine many desirable properties and allow a meaningful comparison of critical model performance. We give an analytical proof of the linearity of the ROC measure with respect to averaging over subjects and demonstrate an appropriate correction of entropy-based measures like KL-divergence for small sample sizes in the context of eye-tracking data. Second, we provide a lower bound and an upper bound of these measures, based on image-independent properties of fixation data and between subject consistency respectively. Based on these bounds it is possible to give a reference frame to judge the predictive power of a model of fixation selection. We provide open-source python code to compute the reference frame. Third, we show that the upper, between subject consistency bound holds only for models that predict averages of subject populations. Departing from this we show that incorporating subject-specific viewing behavior can generate predictions which surpass that upper bound. Taken together, these findings lay out the required information that allow a well-founded judgment of the quality of any model of fixation selection and should therefore be reported when a new model is introduced.
NASA Astrophysics Data System (ADS)
Yu, Nam Yul
2017-12-01
The principle of compressed sensing (CS) can be applied in a cryptosystem by providing the notion of security. In this paper, we study the computational security of a CS-based cryptosystem that encrypts a plaintext with a partial unitary sensing matrix embedding a secret keystream. The keystream is obtained by a keystream generator of stream ciphers, where the initial seed becomes the secret key of the CS-based cryptosystem. For security analysis, the total variation distance, bounded by the relative entropy and the Hellinger distance, is examined as a security measure for the indistinguishability. By developing upper bounds on the distance measures, we show that the CS-based cryptosystem can be computationally secure in terms of the indistinguishability, as long as the keystream length for each encryption is sufficiently large with low compression and sparsity ratios. In addition, we consider a potential chosen plaintext attack (CPA) from an adversary, which attempts to recover the key of the CS-based cryptosystem. Associated with the key recovery attack, we show that the computational security of our CS-based cryptosystem is brought by the mathematical intractability of a constrained integer least-squares (ILS) problem. For a sub-optimal, but feasible key recovery attack, we consider a successive approximate maximum-likelihood detection (SAMD) and investigate the performance by developing an upper bound on the success probability. Through theoretical and numerical analyses, we demonstrate that our CS-based cryptosystem can be secure against the key recovery attack through the SAMD.
Amortized entanglement of a quantum channel and approximately teleportation-simulable channels
NASA Astrophysics Data System (ADS)
Kaur, Eneet; Wilde, Mark M.
2018-01-01
This paper defines the amortized entanglement of a quantum channel as the largest difference in entanglement between the output and the input of the channel, where entanglement is quantified by an arbitrary entanglement measure. We prove that the amortized entanglement of a channel obeys several desirable properties, and we also consider special cases such as the amortized relative entropy of entanglement and the amortized Rains relative entropy. These latter quantities are shown to be single-letter upper bounds on the secret-key-agreement and PPT-assisted quantum capacities of a quantum channel, respectively. Of especial interest is a uniform continuity bound for these latter two special cases of amortized entanglement, in which the deviation between the amortized entanglement of two channels is bounded from above by a simple function of the diamond norm of their difference and the output dimension of the channels. We then define approximately teleportation- and positive-partial-transpose-simulable (PPT-simulable) channels as those that are close in diamond norm to a channel which is either exactly teleportation- or PPT-simulable, respectively. These results then lead to single-letter upper bounds on the secret-key-agreement and PPT-assisted quantum capacities of channels that are approximately teleportation- or PPT-simulable, respectively. Finally, we generalize many of the concepts in the paper to the setting of general resource theories, defining the amortized resourcefulness of a channel and the notion of ν-freely-simulable channels, connecting these concepts in an operational way as well.
General polygamy inequality of multiparty quantum entanglement
NASA Astrophysics Data System (ADS)
Kim, Jeong San
2012-06-01
Using entanglement of assistance, we establish a general polygamy inequality of multiparty entanglement in arbitrary-dimensional quantum systems. For multiparty closed quantum systems, we relate our result with the monogamy of entanglement, and clarify that the entropy of entanglement bounds both monogamy and polygamy of multiparty quantum entanglement.
Bounding entanglement spreading after a local quench
NASA Astrophysics Data System (ADS)
Drumond, Raphael C.; Móller, Natália S.
2017-06-01
We consider the variation of von Neumann entropy of subsystem reduced states of general many-body lattice spin systems due to local quantum quenches. We obtain Lieb-Robinson-like bounds that are independent of the subsystem volume. The main assumptions are that the Hamiltonian satisfies a Lieb-Robinson bound and that the volume of spheres on the lattice grows at most exponentially with their radius. More specifically, the bound exponentially increases with time but exponentially decreases with the distance between the subsystem and the region where the quench takes place. The fact that the bound is independent of the subsystem volume leads to stronger constraints (than previously known) on the propagation of information throughout many-body systems. In particular, it shows that bipartite entanglement satisfies an effective "light cone," regardless of system size. Further implications to t density-matrix renormalization-group simulations of quantum spin chains and limitations to the propagation of information are discussed.
Emergent Geometry from Entropy and Causality
NASA Astrophysics Data System (ADS)
Engelhardt, Netta
In this thesis, we investigate the connections between the geometry of spacetime and aspects of quantum field theory such as entanglement entropy and causality. This work is motivated by the idea that spacetime geometry is an emergent phenomenon in quantum gravity, and that the physics responsible for this emergence is fundamental to quantum field theory. Part I of this thesis is focused on the interplay between spacetime and entropy, with a special emphasis on entropy due to entanglement. In general spacetimes, there exist locally-defined surfaces sensitive to the geometry that may act as local black hole boundaries or cosmological horizons; these surfaces, known as holographic screens, are argued to have a connection with the second law of thermodynamics. Holographic screens obey an area law, suggestive of an association with entropy; they are also distinguished surfaces from the perspective of the covariant entropy bound, a bound on the total entropy of a slice of the spacetime. This construction is shown to be quite general, and is formulated in both classical and perturbatively quantum theories of gravity. The remainder of Part I uses the Anti-de Sitter/ Conformal Field Theory (AdS/CFT) correspondence to both expand and constrain the connection between entanglement entropy and geometry. The AdS/CFT correspondence posits an equivalence between string theory in the "bulk" with AdS boundary conditions and certain quantum field theories. In the limit where the string theory is simply classical General Relativity, the Ryu-Takayanagi and more generally, the Hubeny-Rangamani-Takayanagi (HRT) formulae provide a way of relating the geometry of surfaces to entanglement entropy. A first-order bulk quantum correction to HRT was derived by Faulkner, Lewkowycz and Maldacena. This formula is generalized to include perturbative quantum corrections in the bulk at any (finite) order. Hurdles to spacetime emergence from entanglement entropy as described by HRT and its quantum generalizations are discussed, both at the classical and perturbatively quantum limits. In particular, several No Go Theorems are proven, indicative of a conclusion that supplementary approaches or information may be necessary to recover the full spacetime geometry. Part II of this thesis involves the relation between geometry and causality, the property that information cannot travel faster than light. Requiring this of any quantum field theory results in constraints on string theory setups that are dual to quantum field theories via the AdS/CFT correspondence. At the level of perturbative quantum gravity, it is shown that causality in the field theory constraints the causal structure in the bulk. At the level of nonperturbative quantum string theory, we find that constraints on causal signals restrict the possible ways in which curvature singularities can be resolved in string theory. Finally, a new program of research is proposed for the construction of bulk geometry from the divergences of correlation functions in the dual field theory. This divergence structure is linked to the causal structure of the bulk and of the field theory.
Strong converse theorems using Rényi entropies
NASA Astrophysics Data System (ADS)
Leditzky, Felix; Wilde, Mark M.; Datta, Nilanjana
2016-08-01
We use a Rényi entropy method to prove strong converse theorems for certain information-theoretic tasks which involve local operations and quantum (or classical) communication between two parties. These include state redistribution, coherent state merging, quantum state splitting, measurement compression with quantum side information, randomness extraction against quantum side information, and data compression with quantum side information. The method we employ in proving these results extends ideas developed by Sharma [preprint arXiv:1404.5940 [quant-ph] (2014)], which he used to give a new proof of the strong converse theorem for state merging. For state redistribution, we prove the strong converse property for the boundary of the entire achievable rate region in the (e, q)-plane, where e and q denote the entanglement cost and quantum communication cost, respectively. In the case of measurement compression with quantum side information, we prove a strong converse theorem for the classical communication cost, which is a new result extending the previously known weak converse. For the remaining tasks, we provide new proofs for strong converse theorems previously established using smooth entropies. For each task, we obtain the strong converse theorem from explicit bounds on the figure of merit of the task in terms of a Rényi generalization of the optimal rate. Hence, we identify candidates for the strong converse exponents for each task discussed in this paper. To prove our results, we establish various new entropic inequalities, which might be of independent interest. These involve conditional entropies and mutual information derived from the sandwiched Rényi divergence. In particular, we obtain novel bounds relating these quantities, as well as the Rényi conditional mutual information, to the fidelity of two quantum states.
Strong converse theorems using Rényi entropies
DOE Office of Scientific and Technical Information (OSTI.GOV)
Leditzky, Felix; Datta, Nilanjana; Wilde, Mark M.
We use a Rényi entropy method to prove strong converse theorems for certain information-theoretic tasks which involve local operations and quantum (or classical) communication between two parties. These include state redistribution, coherent state merging, quantum state splitting, measurement compression with quantum side information, randomness extraction against quantum side information, and data compression with quantum side information. The method we employ in proving these results extends ideas developed by Sharma [preprint http://arxiv.org/abs/1404.5940 [quant-ph] (2014)], which he used to give a new proof of the strong converse theorem for state merging. For state redistribution, we prove the strong converse property for themore » boundary of the entire achievable rate region in the (e, q)-plane, where e and q denote the entanglement cost and quantum communication cost, respectively. In the case of measurement compression with quantum side information, we prove a strong converse theorem for the classical communication cost, which is a new result extending the previously known weak converse. For the remaining tasks, we provide new proofs for strong converse theorems previously established using smooth entropies. For each task, we obtain the strong converse theorem from explicit bounds on the figure of merit of the task in terms of a Rényi generalization of the optimal rate. Hence, we identify candidates for the strong converse exponents for each task discussed in this paper. To prove our results, we establish various new entropic inequalities, which might be of independent interest. These involve conditional entropies and mutual information derived from the sandwiched Rényi divergence. In particular, we obtain novel bounds relating these quantities, as well as the Rényi conditional mutual information, to the fidelity of two quantum states.« less
Maximum Entropy Methods as the Bridge Between Microscopic and Macroscopic Theory
NASA Astrophysics Data System (ADS)
Taylor, Jamie M.
2016-09-01
This paper is concerned with an investigation into a function of macroscopic variables known as the singular potential, building on previous work by Ball and Majumdar. The singular potential is a function of the admissible statistical averages of probability distributions on a state space, defined so that it corresponds to the maximum possible entropy given known observed statistical averages, although non-classical entropy-like objective functions will also be considered. First the set of admissible moments must be established, and under the conditions presented in this work the set is open, bounded and convex allowing a description in terms of supporting hyperplanes, which provides estimates on the development of singularities for related probability distributions. Under appropriate conditions it is shown that the singular potential is strictly convex, as differentiable as the microscopic entropy, and blows up uniformly as the macroscopic variable tends to the boundary of the set of admissible moments. Applications of the singular potential are then discussed, and particular consideration will be given to certain free-energy functionals typical in mean-field theory, demonstrating an equivalence between certain microscopic and macroscopic free-energy functionals. This allows statements about L^1-local minimisers of Onsager's free energy to be obtained which cannot be given by two-sided variations, and overcomes the need to ensure local minimisers are bounded away from zero and +∞ before taking L^∞ variations. The analysis also permits the definition of a dual order parameter for which Onsager's free energy allows an explicit representation. Also, the difficulties in approximating the singular potential by everywhere defined functions, in particular by polynomial functions, are addressed, with examples demonstrating the failure of the Taylor approximation to preserve relevant shape properties of the singular potential.
NASA Astrophysics Data System (ADS)
Whitney, Robert S.
2015-03-01
We investigate the nonlinear scattering theory for quantum systems with strong Seebeck and Peltier effects, and consider their use as heat engines and refrigerators with finite power outputs. This paper gives detailed derivations of the results summarized in a previous paper [R. S. Whitney, Phys. Rev. Lett. 112, 130601 (2014), 10.1103/PhysRevLett.112.130601]. It shows how to use the scattering theory to find (i) the quantum thermoelectric with maximum possible power output, and (ii) the quantum thermoelectric with maximum efficiency at given power output. The latter corresponds to a minimal entropy production at that power output. These quantities are of quantum origin since they depend on system size over electronic wavelength, and so have no analog in classical thermodynamics. The maximal efficiency coincides with Carnot efficiency at zero power output, but decreases with increasing power output. This gives a fundamental lower bound on entropy production, which means that reversibility (in the thermodynamic sense) is impossible for finite power output. The suppression of efficiency by (nonlinear) phonon and photon effects is addressed in detail; when these effects are strong, maximum efficiency coincides with maximum power. Finally, we show in particular limits (typically without magnetic fields) that relaxation within the quantum system does not allow the system to exceed the bounds derived for relaxation-free systems, however, a general proof of this remains elusive.
Secure key from bound entanglement.
Horodecki, Karol; Horodecki, Michał; Horodecki, Paweł; Oppenheim, Jonathan
2005-04-29
We characterize the set of shared quantum states which contain a cryptographically private key. This allows us to recast the theory of privacy as a paradigm closely related to that used in entanglement manipulation. It is shown that one can distill an arbitrarily secure key from bound entangled states. There are also states that have less distillable private keys than the entanglement cost of the state. In general, the amount of distillable key is bounded from above by the relative entropy of entanglement. Relationships between distillability and distinguishability are found for a class of states which have Bell states correlated to separable hiding states. We also describe a technique for finding states exhibiting irreversibility in entanglement distillation.
Moisture sorption isotherms and thermodynamic properties of mexican mennonite-style cheese.
Martinez-Monteagudo, Sergio I; Salais-Fierro, Fabiola
2014-10-01
Moisture adsorption isotherms of fresh and ripened Mexican Mennonite-style cheese were investigated using the static gravimetric method at 4, 8, and 12 °C in a water activity range (aw) of 0.08-0.96. These isotherms were modeled using GAB, BET, Oswin and Halsey equations through weighed non-linear regression. All isotherms were sigmoid in shape, showing a type II BET isotherm, and the data were best described by GAB model. GAB model coefficients revealed that water adsorption by cheese matrix is a multilayer process characterized by molecules that are strongly bound in the monolayer and molecules that are slightly structured in a multilayer. Using the GAB model, it was possible to estimate thermodynamic functions (net isosteric heat, differential entropy, integral enthalpy and entropy, and enthalpy-entropy compensation) as function of moisture content. For both samples, the isosteric heat and differential entropy decreased with moisture content in exponential fashion. The integral enthalpy gradually decreased with increasing moisture content after reached a maximum value, while the integral entropy decreased with increasing moisture content after reached a minimum value. A linear compensation was found between integral enthalpy and entropy suggesting enthalpy controlled adsorption. Determination of moisture content and aw relationship yields to important information of controlling the ripening, drying and storage operations as well as understanding of the water state within a cheese matrix.
Multibody local approximation: Application to conformational entropy calculations on biomolecules
NASA Astrophysics Data System (ADS)
Suárez, Ernesto; Suárez, Dimas
2012-08-01
Multibody type expansions like mutual information expansions are widely used for computing or analyzing properties of large composite systems. The power of such expansions stems from their generality. Their weaknesses, however, are the large computational cost of including high order terms due to the combinatorial explosion and the fact that truncation errors do not decrease strictly with the expansion order. Herein, we take advantage of the redundancy of multibody expansions in order to derive an efficient reformulation that captures implicitly all-order correlation effects within a given cutoff, avoiding the combinatory explosion. This approach, which is cutoff dependent rather than order dependent, keeps the generality of the original expansions and simultaneously mitigates their limitations provided that a reasonable cutoff can be used. An application of particular interest can be the computation of the conformational entropy of flexible peptide molecules from molecular dynamics trajectories. By combining the multibody local estimations of conformational entropy with average values of the rigid-rotor and harmonic-oscillator entropic contributions, we obtain by far a tighter upper bound of the absolute entropy than the one obtained by the broadly used quasi-harmonic method.
Multibody local approximation: application to conformational entropy calculations on biomolecules.
Suárez, Ernesto; Suárez, Dimas
2012-08-28
Multibody type expansions like mutual information expansions are widely used for computing or analyzing properties of large composite systems. The power of such expansions stems from their generality. Their weaknesses, however, are the large computational cost of including high order terms due to the combinatorial explosion and the fact that truncation errors do not decrease strictly with the expansion order. Herein, we take advantage of the redundancy of multibody expansions in order to derive an efficient reformulation that captures implicitly all-order correlation effects within a given cutoff, avoiding the combinatory explosion. This approach, which is cutoff dependent rather than order dependent, keeps the generality of the original expansions and simultaneously mitigates their limitations provided that a reasonable cutoff can be used. An application of particular interest can be the computation of the conformational entropy of flexible peptide molecules from molecular dynamics trajectories. By combining the multibody local estimations of conformational entropy with average values of the rigid-rotor and harmonic-oscillator entropic contributions, we obtain by far a tighter upper bound of the absolute entropy than the one obtained by the broadly used quasi-harmonic method.
Fine-grained state counting for black holes in loop quantum gravity.
Ghosh, A; Mitra, P
2009-04-10
A state of a black hole in loop quantum gravity is given by a distribution of spins on punctures on the horizon. The distribution is of the Boltzmann type, with the area playing the role of the energy. In investigations where the total area was kept approximately constant, there was a kind of thermal equilibrium between the spins which have the same analogue temperature and the entropy was proportional to the area. If the area is precisely fixed, however, multiple constraints appear, different spins have different analogue temperatures and the entropy is not strictly linear in the area, but is bounded by a linear rise.
Novel quantum phase transition from bounded to extensive entanglement
Zhang, Zhao; Ahmadain, Amr
2017-01-01
The nature of entanglement in many-body systems is a focus of intense research with the observation that entanglement holds interesting information about quantum correlations in large systems and their relation to phase transitions. In particular, it is well known that although generic, many-body states have large, extensive entropy, ground states of reasonable local Hamiltonians carry much smaller entropy, often associated with the boundary length through the so-called area law. Here we introduce a continuous family of frustration-free Hamiltonians with exactly solvable ground states and uncover a remarkable quantum phase transition whereby the entanglement scaling changes from area law into extensively large entropy. This transition shows that entanglement in many-body systems may be enhanced under special circumstances with a potential for generating “useful” entanglement for the purpose of quantum computing and that the full implications of locality and its restrictions on possible ground states may hold further surprises. PMID:28461464
Novel quantum phase transition from bounded to extensive entanglement.
Zhang, Zhao; Ahmadain, Amr; Klich, Israel
2017-05-16
The nature of entanglement in many-body systems is a focus of intense research with the observation that entanglement holds interesting information about quantum correlations in large systems and their relation to phase transitions. In particular, it is well known that although generic, many-body states have large, extensive entropy, ground states of reasonable local Hamiltonians carry much smaller entropy, often associated with the boundary length through the so-called area law. Here we introduce a continuous family of frustration-free Hamiltonians with exactly solvable ground states and uncover a remarkable quantum phase transition whereby the entanglement scaling changes from area law into extensively large entropy. This transition shows that entanglement in many-body systems may be enhanced under special circumstances with a potential for generating "useful" entanglement for the purpose of quantum computing and that the full implications of locality and its restrictions on possible ground states may hold further surprises.
Entanglement and area law with a fractal boundary in a topologically ordered phase
NASA Astrophysics Data System (ADS)
Hamma, Alioscia; Lidar, Daniel A.; Severini, Simone
2010-01-01
Quantum systems with short-range interactions are known to respect an area law for the entanglement entropy: The von Neumann entropy S associated to a bipartition scales with the boundary p between the two parts. Here we study the case in which the boundary is a fractal. We consider the topologically ordered phase of the toric code with a magnetic field. When the field vanishes it is possible to analytically compute the entanglement entropy for both regular and fractal bipartitions (A,B) of the system and this yields an upper bound for the entire topological phase. When the A-B boundary is regular we have S/p=1 for large p. When the boundary is a fractal of the Hausdorff dimension D, we show that the entanglement between the two parts scales as S/p=γ⩽1/D, and γ depends on the fractal considered.
Efficiency at maximum power output of linear irreversible Carnot-like heat engines.
Wang, Yang; Tu, Z C
2012-01-01
The efficiency at maximum power output of linear irreversible Carnot-like heat engines is investigated based on the assumption that the rate of irreversible entropy production of the working substance in each "isothermal" process is a quadratic form of the heat exchange rate between the working substance and the reservoir. It is found that the maximum power output corresponds to minimizing the irreversible entropy production in two isothermal processes of the Carnot-like cycle, and that the efficiency at maximum power output has the form η(mP)=η(C)/(2-γη(C)), where η(C) is the Carnot efficiency, while γ depends on the heat transfer coefficients between the working substance and two reservoirs. The value of η(mP) is bounded between η(-)≡η(C)/2 and η(+)≡η(C)/(2-η(C)). These results are consistent with those obtained by Chen and Yan [J. Chem. Phys. 90, 3740 (1989)] based on the endoreversible assumption, those obtained by Esposito et al. [Phys. Rev. Lett. 105, 150603 (2010)] based on the low-dissipation assumption, and those obtained by Schmiedl and Seifert [Europhys. Lett. 81, 20003 (2008)] for stochastic heat engines which in fact also satisfy the low-dissipation assumption. Additionally, we find that the endoreversible assumption happens to hold for Carnot-like heat engines operating at the maximum power output based on our fundamental assumption, and that the Carnot-like heat engines that we focused on do not strictly satisfy the low-dissipation assumption, which implies that the low-dissipation assumption or our fundamental assumption is a sufficient but non-necessary condition for the validity of η(mP)=η(C)/(2-γη(C)) as well as the existence of two bounds, η(-)≡η(C)/2 and η(+)≡η(C)/(2-η(C)). © 2012 American Physical Society
Efficiency at maximum power output of linear irreversible Carnot-like heat engines
NASA Astrophysics Data System (ADS)
Wang, Yang; Tu, Z. C.
2012-01-01
The efficiency at maximum power output of linear irreversible Carnot-like heat engines is investigated based on the assumption that the rate of irreversible entropy production of the working substance in each “isothermal” process is a quadratic form of the heat exchange rate between the working substance and the reservoir. It is found that the maximum power output corresponds to minimizing the irreversible entropy production in two isothermal processes of the Carnot-like cycle, and that the efficiency at maximum power output has the form ηmP=ηC/(2-γηC), where ηC is the Carnot efficiency, while γ depends on the heat transfer coefficients between the working substance and two reservoirs. The value of ηmP is bounded between η-≡ηC/2 and η+≡ηC/(2-ηC). These results are consistent with those obtained by Chen and Yan [J. Chem. Phys.JCPSA60021-960610.1063/1.455832 90, 3740 (1989)] based on the endoreversible assumption, those obtained by Esposito [Phys. Rev. Lett.PRLTAO0031-900710.1103/PhysRevLett.105.150603 105, 150603 (2010)] based on the low-dissipation assumption, and those obtained by Schmiedl and Seifert [Europhys. Lett.EULEEJ0295-507510.1209/0295-5075/81/20003 81, 20003 (2008)] for stochastic heat engines which in fact also satisfy the low-dissipation assumption. Additionally, we find that the endoreversible assumption happens to hold for Carnot-like heat engines operating at the maximum power output based on our fundamental assumption, and that the Carnot-like heat engines that we focused on do not strictly satisfy the low-dissipation assumption, which implies that the low-dissipation assumption or our fundamental assumption is a sufficient but non-necessary condition for the validity of ηmP=ηC/(2-γηC) as well as the existence of two bounds, η-≡ηC/2 and η+≡ηC/(2-ηC).
Wang, Bo; Li, Liwei; Hurley, Thomas D; Meroueh, Samy O
2013-10-28
End-point free energy calculations using MM-GBSA and MM-PBSA provide a detailed understanding of molecular recognition in protein-ligand interactions. The binding free energy can be used to rank-order protein-ligand structures in virtual screening for compound or target identification. Here, we carry out free energy calculations for a diverse set of 11 proteins bound to 14 small molecules using extensive explicit-solvent MD simulations. The structure of these complexes was previously solved by crystallography and their binding studied with isothermal titration calorimetry (ITC) data enabling direct comparison to the MM-GBSA and MM-PBSA calculations. Four MM-GBSA and three MM-PBSA calculations reproduced the ITC free energy within 1 kcal·mol(-1) highlighting the challenges in reproducing the absolute free energy from end-point free energy calculations. MM-GBSA exhibited better rank-ordering with a Spearman ρ of 0.68 compared to 0.40 for MM-PBSA with dielectric constant (ε = 1). An increase in ε resulted in significantly better rank-ordering for MM-PBSA (ρ = 0.91 for ε = 10), but larger ε significantly reduced the contributions of electrostatics, suggesting that the improvement is due to the nonpolar and entropy components, rather than a better representation of the electrostatics. The SVRKB scoring function applied to MD snapshots resulted in excellent rank-ordering (ρ = 0.81). Calculations of the configurational entropy using normal-mode analysis led to free energies that correlated significantly better to the ITC free energy than the MD-based quasi-harmonic approach, but the computed entropies showed no correlation with the ITC entropy. When the adaptation energy is taken into consideration by running separate simulations for complex, apo, and ligand (MM-PBSAADAPT), there is less agreement with the ITC data for the individual free energies, but remarkably good rank-ordering is observed (ρ = 0.89). Interestingly, filtering MD snapshots by prescoring protein-ligand complexes with a machine learning-based approach (SVMSP) resulted in a significant improvement in the MM-PBSA results (ε = 1) from ρ = 0.40 to ρ = 0.81. Finally, the nonpolar components of MM-GBSA and MM-PBSA, but not the electrostatic components, showed strong correlation to the ITC free energy; the computed entropies did not correlate with the ITC entropy.
Wang, Bo; Li, Liwei; Hurley, Thomas D.; Meroueh, Samy O.
2014-01-01
End-point free energy calculations using MM-GBSA and MM-PBSA provide a detailed understanding of molecular recognition in protein-ligand interactions. The binding free energy can be used to rank-order protein-ligand structures in virtual screening for compound or target identification. Here, we carry out free energy calculations for a diverse set of 11 proteins bound to 14 small molecules using extensive explicit-solvent MD simulations. The structure of these complexes was previously solved by crystallography and their binding studied with isothermal titration calorimetry (ITC) data enabling direct comparison to the MM-GBSA and MM-PBSA calculations. Four MM-GBSA and three MM-PBSA calculations reproduced the ITC free energy within 1 kcal•mol−1 highlighting the challenges in reproducing the absolute free energy from end-point free energy calculations. MM-GBSA exhibited better rank-ordering with a Spearman ρ of 0.68 compared to 0.40 for MM-PBSA with dielectric constant (ε = 1). An increase in ε resulted in significantly better rank-ordering for MM-PBSA (ρ = 0.91 for ε = 10). But larger ε significantly reduced the contributions of electrostatics, suggesting that the improvement is due to the non-polar and entropy components, rather than a better representation of the electrostatics. SVRKB scoring function applied to MD snapshots resulted in excellent rank-ordering (ρ = 0.81). Calculations of the configurational entropy using normal mode analysis led to free energies that correlated significantly better to the ITC free energy than the MD-based quasi-harmonic approach, but the computed entropies showed no correlation with the ITC entropy. When the adaptation energy is taken into consideration by running separate simulations for complex, apo and ligand (MM-PBSAADAPT), there is less agreement with the ITC data for the individual free energies, but remarkably good rank-ordering is observed (ρ = 0.89). Interestingly, filtering MD snapshots by pre-scoring protein-ligand complexes with a machine learning-based approach (SVMSP) resulted in a significant improvement in the MM-PBSA results (ε = 1) from ρ = 0.40 to ρ = 0.81. Finally, the non-polar components of MM-GBSA and MM-PBSA, but not the electrostatic components, showed strong correlation to the ITC free energy; the computed entropies did not correlate with the ITC entropy. PMID:24032517
Alternate binding modes for a ubiquitin-SH3 domain interaction studied by NMR spectroscopy.
Korzhnev, Dmitry M; Bezsonova, Irina; Lee, Soyoung; Chalikian, Tigran V; Kay, Lewis E
2009-02-20
Surfaces of many binding domains are plastic, enabling them to interact with multiple targets. An understanding of how they bind and recognize their partners is therefore predicated on characterizing such dynamic interfaces. Yet, these interfaces are difficult to study by standard biophysical techniques that often 'freeze' out conformations or that produce data averaged over an ensemble of conformers. In this study, we used NMR spectroscopy to study the interaction between the C-terminal SH3 domain of CIN85 and ubiquitin that involves the 'classical' binding sites of these proteins. Notably, chemical shift titration data of one target with another and relaxation dispersion data that report on millisecond time scale exchange processes are both well fit to a simple binding model in which free protein is in equilibrium with a single bound conformation. However, dissociation constants and chemical shift differences between free and bound states measured from both classes of experiment are in disagreement. It is shown that the data can be reconciled by considering three-state binding models involving two distinct bound conformations. By combining titration and dispersion data, kinetic and thermodynamic parameters of the three-state binding reaction are obtained along with chemical shifts for each state. A picture emerges in which one bound conformer has increased entropy and enthalpy relative to the second and chemical shifts similar to that of the free state, suggesting a less packed interface. This study provides an example of the interplay between entropy and enthalpy to fine-tune molecular interactions involving the same binding surfaces.
Guan, Yue; Li, Weifeng; Jiang, Zhuoran; Chen, Ying; Liu, Song; He, Jian; Zhou, Zhengyang; Ge, Yun
2016-12-01
This study aimed to develop whole-lesion apparent diffusion coefficient (ADC)-based entropy-related parameters of cervical cancer to preliminarily assess intratumoral heterogeneity of this lesion in comparison to adjacent normal cervical tissues. A total of 51 women (mean age, 49 years) with cervical cancers confirmed by biopsy underwent 3-T pelvic diffusion-weighted magnetic resonance imaging with b values of 0 and 800 s/mm 2 prospectively. ADC-based entropy-related parameters including first-order entropy and second-order entropies were derived from the whole tumor volume as well as adjacent normal cervical tissues. Intraclass correlation coefficient, Wilcoxon test with Bonferroni correction, Kruskal-Wallis test, and receiver operating characteristic curve were used for statistical analysis. All the parameters showed excellent interobserver agreement (all intraclass correlation coefficients > 0.900). Entropy, entropy(H) 0 , entropy(H) 45 , entropy(H) 90 , entropy(H) 135 , and entropy(H) mean were significantly higher, whereas entropy(H) range and entropy(H) std were significantly lower in cervical cancers compared to adjacent normal cervical tissues (all P <.0001). Kruskal-Wallis test showed that there were no significant differences among the values of various second-order entropies including entropy(H) 0, entropy(H) 45 , entropy(H) 90 , entropy(H) 135 , and entropy(H) mean. All second-order entropies had larger area under the receiver operating characteristic curve than first-order entropy in differentiating cervical cancers from adjacent normal cervical tissues. Further, entropy(H) 45 , entropy(H) 90 , entropy(H) 135 , and entropy(H) mean had the same largest area under the receiver operating characteristic curve of 0.867. Whole-lesion ADC-based entropy-related parameters of cervical cancers were developed successfully, which showed initial potential in characterizing intratumoral heterogeneity in comparison to adjacent normal cervical tissues. Copyright © 2016 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.
Sasikala, Wilbee D; Mukherjee, Arnab
2012-10-11
DNA intercalation, a biophysical process of enormous clinical significance, has surprisingly eluded molecular understanding for several decades. With appropriate configurational restraint (to prevent dissociation) in all-atom metadynamics simulations, we capture the free energy surface of direct intercalation from minor groove-bound state for the first time using an anticancer agent proflavine. Mechanism along the minimum free energy path reveals that intercalation happens through a minimum base stacking penalty pathway where nonstacking parameters (Twist→Slide/Shift) change first, followed by base stacking parameters (Buckle/Roll→Rise). This mechanism defies the natural fluctuation hypothesis and provides molecular evidence for the drug-induced cavity formation hypothesis. The thermodynamic origin of the barrier is found to be a combination of entropy and desolvation energy.
Wang, Xin; Duan, Runyao
2017-11-03
We demonstrate the irreversibility of asymptotic entanglement manipulation under quantum operations that completely preserve the positivity of partial transpose (PPT), resolving a major open problem in quantum information theory. Our key tool is a new efficiently computable additive lower bound for the asymptotic relative entropy of entanglement with respect to PPT states, which can be used to evaluate the entanglement cost under local operations and classical communication (LOCC). We find that for any rank-two mixed state supporting on the 3⊗3 antisymmetric subspace, the amount of distillable entanglement by PPT operations is strictly smaller than one entanglement bit (ebit) while its entanglement cost under PPT operations is exactly one ebit. As a by-product, we find that for this class of states, both the Rains's bound and its regularization are strictly less than the asymptotic relative entropy of entanglement. So, in general, there is no unique entanglement measure for the manipulation of entanglement by PPT operations. We further show a computable sufficient condition for the irreversibility of entanglement distillation by LOCC (or PPT) operations.
Ruvinsky, Anatoly M
2007-06-01
We present results of testing the ability of eleven popular scoring functions to predict native docked positions using a recently developed method (Ruvinsky and Kozintsev, J Comput Chem 2005, 26, 1089) for estimation the entropy contributions of relative motions to protein-ligand binding affinity. The method is based on the integration of the configurational integral over clusters obtained from multiple docked positions. We use a test set of 100 PDB protein-ligand complexes and ensembles of 101 docked positions generated by (Wang et al. J Med Chem 2003, 46, 2287) for each ligand in the test set. To test the suggested method we compared the averaged root-mean square deviations (RMSD) of the top-scored ligand docked positions, accounting and not accounting for entropy contributions, relative to the experimentally determined positions. We demonstrate that the method increases docking accuracy by 10-21% when used in conjunction with the AutoDock scoring function, by 2-25% with G-Score, by 7-41% with D-Score, by 0-8% with LigScore, by 1-6% with PLP, by 0-12% with LUDI, by 2-8% with F-Score, by 7-29% with ChemScore, by 0-9% with X-Score, by 2-19% with PMF, and by 1-7% with DrugScore. We also compared the performance of the suggested method with the method based on ranking by cluster occupancy only. We analyze how the choice of a clustering-RMSD and a low bound of dense clusters impacts on docking accuracy of the scoring methods. We derive optimal intervals of the clustering-RMSD for 11 scoring functions.
Smirnov, Alexey; Zubrienė, Asta; Manakova, Elena; Gražulis, Saulius
2018-01-01
The structure-thermodynamics correlation analysis was performed for a series of fluorine- and chlorine-substituted benzenesulfonamide inhibitors binding to several human carbonic anhydrase (CA) isoforms. The total of 24 crystal structures of 16 inhibitors bound to isoforms CA I, CA II, CA XII, and CA XIII provided the structural information of selective recognition between a compound and CA isoform. The binding thermodynamics of all structures was determined by the analysis of binding-linked protonation events, yielding the intrinsic parameters, i.e., the enthalpy, entropy, and Gibbs energy of binding. Inhibitor binding was compared within structurally similar pairs that differ by para- or meta-substituents enabling to obtain the contributing energies of ligand fragments. The pairs were divided into two groups. First, similar binders—the pairs that keep the same orientation of the benzene ring exhibited classical hydrophobic effect, a less exothermic enthalpy and a more favorable entropy upon addition of the hydrophobic fragments. Second, dissimilar binders—the pairs of binders that demonstrated altered positions of the benzene rings exhibited the non-classical hydrophobic effect, a more favorable enthalpy and variable entropy contribution. A deeper understanding of the energies contributing to the protein-ligand recognition should lead toward the eventual goal of rational drug design where chemical structures of ligands could be designed based on the target protein structure. PMID:29503769
Sprenger, K G; Pfaendtner, Jim
2016-06-07
Thermodynamic analyses can provide key insights into the origins of protein self-assembly on surfaces, protein function, and protein stability. However, obtaining quantitative measurements of thermodynamic observables from unbiased classical simulations of peptide or protein adsorption is challenging because of sampling limitations brought on by strong biomolecule/surface binding forces as well as time scale limitations. We used the parallel tempering metadynamics in the well-tempered ensemble (PTMetaD-WTE) enhanced sampling method to study the adsorption behavior and thermodynamics of several explicitly solvated model peptide adsorption systems, providing new molecular-level insight into the biomolecule adsorption process. Specifically studied were peptides LKα14 and LKβ15 and trpcage miniprotein adsorbing onto a charged, hydrophilic self-assembled monolayer surface functionalized with a carboxylic acid/carboxylate headgroup and a neutral, hydrophobic methyl-terminated self-assembled monolayer surface. Binding free energies were calculated as a function of temperature for each system and decomposed into their respective energetic and entropic contributions. We investigated how specific interfacial features such as peptide/surface electrostatic interactions and surface-bound ion content affect the thermodynamic landscape of adsorption and lead to differences in surface-bound conformations of the peptides. Results show that upon adsorption to the charged surface, configurational entropy gains of the released solvent molecules dominate the configurational entropy losses of the bound peptide. This behavior leads to an apparent increase in overall system entropy upon binding and therefore to the surprising and seemingly nonphysical result of an apparent increased binding free energy at elevated temperatures. Opposite effects and conclusions are found for the neutral surface. Additional simulations demonstrate that by adjusting the ionic strength of the solution, results that show the expected physical behavior, i.e., peptide binding strength that decreases with increasing temperature or is independent of temperature altogether, can be recovered on the charged surface. On the basis of this analysis, an overall free energy for the entire thermodynamic cycle for peptide adsorption on charged surfaces is constructed and validated with independent simulations.
New Algorithms and Lower Bounds for Sequential-Access Data Compression
NASA Astrophysics Data System (ADS)
Gagie, Travis
2009-02-01
This thesis concerns sequential-access data compression, i.e., by algorithms that read the input one or more times from beginning to end. In one chapter we consider adaptive prefix coding, for which we must read the input character by character, outputting each character's self-delimiting codeword before reading the next one. We show how to encode and decode each character in constant worst-case time while producing an encoding whose length is worst-case optimal. In another chapter we consider one-pass compression with memory bounded in terms of the alphabet size and context length, and prove a nearly tight tradeoff between the amount of memory we can use and the quality of the compression we can achieve. In a third chapter we consider compression in the read/write streams model, which allows us passes and memory both polylogarithmic in the size of the input. We first show how to achieve universal compression using only one pass over one stream. We then show that one stream is not sufficient for achieving good grammar-based compression. Finally, we show that two streams are necessary and sufficient for achieving entropy-only bounds.
STATIC QUARK ANTI-QUARK FREE AND INTERNAL ENERGY IN 2-FLAVOR QCD AND BOUND STATES IN THE QGP.
DOE Office of Scientific and Technical Information (OSTI.GOV)
ZANTOW, F.; KACZMAREK, O.
2005-07-25
We present results on heavy quark free energies in 2-flavour QCD. The temperature dependence of the interaction between static quark anti-quark pairs will be analyzed in terms of temperature dependent screening radii, which give a first estimate on the medium modification of (heavy quark) bound states in the quark gluon plasma. Comparing those radii to the (zero temperature) mean squared charge radii of chasmonium states indicates that the J/{Psi} may survive the phase transition as a bound state, while {chi}{sub c} and {Psi}{prime} are expected to show significant thermal modifications at temperatures close to the transition. Furthermore we will analyzemore » the relation between heavy quark free energies, entropy contributions and internal energy and discuss their relation to potential models used to analyze the melting of heavy quark bound states above the deconfinement temperature. Results of different groups and various potential models for bound states in the deconfined phase of QCD are compared.« less
Universality of the Volume Bound in Slow-Roll Eternal Inflation
DOE Office of Scientific and Technical Information (OSTI.GOV)
Dubovsky, Sergei; Senatore, Leonardo; Villadoro, Giovanni
2012-03-28
It has recently been shown that in single field slow-roll inflation the total volume cannot grow by a factor larger than e{sup S{sub dS}/2} without becoming infinite. The bound is saturated exactly at the phase transition to eternal inflation where the probability to produce infinite volume becomes non zero. We show that the bound holds sharply also in any space-time dimensions, when arbitrary higher-dimensional operators are included and in the multi-field inflationary case. The relation with the entropy of de Sitter and the universality of the bound strengthen the case for a deeper holographic interpretation. As a spin-off we providemore » the formalism to compute the probability distribution of the volume after inflation for generic multi-field models, which might help to address questions about the population of vacua of the landscape during slow-roll inflation.« less
1988-05-01
M 21 M2 I SI M1l[11 II1211 - - - M= II 2+111 I11-211 NONNEGATIVE CONE ORDERING Figure 25. The Matrix Majorant Is a Bound for the Hatrix Block Norm...the with respect to the cone of nonnegative -definite matrices. inequality (1.5) by the r x r nonnegative matrix equation Indeed, the majorant bound...t) eA-) e ea ’ A rT(" 3 ds, t> O , ju E [0 , 1] 0 J(G, )= tr (0,(6)R,) which is monotonically increasing in the nonnegative -definite G , cone with
Out-of-Bounds Hydrodynamics in Anisotropic Dirac Fluids
NASA Astrophysics Data System (ADS)
Link, Julia M.; Narozhny, Boris N.; Kiselev, Egor I.; Schmalian, Jörg
2018-05-01
We study hydrodynamic transport in two-dimensional, interacting electronic systems with merging Dirac points at charge neutrality. The dispersion along one crystallographic direction is Dirac-like, while it is Newtonian-like in the orthogonal direction. As a result, the electrical conductivity is metallic in one and insulating in the other direction. The shear viscosity tensor contains six independent components, which can be probed by measuring an anisotropic thermal flow. One of the viscosity components vanishes at zero temperature leading to a generalization of the previously conjectured lower bound for the shear viscosity to entropy density ratio.
Kabir, Ayesha; Suresh Kumar, Gopinatha
2013-01-01
Background The thermodynamics of the base pair specificity of the binding of the polyamines spermine, spermidine, putrescine, and cadaverine with three genomic DNAs Clostridium perfringens, 27% GC, Escherichia coli, 50% GC and Micrococcus lysodeikticus, 72% GC have been studied using titration calorimetry and the data supplemented with melting studies, ethidium displacement and circular dichroism spectroscopy results. Methodology/Principal Findings Isothermal titration calorimetry, differential scanning calorimetry, optical melting studies, ethidium displacement, circular dichroism spectroscopy are the various techniques employed to characterize the interaction of four polyamines, spermine, spermidine, putersine and cadaverine with the DNAs. Polyamines bound stronger with AT rich DNA compared to the GC rich DNA and the binding varied depending on the charge on the polyamine as spermine>spermidine >putrescine>cadaverine. Thermodynamics of the interaction revealed that the binding was entropy driven with small enthalpy contribution. The binding was influenced by salt concentration suggesting the contribution from electrostatic forces to the Gibbs energy of binding to be the dominant contributor. Each system studied exhibited enthalpy-entropy compensation. The negative heat capacity changes suggested a role for hydrophobic interactions which may arise due to the non polar interactions between DNA and polyamines. Conclusion/Significance From a thermodynamic analysis, the AT base specificity of polyamines to DNAs has been elucidated for the first time and supplemented by structural studies. PMID:23894663
Ratio of shear viscosity to entropy density in multifragmentation of Au + Au
NASA Astrophysics Data System (ADS)
Zhou, C. L.; Ma, Y. G.; Fang, D. Q.; Li, S. X.; Zhang, G. Q.
2012-06-01
The ratio of the shear viscosity (η) to entropy density (s) for the intermediate energy heavy-ion collisions has been calculated by using the Green-Kubo method in the framework of the quantum molecular dynamics model. The theoretical curve of η/s as a function of the incident energy for the head-on Au + Au collisions displays that a minimum region of η/s has been approached at higher incident energies, where the minimum η/s value is about 7 times Kovtun-Son-Starinets (KSS) bound (1/4π). We argue that the onset of minimum η/s region at higher incident energies corresponds to the nuclear liquid gas phase transition in nuclear multifragmentation.
Statistical physics of self-replication.
England, Jeremy L
2013-09-28
Self-replication is a capacity common to every species of living thing, and simple physical intuition dictates that such a process must invariably be fueled by the production of entropy. Here, we undertake to make this intuition rigorous and quantitative by deriving a lower bound for the amount of heat that is produced during a process of self-replication in a system coupled to a thermal bath. We find that the minimum value for the physically allowed rate of heat production is determined by the growth rate, internal entropy, and durability of the replicator, and we discuss the implications of this finding for bacterial cell division, as well as for the pre-biotic emergence of self-replicating nucleic acids.
Characterizing entanglement with global and marginal entropic measures
DOE Office of Scientific and Technical Information (OSTI.GOV)
Adesso, Gerardo; Illuminati, Fabrizio; De Siena, Silvio
2003-12-01
We qualify the entanglement of arbitrary mixed states of bipartite quantum systems by comparing global and marginal mixednesses quantified by different entropic measures. For systems of two qubits we discriminate the class of maximally entangled states with fixed marginal mixednesses, and determine an analytical upper bound relating the entanglement of formation to the marginal linear entropies. This result partially generalizes to mixed states the quantification of entanglement with marginal mixednesses holding for pure states. We identify a class of entangled states that, for fixed marginals, are globally more mixed than product states when measured by the linear entropy. Such statesmore » cannot be discriminated by the majorization criterion.« less
Generalized Probabilistic Description of Noninteracting Identical Particles
NASA Astrophysics Data System (ADS)
Karczewski, Marcin; Markiewicz, Marcin; Kaszlikowski, Dagomir; Kurzyński, Paweł
2018-02-01
We investigate an operational description of identical noninteracting particles in multiports. In particular, we look for physically motivated restrictions that explain their bunching probabilities. We focus on a symmetric 3-port in which a triple of superquantum particles admitted by our generalized probabilistic framework would bunch with a probability of 3/4 . The bosonic bound of 2/3 can then be restored by imposing the additional requirement of product evolution of certain input states. These states are characterized by the fact that, much like product states, their entropy equals the sum of entropies of their one-particle substates. This principle is, however, not enough to exclude the possibility of superquantum particles in higher-order multiports.
Minimax Quantum Tomography: Estimators and Relative Entropy Bounds.
Ferrie, Christopher; Blume-Kohout, Robin
2016-03-04
A minimax estimator has the minimum possible error ("risk") in the worst case. We construct the first minimax estimators for quantum state tomography with relative entropy risk. The minimax risk of nonadaptive tomography scales as O(1/sqrt[N])-in contrast to that of classical probability estimation, which is O(1/N)-where N is the number of copies of the quantum state used. We trace this deficiency to sampling mismatch: future observations that determine risk may come from a different sample space than the past data that determine the estimate. This makes minimax estimators very biased, and we propose a computationally tractable alternative with similar behavior in the worst case, but superior accuracy on most states.
On holographic entanglement entropy with second order excitations
NASA Astrophysics Data System (ADS)
He, Song; Sun, Jia-Rui; Zhang, Hai-Qing
2018-03-01
We study the low-energy corrections to the holographic entanglement entropy (HEE) in the boundary CFT by perturbing the bulk geometry up to second order excitations. Focusing on the case that the boundary subsystem is a strip, we show that the area of the bulk minimal surface can be expanded in terms of the conserved charges, such as mass, angular momentum and electric charge of the AdS black brane. We also calculate the variation of the energy in the subsystem and verify the validity of the first law-like relation of thermodynamics at second order. Moreover, the HEE is naturally bounded at second order perturbations if the cosmic censorship conjecture for the dual black hole still holds.
Entropy and equilibrium via games of complexity
NASA Astrophysics Data System (ADS)
Topsøe, Flemming
2004-09-01
It is suggested that thermodynamical equilibrium equals game theoretical equilibrium. Aspects of this thesis are discussed. The philosophy is consistent with maximum entropy thinking of Jaynes, but goes one step deeper by deriving the maximum entropy principle from an underlying game theoretical principle. The games introduced are based on measures of complexity. Entropy is viewed as minimal complexity. It is demonstrated that Tsallis entropy ( q-entropy) and Kaniadakis entropy ( κ-entropy) can be obtained in this way, based on suitable complexity measures. A certain unifying effect is obtained by embedding these measures in a two-parameter family of entropy functions.
Information-theoretic measures of hydrogen-like ions in weakly coupled Debye plasmas
NASA Astrophysics Data System (ADS)
Zan, Li Rong; Jiao, Li Guang; Ma, Jia; Ho, Yew Kam
2017-12-01
Recent development of information theory provides researchers an alternative and useful tool to quantitatively investigate the variation of the electronic structure when atoms interact with the external environment. In this work, we make systematic studies on the information-theoretic measures for hydrogen-like ions immersed in weakly coupled plasmas modeled by Debye-Hückel potential. Shannon entropy, Fisher information, and Fisher-Shannon complexity in both position and momentum spaces are quantified in high accuracy for the hydrogen atom in a large number of stationary states. The plasma screening effect on embedded atoms can significantly affect the electronic density distributions, in both conjugate spaces, and it is quantified by the variation of information quantities. It is shown that the composite quantities (the Shannon entropy sum and the Fisher information product in combined spaces and Fisher-Shannon complexity in individual space) give a more comprehensive description of the atomic structure information than single ones. The nodes of wave functions play a significant role in the changes of composite information quantities caused by plasmas. With the continuously increasing screening strength, all composite quantities in circular states increase monotonously, while in higher-lying excited states where nodal structures exist, they first decrease to a minimum and then increase rapidly before the bound state approaches the continuum limit. The minimum represents the most reduction of uncertainty properties of the atom in plasmas. The lower bounds for the uncertainty product of the system based on composite information quantities are discussed. Our research presents a comprehensive survey in the investigation of information-theoretic measures for simple atoms embedded in Debye model plasmas.
Double symbolic joint entropy in nonlinear dynamic complexity analysis
NASA Astrophysics Data System (ADS)
Yao, Wenpo; Wang, Jun
2017-07-01
Symbolizations, the base of symbolic dynamic analysis, are classified as global static and local dynamic approaches which are combined by joint entropy in our works for nonlinear dynamic complexity analysis. Two global static methods, symbolic transformations of Wessel N. symbolic entropy and base-scale entropy, and two local ones, namely symbolizations of permutation and differential entropy, constitute four double symbolic joint entropies that have accurate complexity detections in chaotic models, logistic and Henon map series. In nonlinear dynamical analysis of different kinds of heart rate variability, heartbeats of healthy young have higher complexity than those of the healthy elderly, and congestive heart failure (CHF) patients are lowest in heartbeats' joint entropy values. Each individual symbolic entropy is improved by double symbolic joint entropy among which the combination of base-scale and differential symbolizations have best complexity analysis. Test results prove that double symbolic joint entropy is feasible in nonlinear dynamic complexity analysis.
Causal holographic information does not satisfy the linearized quantum focusing condition
NASA Astrophysics Data System (ADS)
Fu, Zicao; Marolf, Donald; Qi, Marvin
2018-04-01
The Hubeny-Rangamani causal holographic information (CHI) defined by a region R of a holographic quantum field theory (QFT) is a modern version of the idea that the area of event horizons might be related to an entropy. Here the event horizon lives in a dual gravitational bulk theory with Newton's constant G bulk, and the relation involves a factor of 4 G bulk. The fact that CHI is bounded below by the von Neumann entropy S suggests that CHI is coarse-grained. Its properties could thus differ markedly from those of S. In particular, recent results imply that when d ≤ 4 holographic QFTs are perturbatively coupled to d-dimensional gravity, the combined system satisfies the so-called quantum focusing condition (QFC) at leading order in the new gravitational coupling G d when the QFT entropy is taken to be that of von Neumann. However, by studying states dual to spherical bulk (anti-de Sitter) Schwarschild black holes in the conformal frame for which the boundary is a (2 + 1)-dimensional de Sitter space, we find the QFC defined by CHI is violated even when perturbing about a Killing horizon and using a single null congruence. Since it is known that a generalized second law (GSL) holds in this context, our work demonstrates that the QFC is not required in order for an entropy, or an entropy-like quantity, to satisfy such a GSL.
Finite Inflation, Holography, and Dark Matter Annihilation
NASA Astrophysics Data System (ADS)
Scacco, Andrew Joseph
This thesis covers work on theoretical cosmology relating to inflation, de Sitter space, dark matter annihilation, and holography. A unifying feature of all these topics is that all of them occur in de Sitter space or focus on epochs of the Universe when the spacetime was close to de Sitter and that all of them have some connection to holography. Chapter 1 provides a pedagogical introduction to the fundamentals of cosmology, inflation, de Sitter space, dark matter annihilation and entanglement entropy. Chapter 2 covers the impact on the causal entropic principle of dark matter annihilation that we find to have the greatest relevance at late times in the future when the dark energy has driven the universe to be asymptotically de Sitter. In this chapter we estimate holographically preferred dark matter properties for a range of assumptions. Chapter 3 covers holographic bounds in models of finite inflation, specifically the Banks-Fischler bound and de Sitter equilibrium. The assumptions in each of these models are explored in detail and some interesting new connections are presented. Chapter 4 tests models of inflation with a fast-roll start that happen to satisfy the holographic bounds in Chapter 3 against cosmic microwave background data from Planck. We find a slight preference for a feature at the scale predicted by the Banks-Fischler bound though this preference is not found to be statistically significant. Chapter 5 contains a numerical computation of the holographic mutual information for an annular configuration of regions on a conformal field theory in de Sitter space using the AdS/CFT correspondence. This computation shows that the de Sitter space CFT entanglement entropy matches what would be expected from a Minkowski CFT and shows that the HRT conjecture works for this case.
Kong, Leopold; Huang, Chih-chin; Coales, Stephen J.; Molnar, Kathleen S.; Skinner, Jeff; Hamuro, Yoshitomo; Kwong, Peter D.
2010-01-01
The binding reaction of the HIV-1 gp120 envelope glycoprotein to the CD4 receptor involves exceptional changes in enthalpy and entropy. Crystal structures of gp120 in unliganded and various ligand-bound states, meanwhile, reveal an inner domain able to fold into diverse conformations, a structurally invariant outer domain, and, in the CD4-bound state, a bridging sheet minidomain. These studies, however, provide only hints as to the flexibility of each state. Here we use amide hydrogen/deuterium exchange coupled to mass spectrometry to provide quantifications of local conformational stability for HIV-1 gp120 in unliganded and CD4-bound states. On average, unliganded core gp120 displayed >10,000-fold slower exchange of backbone-amide hydrogens than a theoretically unstructured protein of the same composition, with binding by CD4 reducing the rate of gp120 amide exchange a further 10-fold. For the structurally constant CD4, alterations in exchange correlated well with alterations in binding surface (P value = 0.0004). For the structurally variable gp120, however, reductions in flexibility extended outside the binding surface, and regions of expected high structural diversity (inner domain/bridging sheet) displayed roughly 20-fold more rapid exchange in the unliganded state than regions of low diversity (outer domain). Thus, despite an extraordinary reduction in entropy, neither unliganded gp120 nor free CD4 was substantially unstructured, suggesting that most of the diverse conformations that make up the gp120 unliganded state are reasonably ordered. The results provide a framework for understanding how local conformational stability influences entropic change, conformational diversity, and structural rearrangements in the gp120-CD4 binding reaction. PMID:20660185
On holographic Rényi entropy in some modified theories of gravity
NASA Astrophysics Data System (ADS)
Dey, Anshuman; Roy, Pratim; Sarkar, Tapobrata
2018-04-01
We perform a detailed analysis of holographic entanglement Rényi entropy in some modified theories of gravity with four dimensional conformal field theory duals. First, we construct perturbative black hole solutions in a recently proposed model of Einsteinian cubic gravity in five dimensions, and compute the Rényi entropy as well as the scaling dimension of the twist operators in the dual field theory. Consistency of these results are verified from the AdS/CFT correspondence, via a corresponding computation of the Weyl anomaly on the gravity side. Similar analyses are then carried out for three other examples of modified gravity in five dimensions that include a chemical potential, namely Born-Infeld gravity, charged quasi-topological gravity and a class of Weyl corrected gravity theories with a gauge field, with the last example being treated perturbatively. Some interesting bounds in the dual conformal field theory parameters in quasi-topological gravity are pointed out. We also provide arguments on the validity of our perturbative analysis, whenever applicable.
Realistic Many-Body Quantum Systems vs. Full Random Matrices: Static and Dynamical Properties
NASA Astrophysics Data System (ADS)
Karp, Jonathan; Torres-Herrera, Jonathan; TáVora, Marco; Santos, Lea
We study the static and dynamical properties of isolated spin 1/2 systems as prototypes of many-body quantum systems and compare the results to those of full random matrices from a Gaussian orthogonal ensemble. Full random matrices do not represent realistic systems, because they imply that all particles interact at the same time, as opposed to realistic Hamiltonians, which are sparse and have only few-body interactions. Nevertheless, with full random matrices we can derive analytical results that can be used as references and bounds for the corresponding properties of realistic systems. In particular, we show that the results for the Shannon information entropy are very similar to those for the von Neumann entanglement entropy, with the former being computationally less expensive. We also discuss the behavior of the survival probability of the initial state at different time scales and show that it contains more information about the system than the entropies. Support from the NSF Grant No. DMR-1147430.
A Critical Look at Entropy-Based Gene-Gene Interaction Measures.
Lee, Woojoo; Sjölander, Arvid; Pawitan, Yudi
2016-07-01
Several entropy-based measures for detecting gene-gene interaction have been proposed recently. It has been argued that the entropy-based measures are preferred because entropy can better capture the nonlinear relationships between genotypes and traits, so they can be useful to detect gene-gene interactions for complex diseases. These suggested measures look reasonable at intuitive level, but so far there has been no detailed characterization of the interactions captured by them. Here we study analytically the properties of some entropy-based measures for detecting gene-gene interactions in detail. The relationship between interactions captured by the entropy-based measures and those of logistic regression models is clarified. In general we find that the entropy-based measures can suffer from a lack of specificity in terms of target parameters, i.e., they can detect uninteresting signals as interactions. Numerical studies are carried out to confirm theoretical findings. © 2016 WILEY PERIODICALS, INC.
Decoherence estimation in quantum theory and beyond
NASA Astrophysics Data System (ADS)
Pfister, Corsin
The quantum physics literature provides many different characterizations of decoherence. Most of them have in common that they describe decoherence as a kind of influence on a quantum system upon interacting with an another system. In the spirit of quantum information theory, we adapt a particular viewpoint on decoherence which describes it as the loss of information into a system that is possibly controlled by an adversary. We use a quantitative framework for decoherence that builds on operational characterizations of the min-entropy that have been developed in the quantum information literature. It characterizes decoherence as an influence on quantum channels that reduces their suitability for a variety of quantifiable tasks such as the distribution of secret cryptographic keys of a certain length or the distribution of a certain number of maximally entangled qubit pairs. This allows for a quantitative and operational characterization of decoherence via operational characterizations of the min-entropy. In this thesis, we present a series of results about the estimation of the minentropy, subdivided into three parts. The first part concerns the estimation of a quantum adversary's uncertainty about classical information--expressed by the smooth min-entropy--as it is done in protocols for quantum key distribution (QKD). We analyze this form of min-entropy estimation in detail and find that some of the more recently suggested QKD protocols have previously unnoticed security loopholes. We show that the specifics of the sifting subroutine of a QKD protocol are crucial for security by pointing out mistakes in the security analysis in the literature and by presenting eavesdropping attacks on those problematic protocols. We provide solutions to the identified problems and present a formalized analysis of the min-entropy estimate that incorporates the sifting stage of QKD protocols. In the second part, we extend ideas from QKD to a protocol that allows to estimate an adversary's uncertainty about quantum information, expressed by the fully quantum smooth min-entropy. Roughly speaking, we show that a protocol that resembles the parallel execution of two QKD protocols can be used to lower bound the min-entropy of some unmeasured qubits. We explain how this result may influence the ongoing search for protocols for entanglement distribution. The third part is dedicated to the development of a framework that allows the estimation of decoherence even in experiments that cannot be correctly described by quantum theory. Inspired by an equivalent formulation of the min-entropy that relates it to the fidelity with a maximally entangled state, we define a decoherence quantity for a very general class of probabilistic theories that reduces to the min-entropy in the special case of quantum theory. This entails a definition of maximal entanglement for generalized probabilistic theories. Using techniques from semidefinite and linear programming, we show how bounds on this quantity can be estimated through Bell-type experiments. This allows to test models for decoherence that cannot be described by quantum theory. As an example application, we devise an experimental test of a model for gravitational decoherence that has been suggested in the literature.
Bit Threads and Holographic Entanglement
NASA Astrophysics Data System (ADS)
Freedman, Michael; Headrick, Matthew
2017-05-01
The Ryu-Takayanagi (RT) formula relates the entanglement entropy of a region in a holographic theory to the area of a corresponding bulk minimal surface. Using the max flow-min cut principle, a theorem from network theory, we rewrite the RT formula in a way that does not make reference to the minimal surface. Instead, we invoke the notion of a "flow", defined as a divergenceless norm-bounded vector field, or equivalently a set of Planck-thickness "bit threads". The entanglement entropy of a boundary region is given by the maximum flux out of it of any flow, or equivalently the maximum number of bit threads that can emanate from it. The threads thus represent entanglement between points on the boundary, and naturally implement the holographic principle. As we explain, this new picture clarifies several conceptual puzzles surrounding the RT formula. We give flow-based proofs of strong subadditivity and related properties; unlike the ones based on minimal surfaces, these proofs correspond in a transparent manner to the properties' information-theoretic meanings. We also briefly discuss certain technical advantages that the flows offer over minimal surfaces. In a mathematical appendix, we review the max flow-min cut theorem on networks and on Riemannian manifolds, and prove in the network case that the set of max flows varies Lipshitz continuously in the network parameters.
Diehl, Carl; Engström, Olof; Delaine, Tamara; Håkansson, Maria; Genheden, Samuel; Modig, Kristofer; Leffler, Hakon; Ryde, Ulf; Nilsson, Ulf J; Akke, Mikael
2010-10-20
Rational drug design is predicated on knowledge of the three-dimensional structure of the protein-ligand complex and the thermodynamics of ligand binding. Despite the fundamental importance of both enthalpy and entropy in driving ligand binding, the role of conformational entropy is rarely addressed in drug design. In this work, we have probed the conformational entropy and its relative contribution to the free energy of ligand binding to the carbohydrate recognition domain of galectin-3. Using a combination of NMR spectroscopy, isothermal titration calorimetry, and X-ray crystallography, we characterized the binding of three ligands with dissociation constants ranging over 2 orders of magnitude. (15)N and (2)H spin relaxation measurements showed that the protein backbone and side chains respond to ligand binding by increased conformational fluctuations, on average, that differ among the three ligand-bound states. Variability in the response to ligand binding is prominent in the hydrophobic core, where a distal cluster of methyl groups becomes more rigid, whereas methyl groups closer to the binding site become more flexible. The results reveal an intricate interplay between structure and conformational fluctuations in the different complexes that fine-tunes the affinity. The estimated change in conformational entropy is comparable in magnitude to the binding enthalpy, demonstrating that it contributes favorably and significantly to ligand binding. We speculate that the relatively weak inherent protein-carbohydrate interactions and limited hydrophobic effect associated with oligosaccharide binding might have exerted evolutionary pressure on carbohydrate-binding proteins to increase the affinity by means of conformational entropy.
Using entropy measures to characterize human locomotion.
Leverick, Graham; Szturm, Tony; Wu, Christine Q
2014-12-01
Entropy measures have been widely used to quantify the complexity of theoretical and experimental dynamical systems. In this paper, the value of using entropy measures to characterize human locomotion is demonstrated based on their construct validity, predictive validity in a simple model of human walking and convergent validity in an experimental study. Results show that four of the five considered entropy measures increase meaningfully with the increased probability of falling in a simple passive bipedal walker model. The same four entropy measures also experienced statistically significant increases in response to increasing age and gait impairment caused by cognitive interference in an experimental study. Of the considered entropy measures, the proposed quantized dynamical entropy (QDE) and quantization-based approximation of sample entropy (QASE) offered the best combination of sensitivity to changes in gait dynamics and computational efficiency. Based on these results, entropy appears to be a viable candidate for assessing the stability of human locomotion.
High-order computer-assisted estimates of topological entropy
NASA Astrophysics Data System (ADS)
Grote, Johannes
The concept of Taylor Models is introduced, which offers highly accurate C0-estimates for the enclosures of functional dependencies, combining high-order Taylor polynomial approximation of functions and rigorous estimates of the truncation error, performed using verified interval arithmetic. The focus of this work is on the application of Taylor Models in algorithms for strongly nonlinear dynamical systems. A method to obtain sharp rigorous enclosures of Poincare maps for certain types of flows and surfaces is developed and numerical examples are presented. Differential algebraic techniques allow the efficient and accurate computation of polynomial approximations for invariant curves of certain planar maps around hyperbolic fixed points. Subsequently we introduce a procedure to extend these polynomial curves to verified Taylor Model enclosures of local invariant manifolds with C0-errors of size 10-10--10 -14, and proceed to generate the global invariant manifold tangle up to comparable accuracy through iteration in Taylor Model arithmetic. Knowledge of the global manifold structure up to finite iterations of the local manifold pieces enables us to find all homoclinic and heteroclinic intersections in the generated manifold tangle. Combined with the mapping properties of the homoclinic points and their ordering we are able to construct a subshift of finite type as a topological factor of the original planar system to obtain rigorous lower bounds for its topological entropy. This construction is fully automatic and yields homoclinic tangles with several hundred homoclinic points. As an example rigorous lower bounds for the topological entropy of the Henon map are computed, which to the best knowledge of the authors yield the largest such estimates published so far.
NASA Astrophysics Data System (ADS)
Giribet, Gaston; Oliva, Julio; Tempo, David; Troncoso, Ricardo
2009-12-01
Asymptotically anti-de Sitter rotating black holes for the Bergshoeff-Hohm-Townsend massive gravity theory in three dimensions are considered. In the special case when the theory admits a unique maximally symmetric solution, apart from the mass and the angular momentum, the black hole is described by an independent “gravitational hair” parameter, which provides a negative lower bound for the mass. This bound is saturated at the extremal case, and since the temperature and the semiclassical entropy vanish, it is naturally regarded as the ground state. The absence of a global charge associated with the gravitational hair parameter reflects itself through the first law of thermodynamics in the fact that the variation of this parameter can be consistently reabsorbed by a shift of the global charges, giving further support to consider the extremal case as the ground state. The rotating black hole fits within relaxed asymptotic conditions as compared with the ones of Brown and Henneaux, such that they are invariant under the standard asymptotic symmetries spanned by two copies of the Virasoro generators, and the algebra of the conserved charges acquires a central extension. Then it is shown that Strominger’s holographic computation for general relativity can also be extended to the Bergshoeff-Hohm-Townsend theory; i.e., assuming that the quantum theory could be consistently described by a dual conformal field theory at the boundary, the black hole entropy can be microscopically computed from the asymptotic growth of the number of states according to Cardy’s formula, in exact agreement with the semiclassical result.
Identifying functional thermodynamics in autonomous Maxwellian ratchets
NASA Astrophysics Data System (ADS)
Boyd, Alexander B.; Mandal, Dibyendu; Crutchfield, James P.
2016-02-01
We introduce a family of Maxwellian Demons for which correlations among information bearing degrees of freedom can be calculated exactly and in compact analytical form. This allows one to precisely determine Demon functional thermodynamic operating regimes, when previous methods either misclassify or simply fail due to approximations they invoke. This reveals that these Demons are more functional than previous candidates. They too behave either as engines, lifting a mass against gravity by extracting energy from a single heat reservoir, or as Landauer erasers, consuming external work to remove information from a sequence of binary symbols by decreasing their individual uncertainty. Going beyond these, our Demon exhibits a new functionality that erases bits not by simply decreasing individual-symbol uncertainty, but by increasing inter-bit correlations (that is, by adding temporal order) while increasing single-symbol uncertainty. In all cases, but especially in the new erasure regime, exactly accounting for informational correlations leads to tight bounds on Demon performance, expressed as a refined Second Law of thermodynamics that relies on the Kolmogorov-Sinai entropy for dynamical processes and not on changes purely in system configurational entropy, as previously employed. We rigorously derive the refined Second Law under minimal assumptions and so it applies quite broadly—for Demons with and without memory and input sequences that are correlated or not. We note that general Maxwellian Demons readily violate previously proposed, alternative such bounds, while the current bound still holds. As such, it broadly describes the minimal energetic cost of any computation by a thermodynamic system.
Shear viscosity in an anisotropic unitary Fermi gas
NASA Astrophysics Data System (ADS)
Samanta, Rickmoy; Sharma, Rishi; Trivedi, Sandip P.
2017-11-01
We consider a system consisting of a strongly interacting, ultracold unitary Fermi gas under harmonic confinement. Our analysis suggests the possibility of experimentally studying, in this system, an anisotropic shear viscosity tensor driven by the anisotropy in the trapping potential. In particular, we suggest that this experimental setup could mimic some features of anisotropic geometries that have recently been studied for strongly coupled field theories which have a dual gravitational description. Results using the AdS/CFT (anti-de Sitter/conformal field theory correspondence) in these theories show that in systems with a background linear potential, certain viscosity components can be made much smaller than the entropy density, parametrically violating the bound proposed by Kovtun, Son, and Starinets (KSS). This intuition, along with results from a Boltzmann analysis that we perform, suggests that a violation of the KSS bound can perhaps occur in the unitary Fermi gas system when it is subjected to a suitable anisotropic trapping potential which may be approximated to be linear in a suitable range of parameters. We give a concrete proposal for an experimental setup where an anisotropic shear viscosity tensor may arise. In such situations, it may also be possible to observe a reduction in the spin-1 component of the shear viscosity from its lowest value observed so far in ultracold Fermi gases. In extreme anisotropic situations, the reduction may be enough to reduce the shear viscosity to entropy ratio below the proposed KSS bound, although this regime is difficult to analyze in a theoretically controlled manner.
Rifai Chai; Naik, Ganesh R; Tran, Yvonne; Sai Ho Ling; Craig, Ashley; Nguyen, Hung T
2015-08-01
An electroencephalography (EEG)-based counter measure device could be used for fatigue detection during driving. This paper explores the classification of fatigue and alert states using power spectral density (PSD) as a feature extractor and fuzzy swarm based-artificial neural network (ANN) as a classifier. An independent component analysis of entropy rate bound minimization (ICA-ERBM) is investigated as a novel source separation technique for fatigue classification using EEG analysis. A comparison of the classification accuracy of source separator versus no source separator is presented. Classification performance based on 43 participants without the inclusion of the source separator resulted in an overall sensitivity of 71.67%, a specificity of 75.63% and an accuracy of 73.65%. However, these results were improved after the inclusion of a source separator module, resulting in an overall sensitivity of 78.16%, a specificity of 79.60% and an accuracy of 78.88% (p <; 0.05).
Diversity of Poissonian populations.
Eliazar, Iddo I; Sokolov, Igor M
2010-01-01
Populations represented by collections of points scattered randomly on the real line are ubiquitous in science and engineering. The statistical modeling of such populations leads naturally to Poissonian populations-Poisson processes on the real line with a distinguished maximal point. Poissonian populations are infinite objects underlying key issues in statistical physics, probability theory, and random fractals. Due to their infiniteness, measuring the diversity of Poissonian populations depends on the lower-bound cut-off applied. This research characterizes the classes of Poissonian populations whose diversities are invariant with respect to the cut-off level applied and establishes an elemental connection between these classes and extreme-value theory. The measures of diversity considered are variance and dispersion, Simpson's index and inverse participation ratio, Shannon's entropy and Rényi's entropy, and Gini's index.
Computation and analysis for a constrained entropy optimization problem in finance
NASA Astrophysics Data System (ADS)
He, Changhong; Coleman, Thomas F.; Li, Yuying
2008-12-01
In [T. Coleman, C. He, Y. Li, Calibrating volatility function bounds for an uncertain volatility model, Journal of Computational Finance (2006) (submitted for publication)], an entropy minimization formulation has been proposed to calibrate an uncertain volatility option pricing model (UVM) from market bid and ask prices. To avoid potential infeasibility due to numerical error, a quadratic penalty function approach is applied. In this paper, we show that the solution to the quadratic penalty problem can be obtained by minimizing an objective function which can be evaluated via solving a Hamilton-Jacobian-Bellman (HJB) equation. We prove that the implicit finite difference solution of this HJB equation converges to its viscosity solution. In addition, we provide computational examples illustrating accuracy of calibration.
NASA Astrophysics Data System (ADS)
Lütfüoğlu, B. C.
2018-01-01
In this study, we reveal the difference between Woods-Saxon (WS) and Generalized Symmetric Woods-Saxon (GSWS) potentials in order to describe the physical properties of a nucleon, by means of solving Schrödinger equation for the two potentials. The additional term squeezes the WS potential well, which leads an upward shift in the spectrum, resulting in a more realistic picture. The resulting GSWS potential does not merely accommodate extra quasi bound states, but also has modified bound state spectrum. As an application, we apply the formalism to a real problem, an α particle confined in Bohrium-270 nucleus. The thermodynamic functions Helmholtz energy, entropy, internal energy, specific heat of the system are calculated and compared for both wells. The internal energy and the specific heat capacity increase as a result of upward shift in the spectrum. The shift of the Helmholtz free energy is a direct consequence of the shift of the spectrum. The entropy decreases because of a decrement in the number of available states. Supported by the Turkish Science and Research Council (TÜBİTAK) and Akdeniz University
Cryptography in the Bounded-Quantum-Storage Model
NASA Astrophysics Data System (ADS)
Schaffner, Christian
2007-09-01
This thesis initiates the study of cryptographic protocols in the bounded-quantum-storage model. On the practical side, simple protocols for Rabin Oblivious Transfer, 1-2 Oblivious Transfer and Bit Commitment are presented. No quantum memory is required for honest players, whereas the protocols can only be broken by an adversary controlling a large amount of quantum memory. The protocols are efficient, non-interactive and can be implemented with today's technology. On the theoretical side, new entropic uncertainty relations involving min-entropy are established and used to prove the security of protocols according to new strong security definitions. For instance, in the realistic setting of Quantum Key Distribution (QKD) against quantum-memory-bounded eavesdroppers, the uncertainty relation allows to prove the security of QKD protocols while tolerating considerably higher error rates compared to the standard model with unbounded adversaries.
Time-dependent entropy evolution in microscopic and macroscopic electromagnetic relaxation
DOE Office of Scientific and Technical Information (OSTI.GOV)
Baker-Jarvis, James
This paper is a study of entropy and its evolution in the time and frequency domains upon application of electromagnetic fields to materials. An understanding of entropy and its evolution in electromagnetic interactions bridges the boundaries between electromagnetism and thermodynamics. The approach used here is a Liouville-based statistical-mechanical theory. I show that the microscopic entropy is reversible and the macroscopic entropy satisfies an H theorem. The spectral entropy development can be very useful for studying the frequency response of materials. Using a projection-operator based nonequilibrium entropy, different equations are derived for the entropy and entropy production and are applied tomore » the polarization, magnetization, and macroscopic fields. I begin by proving an exact H theorem for the entropy, progress to application of time-dependent entropy in electromagnetics, and then apply the theory to relevant applications in electromagnetics. The paper concludes with a discussion of the relationship of the frequency-domain form of the entropy to the permittivity, permeability, and impedance.« less
Relating different quantum generalizations of the conditional Rényi entropy
DOE Office of Scientific and Technical Information (OSTI.GOV)
Tomamichel, Marco; School of Physics, The University of Sydney, Sydney 2006; Berta, Mario
2014-08-15
Recently a new quantum generalization of the Rényi divergence and the corresponding conditional Rényi entropies was proposed. Here, we report on a surprising relation between conditional Rényi entropies based on this new generalization and conditional Rényi entropies based on the quantum relative Rényi entropy that was used in previous literature. Our result generalizes the well-known duality relation H(A|B) + H(A|C) = 0 of the conditional von Neumann entropy for tripartite pure states to Rényi entropies of two different kinds. As a direct application, we prove a collection of inequalities that relate different conditional Rényi entropies and derive a new entropicmore » uncertainty relation.« less
Valence tautomerism in synthetic models of cytochrome P450
Das, Pradip Kumar; Samanta, Subhra; McQuarters, Ashley B.; Lehnert, Nicolai
2016-01-01
CytP450s have a cysteine-bound heme cofactor that, in its as-isolated resting (oxidized) form, can be conclusively described as a ferric thiolate species. Unlike the native enzyme, most synthetic thiolate-bound ferric porphyrins are unstable in air unless the axial thiolate ligand is sterically protected. Spectroscopic investigations on a series of synthetic mimics of cytP450 indicate that a thiolate-bound ferric porphyrin coexists in organic solutions at room temperature (RT) with a thiyl-radical bound ferrous porphyrin, i.e., its valence tautomer. The ferric thiolate state is favored by greater enthalpy and is air stable. The ferrous thiyl state is favored by entropy, populates at RT, and degrades in air. These ground states can be reversibly interchanged at RT by the addition or removal of water to the apolar medium. It is concluded that hydrogen bonding and local electrostatics protect the resting oxidized cytP450 active site from degradation in air by stabilizing the ferric thiolate ground state in contrast to its synthetic analogs. PMID:27302948
Entanglement Entropy of Eigenstates of Quadratic Fermionic Hamiltonians.
Vidmar, Lev; Hackl, Lucas; Bianchi, Eugenio; Rigol, Marcos
2017-07-14
In a seminal paper [D. N. Page, Phys. Rev. Lett. 71, 1291 (1993)PRLTAO0031-900710.1103/PhysRevLett.71.1291], Page proved that the average entanglement entropy of subsystems of random pure states is S_{ave}≃lnD_{A}-(1/2)D_{A}^{2}/D for 1≪D_{A}≤sqrt[D], where D_{A} and D are the Hilbert space dimensions of the subsystem and the system, respectively. Hence, typical pure states are (nearly) maximally entangled. We develop tools to compute the average entanglement entropy ⟨S⟩ of all eigenstates of quadratic fermionic Hamiltonians. In particular, we derive exact bounds for the most general translationally invariant models lnD_{A}-(lnD_{A})^{2}/lnD≤⟨S⟩≤lnD_{A}-[1/(2ln2)](lnD_{A})^{2}/lnD. Consequently, we prove that (i) if the subsystem size is a finite fraction of the system size, then ⟨S⟩
Entropy generation of nanofluid flow in a microchannel heat sink
NASA Astrophysics Data System (ADS)
Manay, Eyuphan; Akyürek, Eda Feyza; Sahin, Bayram
2018-06-01
Present study aims to investigate the effects of the presence of nano sized TiO2 particles in the base fluid on entropy generation rate in a microchannel heat sink. Pure water was chosen as base fluid, and TiO2 particles were suspended into the pure water in five different particle volume fractions of 0.25%, 0.5%, 1.0%, 1.5% and 2.0%. Under laminar, steady state flow and constant heat flux boundary conditions, thermal, frictional, total entropy generation rates and entropy generation number ratios of nanofluids were experimentally analyzed in microchannel flow for different channel heights of 200 μm, 300 μm, 400 μm and 500 μm. It was observed that frictional and total entropy generation rates increased as thermal entropy generation rate were decreasing with an increase in particle volume fraction. In microchannel flows, thermal entropy generation could be neglected due to its too low rate smaller than 1.10e-07 in total entropy generation. Higher channel heights caused higher thermal entropy generation rates, and increasing channel height yielded an increase from 30% to 52% in thermal entropy generation. When channel height decreased, an increase of 66%-98% in frictional entropy generation was obtained. Adding TiO2 nanoparticles into the base fluid caused thermal entropy generation to decrease about 1.8%-32.4%, frictional entropy generation to increase about 3.3%-21.6%.
Multi-shell model of ion-induced nucleic acid condensation
NASA Astrophysics Data System (ADS)
Tolokh, Igor S.; Drozdetski, Aleksander V.; Pollack, Lois; Baker, Nathan A.; Onufriev, Alexey V.
2016-04-01
We present a semi-quantitative model of condensation of short nucleic acid (NA) duplexes induced by trivalent cobalt(iii) hexammine (CoHex) ions. The model is based on partitioning of bound counterion distribution around single NA duplex into "external" and "internal" ion binding shells distinguished by the proximity to duplex helical axis. In the aggregated phase the shells overlap, which leads to significantly increased attraction of CoHex ions in these overlaps with the neighboring duplexes. The duplex aggregation free energy is decomposed into attractive and repulsive components in such a way that they can be represented by simple analytical expressions with parameters derived from molecular dynamic simulations and numerical solutions of Poisson equation. The attractive term depends on the fractions of bound ions in the overlapping shells and affinity of CoHex to the "external" shell of nearly neutralized duplex. The repulsive components of the free energy are duplex configurational entropy loss upon the aggregation and the electrostatic repulsion of the duplexes that remains after neutralization by bound CoHex ions. The estimates of the aggregation free energy are consistent with the experimental range of NA duplex condensation propensities, including the unusually poor condensation of RNA structures and subtle sequence effects upon DNA condensation. The model predicts that, in contrast to DNA, RNA duplexes may condense into tighter packed aggregates with a higher degree of duplex neutralization. An appreciable CoHex mediated RNA-RNA attraction requires closer inter-duplex separation to engage CoHex ions (bound mostly in the "internal" shell of RNA) into short-range attractive interactions. The model also predicts that longer NA fragments will condense more readily than shorter ones. The ability of this model to explain experimentally observed trends in NA condensation lends support to proposed NA condensation picture based on the multivalent "ion binding shells."
NASA Astrophysics Data System (ADS)
O'Brien, Paul
2017-01-01
Max Plank did not quantize temperature. I will show that the Plank temperature violates the Plank scale. Plank stated that the Plank scale was Natures scale and independent of human construct. Also stating that even aliens would derive the same values. He made a huge mistake, because temperature is based on the Kelvin scale, which is man-made just like the meter and kilogram. He did not discover natures scale for the quantization of temperature. His formula is flawed, and his value is incorrect. Plank's calculation is Tp = c2Mp/Kb. The general form of this equation is T = E/Kb Why is this wrong? The temperature for a fixed amount of energy is dependent upon the volume it occupies. Using the correct formula involves specifying the radius of the volume in the form of (RE). This leads to an inequality and a limit that is equivalent to the Bekenstein Bound, but using temperature instead of entropy. Rewriting this equation as a limit defines both the maximum temperature and Boltzmann's constant. This will saturate any space-time boundary with maximum temperature and information density, also the minimum radius and entropy. The general form of the equation then becomes a limit in BH thermodynamics T <= (RE)/(λKb) .
Entropy-based goodness-of-fit test: Application to the Pareto distribution
NASA Astrophysics Data System (ADS)
Lequesne, Justine
2013-08-01
Goodness-of-fit tests based on entropy have been introduced in [13] for testing normality. The maximum entropy distribution in a class of probability distributions defined by linear constraints induces a Pythagorean equality between the Kullback-Leibler information and an entropy difference. This allows one to propose a goodness-of-fit test for maximum entropy parametric distributions which is based on the Kullback-Leibler information. We will focus on the application of the method to the Pareto distribution. The power of the proposed test is computed through Monte Carlo simulation.
RED: a set of molecular descriptors based on Renyi entropy.
Delgado-Soler, Laura; Toral, Raul; Tomás, M Santos; Rubio-Martinez, Jaime
2009-11-01
New molecular descriptors, RED (Renyi entropy descriptors), based on the generalized entropies introduced by Renyi are presented. Topological descriptors based on molecular features have proven to be useful for describing molecular profiles. Renyi entropy is used as a variability measure to contract a feature-pair distribution composing the descriptor vector. The performance of RED descriptors was tested for the analysis of different sets of molecular distances, virtual screening, and pharmacological profiling. A free parameter of the Renyi entropy has been optimized for all the considered applications.
Quantum state discrimination bounds for finite sample size
DOE Office of Scientific and Technical Information (OSTI.GOV)
Audenaert, Koenraad M. R.; Mosonyi, Milan; Mathematical Institute, Budapest University of Technology and Economics, Egry Jozsef u 1., Budapest 1111
2012-12-15
In the problem of quantum state discrimination, one has to determine by measurements the state of a quantum system, based on the a priori side information that the true state is one of the two given and completely known states, {rho} or {sigma}. In general, it is not possible to decide the identity of the true state with certainty, and the optimal measurement strategy depends on whether the two possible errors (mistaking {rho} for {sigma}, or the other way around) are treated as of equal importance or not. Results on the quantum Chernoff and Hoeffding bounds and the quantum Stein'smore » lemma show that, if several copies of the system are available then the optimal error probabilities decay exponentially in the number of copies, and the decay rate is given by a certain statistical distance between {rho} and {sigma} (the Chernoff distance, the Hoeffding distances, and the relative entropy, respectively). While these results provide a complete solution to the asymptotic problem, they are not completely satisfying from a practical point of view. Indeed, in realistic scenarios one has access only to finitely many copies of a system, and therefore it is desirable to have bounds on the error probabilities for finite sample size. In this paper we provide finite-size bounds on the so-called Stein errors, the Chernoff errors, the Hoeffding errors, and the mixed error probabilities related to the Chernoff and the Hoeffding errors.« less
Latency-Information Theory: The Mathematical-Physical Theory of Communication-Observation
2010-01-01
Werner Heisenberg of quantum mechanics; 3) the source-entropy and channel-capacity lossless performance bounds of Claude Shannon that guide...through noisy intel-space channels, and where the physical time-dislocations of intel-space exhibit a passing of time Heisenberg information...life-space sensor, and where the physical time- dislocations of life-space exhibit a passing of time Heisenberg information-uncertainty; and 4
Zou, Haiyin; Wu, Ying
2016-01-01
The four tissue inhibitors of metalloproteinases (TIMPs) are potent inhibitors of the many matrixins (MMPs), except that TIMP1 weakly inhibits some MMPs, including MMP14. The broad-spectrum inhibition of MMPs by TIMPs and their N-domains (NTIMPs) is consistent with the previous isothermal titration calorimetric finding that their interactions are entropy-driven but differ in contributions from solvent and conformational entropy (ΔSsolv, ΔSconf), estimated using heat capacity changes (ΔCp). Selective engineered NTIMPs have potential applications for treating MMP-related diseases, including cancer and cardiomyopathy. Here we report isothermal titration calorimetric studies of the effects of selectivity-modifying mutations in NTIMP1 and NTIMP2 on the thermodynamics of their interactions with MMP1, MMP3, and MMP14. The weak inhibition of MMP14 by NTIMP1 reflects a large conformational entropy penalty for binding. The T98L mutation, peripheral to the NTIMP1 reactive site, enhances binding by increasing ΔSsolv but also reduces ΔSconf. However, the same mutation increases NTIMP1 binding to MMP3 in an interaction that has an unusual positive ΔCp. This indicates a decrease in solvent entropy compensated by increased conformational entropy, possibly reflecting interactions involving alternative conformers. The NTIMP2 mutant, S2D/S4A is a selective MMP1 inhibitor through electrostatic effects of a unique MMP-1 arginine. Asp-2 increases reactive site polarity, reducing ΔCp, but increases conformational entropy to maintain strong binding to MMP1. There is a strong negative correlation between ΔSsolv and ΔSconf for all characterized interactions, but the data for each MMP have characteristic ranges, reflecting intrinsic differences in the structures and dynamics of their free and inhibitor-bound forms. PMID:27033700
Content Based Image Retrieval and Information Theory: A General Approach.
ERIC Educational Resources Information Center
Zachary, John; Iyengar, S. S.; Barhen, Jacob
2001-01-01
Proposes an alternative real valued representation of color based on the information theoretic concept of entropy. A theoretical presentation of image entropy is accompanied by a practical description of the merits and limitations of image entropy compared to color histograms. Results suggest that image entropy is a promising approach to image…
Subgrid-scale Condensation Modeling for Entropy-based Large Eddy Simulations of Clouds
NASA Astrophysics Data System (ADS)
Kaul, C. M.; Schneider, T.; Pressel, K. G.; Tan, Z.
2015-12-01
An entropy- and total water-based formulation of LES thermodynamics, such as that used by the recently developed code PyCLES, is advantageous from physical and numerical perspectives. However, existing closures for subgrid-scale thermodynamic fluctuations assume more traditional choices for prognostic thermodynamic variables, such as liquid potential temperature, and are not directly applicable to entropy-based modeling. Since entropy and total water are generally nonlinearly related to diagnosed quantities like temperature and condensate amounts, neglecting their small-scale variability can lead to bias in simulation results. Here we present the development of a subgrid-scale condensation model suitable for use with entropy-based thermodynamic formulations.
Driver fatigue detection through multiple entropy fusion analysis in an EEG-based system.
Min, Jianliang; Wang, Ping; Hu, Jianfeng
2017-01-01
Driver fatigue is an important contributor to road accidents, and fatigue detection has major implications for transportation safety. The aim of this research is to analyze the multiple entropy fusion method and evaluate several channel regions to effectively detect a driver's fatigue state based on electroencephalogram (EEG) records. First, we fused multiple entropies, i.e., spectral entropy, approximate entropy, sample entropy and fuzzy entropy, as features compared with autoregressive (AR) modeling by four classifiers. Second, we captured four significant channel regions according to weight-based electrodes via a simplified channel selection method. Finally, the evaluation model for detecting driver fatigue was established with four classifiers based on the EEG data from four channel regions. Twelve healthy subjects performed continuous simulated driving for 1-2 hours with EEG monitoring on a static simulator. The leave-one-out cross-validation approach obtained an accuracy of 98.3%, a sensitivity of 98.3% and a specificity of 98.2%. The experimental results verified the effectiveness of the proposed method, indicating that the multiple entropy fusion features are significant factors for inferring the fatigue state of a driver.
NASA Astrophysics Data System (ADS)
Shimazaki, Tomomi; Nakajima, Takahito
2016-06-01
This paper discusses the exciton dissociation process at the donor-acceptor interface in organic photocells. In our previous study, we introduced a local temperature to handle the hot charge-transfer (CT) state and calculated the exciton dissociation probability based on the 1D organic semiconductor model [T. Shimazaki and T. Nakajima, Phys. Chem. Chem. Phys. 17, 12538 (2015)]. Although the hot CT state plays an essential role in exciton dissociations, the probabilities calculated are not high enough to efficiently separate bound electron-hole pairs. This paper focuses on the dimensional (entropy) effect together with the hot CT state effect and shows that cooperative behavior between both effects can improve the exciton dissociation process. In addition, we discuss cooperative effects with site-disorders and external-electric-fields.
Studies of Entanglement Entropy, and Relativistic Fluids for Thermal Field Theories
NASA Astrophysics Data System (ADS)
Spillane, Michael
In this dissertation we consider physical consequences of adding a finite temperature to quantum field theories. At small length scales entanglement is a critically important feature. It is therefore unsurprising that entanglement entropy and Renyi entropy are useful tools in studying quantum phase transition, and quantum information. In this thesis we consider the corrections to entanglement and Renyi entropies due to addition of a finite temperature. More specifically, we investigate the entanglement entropy of a massive scalar field in 1+1 dimensions at nonzero temperature. In the small mass ( m) and temperature (T) limit, we put upper and lower bounds on the two largest eigenvalues of the covariance matrix used to compute the entanglement entropy. We argue that the entanglement entropy has e-m/T scaling in the limit T << m.. Additionally, we calculate thermal corrections to Renyi entropies for free massless fermions on R x S d-1. By expanding the density matrix in a Boltzmann sum, the problem of finding the Renyi entropies can be mapped to the problem of calculating a two point function on an n-sheeted cover of the sphere. We map the problem on the sphere to a conical region in Euclidean space. By using the method of images, we calculate the two point function and recover the Renyi entropies. At large length scales hydrodynamics is a useful way to study quantum field theories. We review recent interest in the Riemann problem as a method for generating a non-equilibrium steady state. The initial conditions consist of a planar interface between two halves of a system held at different temperatures in a hydrodynamic regime. The resulting fluid flow contains a fixed temperature region with a nonzero flux. We briefly discuss the effects of a conserved charge. Next we discuss deforming the relativistic equations with a nonlinear term and how that deformation affects the temperature and velocity in the region connecting the asymptotic fluids. Finally, we study properties of a non-equilibrium steady state generated when two heat baths are initially in contact with one another. The dynamics of the system in question are governed by holographic duality to a blackhole. We discuss the "phase diagram" associated with the steady state of the dual, dynamical black hole and its relation to the fluid/gravity correspondence.
Minimax Quantum Tomography: Estimators and Relative Entropy Bounds
Ferrie, Christopher; Blume-Kohout, Robin
2016-03-04
A minimax estimator has the minimum possible error (“risk”) in the worst case. Here we construct the first minimax estimators for quantum state tomography with relative entropy risk. The minimax risk of nonadaptive tomography scales as O (1/more » $$\\sqrt{N}$$ ) —in contrast to that of classical probability estimation, which is O (1/N) —where N is the number of copies of the quantum state used. We trace this deficiency to sampling mismatch: future observations that determine risk may come from a different sample space than the past data that determine the estimate. Lastly, this makes minimax estimators very biased, and we propose a computationally tractable alternative with similar behavior in the worst case, but superior accuracy on most states.« less
A maximum entropy model for chromatin structure
NASA Astrophysics Data System (ADS)
Farre, Pau; Emberly, Eldon; Emberly Group Team
The DNA inside the nucleus of eukaryotic cells shows a variety of conserved structures at different length scales These structures are formed by interactions between protein complexes that bind to the DNA and regulate gene activity. Recent high throughput sequencing techniques allow for the measurement both of the genome wide contact map of the folded DNA within a cell (HiC) and where various proteins are bound to the DNA (ChIP-seq). In this talk I will present a maximum-entropy method capable of both predicting HiC contact maps from binding data, and binding data from HiC contact maps. This method results in an intuitive Ising-type model that is able to predict how altering the presence of binding factors can modify chromosome conformation, without the need of polymer simulations.
Strong-Coupling Effects and Shear Viscosity in an Ultracold Fermi Gas
NASA Astrophysics Data System (ADS)
Kagamihara, D.; Ohashi, Y.
2017-06-01
We theoretically investigate the shear viscosity η , as well as the entropy density s, in the normal state of an ultracold Fermi gas. Including pairing fluctuations within the framework of a T-matrix approximation, we calculate these quantities in the Bardeen-Cooper-Schrieffer (BCS)-Bose-Einstein condensation (BEC) crossover region. We also evaluate η / s, to compare it with the lower bound of this ratio, conjectured by Kovtun, Son, and Starinets (KSS bound). In the weak-coupling BCS side, we show that the shear viscosity η is remarkably suppressed near the superfluid phase transition temperature Tc, due to the so-called pseudogap phenomenon. In the strong-coupling BEC side, we find that, within the neglect of the vertex corrections, one cannot correctly describe η . We also show that η / s decreases with increasing the interaction strength, to become very close to the KSS bound, \\hbar /4π kB, on the BEC side.
Source-Device-Independent Ultrafast Quantum Random Number Generation.
Marangon, Davide G; Vallone, Giuseppe; Villoresi, Paolo
2017-02-10
Secure random numbers are a fundamental element of many applications in science, statistics, cryptography and more in general in security protocols. We present a method that enables the generation of high-speed unpredictable random numbers from the quadratures of an electromagnetic field without any assumption on the input state. The method allows us to eliminate the numbers that can be predicted due to the presence of classical and quantum side information. In particular, we introduce a procedure to estimate a bound on the conditional min-entropy based on the entropic uncertainty principle for position and momentum observables of infinite dimensional quantum systems. By the above method, we experimentally demonstrated the generation of secure true random bits at a rate greater than 1.7 Gbit/s.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Sanchez-Moreno, P.; Instituto 'Carlos I' de Fisica Teorica y Computacional, Universidad de Granada, Granada; Zozor, S.
The Renyi and Shannon entropies are information-theoretic measures, which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation. Moreover, they are closely related to various energetic density functionals of quantum systems. Here we derive upper bounds on these quantities in terms of the second-order moment
An Entropy-Based Measure for Assessing Fuzziness in Logistic Regression
ERIC Educational Resources Information Center
Weiss, Brandi A.; Dardick, William
2016-01-01
This article introduces an entropy-based measure of data-model fit that can be used to assess the quality of logistic regression models. Entropy has previously been used in mixture-modeling to quantify how well individuals are classified into latent classes. The current study proposes the use of entropy for logistic regression models to quantify…
Information Entropy Analysis of the H1N1 Genetic Code
NASA Astrophysics Data System (ADS)
Martwick, Andy
2010-03-01
During the current H1N1 pandemic, viral samples are being obtained from large numbers of infected people world-wide and are being sequenced on the NCBI Influenza Virus Resource Database. The information entropy of the sequences was computed from the probability of occurrence of each nucleotide base at every position of each set of sequences using Shannon's definition of information entropy, [ H=∑bpb,2( 1pb ) ] where H is the observed information entropy at each nucleotide position and pb is the probability of the base pair of the nucleotides A, C, G, U. Information entropy of the current H1N1 pandemic is compared to reference human and swine H1N1 entropy. As expected, the current H1N1 entropy is in a low entropy state and has a very large mutation potential. Using the entropy method in mature genes we can identify low entropy regions of nucleotides that generally correlate to critical protein function.
Exploring stability of entropy analysis for signal with different trends
NASA Astrophysics Data System (ADS)
Zhang, Yin; Li, Jin; Wang, Jun
2017-03-01
Considering the effects of environment disturbances and instrument systems, the actual detecting signals always are carrying different trends, which result in that it is difficult to accurately catch signals complexity. So choosing steady and effective analysis methods is very important. In this paper, we applied entropy measures-the base-scale entropy and approximate entropy to analyze signal complexity, and studied the effect of trends on the ideal signal and the heart rate variability (HRV) signals, that is, linear, periodic, and power-law trends which are likely to occur in actual signals. The results show that approximate entropy is unsteady when we embed different trends into the signals, so it is not suitable to analyze signal with trends. However, the base-scale entropy has preferable stability and accuracy for signal with different trends. So the base-scale entropy is an effective method to analyze the actual signals.
MaxEnt, second variation, and generalized statistics
NASA Astrophysics Data System (ADS)
Plastino, A.; Rocca, M. C.
2015-10-01
There are two kinds of Tsallis-probability distributions: heavy tail ones and compact support distributions. We show here, by appeal to functional analysis' tools, that for lower bound Hamiltonians, the second variation's analysis of the entropic functional guarantees that the heavy tail q-distribution constitutes a maximum of Tsallis' entropy. On the other hand, in the compact support instance, a case by case analysis is necessary in order to tackle the issue.
Coding For Compression Of Low-Entropy Data
NASA Technical Reports Server (NTRS)
Yeh, Pen-Shu
1994-01-01
Improved method of encoding digital data provides for efficient lossless compression of partially or even mostly redundant data from low-information-content source. Method of coding implemented in relatively simple, high-speed arithmetic and logic circuits. Also increases coding efficiency beyond that of established Huffman coding method in that average number of bits per code symbol can be less than 1, which is the lower bound for Huffman code.
Highly Entangled, Non-random Subspaces of Tensor Products from Quantum Groups
NASA Astrophysics Data System (ADS)
Brannan, Michael; Collins, Benoît
2018-03-01
In this paper we describe a class of highly entangled subspaces of a tensor product of finite-dimensional Hilbert spaces arising from the representation theory of free orthogonal quantum groups. We determine their largest singular values and obtain lower bounds for the minimum output entropy of the corresponding quantum channels. An application to the construction of d-positive maps on matrix algebras is also presented.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Śliwa, Izabela, E-mail: izasliwa@ifmpan.poznan.pl; Zakharov, A. V., E-mail: alexandre.zakharov@yahoo.ca
Using the extended McMillan's mean field approach with anisotropic forces a study of both the structural and thermodynamic properties of free-standing smectic film (FSSF) in water on heating to the isotropic temperature is carried out numerically. By solving the self-consistent nonlinear equations for the order parameters, we obtained that the smectic-A-isotropic (AI) transition occurs through the series of layer-thinning transitions causing the films to thin in the stepwise manner as the temperature is increased above the bulk smectic-A-isotropic temperature T{sub AI}(bulk). With enhanced pair interactions in the bounding layers, the smectic-isotropic transition corresponds to smectic melting of the central layers.more » The effects of surface “enhanced” pair interactions in the bounding layers and of film thickness on the orientational and translational order parameters, the Helmholtz free energy and entropy, as well as the temperature dependence of the heat capacity of FSSFs, have also been investigated. Reasonable agreement between the theoretically predicted and the experimentally obtained – by means of optical microscopy and ellipsometry techniques – data of the temperature when the thin decylcyanobiphenyl smectic film immersing in water ruptures has been obtained.« less
Thermodynamics of natural selection III: Landauer's principle in computation and chemistry.
Smith, Eric
2008-05-21
This is the third in a series of three papers devoted to energy flow and entropy changes in chemical and biological processes, and their relations to the thermodynamics of computation. The previous two papers have developed reversible chemical transformations as idealizations for studying physiology and natural selection, and derived bounds from the second law of thermodynamics, between information gain in an ensemble and the chemical work required to produce it. This paper concerns the explicit mapping of chemistry to computation, and particularly the Landauer decomposition of irreversible computations, in which reversible logical operations generating no heat are separated from heat-generating erasure steps which are logically irreversible but thermodynamically reversible. The Landauer arrangement of computation is shown to produce the same entropy-flow diagram as that of the chemical Carnot cycles used in the second paper of the series to idealize physiological cycles. The specific application of computation to data compression and error-correcting encoding also makes possible a Landauer analysis of the somewhat different problem of optimal molecular recognition, which has been considered as an information theory problem. It is shown here that bounds on maximum sequence discrimination from the enthalpy of complex formation, although derived from the same logical model as the Shannon theorem for channel capacity, arise from exactly the opposite model for erasure.
Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing
2015-08-01
In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.
NASA Astrophysics Data System (ADS)
Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing
2015-08-01
In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.
Driver fatigue detection through multiple entropy fusion analysis in an EEG-based system
Min, Jianliang; Wang, Ping
2017-01-01
Driver fatigue is an important contributor to road accidents, and fatigue detection has major implications for transportation safety. The aim of this research is to analyze the multiple entropy fusion method and evaluate several channel regions to effectively detect a driver's fatigue state based on electroencephalogram (EEG) records. First, we fused multiple entropies, i.e., spectral entropy, approximate entropy, sample entropy and fuzzy entropy, as features compared with autoregressive (AR) modeling by four classifiers. Second, we captured four significant channel regions according to weight-based electrodes via a simplified channel selection method. Finally, the evaluation model for detecting driver fatigue was established with four classifiers based on the EEG data from four channel regions. Twelve healthy subjects performed continuous simulated driving for 1–2 hours with EEG monitoring on a static simulator. The leave-one-out cross-validation approach obtained an accuracy of 98.3%, a sensitivity of 98.3% and a specificity of 98.2%. The experimental results verified the effectiveness of the proposed method, indicating that the multiple entropy fusion features are significant factors for inferring the fatigue state of a driver. PMID:29220351
Upper entropy axioms and lower entropy axioms
DOE Office of Scientific and Technical Information (OSTI.GOV)
Guo, Jin-Li, E-mail: phd5816@163.com; Suo, Qi
2015-04-15
The paper suggests the concepts of an upper entropy and a lower entropy. We propose a new axiomatic definition, namely, upper entropy axioms, inspired by axioms of metric spaces, and also formulate lower entropy axioms. We also develop weak upper entropy axioms and weak lower entropy axioms. Their conditions are weaker than those of Shannon–Khinchin axioms and Tsallis axioms, while these conditions are stronger than those of the axiomatics based on the first three Shannon–Khinchin axioms. The subadditivity and strong subadditivity of entropy are obtained in the new axiomatics. Tsallis statistics is a special case of satisfying our axioms. Moreover,more » different forms of information measures, such as Shannon entropy, Daroczy entropy, Tsallis entropy and other entropies, can be unified under the same axiomatics.« less
Damage detection in rotating machinery by means of entropy-based parameters
NASA Astrophysics Data System (ADS)
Tocarciuc, Alexandru; Bereteu, Liviu; ǎgǎnescu, Gheorghe Eugen, Dr
2014-11-01
The paper is proposing two new entropy-based parameters, namely Renyi Entropy Index (REI) and Sharma-Mittal Entropy Index (SMEI), for detecting the presence of failures (or damages) in rotating machinery, namely: belt structural damage, belt wheels misalignment, failure of the fixing bolt of the machine to its baseplate and eccentricities (i.e.: due to detaching a small piece of material or bad mounting of the rotating components of the machine). The algorithms to obtain the proposed entropy-based parameters are described and test data is used in order to assess their sensitivity. A vibration test bench is used for measuring the levels of vibration while artificially inducing damage. The deviation of the two entropy-based parameters is compared in two states of the vibration test bench: not damaged and damaged. At the end of the study, their sensitivity is compared to Shannon Entropic Index.
An efficient algorithm for automatic phase correction of NMR spectra based on entropy minimization
NASA Astrophysics Data System (ADS)
Chen, Li; Weng, Zhiqiang; Goh, LaiYoong; Garland, Marc
2002-09-01
A new algorithm for automatic phase correction of NMR spectra based on entropy minimization is proposed. The optimal zero-order and first-order phase corrections for a NMR spectrum are determined by minimizing entropy. The objective function is constructed using a Shannon-type information entropy measure. Entropy is defined as the normalized derivative of the NMR spectral data. The algorithm has been successfully applied to experimental 1H NMR spectra. The results of automatic phase correction are found to be comparable to, or perhaps better than, manual phase correction. The advantages of this automatic phase correction algorithm include its simple mathematical basis and the straightforward, reproducible, and efficient optimization procedure. The algorithm is implemented in the Matlab program ACME—Automated phase Correction based on Minimization of Entropy.
Lower bounds on the violation of the monogamy inequality for quantum correlation measures
NASA Astrophysics Data System (ADS)
Kumar, Asutosh; Dhar, Himadri Shekhar
2016-06-01
In multiparty quantum systems, the monogamy inequality proposes an upper bound on the distribution of bipartite quantum correlation between a single party and each of the remaining parties in the system, in terms of the amount of quantum correlation shared by that party with the rest of the system taken as a whole. However, it is well known that not all quantum correlation measures universally satisfy the monogamy inequality. In this work, we aim at determining the nontrivial value by which the monogamy inequality can be violated by a quantum correlation measure. Using an information-theoretic complementarity relation between the normalized purity and quantum correlation in any given multiparty state, we obtain a nontrivial lower bound on the negative monogamy score for the quantum correlation measure. In particular, for the three-qubit states the lower bound is equal to the negative von Neumann entropy of the single qubit reduced density matrix. We analytically examine the tightness of the derived lower bound for certain n -qubit quantum states. Further, we report numerical results of the same for monogamy violating correlation measures using Haar uniformly generated three-qubit states.
Demetrius, L
2000-09-07
The science of thermodynamics is concerned with understanding the properties of inanimate matter in so far as they are determined by changes in temperature. The Second Law asserts that in irreversible processes there is a uni-directional increase in thermodynamic entropy, a measure of the degree of uncertainty in the thermal energy state of a randomly chosen particle in the aggregate. The science of evolution is concerned with understanding the properties of populations of living matter in so far as they are regulated by changes in generation time. Directionality theory, a mathematical model of the evolutionary process, establishes that in populations subject to bounded growth constraints, there is a uni-directional increase in evolutionary entropy, a measure of the degree of uncertainty in the age of the immediate ancestor of a randomly chosen newborn. This article reviews the mathematical basis of directionality theory and analyses the relation between directionality theory and statistical thermodynamics. We exploit an analytic relation between temperature, and generation time, to show that the directionality principle for evolutionary entropy is a non-equilibrium extension of the principle of a uni-directional increase of thermodynamic entropy. The analytic relation between these directionality principles is consistent with the hypothesis of the equivalence of fundamental laws as one moves up the hierarchy, from a molecular ensemble where the thermodynamic laws apply, to a population of replicating entities (molecules, cells, higher organisms), where evolutionary principles prevail. Copyright 2000 Academic Press.
Theory and Normal Mode Analysis of Change in Protein Vibrational Dynamics on Ligand Binding
DOE Office of Scientific and Technical Information (OSTI.GOV)
Mortisugu, Kei; Njunda, Brigitte; Smith, Jeremy C
2009-12-01
The change of protein vibrations on ligand binding is of functional and thermodynamic importance. Here, this process is characterized using a simple analytical 'ball-and-spring' model and all-atom normal-mode analysis (NMA) of the binding of the cancer drug, methotrexate (MTX) to its target, dihydrofolate reductase (DHFR). The analytical model predicts that the coupling between protein vibrations and ligand external motion generates entropy-rich, low-frequency vibrations in the complex. This is consistent with the atomistic NMA which reveals vibrational softening in forming the DHFR-MTX complex, a result also in qualitative agreement with neutron-scattering experiments. Energy minimization of the atomistic bound-state (B) structure whilemore » gradually decreasing the ligand interaction to zero allows the generation of a hypothetical 'intermediate' (I) state, without the ligand force field but with a structure similar to that of B. In going from I to B, it is found that the vibrational entropies of both the protein and MTX decrease while the complex structure becomes enthalpically stabilized. However, the relatively weak DHFR:MTX interaction energy results in the net entropy gain arising from coupling between the protein and MTX external motion being larger than the loss of vibrational entropy on complex formation. This, together with the I structure being more flexible than the unbound structure, results in the observed vibrational softening on ligand binding.« less
Salient target detection based on pseudo-Wigner-Ville distribution and Rényi entropy.
Xu, Yuannan; Zhao, Yuan; Jin, Chenfei; Qu, Zengfeng; Liu, Liping; Sun, Xiudong
2010-02-15
We present what we believe to be a novel method based on pseudo-Wigner-Ville distribution (PWVD) and Rényi entropy for salient targets detection. In the foundation of studying the statistical property of Rényi entropy via PWVD, the residual entropy-based saliency map of an input image can be obtained. From the saliency map, target detection is completed by the simple and convenient threshold segmentation. Experimental results demonstrate the proposed method can detect targets effectively in complex ground scenes.
Entropy coders for image compression based on binary forward classification
NASA Astrophysics Data System (ADS)
Yoo, Hoon; Jeong, Jechang
2000-12-01
Entropy coders as a noiseless compression method are widely used as final step compression for images, and there have been many contributions to increase of entropy coder performance and to reduction of entropy coder complexity. In this paper, we propose some entropy coders based on the binary forward classification (BFC). The BFC requires overhead of classification but there is no change between the amount of input information and the total amount of classified output information, which we prove this property in this paper. And using the proved property, we propose entropy coders that are the BFC followed by Golomb-Rice coders (BFC+GR) and the BFC followed by arithmetic coders (BFC+A). The proposed entropy coders introduce negligible additional complexity due to the BFC. Simulation results also show better performance than other entropy coders that have similar complexity to the proposed coders.
NASA Astrophysics Data System (ADS)
Yao, Lei; Wang, Zhenpo; Ma, Jun
2015-10-01
This paper proposes a method of fault detection of the connection of Lithium-Ion batteries based on entropy for electric vehicle. In electric vehicle operation process, some factors, such as road conditions, driving habits, vehicle performance, always affect batteries by vibration, which easily cause loosing or virtual connection between batteries. Through the simulation of the battery charging and discharging experiment under vibration environment, the data of voltage fluctuation can be obtained. Meanwhile, an optimal filtering method is adopted using discrete cosine filter method to analyze the characteristics of system noise, based on the voltage set when batteries are working under different vibration frequency. Experimental data processed by filtering is analyzed based on local Shannon entropy, ensemble Shannon entropy and sample entropy. And the best way to find a method of fault detection of the connection of lithium-ion batteries based on entropy is presented for electric vehicle. The experimental data shows that ensemble Shannon entropy can predict the accurate time and the location of battery connection failure in real time. Besides electric-vehicle industry, this method can also be used in other areas in complex vibration environment.
Global sensitivity analysis for fuzzy inputs based on the decomposition of fuzzy output entropy
NASA Astrophysics Data System (ADS)
Shi, Yan; Lu, Zhenzhou; Zhou, Yicheng
2018-06-01
To analyse the component of fuzzy output entropy, a decomposition method of fuzzy output entropy is first presented. After the decomposition of fuzzy output entropy, the total fuzzy output entropy can be expressed as the sum of the component fuzzy entropy contributed by fuzzy inputs. Based on the decomposition of fuzzy output entropy, a new global sensitivity analysis model is established for measuring the effects of uncertainties of fuzzy inputs on the output. The global sensitivity analysis model can not only tell the importance of fuzzy inputs but also simultaneously reflect the structural composition of the response function to a certain degree. Several examples illustrate the validity of the proposed global sensitivity analysis, which is a significant reference in engineering design and optimization of structural systems.
An Entropy-Based Measure for Assessing Fuzziness in Logistic Regression
Weiss, Brandi A.; Dardick, William
2015-01-01
This article introduces an entropy-based measure of data–model fit that can be used to assess the quality of logistic regression models. Entropy has previously been used in mixture-modeling to quantify how well individuals are classified into latent classes. The current study proposes the use of entropy for logistic regression models to quantify the quality of classification and separation of group membership. Entropy complements preexisting measures of data–model fit and provides unique information not contained in other measures. Hypothetical data scenarios, an applied example, and Monte Carlo simulation results are used to demonstrate the application of entropy in logistic regression. Entropy should be used in conjunction with other measures of data–model fit to assess how well logistic regression models classify cases into observed categories. PMID:29795897
An Entropy-Based Measure for Assessing Fuzziness in Logistic Regression.
Weiss, Brandi A; Dardick, William
2016-12-01
This article introduces an entropy-based measure of data-model fit that can be used to assess the quality of logistic regression models. Entropy has previously been used in mixture-modeling to quantify how well individuals are classified into latent classes. The current study proposes the use of entropy for logistic regression models to quantify the quality of classification and separation of group membership. Entropy complements preexisting measures of data-model fit and provides unique information not contained in other measures. Hypothetical data scenarios, an applied example, and Monte Carlo simulation results are used to demonstrate the application of entropy in logistic regression. Entropy should be used in conjunction with other measures of data-model fit to assess how well logistic regression models classify cases into observed categories.
Antenna Allocation in MIMO Radar with Widely Separated Antennas for Multi-Target Detection
Gao, Hao; Wang, Jian; Jiang, Chunxiao; Zhang, Xudong
2014-01-01
In this paper, we explore a new resource called multi-target diversity to optimize the performance of multiple input multiple output (MIMO) radar with widely separated antennas for detecting multiple targets. In particular, we allocate antennas of the MIMO radar to probe different targets simultaneously in a flexible manner based on the performance metric of relative entropy. Two antenna allocation schemes are proposed. In the first scheme, each antenna is allocated to illuminate a proper target over the entire illumination time, so that the detection performance of each target is guaranteed. The problem is formulated as a minimum makespan scheduling problem in the combinatorial optimization framework. Antenna allocation is implemented through a branch-and-bound algorithm and an enhanced factor 2 algorithm. In the second scheme, called antenna-time allocation, each antenna is allocated to illuminate different targets with different illumination time. Both antenna allocation and time allocation are optimized based on illumination probabilities. Over a large range of transmitted power, target fluctuations and target numbers, both of the proposed antenna allocation schemes outperform the scheme without antenna allocation. Moreover, the antenna-time allocation scheme achieves a more robust detection performance than branch-and-bound algorithm and the enhanced factor 2 algorithm when the target number changes. PMID:25350505
Antenna allocation in MIMO radar with widely separated antennas for multi-target detection.
Gao, Hao; Wang, Jian; Jiang, Chunxiao; Zhang, Xudong
2014-10-27
In this paper, we explore a new resource called multi-target diversity to optimize the performance of multiple input multiple output (MIMO) radar with widely separated antennas for detecting multiple targets. In particular, we allocate antennas of the MIMO radar to probe different targets simultaneously in a flexible manner based on the performance metric of relative entropy. Two antenna allocation schemes are proposed. In the first scheme, each antenna is allocated to illuminate a proper target over the entire illumination time, so that the detection performance of each target is guaranteed. The problem is formulated as a minimum makespan scheduling problem in the combinatorial optimization framework. Antenna allocation is implemented through a branch-and-bound algorithm and an enhanced factor 2 algorithm. In the second scheme, called antenna-time allocation, each antenna is allocated to illuminate different targets with different illumination time. Both antenna allocation and time allocation are optimized based on illumination probabilities. Over a large range of transmitted power, target fluctuations and target numbers, both of the proposed antenna allocation schemes outperform the scheme without antenna allocation. Moreover, the antenna-time allocation scheme achieves a more robust detection performance than branch-and-bound algorithm and the enhanced factor 2 algorithm when the target number changes.
Predicting the Cosmological Constant from the CausalEntropic Principle
DOE Office of Scientific and Technical Information (OSTI.GOV)
Bousso, Raphael; Harnik, Roni; Kribs, Graham D.
2007-02-20
We compute the expected value of the cosmological constant in our universe from the Causal Entropic Principle. Since observers must obey the laws of thermodynamics and causality, it asserts that physical parameters are most likely to be found in the range of values for which the total entropy production within a causally connected region is maximized. Despite the absence of more explicit anthropic criteria, the resulting probability distribution turns out to be in excellent agreement with observation. In particular, we find that dust heated by stars dominates the entropy production, demonstrating the remarkable power of this thermodynamic selection criterion. Themore » alternative approach--weighting by the number of ''observers per baryon''--is less well-defined, requires problematic assumptions about the nature of observers, and yet prefers values larger than present experimental bounds.« less
An entropy-based statistic for genomewide association studies.
Zhao, Jinying; Boerwinkle, Eric; Xiong, Momiao
2005-07-01
Efficient genotyping methods and the availability of a large collection of single-nucleotide polymorphisms provide valuable tools for genetic studies of human disease. The standard chi2 statistic for case-control studies, which uses a linear function of allele frequencies, has limited power when the number of marker loci is large. We introduce a novel test statistic for genetic association studies that uses Shannon entropy and a nonlinear function of allele frequencies to amplify the differences in allele and haplotype frequencies to maintain statistical power with large numbers of marker loci. We investigate the relationship between the entropy-based test statistic and the standard chi2 statistic and show that, in most cases, the power of the entropy-based statistic is greater than that of the standard chi2 statistic. The distribution of the entropy-based statistic and the type I error rates are validated using simulation studies. Finally, we apply the new entropy-based test statistic to two real data sets, one for the COMT gene and schizophrenia and one for the MMP-2 gene and esophageal carcinoma, to evaluate the performance of the new method for genetic association studies. The results show that the entropy-based statistic obtained smaller P values than did the standard chi2 statistic.
Complex Physical, Biophysical and Econophysical Systems
NASA Astrophysics Data System (ADS)
Dewar, Robert L.; Detering, Frank
1. Introduction to complex and econophysics systems: a navigation map / T. Aste and T. Di Matteo -- 2. An introduction to fractional diffusion / B. I. Henry, T.A.M. Langlands and P. Straka -- 3. Space plasmas and fusion plasmas as complex systems / R. O. Dendy -- 4. Bayesian data analysis / M. S. Wheatland -- 5. Inverse problems and complexity in earth system science / I. G. Enting -- 6. Applied fluid chaos: designing advection with periodically reoriented flows for micro to geophysical mixing and transport enhancement / G. Metcalfe -- 7. Approaches to modelling the dynamical activity of brain function based on the electroencephalogram / D. T. J. Liley and F. Frascoli -- 8. Jaynes' maximum entropy principle, Riemannian metrics and generalised least action bound / R. K. Niven and B. Andresen -- 9. Complexity, post-genomic biology and gene expression programs / R. B. H. Williams and O. J.-H. Luo -- 10. Tutorials on agent-based modelling with NetLogo and network analysis with Pajek / M. J. Berryman and S. D. Angus.
Mixing geometric and radiometric features for change classification
NASA Astrophysics Data System (ADS)
Fournier, Alexandre; Descombes, Xavier; Zerubia, Josiane
2008-02-01
Most basic change detection algorithms use a pixel-based approach. Whereas such approach is quite well defined for monitoring important area changes (such as urban growth monitoring) in low resolution images, an object based approach seems more relevant when the change detection is specifically aimed toward targets (such as small buildings and vehicles). In this paper, we present an approach that mixes radiometric and geometric features to qualify the changed zones. The goal is to establish bounds (appearance, disappearance, substitution ...) between the detected changes and the underlying objects. We proceed by first clustering the change map (containing each pixel bitemporal radiosity) in different classes using the entropy-kmeans algorithm. Assuming that most man-made objects have a polygonal shape, a polygonal approximation algorithm is then used in order to characterize the resulting zone shapes. Hence allowing us to refine the primary rough classification, by integrating the polygon orientations in the state space. Tests are currently conducted on Quickbird data.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Shimazaki, Tomomi; Nakajima, Takahito
2016-06-21
This paper discusses the exciton dissociation process at the donor–acceptor interface in organic photocells. In our previous study, we introduced a local temperature to handle the hot charge-transfer (CT) state and calculated the exciton dissociation probability based on the 1D organic semiconductor model [T. Shimazaki and T. Nakajima, Phys. Chem. Chem. Phys. 17, 12538 (2015)]. Although the hot CT state plays an essential role in exciton dissociations, the probabilities calculated are not high enough to efficiently separate bound electron–hole pairs. This paper focuses on the dimensional (entropy) effect together with the hot CT state effect and shows that cooperative behaviormore » between both effects can improve the exciton dissociation process. In addition, we discuss cooperative effects with site-disorders and external-electric-fields.« less
Dual-threshold segmentation using Arimoto entropy based on chaotic bee colony optimization
NASA Astrophysics Data System (ADS)
Li, Li
2018-03-01
In order to extract target from complex background more quickly and accurately, and to further improve the detection effect of defects, a method of dual-threshold segmentation using Arimoto entropy based on chaotic bee colony optimization was proposed. Firstly, the method of single-threshold selection based on Arimoto entropy was extended to dual-threshold selection in order to separate the target from the background more accurately. Then intermediate variables in formulae of Arimoto entropy dual-threshold selection was calculated by recursion to eliminate redundant computation effectively and to reduce the amount of calculation. Finally, the local search phase of artificial bee colony algorithm was improved by chaotic sequence based on tent mapping. The fast search for two optimal thresholds was achieved using the improved bee colony optimization algorithm, thus the search could be accelerated obviously. A large number of experimental results show that, compared with the existing segmentation methods such as multi-threshold segmentation method using maximum Shannon entropy, two-dimensional Shannon entropy segmentation method, two-dimensional Tsallis gray entropy segmentation method and multi-threshold segmentation method using reciprocal gray entropy, the proposed method can segment target more quickly and accurately with superior segmentation effect. It proves to be an instant and effective method for image segmentation.
Bivariate Rainfall and Runoff Analysis Using Shannon Entropy Theory
NASA Astrophysics Data System (ADS)
Rahimi, A.; Zhang, L.
2012-12-01
Rainfall-Runoff analysis is the key component for many hydrological and hydraulic designs in which the dependence of rainfall and runoff needs to be studied. It is known that the convenient bivariate distribution are often unable to model the rainfall-runoff variables due to that they either have constraints on the range of the dependence or fixed form for the marginal distributions. Thus, this paper presents an approach to derive the entropy-based joint rainfall-runoff distribution using Shannon entropy theory. The distribution derived can model the full range of dependence and allow different specified marginals. The modeling and estimation can be proceeded as: (i) univariate analysis of marginal distributions which includes two steps, (a) using the nonparametric statistics approach to detect modes and underlying probability density, and (b) fitting the appropriate parametric probability density functions; (ii) define the constraints based on the univariate analysis and the dependence structure; (iii) derive and validate the entropy-based joint distribution. As to validate the method, the rainfall-runoff data are collected from the small agricultural experimental watersheds located in semi-arid region near Riesel (Waco), Texas, maintained by the USDA. The results of unviariate analysis show that the rainfall variables follow the gamma distribution, whereas the runoff variables have mixed structure and follow the mixed-gamma distribution. With this information, the entropy-based joint distribution is derived using the first moments, the first moments of logarithm transformed rainfall and runoff, and the covariance between rainfall and runoff. The results of entropy-based joint distribution indicate: (1) the joint distribution derived successfully preserves the dependence between rainfall and runoff, and (2) the K-S goodness of fit statistical tests confirm the marginal distributions re-derived reveal the underlying univariate probability densities which further assure that the entropy-based joint rainfall-runoff distribution are satisfactorily derived. Overall, the study shows the Shannon entropy theory can be satisfactorily applied to model the dependence between rainfall and runoff. The study also shows that the entropy-based joint distribution is an appropriate approach to capture the dependence structure that cannot be captured by the convenient bivariate joint distributions. Joint Rainfall-Runoff Entropy Based PDF, and Corresponding Marginal PDF and Histogram for W12 Watershed The K-S Test Result and RMSE on Univariate Distributions Derived from the Maximum Entropy Based Joint Probability Distribution;
NASA Astrophysics Data System (ADS)
Ai, Yan-Ting; Guan, Jiao-Yue; Fei, Cheng-Wei; Tian, Jing; Zhang, Feng-Ling
2017-05-01
To monitor rolling bearing operating status with casings in real time efficiently and accurately, a fusion method based on n-dimensional characteristic parameters distance (n-DCPD) was proposed for rolling bearing fault diagnosis with two types of signals including vibration signal and acoustic emission signals. The n-DCPD was investigated based on four information entropies (singular spectrum entropy in time domain, power spectrum entropy in frequency domain, wavelet space characteristic spectrum entropy and wavelet energy spectrum entropy in time-frequency domain) and the basic thought of fusion information entropy fault diagnosis method with n-DCPD was given. Through rotor simulation test rig, the vibration and acoustic emission signals of six rolling bearing faults (ball fault, inner race fault, outer race fault, inner-ball faults, inner-outer faults and normal) are collected under different operation conditions with the emphasis on the rotation speed from 800 rpm to 2000 rpm. In the light of the proposed fusion information entropy method with n-DCPD, the diagnosis of rolling bearing faults was completed. The fault diagnosis results show that the fusion entropy method holds high precision in the recognition of rolling bearing faults. The efforts of this study provide a novel and useful methodology for the fault diagnosis of an aeroengine rolling bearing.
Entropy Based Genetic Association Tests and Gene-Gene Interaction Tests
de Andrade, Mariza; Wang, Xin
2011-01-01
In the past few years, several entropy-based tests have been proposed for testing either single SNP association or gene-gene interaction. These tests are mainly based on Shannon entropy and have higher statistical power when compared to standard χ2 tests. In this paper, we extend some of these tests using a more generalized entropy definition, Rényi entropy, where Shannon entropy is a special case of order 1. The order λ (>0) of Rényi entropy weights the events (genotype/haplotype) according to their probabilities (frequencies). Higher λ places more emphasis on higher probability events while smaller λ (close to 0) tends to assign weights more equally. Thus, by properly choosing the λ, one can potentially increase the power of the tests or the p-value level of significance. We conducted simulation as well as real data analyses to assess the impact of the order λ and the performance of these generalized tests. The results showed that for dominant model the order 2 test was more powerful and for multiplicative model the order 1 or 2 had similar power. The analyses indicate that the choice of λ depends on the underlying genetic model and Shannon entropy is not necessarily the most powerful entropy measure for constructing genetic association or interaction tests. PMID:23089811
NASA Astrophysics Data System (ADS)
Beckwith, A. W.
2008-01-01
Sean Carroll's pre-inflation state of low temperature-low entropy provides a bridge between two models with different predictions. The Wheeler-de Witt equation provides thermal input into today's universe for graviton production. Also, brane world models by Sundrum allow low entropy conditions, as given by Carroll & Chen (2005). Moreover, this paper answers the question of how to go from a brane world model to the 10 to the 32 power Kelvin conditions stated by Weinberg in 1972 as necessary for the initiation of quantum gravity processes. This is a way of getting around the fact CMBR is cut off at a red shift of z = 1100. This paper discusses the difference in values of the upper bound of the cosmological constant between a large upper bound predicated for a temperature dependent vacuum energy predicted by Park (2002), and the much lower bound predicted by Barvinsky (2006). with the difference in values in vacuum energy contributing to relic graviton production. This paper claims that this large thermal influx, with a high initial cosmological constant and a large region of space for relic gravitons interacting with space-time up to the z = 1100 CMBR observational limit are interlinked processes delineated in the Lloyd (2002) analogy of the universe as a quantum computing system. Finally, the paper claims that linking a shrinking prior universe via a worm hole solution for a pseudo time dependent Wheeler-De Witt equation permits graviton generation as thermal input from the prior universe, transferred instantaneously to relic inflationary conditions today. The existence of a wormhole is presented as a necessary condition for relic gravitons. Proving the sufficiency of the existence of a worm hole for relic gravitons is a future project.
The predictive power of singular value decomposition entropy for stock market dynamics
NASA Astrophysics Data System (ADS)
Caraiani, Petre
2014-01-01
We use a correlation-based approach to analyze financial data from the US stock market, both daily and monthly observations from the Dow Jones. We compute the entropy based on the singular value decomposition of the correlation matrix for the components of the Dow Jones Industrial Index. Based on a moving window, we derive time varying measures of entropy for both daily and monthly data. We find that the entropy has a predictive ability with respect to stock market dynamics as indicated by the Granger causality tests.
Hunt, Brian R; Ott, Edward
2015-09-01
In this paper, we propose, discuss, and illustrate a computationally feasible definition of chaos which can be applied very generally to situations that are commonly encountered, including attractors, repellers, and non-periodically forced systems. This definition is based on an entropy-like quantity, which we call "expansion entropy," and we define chaos as occurring when this quantity is positive. We relate and compare expansion entropy to the well-known concept of topological entropy to which it is equivalent under appropriate conditions. We also present example illustrations, discuss computational implementations, and point out issues arising from attempts at giving definitions of chaos that are not entropy-based.
Theory of Genuine Tripartite Nonlocality of Gaussian States
NASA Astrophysics Data System (ADS)
Adesso, Gerardo; Piano, Samanta
2014-01-01
We investigate the genuine multipartite nonlocality of three-mode Gaussian states of continuous variable systems. For pure states, we present a simplified procedure to obtain the maximum violation of the Svetlichny inequality based on displaced parity measurements, and we analyze its interplay with genuine tripartite entanglement measured via Rényi-2 entropy. The maximum Svetlichny violation admits tight upper and lower bounds at fixed tripartite entanglement. For mixed states, no violation is possible when the purity falls below 0.86. We also explore a set of recently derived weaker inequalities for three-way nonlocality, finding violations for all tested pure states. Our results provide a strong signature for the nonclassical and nonlocal nature of Gaussian states despite their positive Wigner function, and lead to precise recipes for its experimental verification.
Entropy information of heart rate variability and its power spectrum during day and night
NASA Astrophysics Data System (ADS)
Jin, Li; Jun, Wang
2013-07-01
Physiologic systems generate complex fluctuations in their output signals that reflect the underlying dynamics. We employed the base-scale entropy method and the power spectral analysis to study the 24 hours heart rate variability (HRV) signals. The results show that such profound circadian-, age- and pathologic-dependent changes are accompanied by changes in base-scale entropy and power spectral distribution. Moreover, the base-scale entropy changes reflect the corresponding changes in the autonomic nerve outflow. With the suppression of the vagal tone and dominance of the sympathetic tone in congestive heart failure (CHF) subjects, there is more variability in the date fluctuation mode. So the higher base-scale entropy belongs to CHF subjects. With the decrease of the sympathetic tone and the respiratory frequency (RSA) becoming more pronounced with slower breathing during sleeping, the base-scale entropy drops in CHF subjects. The HRV series of the two healthy groups have the same diurnal/nocturnal trend as the CHF series. The fluctuation dynamics trend of data in the three groups can be described as “HF effect”.
Entropy in molecular recognition by proteins
Caro, José A.; Harpole, Kyle W.; Kasinath, Vignesh; Lim, Jackwee; Granja, Jeffrey; Valentine, Kathleen G.; Sharp, Kim A.
2017-01-01
Molecular recognition by proteins is fundamental to molecular biology. Dissection of the thermodynamic energy terms governing protein–ligand interactions has proven difficult, with determination of entropic contributions being particularly elusive. NMR relaxation measurements have suggested that changes in protein conformational entropy can be quantitatively obtained through a dynamical proxy, but the generality of this relationship has not been shown. Twenty-eight protein–ligand complexes are used to show a quantitative relationship between measures of fast side-chain motion and the underlying conformational entropy. We find that the contribution of conformational entropy can range from favorable to unfavorable, which demonstrates the potential of this thermodynamic variable to modulate protein–ligand interactions. For about one-quarter of these complexes, the absence of conformational entropy would render the resulting affinity biologically meaningless. The dynamical proxy for conformational entropy or “entropy meter” also allows for refinement of the contributions of solvent entropy and the loss in rotational-translational entropy accompanying formation of high-affinity complexes. Furthermore, structure-based application of the approach can also provide insight into long-lived specific water–protein interactions that escape the generic treatments of solvent entropy based simply on changes in accessible surface area. These results provide a comprehensive and unified view of the general role of entropy in high-affinity molecular recognition by proteins. PMID:28584100
Entropy in molecular recognition by proteins.
Caro, José A; Harpole, Kyle W; Kasinath, Vignesh; Lim, Jackwee; Granja, Jeffrey; Valentine, Kathleen G; Sharp, Kim A; Wand, A Joshua
2017-06-20
Molecular recognition by proteins is fundamental to molecular biology. Dissection of the thermodynamic energy terms governing protein-ligand interactions has proven difficult, with determination of entropic contributions being particularly elusive. NMR relaxation measurements have suggested that changes in protein conformational entropy can be quantitatively obtained through a dynamical proxy, but the generality of this relationship has not been shown. Twenty-eight protein-ligand complexes are used to show a quantitative relationship between measures of fast side-chain motion and the underlying conformational entropy. We find that the contribution of conformational entropy can range from favorable to unfavorable, which demonstrates the potential of this thermodynamic variable to modulate protein-ligand interactions. For about one-quarter of these complexes, the absence of conformational entropy would render the resulting affinity biologically meaningless. The dynamical proxy for conformational entropy or "entropy meter" also allows for refinement of the contributions of solvent entropy and the loss in rotational-translational entropy accompanying formation of high-affinity complexes. Furthermore, structure-based application of the approach can also provide insight into long-lived specific water-protein interactions that escape the generic treatments of solvent entropy based simply on changes in accessible surface area. These results provide a comprehensive and unified view of the general role of entropy in high-affinity molecular recognition by proteins.
NASA Astrophysics Data System (ADS)
Xu, Pengcheng; Wang, Dong; Singh, Vijay P.; Wang, Yuankun; Wu, Jichun; Wang, Lachun; Zou, Xinqing; Chen, Yuanfang; Chen, Xi; Liu, Jiufu; Zou, Ying; He, Ruimin
2017-12-01
Hydrometeorological data are needed for obtaining point and areal mean, quantifying the spatial variability of hydrometeorological variables, and calibration and verification of hydrometeorological models. Hydrometeorological networks are utilized to collect such data. Since data collection is expensive, it is essential to design an optimal network based on the minimal number of hydrometeorological stations in order to reduce costs. This study proposes a two-phase copula entropy- based multiobjective optimization approach that includes: (1) copula entropy-based directional information transfer (CDIT) for clustering the potential hydrometeorological gauges into several groups, and (2) multiobjective method for selecting the optimal combination of gauges for regionalized groups. Although entropy theory has been employed for network design before, the joint histogram method used for mutual information estimation has several limitations. The copula entropy-based mutual information (MI) estimation method is shown to be more effective for quantifying the uncertainty of redundant information than the joint histogram (JH) method. The effectiveness of this approach is verified by applying to one type of hydrometeorological gauge network, with the use of three model evaluation measures, including Nash-Sutcliffe Coefficient (NSC), arithmetic mean of the negative copula entropy (MNCE), and MNCE/NSC. Results indicate that the two-phase copula entropy-based multiobjective technique is capable of evaluating the performance of regional hydrometeorological networks and can enable decision makers to develop strategies for water resources management.
Approximate reversibility in the context of entropy gain, information gain, and complete positivity
NASA Astrophysics Data System (ADS)
Buscemi, Francesco; Das, Siddhartha; Wilde, Mark M.
2016-06-01
There are several inequalities in physics which limit how well we can process physical systems to achieve some intended goal, including the second law of thermodynamics, entropy bounds in quantum information theory, and the uncertainty principle of quantum mechanics. Recent results provide physically meaningful enhancements of these limiting statements, determining how well one can attempt to reverse an irreversible process. In this paper, we apply and extend these results to give strong enhancements to several entropy inequalities, having to do with entropy gain, information gain, entropic disturbance, and complete positivity of open quantum systems dynamics. Our first result is a remainder term for the entropy gain of a quantum channel. This result implies that a small increase in entropy under the action of a subunital channel is a witness to the fact that the channel's adjoint can be used as a recovery map to undo the action of the original channel. We apply this result to pure-loss, quantum-limited amplifier, and phase-insensitive quantum Gaussian channels, showing how a quantum-limited amplifier can serve as a recovery from a pure-loss channel and vice versa. Our second result regards the information gain of a quantum measurement, both without and with quantum side information. We find here that a small information gain implies that it is possible to undo the action of the original measurement if it is efficient. The result also has operational ramifications for the information-theoretic tasks known as measurement compression without and with quantum side information. Our third result shows that the loss of Holevo information caused by the action of a noisy channel on an input ensemble of quantum states is small if and only if the noise can be approximately corrected on average. We finally establish that the reduced dynamics of a system-environment interaction are approximately completely positive and trace preserving if and only if the data processing inequality holds approximately.
Probing the History of Galaxy Clusters with Metallicity and Entropy Measurements
NASA Astrophysics Data System (ADS)
Elkholy, Tamer Yohanna
Galaxy clusters are the largest gravitationally bound objects found today in our Universe. The gas they contain, the intra-cluster medium (ICM), is heated to temperatures in the approximate range of 1 to 10 keV, and thus emits X-ray radiation. Studying the ICM through the spatial and spectral analysis of its emission returns the richest information about both the overall cosmological context which governs the formation of clusters, as well as the physical processes occurring within. The aim of this thesis is to learn about the history of the physical processes that drive the evolution of galaxy clusters, through careful, spatially resolved measurements of their metallicity and entropy content. A sample of 45 nearby clusters observed with Chandra is analyzed to produce radial density, temperature, entropy and metallicity profiles. The entropy profiles are computed to larger radial extents than in previous Chandra analyses. The results of this analysis are made available to the scientific community in an electronic database. Comparing metallicity and entropy in the outskirts of clusters, we find no signature on the entropy profiles of the ensemble of supernovae that produced the observed metals. In the centers of clusters, we find that the metallicities of high-mass clusters are much less dispersed than those of low-mass clusters. A comparison of metallicity with the regularity of the X-ray emission morphology suggests that metallicities in low-mass clusters are more susceptible to increase from violent events such as mergers. We also find that the variation in the stellar-to-gas mass ratio as a function of cluster mass can explain the variation of central metallicity with cluster mass, only if we assume that there is a constant level of metallicity for clusters of all masses, above which the observed galaxies add more metals in proportion to their mass. (Copies available exclusively from MIT Libraries, libraries.mit.edu/docs - docs mit.edu)
Zou, Haiyin; Wu, Ying; Brew, Keith
2016-05-20
The four tissue inhibitors of metalloproteinases (TIMPs) are potent inhibitors of the many matrixins (MMPs), except that TIMP1 weakly inhibits some MMPs, including MMP14. The broad-spectrum inhibition of MMPs by TIMPs and their N-domains (NTIMPs) is consistent with the previous isothermal titration calorimetric finding that their interactions are entropy-driven but differ in contributions from solvent and conformational entropy (ΔSsolv, ΔSconf), estimated using heat capacity changes (ΔCp). Selective engineered NTIMPs have potential applications for treating MMP-related diseases, including cancer and cardiomyopathy. Here we report isothermal titration calorimetric studies of the effects of selectivity-modifying mutations in NTIMP1 and NTIMP2 on the thermodynamics of their interactions with MMP1, MMP3, and MMP14. The weak inhibition of MMP14 by NTIMP1 reflects a large conformational entropy penalty for binding. The T98L mutation, peripheral to the NTIMP1 reactive site, enhances binding by increasing ΔSsolv but also reduces ΔSconf However, the same mutation increases NTIMP1 binding to MMP3 in an interaction that has an unusual positive ΔCp This indicates a decrease in solvent entropy compensated by increased conformational entropy, possibly reflecting interactions involving alternative conformers. The NTIMP2 mutant, S2D/S4A is a selective MMP1 inhibitor through electrostatic effects of a unique MMP-1 arginine. Asp-2 increases reactive site polarity, reducing ΔCp, but increases conformational entropy to maintain strong binding to MMP1. There is a strong negative correlation between ΔSsolv and ΔSconf for all characterized interactions, but the data for each MMP have characteristic ranges, reflecting intrinsic differences in the structures and dynamics of their free and inhibitor-bound forms. © 2016 by The American Society for Biochemistry and Molecular Biology, Inc.
NASA Astrophysics Data System (ADS)
Tiotsop, M.; Fotue, A. J.; Fotsin, H. B.; Fai, L. C.
2017-08-01
Bound polaron in RbCl delta quantum dot under electric field and Coulombic impurity were considered. The ground and first excited state energy were derived by employing Pekar variational and unitary transformation methods. Applying Fermi golden rule, the expression of temperature and polaron lifetime were derived. The decoherence was studied trough the Tsallis entropy. Results shows that decreasing (or increasing) the lifetime increases (or decreases) the temperature and delta parameter (electric field strength and hydrogenic impurity). This suggests that to accelerate quantum transition in nanostructure, temperature and delta have to be enhanced. The improvement of electric field and coulomb parameter, increases the lifetime of the delta quantum dot qubit. Energy spectrum of polaron increases with increase in temperature, electric field strength, Coulomb parameter, delta parameter, and polaronic radius. The control of the delta quantum dot energies can be done via the electric field, coulomb impurity, and delta parameter. Results also show that the non-extensive entropy is an oscillatory function of time. With the enhancement of delta parameter, non-extensive parameter, Coulombic parameter, and electric field strength, the entropy has a sinusoidal increase behavior with time. With the study of decoherence through the Tsallis entropy, it may be advised that to have a quantum system with efficient transmission of information, the non-extensive and delta parameters need to be significant. The study of the probability density showed an increase from the boundary to the center of the dot where it has its maximum value and oscillates with period T0 = ℏ / ΔE with the tunneling of the delta parameter, electric field strength, and Coulombic parameter. The results may be very helpful in the transmission of information in nanostructures and control of decoherence
NASA Astrophysics Data System (ADS)
Wu, Yue; Shang, Pengjian; Li, Yilong
2018-03-01
A modified multiscale sample entropy measure based on symbolic representation and similarity (MSEBSS) is proposed in this paper to research the complexity of stock markets. The modified algorithm reduces the probability of inducing undefined entropies and is confirmed to be robust to strong noise. Considering the validity and accuracy, MSEBSS is more reliable than Multiscale entropy (MSE) for time series mingled with much noise like financial time series. We apply MSEBSS to financial markets and results show American stock markets have the lowest complexity compared with European and Asian markets. There are exceptions to the regularity that stock markets show a decreasing complexity over the time scale, indicating a periodicity at certain scales. Based on MSEBSS, we introduce the modified multiscale cross-sample entropy measure based on symbolic representation and similarity (MCSEBSS) to consider the degree of the asynchrony between distinct time series. Stock markets from the same area have higher synchrony than those from different areas. And for stock markets having relative high synchrony, the entropy values will decrease with the increasing scale factor. While for stock markets having high asynchrony, the entropy values will not decrease with the increasing scale factor sometimes they tend to increase. So both MSEBSS and MCSEBSS are able to distinguish stock markets of different areas, and they are more helpful if used together for studying other features of financial time series.
Awan, Imtiaz; Aziz, Wajid; Habib, Nazneen; Alowibdi, Jalal S.; Saeed, Sharjil; Nadeem, Malik Sajjad Ahmed; Shah, Syed Ahsin Ali
2018-01-01
Considerable interest has been devoted for developing a deeper understanding of the dynamics of healthy biological systems and how these dynamics are affected due to aging and disease. Entropy based complexity measures have widely been used for quantifying the dynamics of physical and biological systems. These techniques have provided valuable information leading to a fuller understanding of the dynamics of these systems and underlying stimuli that are responsible for anomalous behavior. The single scale based traditional entropy measures yielded contradictory results about the dynamics of real world time series data of healthy and pathological subjects. Recently the multiscale entropy (MSE) algorithm was introduced for precise description of the complexity of biological signals, which was used in numerous fields since its inception. The original MSE quantified the complexity of coarse-grained time series using sample entropy. The original MSE may be unreliable for short signals because the length of the coarse-grained time series decreases with increasing scaling factor τ, however, MSE works well for long signals. To overcome the drawback of original MSE, various variants of this method have been proposed for evaluating complexity efficiently. In this study, we have proposed multiscale normalized corrected Shannon entropy (MNCSE), in which instead of using sample entropy, symbolic entropy measure NCSE has been used as an entropy estimate. The results of the study are compared with traditional MSE. The effectiveness of the proposed approach is demonstrated using noise signals as well as interbeat interval signals from healthy and pathological subjects. The preliminary results of the study indicate that MNCSE values are more stable and reliable than original MSE values. The results show that MNCSE based features lead to higher classification accuracies in comparison with the MSE based features. PMID:29771977
Awan, Imtiaz; Aziz, Wajid; Shah, Imran Hussain; Habib, Nazneen; Alowibdi, Jalal S; Saeed, Sharjil; Nadeem, Malik Sajjad Ahmed; Shah, Syed Ahsin Ali
2018-01-01
Considerable interest has been devoted for developing a deeper understanding of the dynamics of healthy biological systems and how these dynamics are affected due to aging and disease. Entropy based complexity measures have widely been used for quantifying the dynamics of physical and biological systems. These techniques have provided valuable information leading to a fuller understanding of the dynamics of these systems and underlying stimuli that are responsible for anomalous behavior. The single scale based traditional entropy measures yielded contradictory results about the dynamics of real world time series data of healthy and pathological subjects. Recently the multiscale entropy (MSE) algorithm was introduced for precise description of the complexity of biological signals, which was used in numerous fields since its inception. The original MSE quantified the complexity of coarse-grained time series using sample entropy. The original MSE may be unreliable for short signals because the length of the coarse-grained time series decreases with increasing scaling factor τ, however, MSE works well for long signals. To overcome the drawback of original MSE, various variants of this method have been proposed for evaluating complexity efficiently. In this study, we have proposed multiscale normalized corrected Shannon entropy (MNCSE), in which instead of using sample entropy, symbolic entropy measure NCSE has been used as an entropy estimate. The results of the study are compared with traditional MSE. The effectiveness of the proposed approach is demonstrated using noise signals as well as interbeat interval signals from healthy and pathological subjects. The preliminary results of the study indicate that MNCSE values are more stable and reliable than original MSE values. The results show that MNCSE based features lead to higher classification accuracies in comparison with the MSE based features.
Sinha, Rangana; Hossain, Maidul; Kumar, Gopinatha Suresh
2009-04-01
Design and synthesis of new small molecules binding to double-stranded RNA necessitate complete understanding of the molecular aspects of the binding of many existing molecules. Toward this goal, in this work we evaluated the biophysical aspects of the interaction of a DNA intercalator (proflavine) and a minor groove binder (hoechst 33258) with two polymorphic forms of polyCG, namely, the right-handed Watson-Crick base paired A-form and the left-handed Hoogsteen base paired H(L)-form, by absorption, fluorescence, and viscometry experiments. The energetics of the interaction of these molecules with the RNA structures has also been elucidated by isothermal titration calorimetry (ITC). Results suggest that proflavine strongly intercalates in both forms of polyCG, whereas hoechst shows mainly groove-binding modes. The binding of both drugs to both forms of RNA resulted in significant conformational change to the RNA structure with the bound molecules being placed in the chiral RNA helix. ITC profiles for both proflavine and hoechst show two binding sites. Binding of proflavine to both forms of RNA is endothermic and entropy driven in the first site and exothermic and enthalpy driven in the second site, whereas hoechst binding to both forms of RNA is exothermic and enthalpy driven in the first site and endothermic and entropy driven in the second site. This study suggests that the binding affinity characteristics and energetics of interaction of these DNA binding molecules with the RNA conformations are significantly different and may serve as data for future development of effective structure-selective RNA-based drugs.
Upper bounds on secret-key agreement over lossy thermal bosonic channels
NASA Astrophysics Data System (ADS)
Kaur, Eneet; Wilde, Mark M.
2017-12-01
Upper bounds on the secret-key-agreement capacity of a quantum channel serve as a way to assess the performance of practical quantum-key-distribution protocols conducted over that channel. In particular, if a protocol employs a quantum repeater, achieving secret-key rates exceeding these upper bounds is evidence of having a working quantum repeater. In this paper, we extend a recent advance [Liuzzo-Scorpo et al., Phys. Rev. Lett. 119, 120503 (2017), 10.1103/PhysRevLett.119.120503] in the theory of the teleportation simulation of single-mode phase-insensitive Gaussian channels such that it now applies to the relative entropy of entanglement measure. As a consequence of this extension, we find tighter upper bounds on the nonasymptotic secret-key-agreement capacity of the lossy thermal bosonic channel than were previously known. The lossy thermal bosonic channel serves as a more realistic model of communication than the pure-loss bosonic channel, because it can model the effects of eavesdropper tampering and imperfect detectors. An implication of our result is that the previously known upper bounds on the secret-key-agreement capacity of the thermal channel are too pessimistic for the practical finite-size regime in which the channel is used a finite number of times, and so it should now be somewhat easier to witness a working quantum repeater when using secret-key-agreement capacity upper bounds as a benchmark.
Note on a Family of Monotone Quantum Relative Entropies
NASA Astrophysics Data System (ADS)
Deuchert, Andreas; Hainzl, Christian; Seiringer, Robert
2015-10-01
Given a convex function and two hermitian matrices A and B, Lewin and Sabin study in (Lett Math Phys 104:691-705, 2014) the relative entropy defined by . Among other things, they prove that the so-defined quantity is monotone if and only if is operator monotone. The monotonicity is then used to properly define for bounded self-adjoint operators acting on an infinite-dimensional Hilbert space by a limiting procedure. More precisely, for an increasing sequence of finite-dimensional projections with strongly, the limit is shown to exist and to be independent of the sequence of projections . The question whether this sequence converges to its "obvious" limit, namely , has been left open. We answer this question in principle affirmatively and show that . If the operators A and B are regular enough, that is ( A - B), and are trace-class, the identity holds.
Optimal Binarization of Gray-Scaled Digital Images via Fuzzy Reasoning
NASA Technical Reports Server (NTRS)
Dominguez, Jesus A. (Inventor); Klinko, Steven J. (Inventor)
2007-01-01
A technique for finding an optimal threshold for binarization of a gray scale image employs fuzzy reasoning. A triangular membership function is employed which is dependent on the degree to which the pixels in the image belong to either the foreground class or the background class. Use of a simplified linear fuzzy entropy factor function facilitates short execution times and use of membership values between 0.0 and 1.0 for improved accuracy. To improve accuracy further, the membership function employs lower and upper bound gray level limits that can vary from image to image and are selected to be equal to the minimum and the maximum gray levels, respectively, that are present in the image to be converted. To identify the optimal binarization threshold, an iterative process is employed in which different possible thresholds are tested and the one providing the minimum fuzzy entropy measure is selected.
Entropy-based link prediction in weighted networks
NASA Astrophysics Data System (ADS)
Xu, Zhongqi; Pu, Cunlai; Ramiz Sharafat, Rajput; Li, Lunbo; Yang, Jian
2017-01-01
Information entropy has been proved to be an effective tool to quantify the structural importance of complex networks. In the previous work (Xu et al, 2016 \\cite{xu2016}), we measure the contribution of a path in link prediction with information entropy. In this paper, we further quantify the contribution of a path with both path entropy and path weight, and propose a weighted prediction index based on the contributions of paths, namely Weighted Path Entropy (WPE), to improve the prediction accuracy in weighted networks. Empirical experiments on six weighted real-world networks show that WPE achieves higher prediction accuracy than three typical weighted indices.
Entropy Is Simple, Qualitatively.
ERIC Educational Resources Information Center
Lambert, Frank L.
2002-01-01
Suggests that qualitatively, entropy is simple. Entropy increase from a macro viewpoint is a measure of the dispersal of energy from localized to spread out at a temperature T. Fundamentally based on statistical and quantum mechanics, this approach is superior to the non-fundamental "disorder" as a descriptor of entropy change. (MM)
Watkins, Herschel M.; Vallée-Bélisle, Alexis; Ricci, Francesco; Makarov, Dmitrii E.; Plaxco, Kevin W.
2012-01-01
Surface-tethered biomolecules play key roles in many biological processes and biotechnologies. However, while the physical consequences of such surface attachment have seen significant theoretical study, to date this issue has seen relatively little experimental investigation. In response we present here a quantitative experimental and theoretical study of the extent to which attachment to a charged –but otherwise apparently inert– surface alters the folding free energy of a simple biomolecule. Specifically, we have measured the folding free energy of a DNA stem loop both in solution and when site-specifically attached to a negatively charged, hydroxyl-alkane-coated gold surface. We find that, whereas surface attachment is destabilizing at low ionic strength it becomes stabilizing at ionic strengths above ~130 mM. This behavior presumably reflects two competing mechanisms: excluded volume effects, which stabilize the folded conformation by reducing the entropy of the unfolded state, and electrostatics, which, at lower ionic strengths, destabilizes the more compact folded state via repulsion from the negatively charged surface. To test this hypothesis we have employed existing theories of the electrostatics of surface-bound polyelectrolytes and the entropy of surface-bound polymers to model both effects. Despite lacking any fitted parameters, these theoretical models quantitatively fit our experimental results, suggesting that, for this system, current knowledge of both surface electrostatics and excluded volume effects is reasonably complete and accurate. PMID:22239220
Right-handed neutrino dark matter in left-right symmetric models
NASA Astrophysics Data System (ADS)
Bhupal Dev, P. S.; Mohapatra, Rabindra N.; Zhang, Yongchao
2017-07-01
We show that in a class of non-supersymmetric left-right extensions of the Standard Model (SM), the lightest right-handed neutrino (RHN) is naturally stable and can therefore play the role of thermal Dark Matter (DM) in the Universe for a wide mass range from TeV to PeV. Our model is based on the gauge group SU(3) c × SU(2) L × SU(2) R × U(1) YL × U(1) YR in which a heavy copy of the SM fermions are introduced and the stability of the RHN DM is guaranteed by an automatic Z 2 symmetry present in the leptonic sector. The active neutrino masses in the model arise from the type-II seesaw mechanism. We find a lower bound on the RHN DM mass of order TeV from relic density constraints, as well as an unitarity upper bound in the multi-TeV to PeV scale, depending on the entropy dilution factor. The RHN DM could be made long-lived by soft-breaking of the Z 2 symmetry and provides a concrete example of decaying DM interpretation of the PeV neutrinos observed at IceCube.
Entropy Viscosity and L1-based Approximations of PDEs: Exploiting Sparsity
2015-10-23
AFRL-AFOSR-VA-TR-2015-0337 Entropy Viscosity and L1-based Approximations of PDEs: Exploiting Sparsity Jean-Luc Guermond TEXAS A & M UNIVERSITY 750...REPORT DATE (DD-MM-YYYY) 09-05-2015 2. REPORT TYPE Final report 3. DATES COVERED (From - To) 01-07-2012 - 30-06-2015 4. TITLE AND SUBTITLE Entropy ...conservation equations can be stabilized by using the so-called entropy viscosity method and we proposed to to investigate this new technique. We
Lindström, Ida; Dogan, Jakob
2018-05-18
Intrinsically disordered proteins (IDPs) are abundant in the eukaryotic proteome. However, little is known about the role of subnanosecond dynamics and the conformational entropy that it represents in protein-protein interactions involving IDPs. Using nuclear magnetic resonance side chain and backbone relaxation, stopped-flow kinetics, isothermal titration calorimetry, and computational studies, we have characterized the interaction between the globular TAZ1 domain of the CREB binding protein and the intrinsically disordered transactivation domain of STAT2 (TAD-STAT2). We show that the TAZ1/TAD-STAT2 complex retains considerable subnanosecond motions, with TAD-STAT2 undergoing only a partial disorder-to-order transition. We report here the first experimental determination of the conformational entropy change for both binding partners in an IDP binding interaction and find that the total change even exceeds in magnitude the binding enthalpy and is comparable to the contribution from the hydrophobic effect, demonstrating its importance in the binding energetics. Furthermore, we show that the conformational entropy change for TAZ1 is also instrumental in maintaining a biologically meaningful binding affinity. Strikingly, a spatial clustering of very high amplitude motions and a cluster of more rigid sites in the complex exist, which through computational studies we found to overlap with regions that experience energetic frustration and are less frustrated, respectively. Thus, the residual dynamics in the bound state could be necessary for faster dissociation, which is important for proteins that interact with multiple binding partners.
Multi-shell model of ion-induced nucleic acid condensation
DOE Office of Scientific and Technical Information (OSTI.GOV)
Tolokh, Igor S.; Drozdetski, Aleksander V.; Pollack, Lois
We present a semi-quantitative model of condensation of short nucleic acid (NA) duplexes induced by trivalent cobalt(III) hexammine (CoHex) ions. The model is based on partitioning of bound counterion distribution around single NA duplex into “external” and “internal” ion binding shells distinguished by the proximity to duplex helical axis. In the aggregated phase the shells overlap, which leads to significantly increased attraction of CoHex ions in these overlaps with the neighboring duplexes. The duplex aggregation free energy is decomposed into attractive and repulsive components in such a way that they can be represented by simple analytical expressions with parameters derivedmore » from molecular dynamic simulations and numerical solutions of Poisson equation. The attractive term depends on the fractions of bound ions in the overlapping shells and affinity of CoHex to the “external” shell of nearly neutralized duplex. The repulsive components of the free energy are duplex configurational entropy loss upon the aggregation and the electrostatic repulsion of the duplexes that remains after neutralization by bound CoHex ions. The estimates of the aggregation free energy are consistent with the experimental range of NA duplex condensation propensities, including the unusually poor condensation of RNA structures and subtle sequence effects upon DNA condensation. The model predicts that, in contrast to DNA, RNA duplexes may condense into tighter packed aggregates with a higher degree of duplex neutralization. An appreciable CoHex mediated RNA-RNA attraction requires closer inter-duplex separation to engage CoHex ions (bound mostly in the “internal” shell of RNA) into short-range attractive interactions. The model also predicts that longer NA fragments will condense more readily than shorter ones. The ability of this model to explain experimentally observed trends in NA condensation lends support to proposed NA condensation picture based on the multivalent “ion binding shells.”.« less
Multi-shell model of ion-induced nucleic acid condensation
Tolokh, Igor S.; Drozdetski, Aleksander V.; Pollack, Lois; Onufriev, Alexey V.
2016-01-01
We present a semi-quantitative model of condensation of short nucleic acid (NA) duplexes induced by trivalent cobalt(iii) hexammine (CoHex) ions. The model is based on partitioning of bound counterion distribution around single NA duplex into “external” and “internal” ion binding shells distinguished by the proximity to duplex helical axis. In the aggregated phase the shells overlap, which leads to significantly increased attraction of CoHex ions in these overlaps with the neighboring duplexes. The duplex aggregation free energy is decomposed into attractive and repulsive components in such a way that they can be represented by simple analytical expressions with parameters derived from molecular dynamic simulations and numerical solutions of Poisson equation. The attractive term depends on the fractions of bound ions in the overlapping shells and affinity of CoHex to the “external” shell of nearly neutralized duplex. The repulsive components of the free energy are duplex configurational entropy loss upon the aggregation and the electrostatic repulsion of the duplexes that remains after neutralization by bound CoHex ions. The estimates of the aggregation free energy are consistent with the experimental range of NA duplex condensation propensities, including the unusually poor condensation of RNA structures and subtle sequence effects upon DNA condensation. The model predicts that, in contrast to DNA, RNA duplexes may condense into tighter packed aggregates with a higher degree of duplex neutralization. An appreciable CoHex mediated RNA-RNA attraction requires closer inter-duplex separation to engage CoHex ions (bound mostly in the “internal” shell of RNA) into short-range attractive interactions. The model also predicts that longer NA fragments will condense more readily than shorter ones. The ability of this model to explain experimentally observed trends in NA condensation lends support to proposed NA condensation picture based on the multivalent “ion binding shells.” PMID:27389241
Entanglement asymmetry for boosted black branes and the bound
NASA Astrophysics Data System (ADS)
Mishra, Rohit; Singh, Harvendra
2017-06-01
We study the effects of asymmetry in the entanglement thermodynamics of CFT subsystems. It is found that “boosted” Dp-brane backgrounds give rise to the first law of the entanglement thermodynamics where the CFT pressure asymmetry plays a decisive role in the entanglement. Two different strip like subsystems, one parallel to the boost and the other perpendicular, are studied in the perturbative regime Tthermal ≪ TE. We mainly seek to quantify this entanglement asymmetry as a ratio of the first-order entanglement entropies of the excitations. We discuss the AdS-wave backgrounds at zero temperature having maximum asymmetry from where a bound on entanglement asymmetry is obtained. The entanglement asymmetry reduces as we switch on finite temperature in the CFT while it is maximum at zero temperature.
Higher Spin Fields in Three-Dimensional Gravity
NASA Astrophysics Data System (ADS)
Lepage-Jutier, Arnaud
In this thesis, we study the effects of massless higher spin fields in three-dimensional gravity with a negative cosmological constant. First, we introduce gravity in Anti-de Sitter (AdS) space without the higher spin gauge symmetry. We recapitulate the semi-classical analysis that outlines the duality between quantum gravity in three dimensions with a negative cosmological constant and a conformal field theory on the asymptotic boundary of AdS 3. We review the statistical interpretation of the black hole entropy via the AdS/CFT correspondence and the modular invariance of the partition function of a CFT on a torus. For the case of higher spin theories in AdS 3 we use those modular properties to bound the amount of gauge symmetry present. We then discuss briefly cases that can evade this bound.
Truncated Gaussians as tolerance sets
NASA Technical Reports Server (NTRS)
Cozman, Fabio; Krotkov, Eric
1994-01-01
This work focuses on the use of truncated Gaussian distributions as models for bounded data measurements that are constrained to appear between fixed limits. The authors prove that the truncated Gaussian can be viewed as a maximum entropy distribution for truncated bounded data, when mean and covariance are given. The characteristic function for the truncated Gaussian is presented; from this, algorithms are derived for calculation of mean, variance, summation, application of Bayes rule and filtering with truncated Gaussians. As an example of the power of their methods, a derivation of the disparity constraint (used in computer vision) from their models is described. The authors' approach complements results in Statistics, but their proposal is not only to use the truncated Gaussian as a model for selected data; they propose to model measurements as fundamentally in terms of truncated Gaussians.
Jiang, Quansheng; Shen, Yehu; Li, Hua; Xu, Fengyu
2018-01-24
Feature recognition and fault diagnosis plays an important role in equipment safety and stable operation of rotating machinery. In order to cope with the complexity problem of the vibration signal of rotating machinery, a feature fusion model based on information entropy and probabilistic neural network is proposed in this paper. The new method first uses information entropy theory to extract three kinds of characteristics entropy in vibration signals, namely, singular spectrum entropy, power spectrum entropy, and approximate entropy. Then the feature fusion model is constructed to classify and diagnose the fault signals. The proposed approach can combine comprehensive information from different aspects and is more sensitive to the fault features. The experimental results on simulated fault signals verified better performances of our proposed approach. In real two-span rotor data, the fault detection accuracy of the new method is more than 10% higher compared with the methods using three kinds of information entropy separately. The new approach is proved to be an effective fault recognition method for rotating machinery.
Application of Renyi entropy for ultrasonic molecular imaging.
Hughes, M S; Marsh, J N; Arbeit, J M; Neumann, R G; Fuhrhop, R W; Wallace, K D; Thomas, L; Smith, J; Agyem, K; Lanza, G M; Wickline, S A; McCarthy, J E
2009-05-01
Previous work has demonstrated that a signal receiver based on a limiting form of the Shannon entropy is, in certain settings, more sensitive to subtle changes in scattering architecture than conventional energy-based signal receivers [M. S. Hughes et al., J. Acoust. Soc. Am. 121, 3542-3557 (2007)]. In this paper new results are presented demonstrating further improvements in sensitivity using a signal receiver based on the Renyi entropy.
Gul, Ahmet; Erman, Burak
2018-01-16
Prediction of peptide binding on specific human leukocyte antigens (HLA) has long been studied with successful results. We herein describe the effects of entropy and dynamics by investigating the binding stabilities of 10 nanopeptides on various HLA Class I alleles using a theoretical model based on molecular dynamics simulations. The fluctuational entropies of the peptides are estimated over a temperature range of 310-460 K. The estimated entropies correlate well with experimental binding affinities of the peptides: peptides that have higher binding affinities have lower entropies compared to non-binders, which have significantly larger entropies. The computation of the entropies is based on a simple model that requires short molecular dynamics trajectories and allows for approximate but rapid determination. The paper draws attention to the long neglected dynamic aspects of peptide binding, and provides a fast computation scheme that allows for rapid scanning of large numbers of peptides on selected HLA antigens, which may be useful in defining the right peptides for personal immunotherapy.
Prediction of Protein Configurational Entropy (Popcoen).
Goethe, Martin; Gleixner, Jan; Fita, Ignacio; Rubi, J Miguel
2018-03-13
A knowledge-based method for configurational entropy prediction of proteins is presented; this methodology is extremely fast, compared to previous approaches, because it does not involve any type of configurational sampling. Instead, the configurational entropy of a query fold is estimated by evaluating an artificial neural network, which was trained on molecular-dynamics simulations of ∼1000 proteins. The predicted entropy can be incorporated into a large class of protein software based on cost-function minimization/evaluation, in which configurational entropy is currently neglected for performance reasons. Software of this type is used for all major protein tasks such as structure predictions, proteins design, NMR and X-ray refinement, docking, and mutation effect predictions. Integrating the predicted entropy can yield a significant accuracy increase as we show exemplarily for native-state identification with the prominent protein software FoldX. The method has been termed Popcoen for Prediction of Protein Configurational Entropy. An implementation is freely available at http://fmc.ub.edu/popcoen/ .
NASA Astrophysics Data System (ADS)
Gul, Ahmet; Erman, Burak
2018-03-01
Prediction of peptide binding on specific human leukocyte antigens (HLA) has long been studied with successful results. We herein describe the effects of entropy and dynamics by investigating the binding stabilities of 10 nanopeptides on various HLA Class I alleles using a theoretical model based on molecular dynamics simulations. The fluctuational entropies of the peptides are estimated over a temperature range of 310-460 K. The estimated entropies correlate well with experimental binding affinities of the peptides: peptides that have higher binding affinities have lower entropies compared to non-binders, which have significantly larger entropies. The computation of the entropies is based on a simple model that requires short molecular dynamics trajectories and allows for approximate but rapid determination. The paper draws attention to the long neglected dynamic aspects of peptide binding, and provides a fast computation scheme that allows for rapid scanning of large numbers of peptides on selected HLA antigens, which may be useful in defining the right peptides for personal immunotherapy.
Logarithmic black hole entropy corrections and holographic Rényi entropy
NASA Astrophysics Data System (ADS)
Mahapatra, Subhash
2018-01-01
The entanglement and Rényi entropies for spherical entangling surfaces in CFTs with gravity duals can be explicitly calculated by mapping these entropies first to the thermal entropy on hyperbolic space and then, using the AdS/CFT correspondence, to the Wald entropy of topological black holes. Here we extend this idea by taking into account corrections to the Wald entropy. Using the method based on horizon symmetries and the asymptotic Cardy formula, we calculate corrections to the Wald entropy and find that these corrections are proportional to the logarithm of the area of the horizon. With the corrected expression for the entropy of the black hole, we then find corrections to the Rényi entropies. We calculate these corrections for both Einstein and Gauss-Bonnet gravity duals. Corrections with logarithmic dependence on the area of the entangling surface naturally occur at the order GD^0. The entropic c-function and the inequalities of the Rényi entropy are also satisfied even with the correction terms.
Antiferromagnetic Potts Model on the Erdős-Rényi Random Graph
NASA Astrophysics Data System (ADS)
Contucci, Pierluigi; Dommers, Sander; Giardinà, Cristian; Starr, Shannon
2013-10-01
We study the antiferromagnetic Potts model on the Poissonian Erdős-Rényi random graph. By identifying a suitable interpolation structure and an extended variational principle, together with a positive temperature second-moment analysis we prove the existence of a phase transition at a positive critical temperature. Upper and lower bounds on the temperature critical value are obtained from the stability analysis of the replica symmetric solution (recovered in the framework of Derrida-Ruelle probability cascades) and from an entropy positivity argument.
Phase space gradient of dissipated work and information: A role of relative Fisher information
DOE Office of Scientific and Technical Information (OSTI.GOV)
Yamano, Takuya, E-mail: yamano@amy.hi-ho.ne.jp
2013-11-15
We show that an information theoretic distance measured by the relative Fisher information between canonical equilibrium phase densities corresponding to forward and backward processes is intimately related to the gradient of the dissipated work in phase space. We present a universal constraint on it via the logarithmic Sobolev inequality. Furthermore, we point out that a possible expression of the lower bound indicates a deep connection in terms of the relative entropy and the Fisher information of the canonical distributions.
A Collaborative 20 Questions Model for Target Search with Human-Machine Interaction
2013-05-01
optimal policies for entropy loss,” Journal of Applied Probability, vol. 49, pp. 114–136, 2012. [2] R. Castro and R. Nowak, “ Active learning and...vol. 10, pp. 223231, 1974. [8] R. Castro, Active Learning and Adaptive Sampling for Non- parametric Inference, Ph.D. thesis, Rice University, August...2007. [9] R. Castro and R. D. Nowak, “Upper and lower bounds for active learning ,” in 44th Annual Allerton Conference on Communica- tion, Control and Computing, 2006.
Application of Renyi entropy for ultrasonic molecular imaging
Hughes, M. S.; Marsh, J. N.; Arbeit, J. M.; Neumann, R. G.; Fuhrhop, R. W.; Wallace, K. D.; Thomas, L.; Smith, J.; Agyem, K.; Lanza, G. M.; Wickline, S. A.; McCarthy, J. E.
2009-01-01
Previous work has demonstrated that a signal receiver based on a limiting form of the Shannon entropy is, in certain settings, more sensitive to subtle changes in scattering architecture than conventional energy-based signal receivers [M. S. Hughes et al., J. Acoust. Soc. Am. 121, 3542–3557 (2007)]. In this paper new results are presented demonstrating further improvements in sensitivity using a signal receiver based on the Renyi entropy. PMID:19425656
Financial time series analysis based on effective phase transfer entropy
NASA Astrophysics Data System (ADS)
Yang, Pengbo; Shang, Pengjian; Lin, Aijing
2017-02-01
Transfer entropy is a powerful technique which is able to quantify the impact of one dynamic system on another system. In this paper, we propose the effective phase transfer entropy method based on the transfer entropy method. We use simulated data to test the performance of this method, and the experimental results confirm that the proposed approach is capable of detecting the information transfer between the systems. We also explore the relationship between effective phase transfer entropy and some variables, such as data size, coupling strength and noise. The effective phase transfer entropy is positively correlated with the data size and the coupling strength. Even in the presence of a large amount of noise, it can detect the information transfer between systems, and it is very robust to noise. Moreover, this measure is indeed able to accurately estimate the information flow between systems compared with phase transfer entropy. In order to reflect the application of this method in practice, we apply this method to financial time series and gain new insight into the interactions between systems. It is demonstrated that the effective phase transfer entropy can be used to detect some economic fluctuations in the financial market. To summarize, the effective phase transfer entropy method is a very efficient tool to estimate the information flow between systems.
Calculating the Entropy of Solid and Liquid Metals, Based on Acoustic Data
NASA Astrophysics Data System (ADS)
Tekuchev, V. V.; Kalinkin, D. P.; Ivanova, I. V.
2018-05-01
The entropies of iron, cobalt, rhodium, and platinum are studied for the first time, based on acoustic data and using the Debye theory and rigid-sphere model, from 298 K up to the boiling point. A formula for the melting entropy of metals is validated. Good agreement between the research results and the literature data is obtained.
Controlling the Shannon Entropy of Quantum Systems
Xing, Yifan; Wu, Jun
2013-01-01
This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking. PMID:23818819
Controlling the shannon entropy of quantum systems.
Xing, Yifan; Wu, Jun
2013-01-01
This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking.
Accuracy of topological entanglement entropy on finite cylinders.
Jiang, Hong-Chen; Singh, Rajiv R P; Balents, Leon
2013-09-06
Topological phases are unique states of matter which support nonlocal excitations which behave as particles with fractional statistics. A universal characterization of gapped topological phases is provided by the topological entanglement entropy (TEE). We study the finite size corrections to the TEE by focusing on systems with a Z2 topological ordered state using density-matrix renormalization group and perturbative series expansions. We find that extrapolations of the TEE based on the Renyi entropies with a Renyi index of n≥2 suffer from much larger finite size corrections than do extrapolations based on the von Neumann entropy. In particular, when the circumference of the cylinder is about ten times the correlation length, the TEE obtained using von Neumann entropy has an error of order 10(-3), while for Renyi entropies it can even exceed 40%. We discuss the relevance of these findings to previous and future searches for topological ordered phases, including quantum spin liquids.
Derivation of Hunt equation for suspension distribution using Shannon entropy theory
NASA Astrophysics Data System (ADS)
Kundu, Snehasis
2017-12-01
In this study, the Hunt equation for computing suspension concentration in sediment-laden flows is derived using Shannon entropy theory. Considering the inverse of the void ratio as a random variable and using principle of maximum entropy, probability density function and cumulative distribution function of suspension concentration is derived. A new and more general cumulative distribution function for the flow domain is proposed which includes several specific other models of CDF reported in literature. This general form of cumulative distribution function also helps to derive the Rouse equation. The entropy based approach helps to estimate model parameters using suspension data of sediment concentration which shows the advantage of using entropy theory. Finally model parameters in the entropy based model are also expressed as functions of the Rouse number to establish a link between the parameters of the deterministic and probabilistic approaches.
NOTE: Entropy-based automated classification of independent components separated from fMCG
NASA Astrophysics Data System (ADS)
Comani, S.; Srinivasan, V.; Alleva, G.; Romani, G. L.
2007-03-01
Fetal magnetocardiography (fMCG) is a noninvasive technique suitable for the prenatal diagnosis of the fetal heart function. Reliable fetal cardiac signals can be reconstructed from multi-channel fMCG recordings by means of independent component analysis (ICA). However, the identification of the separated components is usually accomplished by visual inspection. This paper discusses a novel automated system based on entropy estimators, namely approximate entropy (ApEn) and sample entropy (SampEn), for the classification of independent components (ICs). The system was validated on 40 fMCG datasets of normal fetuses with the gestational age ranging from 22 to 37 weeks. Both ApEn and SampEn were able to measure the stability and predictability of the physiological signals separated with ICA, and the entropy values of the three categories were significantly different at p <0.01. The system performances were compared with those of a method based on the analysis of the time and frequency content of the components. The outcomes of this study showed a superior performance of the entropy-based system, in particular for early gestation, with an overall ICs detection rate of 98.75% and 97.92% for ApEn and SampEn respectively, as against a value of 94.50% obtained with the time-frequency-based system.
Fault Diagnosis for Micro-Gas Turbine Engine Sensors via Wavelet Entropy
Yu, Bing; Liu, Dongdong; Zhang, Tianhong
2011-01-01
Sensor fault diagnosis is necessary to ensure the normal operation of a gas turbine system. However, the existing methods require too many resources and this need can’t be satisfied in some occasions. Since the sensor readings are directly affected by sensor state, sensor fault diagnosis can be performed by extracting features of the measured signals. This paper proposes a novel fault diagnosis method for sensors based on wavelet entropy. Based on the wavelet theory, wavelet decomposition is utilized to decompose the signal in different scales. Then the instantaneous wavelet energy entropy (IWEE) and instantaneous wavelet singular entropy (IWSE) are defined based on the previous wavelet entropy theory. Subsequently, a fault diagnosis method for gas turbine sensors is proposed based on the results of a numerically simulated example. Then, experiments on this method are carried out on a real micro gas turbine engine. In the experiment, four types of faults with different magnitudes are presented. The experimental results show that the proposed method for sensor fault diagnosis is efficient. PMID:22163734
Fault diagnosis for micro-gas turbine engine sensors via wavelet entropy.
Yu, Bing; Liu, Dongdong; Zhang, Tianhong
2011-01-01
Sensor fault diagnosis is necessary to ensure the normal operation of a gas turbine system. However, the existing methods require too many resources and this need can't be satisfied in some occasions. Since the sensor readings are directly affected by sensor state, sensor fault diagnosis can be performed by extracting features of the measured signals. This paper proposes a novel fault diagnosis method for sensors based on wavelet entropy. Based on the wavelet theory, wavelet decomposition is utilized to decompose the signal in different scales. Then the instantaneous wavelet energy entropy (IWEE) and instantaneous wavelet singular entropy (IWSE) are defined based on the previous wavelet entropy theory. Subsequently, a fault diagnosis method for gas turbine sensors is proposed based on the results of a numerically simulated example. Then, experiments on this method are carried out on a real micro gas turbine engine. In the experiment, four types of faults with different magnitudes are presented. The experimental results show that the proposed method for sensor fault diagnosis is efficient.
Stochastic approach to equilibrium and nonequilibrium thermodynamics.
Tomé, Tânia; de Oliveira, Mário J
2015-04-01
We develop the stochastic approach to thermodynamics based on stochastic dynamics, which can be discrete (master equation) and continuous (Fokker-Planck equation), and on two assumptions concerning entropy. The first is the definition of entropy itself and the second the definition of entropy production rate, which is non-negative and vanishes in thermodynamic equilibrium. Based on these assumptions, we study interacting systems with many degrees of freedom in equilibrium or out of thermodynamic equilibrium and how the macroscopic laws are derived from the stochastic dynamics. These studies include the quasiequilibrium processes; the convexity of the equilibrium surface; the monotonic time behavior of thermodynamic potentials, including entropy; the bilinear form of the entropy production rate; the Onsager coefficients and reciprocal relations; and the nonequilibrium steady states of chemical reactions.
Entropy Analysis of Kinetic Flux Vector Splitting Schemes for the Compressible Euler Equations
NASA Technical Reports Server (NTRS)
Shiuhong, Lui; Xu, Jun
1999-01-01
Flux Vector Splitting (FVS) scheme is one group of approximate Riemann solvers for the compressible Euler equations. In this paper, the discretized entropy condition of the Kinetic Flux Vector Splitting (KFVS) scheme based on the gas-kinetic theory is proved. The proof of the entropy condition involves the entropy definition difference between the distinguishable and indistinguishable particles.
Exact solutions for the entropy production rate of several irreversible processes.
Ross, John; Vlad, Marcel O
2005-11-24
We investigate thermal conduction described by Newton's law of cooling and by Fourier's transport equation and chemical reactions based on mass action kinetics where we detail a simple example of a reaction mechanism with one intermediate. In these cases we derive exact expressions for the entropy production rate and its differential. We show that at a stationary state the entropy production rate is an extremum if and only if the stationary state is a state of thermodynamic equilibrium. These results are exact and independent of any expansions of the entropy production rate. In the case of thermal conduction we compare our exact approach with the conventional approach based on the expansion of the entropy production rate near equilibrium. If we expand the entropy production rate in a series and keep terms up to the third order in the deviation variables and then differentiate, we find out that the entropy production rate is not an extremum at a nonequilibrium steady state. If there is a strict proportionality between fluxes and forces, then the entropy production rate is an extremum at the stationary state even if the stationary state is far away from equilibrium.
A new entropy based on a group-theoretical structure
NASA Astrophysics Data System (ADS)
Curado, Evaldo M. F.; Tempesta, Piergiulio; Tsallis, Constantino
2016-03-01
A multi-parametric version of the nonadditive entropy Sq is introduced. This new entropic form, denoted by S a , b , r, possesses many interesting statistical properties, and it reduces to the entropy Sq for b = 0, a = r : = 1 - q (hence Boltzmann-Gibbs entropy SBG for b = 0, a = r → 0). The construction of the entropy S a , b , r is based on a general group-theoretical approach recently proposed by one of us, Tempesta (2016). Indeed, essentially all the properties of this new entropy are obtained as a consequence of the existence of a rational group law, which expresses the structure of S a , b , r with respect to the composition of statistically independent subsystems. Depending on the choice of the parameters, the entropy S a , b , r can be used to cover a wide range of physical situations, in which the measure of the accessible phase space increases say exponentially with the number of particles N of the system, or even stabilizes, by increasing N, to a limiting value. This paves the way to the use of this entropy in contexts where the size of the phase space does not increase as fast as the number of its constituting particles (or subsystems) increases.
Pawlowski, Marcin Piotr; Jara, Antonio; Ogorzalek, Maciej
2015-01-01
Entropy in computer security is associated with the unpredictability of a source of randomness. The random source with high entropy tends to achieve a uniform distribution of random values. Random number generators are one of the most important building blocks of cryptosystems. In constrained devices of the Internet of Things ecosystem, high entropy random number generators are hard to achieve due to hardware limitations. For the purpose of the random number generation in constrained devices, this work proposes a solution based on the least-significant bits concatenation entropy harvesting method. As a potential source of entropy, on-board integrated sensors (i.e., temperature, humidity and two different light sensors) have been analyzed. Additionally, the costs (i.e., time and memory consumption) of the presented approach have been measured. The results obtained from the proposed method with statistical fine tuning achieved a Shannon entropy of around 7.9 bits per byte of data for temperature and humidity sensors. The results showed that sensor-based random number generators are a valuable source of entropy with very small RAM and Flash memory requirements for constrained devices of the Internet of Things. PMID:26506357
Population entropies estimates of proteins
NASA Astrophysics Data System (ADS)
Low, Wai Yee
2017-05-01
The Shannon entropy equation provides a way to estimate variability of amino acids sequences in a multiple sequence alignment of proteins. Knowledge of protein variability is useful in many areas such as vaccine design, identification of antibody binding sites, and exploration of protein 3D structural properties. In cases where the population entropies of a protein are of interest but only a small sample size can be obtained, a method based on linear regression and random subsampling can be used to estimate the population entropy. This method is useful for comparisons of entropies where the actual sequence counts differ and thus, correction for alignment size bias is needed. In the current work, an R based package named EntropyCorrect that enables estimation of population entropy is presented and an empirical study on how well this new algorithm performs on simulated dataset of various combinations of population and sample sizes is discussed. The package is available at https://github.com/lloydlow/EntropyCorrect. This article, which was originally published online on 12 May 2017, contained an error in Eq. (1), where the summation sign was missing. The corrected equation appears in the Corrigendum attached to the pdf.
Pawlowski, Marcin Piotr; Jara, Antonio; Ogorzalek, Maciej
2015-10-22
Entropy in computer security is associated with the unpredictability of a source of randomness. The random source with high entropy tends to achieve a uniform distribution of random values. Random number generators are one of the most important building blocks of cryptosystems. In constrained devices of the Internet of Things ecosystem, high entropy random number generators are hard to achieve due to hardware limitations. For the purpose of the random number generation in constrained devices, this work proposes a solution based on the least-significant bits concatenation entropy harvesting method. As a potential source of entropy, on-board integrated sensors (i.e., temperature, humidity and two different light sensors) have been analyzed. Additionally, the costs (i.e., time and memory consumption) of the presented approach have been measured. The results obtained from the proposed method with statistical fine tuning achieved a Shannon entropy of around 7.9 bits per byte of data for temperature and humidity sensors. The results showed that sensor-based random number generators are a valuable source of entropy with very small RAM and Flash memory requirements for constrained devices of the Internet of Things.
NASA Astrophysics Data System (ADS)
Alameddine, Ibrahim; Karmakar, Subhankar; Qian, Song S.; Paerl, Hans W.; Reckhow, Kenneth H.
2013-10-01
The total maximum daily load program aims to monitor more than 40,000 standard violations in around 20,000 impaired water bodies across the United States. Given resource limitations, future monitoring efforts have to be hedged against the uncertainties in the monitored system, while taking into account existing knowledge. In that respect, we have developed a hierarchical spatiotemporal Bayesian model that can be used to optimize an existing monitoring network by retaining stations that provide the maximum amount of information, while identifying locations that would benefit from the addition of new stations. The model assumes the water quality parameters are adequately described by a joint matrix normal distribution. The adopted approach allows for a reduction in redundancies, while emphasizing information richness rather than data richness. The developed approach incorporates the concept of entropy to account for the associated uncertainties. Three different entropy-based criteria are adopted: total system entropy, chlorophyll-a standard violation entropy, and dissolved oxygen standard violation entropy. A multiple attribute decision making framework is adopted to integrate the competing design criteria and to generate a single optimal design. The approach is implemented on the water quality monitoring system of the Neuse River Estuary in North Carolina, USA. The model results indicate that the high priority monitoring areas identified by the total system entropy and the dissolved oxygen violation entropy criteria are largely coincident. The monitoring design based on the chlorophyll-a standard violation entropy proved to be less informative, given the low probabilities of violating the water quality standard in the estuary.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Zhang, Lin, E-mail: godyalin@163.com; Singh, Uttam, E-mail: uttamsingh@hri.res.in; Pati, Arun K., E-mail: akpati@hri.res.in
Compact expressions for the average subentropy and coherence are obtained for random mixed states that are generated via various probability measures. Surprisingly, our results show that the average subentropy of random mixed states approaches the maximum value of the subentropy which is attained for the maximally mixed state as we increase the dimension. In the special case of the random mixed states sampled from the induced measure via partial tracing of random bipartite pure states, we establish the typicality of the relative entropy of coherence for random mixed states invoking the concentration of measure phenomenon. Our results also indicate thatmore » mixed quantum states are less useful compared to pure quantum states in higher dimension when we extract quantum coherence as a resource. This is because of the fact that average coherence of random mixed states is bounded uniformly, however, the average coherence of random pure states increases with the increasing dimension. As an important application, we establish the typicality of relative entropy of entanglement and distillable entanglement for a specific class of random bipartite mixed states. In particular, most of the random states in this specific class have relative entropy of entanglement and distillable entanglement equal to some fixed number (to within an arbitrary small error), thereby hugely reducing the complexity of computation of these entanglement measures for this specific class of mixed states.« less
Generalized Entanglement Entropy and Holography
NASA Astrophysics Data System (ADS)
Obregón, O.
2018-04-01
A nonextensive statistical mechanics entropy that depends only on the probability distribution is proposed in the framework of superstatistics. It is based on a Γ(χ 2) distribution that depends on β and also on pl . The corresponding modified von Neumann entropy is constructed; it is shown that it can also be obtained from a generalized Replica trick. We address the question whether the generalized entanglement entropy can play a role in the gauge/gravity duality. We pay attention to 2dCFT and their gravity duals. The correction terms to the von Neumann entropy result more relevant than the usual UV (for c = 1) ones and also than those due to the area dependent AdS 3 entropy which result comparable to the UV ones. Then the correction terms due to the new entropy would modify the Ryu-Takayanagi identification between the CFT entanglement entropy and the AdS entropy in a different manner than the UV ones or than the corrections to the AdS 3 area dependent entropy.
Characterizing time series via complexity-entropy curves
NASA Astrophysics Data System (ADS)
Ribeiro, Haroldo V.; Jauregui, Max; Zunino, Luciano; Lenzi, Ervin K.
2017-06-01
The search for patterns in time series is a very common task when dealing with complex systems. This is usually accomplished by employing a complexity measure such as entropies and fractal dimensions. However, such measures usually only capture a single aspect of the system dynamics. Here, we propose a family of complexity measures for time series based on a generalization of the complexity-entropy causality plane. By replacing the Shannon entropy by a monoparametric entropy (Tsallis q entropy) and after considering the proper generalization of the statistical complexity (q complexity), we build up a parametric curve (the q -complexity-entropy curve) that is used for characterizing and classifying time series. Based on simple exact results and numerical simulations of stochastic processes, we show that these curves can distinguish among different long-range, short-range, and oscillating correlated behaviors. Also, we verify that simulated chaotic and stochastic time series can be distinguished based on whether these curves are open or closed. We further test this technique in experimental scenarios related to chaotic laser intensity, stock price, sunspot, and geomagnetic dynamics, confirming its usefulness. Finally, we prove that these curves enhance the automatic classification of time series with long-range correlations and interbeat intervals of healthy subjects and patients with heart disease.
Secondary structural entropy in RNA switch (Riboswitch) identification.
Manzourolajdad, Amirhossein; Arnold, Jonathan
2015-04-28
RNA regulatory elements play a significant role in gene regulation. Riboswitches, a widespread group of regulatory RNAs, are vital components of many bacterial genomes. These regulatory elements generally function by forming a ligand-induced alternative fold that controls access to ribosome binding sites or other regulatory sites in RNA. Riboswitch-mediated mechanisms are ubiquitous across bacterial genomes. A typical class of riboswitch has its own unique structural and biological complexity, making de novo riboswitch identification a formidable task. Traditionally, riboswitches have been identified through comparative genomics based on sequence and structural homology. The limitations of structural-homology-based approaches, coupled with the assumption that there is a great diversity of undiscovered riboswitches, suggests the need for alternative methods for riboswitch identification, possibly based on features intrinsic to their structure. As of yet, no such reliable method has been proposed. We used structural entropy of riboswitch sequences as a measure of their secondary structural dynamics. Entropy values of a diverse set of riboswitches were compared to that of their mutants, their dinucleotide shuffles, and their reverse complement sequences under different stochastic context-free grammar folding models. Significance of our results was evaluated by comparison to other approaches, such as the base-pairing entropy and energy landscapes dynamics. Classifiers based on structural entropy optimized via sequence and structural features were devised as riboswitch identifiers and tested on Bacillus subtilis, Escherichia coli, and Synechococcus elongatus as an exploration of structural entropy based approaches. The unusually long untranslated region of the cotH in Bacillus subtilis, as well as upstream regions of certain genes, such as the sucC genes were associated with significant structural entropy values in genome-wide examinations. Various tests show that there is in fact a relationship between higher structural entropy and the potential for the RNA sequence to have alternative structures, within the limitations of our methodology. This relationship, though modest, is consistent across various tests. Understanding the behavior of structural entropy as a fairly new feature for RNA conformational dynamics, however, may require extensive exploratory investigation both across RNA sequences and folding models.
Five-Dimensional Gauged Supergravity with Higher Derivatives
NASA Astrophysics Data System (ADS)
Hanaki, Kentaro
This thesis summarizes the recent developments on the study of five-dimensional gauged supergravity with higher derivative terms, emphasizing in particular the application to understanding the hydrodynamic properties of gauge theory plasma via the AdS/CFT correspondence. We first review how the ungauged and gauged five-dimensional supergravity actions with higher derivative terms can be constructed using the off-shell superconformal formalism. Then we relate the gauged supergravity to four-dimensional gauge theory using the AdS/CFT correspondence and extract the physical quantities associated with gauge theory plasma from the dual classical supergravity computations. We put a particular emphasis on the discussion of the conjectured lower bound for the shear viscosity over entropy density ratio proposed by Kovtun, Son and Starinets, and discuss how higher derivative terms in supergravity and the introduction of chemical potential for the R-charge affect this bound.
Estimating the Entropy of Binary Time Series: Methodology, Some Theory and a Simulation Study
NASA Astrophysics Data System (ADS)
Gao, Yun; Kontoyiannis, Ioannis; Bienenstock, Elie
2008-06-01
Partly motivated by entropy-estimation problems in neuroscience, we present a detailed and extensive comparison between some of the most popular and effective entropy estimation methods used in practice: The plug-in method, four different estimators based on the Lempel-Ziv (LZ) family of data compression algorithms, an estimator based on the Context-Tree Weighting (CTW) method, and the renewal entropy estimator. METHODOLOGY: Three new entropy estimators are introduced; two new LZ-based estimators, and the “renewal entropy estimator,” which is tailored to data generated by a binary renewal process. For two of the four LZ-based estimators, a bootstrap procedure is described for evaluating their standard error, and a practical rule of thumb is heuristically derived for selecting the values of their parameters in practice. THEORY: We prove that, unlike their earlier versions, the two new LZ-based estimators are universally consistent, that is, they converge to the entropy rate for every finite-valued, stationary and ergodic process. An effective method is derived for the accurate approximation of the entropy rate of a finite-state hidden Markov model (HMM) with known distribution. Heuristic calculations are presented and approximate formulas are derived for evaluating the bias and the standard error of each estimator. SIMULATION: All estimators are applied to a wide range of data generated by numerous different processes with varying degrees of dependence and memory. The main conclusions drawn from these experiments include: (i) For all estimators considered, the main source of error is the bias. (ii) The CTW method is repeatedly and consistently seen to provide the most accurate results. (iii) The performance of the LZ-based estimators is often comparable to that of the plug-in method. (iv) The main drawback of the plug-in method is its computational inefficiency; with small word-lengths it fails to detect longer-range structure in the data, and with longer word-lengths the empirical distribution is severely undersampled, leading to large biases.
NASA Astrophysics Data System (ADS)
Mohammad-Djafari, Ali
2015-01-01
The main object of this tutorial article is first to review the main inference tools using Bayesian approach, Entropy, Information theory and their corresponding geometries. This review is focused mainly on the ways these tools have been used in data, signal and image processing. After a short introduction of the different quantities related to the Bayes rule, the entropy and the Maximum Entropy Principle (MEP), relative entropy and the Kullback-Leibler divergence, Fisher information, we will study their use in different fields of data and signal processing such as: entropy in source separation, Fisher information in model order selection, different Maximum Entropy based methods in time series spectral estimation and finally, general linear inverse problems.
Wavelet entropy characterization of elevated intracranial pressure.
Xu, Peng; Scalzo, Fabien; Bergsneider, Marvin; Vespa, Paul; Chad, Miller; Hu, Xiao
2008-01-01
Intracranial Hypertension (ICH) often occurs for those patients with traumatic brain injury (TBI), stroke, tumor, etc. Pathology of ICH is still controversial. In this work, we used wavelet entropy and relative wavelet entropy to study the difference existed between normal and hypertension states of ICP for the first time. The wavelet entropy revealed the similar findings as the approximation entropy that entropy during ICH state is smaller than that in normal state. Moreover, with wavelet entropy, we can see that ICH state has the more focused energy in the low wavelet frequency band (0-3.1 Hz) than the normal state. The relative wavelet entropy shows that the energy distribution in the wavelet bands between these two states is actually different. Based on these results, we suggest that ICH may be formed by the re-allocation of oscillation energy within brain.
Entropy of electromyography time series
NASA Astrophysics Data System (ADS)
Kaufman, Miron; Zurcher, Ulrich; Sung, Paul S.
2007-12-01
A nonlinear analysis based on Renyi entropy is applied to electromyography (EMG) time series from back muscles. The time dependence of the entropy of the EMG signal exhibits a crossover from a subdiffusive regime at short times to a plateau at longer times. We argue that this behavior characterizes complex biological systems. The plateau value of the entropy can be used to differentiate between healthy and low back pain individuals.
Coherent Structure Detection using Persistent Homology and other Topological Tools
NASA Astrophysics Data System (ADS)
Smith, Spencer; Roberts, Eric; Sindi, Suzanne; Mitchell, Kevin
2017-11-01
For non-autonomous, aperiodic fluid flows, coherent structures help organize the dynamics, much as invariant manifolds and periodic orbits do for autonomous or periodic systems. The prevalence of such flows in nature and industry has motivated many successful techniques for defining and detecting coherent structures. However, often these approaches require very fine trajectory data to reconstruct velocity fields and compute Cauchy-Green-tensor-related quantities. We use topological techniques to help detect coherent trajectory sets in relatively sparse 2D advection problems. More specifically, we have developed a homotopy-based algorithm, the ensemble-based topological entropy calculation (E-tec), which assigns to each edge in an initial triangulation of advected points a topologically forced lower bound on its future stretching rate. The triangulation and its weighted edges allow us to analyze flows using persistent homology. This topological data analysis tool detects clusters and loops in the triangulation that are robust in the presence of noise and in this case correspond to coherent trajectory sets.
The third law of thermodynamics and the fractional entropies
NASA Astrophysics Data System (ADS)
Baris Bagci, G.
2016-08-01
We consider the fractal calculus based Ubriaco and Machado entropies and investigate whether they conform to the third law of thermodynamics. The Ubriaco entropy satisfies the third law of thermodynamics in the interval 0 < q ≤ 1 exactly where it is also thermodynamically stable. The Machado entropy, on the other hand, yields diverging inverse temperature in the region 0 < q ≤ 1, albeit with non-vanishing negative entropy values. Therefore, despite the divergent inverse temperature behavior, the Machado entropy fails the third law of thermodynamics. We also show that the aforementioned results are also supported by the one-dimensional Ising model with no external field.
From clocks to cloners: Catalytic transformations under covariant operations and recoverability
NASA Astrophysics Data System (ADS)
Marvian, Iman; Lloyd, Seth
There are various physical scenarios in which one can only implement operations with a certain symmetry. Under such restriction, a system in a symmetry-breaking state can be used as a catalyst, e.g. to prepare another system in a desired symmetry-breaking state. This sort of (approximate) catalytic state transformations are relevant in the context of (i) state preparation using a bounded-size quantum clock or reference frame, where the clock or reference frame acts as a catalyst, (ii) quantum thermodynamics, where again a clock can be used as a catalyst to prepare states which contain coherence with respect to the system Hamiltonian, and (iii) cloning of unknown quantum states, where the given copies of state can be interpreted as a catalyst for preparing the new copies. Using a recent result of Fawzi and Renner on approximate recoverability, we show that the achievable accuracy in this kind of catalytic transformations can be determined by a single function, namely the relative entropy of asymmetry, which is equal to the difference between the entropy of state and its symmetrized version: if the desired state transition does not require a large increase of this quantity, then it can be implemented with high fidelity using only symmetric operations. Our lower bound on the achievable fidelity is tight in the case of cloners, and can be achieved using the Petz recovery map, which interestingly turns out to be the optimal cloning map found by Werner.
Intrinsic thermodynamics of inhibitor binding to human carbonic anhydrase IX.
Linkuvienė, Vaida; Matulienė, Jurgita; Juozapaitienė, Vaida; Michailovienė, Vilma; Jachno, Jelena; Matulis, Daumantas
2016-04-01
Human carbonic anhydrase 9th isoform (CA IX) is an important marker of numerous cancers and is increasingly interesting as a potential anticancer drug target. Various synthetic aromatic sulfonamide-bearing compounds are being designed as potent inhibitors of CA IX. However, sulfonamide compound binding to CA IX is linked to several reactions, the deprotonation of the sulfonamide amino group and the protonation of the CA active site Zn(II)-bound hydroxide. These linked reactions significantly affect the affinities and other thermodynamic parameters such as enthalpies and entropies of binding. The observed and intrinsic affinities of compound binding to CA IX were determined by the fluorescent thermal shift assay. The enthalpies and entropies of binding were determined by the isothermal titration calorimetry. The pKa of CA IX was determined to be 6.8 and the enthalpy of CA IX-Zn(II)-bound hydroxide protonation was -24 kJ/mol. These values enabled the analysis of intrinsic thermodynamics of a library of compounds binding to CA IX. The most strongly binding compounds exhibited the intrinsic affinity of 0.01 nM and the observed affinity of 2 nM. The intrinsic thermodynamic parameters of compound binding to CA IX helped to draw the compound structure to thermodynamics relationship. It is important to distinguish the intrinsic from observed parameters of any disease target protein interaction with its inhibitors as drug candidates when drawing detailed compound structure to thermodynamics correlations. Copyright © 2016 Elsevier B.V. All rights reserved.
Entropy as an indicator of cerebral perfusion in patients with increased intracranial pressure.
Khan, James; Mariappan, Ramamani; Venkatraghavan, Lashmi
2014-07-01
Changes in electroencephalogram (EEG) patterns correlate well with changes in cerebral perfusion pressure (CPP) and hence entropy and bispectral index values may also correlate with CPP. To highlight the potential application of entropy, an EEG-based anesthetic depth monitor, on indicating cerebral perfusion in patients with increased intracranial pressure (ICP), we report two cases of emergency neurosurgical procedure in patients with raised ICP where anesthesia was titrated to entropy values and the entropy values suddenly increased after cranial decompression, reflecting the increase in CPP. Maintaining systemic blood pressure in order to maintain the CPP is the anesthetic goal while managing patients with raised ICP. EEG-based anesthetic depth monitors may hold valuable information on guiding anesthetic management in patients with decreased CPP for better neurological outcome.
Formulating the shear stress distribution in circular open channels based on the Renyi entropy
NASA Astrophysics Data System (ADS)
Khozani, Zohreh Sheikh; Bonakdari, Hossein
2018-01-01
The principle of maximum entropy is employed to derive the shear stress distribution by maximizing the Renyi entropy subject to some constraints and by assuming that dimensionless shear stress is a random variable. A Renyi entropy-based equation can be used to model the shear stress distribution along the entire wetted perimeter of circular channels and circular channels with flat beds and deposited sediments. A wide range of experimental results for 12 hydraulic conditions with different Froude numbers (0.375 to 1.71) and flow depths (20.3 to 201.5 mm) were used to validate the derived shear stress distribution. For circular channels, model performance enhanced with increasing flow depth (mean relative error (RE) of 0.0414) and only deteriorated slightly at the greatest flow depth (RE of 0.0573). For circular channels with flat beds, the Renyi entropy model predicted the shear stress distribution well at lower sediment depth. The Renyi entropy model results were also compared with Shannon entropy model results. Both models performed well for circular channels, but for circular channels with flat beds the Renyi entropy model displayed superior performance in estimating the shear stress distribution. The Renyi entropy model was highly precise and predicted the shear stress distribution in a circular channel with RE of 0.0480 and in a circular channel with a flat bed with RE of 0.0488.
Chao, Anne; Jost, Lou; Hsieh, T C; Ma, K H; Sherwin, William B; Rollins, Lee Ann
2015-01-01
Shannon entropy H and related measures are increasingly used in molecular ecology and population genetics because (1) unlike measures based on heterozygosity or allele number, these measures weigh alleles in proportion to their population fraction, thus capturing a previously-ignored aspect of allele frequency distributions that may be important in many applications; (2) these measures connect directly to the rich predictive mathematics of information theory; (3) Shannon entropy is completely additive and has an explicitly hierarchical nature; and (4) Shannon entropy-based differentiation measures obey strong monotonicity properties that heterozygosity-based measures lack. We derive simple new expressions for the expected values of the Shannon entropy of the equilibrium allele distribution at a neutral locus in a single isolated population under two models of mutation: the infinite allele model and the stepwise mutation model. Surprisingly, this complex stochastic system for each model has an entropy expressable as a simple combination of well-known mathematical functions. Moreover, entropy- and heterozygosity-based measures for each model are linked by simple relationships that are shown by simulations to be approximately valid even far from equilibrium. We also identify a bridge between the two models of mutation. We apply our approach to subdivided populations which follow the finite island model, obtaining the Shannon entropy of the equilibrium allele distributions of the subpopulations and of the total population. We also derive the expected mutual information and normalized mutual information ("Shannon differentiation") between subpopulations at equilibrium, and identify the model parameters that determine them. We apply our measures to data from the common starling (Sturnus vulgaris) in Australia. Our measures provide a test for neutrality that is robust to violations of equilibrium assumptions, as verified on real world data from starlings.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Shirokov, M. E.
We analyse two possible definitions of the squashed entanglement in an infinite-dimensional bipartite system: direct translation of the finite-dimensional definition and its universal extension. It is shown that the both definitions produce the same lower semicontinuous entanglement measure possessing all basis properties of the squashed entanglement on the set of states having at least one finite marginal entropy. It is also shown that the second definition gives an adequate lower semicontinuous extension of this measure to all states of the infinite-dimensional bipartite system. A general condition relating continuity of the squashed entanglement to continuity of the quantum mutual information ismore » proved and its corollaries are considered. Continuity bound for the squashed entanglement under the energy constraint on one subsystem is obtained by using the tight continuity bound for quantum conditional mutual information (proved in the Appendix by using Winter’s technique). It is shown that the same continuity bound is valid for the entanglement of formation. As a result the asymptotic continuity of the both entanglement measures under the energy constraint on one subsystem is proved.« less
Device-independent characterizations of a shared quantum state independent of any Bell inequalities
NASA Astrophysics Data System (ADS)
Wei, Zhaohui; Sikora, Jamie
2017-03-01
In a Bell experiment two parties share a quantum state and perform local measurements on their subsystems separately, and the statistics of the measurement outcomes are recorded as a Bell correlation. For any Bell correlation, it turns out that a quantum state with minimal size that is able to produce this correlation can always be pure. In this work, we first exhibit two device-independent characterizations for the pure state that Alice and Bob share using only the correlation data. Specifically, we give two conditions that the Schmidt coefficients must satisfy, which can be tight, and have various applications in quantum tasks. First, one of the characterizations allows us to bound the entanglement between Alice and Bob using Renyi entropies and also to bound the underlying Hilbert space dimension. Second, when the Hilbert space dimension bound is tight, the shared pure quantum state has to be maximally entangled. Third, the second characterization gives a sufficient condition that a Bell correlation cannot be generated by particular quantum states. We also show that our results can be generalized to the case of shared mixed states.
Small-window parametric imaging based on information entropy for ultrasound tissue characterization
Tsui, Po-Hsiang; Chen, Chin-Kuo; Kuo, Wen-Hung; Chang, King-Jen; Fang, Jui; Ma, Hsiang-Yang; Chou, Dean
2017-01-01
Constructing ultrasound statistical parametric images by using a sliding window is a widely adopted strategy for characterizing tissues. Deficiency in spatial resolution, the appearance of boundary artifacts, and the prerequisite data distribution limit the practicability of statistical parametric imaging. In this study, small-window entropy parametric imaging was proposed to overcome the above problems. Simulations and measurements of phantoms were executed to acquire backscattered radiofrequency (RF) signals, which were processed to explore the feasibility of small-window entropy imaging in detecting scatterer properties. To validate the ability of entropy imaging in tissue characterization, measurements of benign and malignant breast tumors were conducted (n = 63) to compare performances of conventional statistical parametric (based on Nakagami distribution) and entropy imaging by the receiver operating characteristic (ROC) curve analysis. The simulation and phantom results revealed that entropy images constructed using a small sliding window (side length = 1 pulse length) adequately describe changes in scatterer properties. The area under the ROC for using small-window entropy imaging to classify tumors was 0.89, which was higher than 0.79 obtained using statistical parametric imaging. In particular, boundary artifacts were largely suppressed in the proposed imaging technique. Entropy enables using a small window for implementing ultrasound parametric imaging. PMID:28106118
Small-window parametric imaging based on information entropy for ultrasound tissue characterization
NASA Astrophysics Data System (ADS)
Tsui, Po-Hsiang; Chen, Chin-Kuo; Kuo, Wen-Hung; Chang, King-Jen; Fang, Jui; Ma, Hsiang-Yang; Chou, Dean
2017-01-01
Constructing ultrasound statistical parametric images by using a sliding window is a widely adopted strategy for characterizing tissues. Deficiency in spatial resolution, the appearance of boundary artifacts, and the prerequisite data distribution limit the practicability of statistical parametric imaging. In this study, small-window entropy parametric imaging was proposed to overcome the above problems. Simulations and measurements of phantoms were executed to acquire backscattered radiofrequency (RF) signals, which were processed to explore the feasibility of small-window entropy imaging in detecting scatterer properties. To validate the ability of entropy imaging in tissue characterization, measurements of benign and malignant breast tumors were conducted (n = 63) to compare performances of conventional statistical parametric (based on Nakagami distribution) and entropy imaging by the receiver operating characteristic (ROC) curve analysis. The simulation and phantom results revealed that entropy images constructed using a small sliding window (side length = 1 pulse length) adequately describe changes in scatterer properties. The area under the ROC for using small-window entropy imaging to classify tumors was 0.89, which was higher than 0.79 obtained using statistical parametric imaging. In particular, boundary artifacts were largely suppressed in the proposed imaging technique. Entropy enables using a small window for implementing ultrasound parametric imaging.
Entropy-based financial asset pricing.
Ormos, Mihály; Zibriczky, Dávid
2014-01-01
We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative measure of risk. Our results show that entropy decreases in the function of the number of securities involved in a portfolio in a similar way to the standard deviation, and that efficient portfolios are situated on a hyperbola in the expected return-entropy system. For empirical investigation we use daily returns of 150 randomly selected securities for a period of 27 years. Our regression results show that entropy has a higher explanatory power for the expected return than the capital asset pricing model beta. Furthermore we show the time varying behavior of the beta along with entropy.
Entropy-Based Financial Asset Pricing
Ormos, Mihály; Zibriczky, Dávid
2014-01-01
We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative measure of risk. Our results show that entropy decreases in the function of the number of securities involved in a portfolio in a similar way to the standard deviation, and that efficient portfolios are situated on a hyperbola in the expected return – entropy system. For empirical investigation we use daily returns of 150 randomly selected securities for a period of 27 years. Our regression results show that entropy has a higher explanatory power for the expected return than the capital asset pricing model beta. Furthermore we show the time varying behavior of the beta along with entropy. PMID:25545668
Entropy in self-similar shock profiles
DOE Office of Scientific and Technical Information (OSTI.GOV)
Margolin, Len G.; Reisner, Jon Michael; Jordan, Pedro M.
In this paper, we study the structure of a gaseous shock, and in particular the distribution of entropy within, in both a thermodynamics and a statistical mechanics context. The problem of shock structure has a long and distinguished history that we review. We employ the Navier–Stokes equations to construct a self–similar version of Becker’s solution for a shock assuming a particular (physically plausible) Prandtl number; that solution reproduces the well–known result of Morduchow & Libby that features a maximum of the equilibrium entropy inside the shock profile. We then construct an entropy profile, based on gas kinetic theory, that ismore » smooth and monotonically increasing. The extension of equilibrium thermodynamics to irreversible processes is based in part on the assumption of local thermodynamic equilibrium. We show that this assumption is not valid except for the weakest shocks. Finally, we conclude by hypothesizing a thermodynamic nonequilibrium entropy and demonstrating that it closely estimates the gas kinetic nonequilibrium entropy within a shock.« less
Statistical Mechanical Proof of the Second Law of Thermodynamics based on Volume Entropy
NASA Astrophysics Data System (ADS)
Campisi, Michele
2007-10-01
As pointed out in [M. Campisi. Stud. Hist. Phil. M. P. 36 (2005) 275-290] the volume entropy (that is the logarithm of the volume of phase space enclosed by the constant energy hyper-surface) provides a good mechanical analogue of thermodynamic entropy because it satisfies the heat theorem and it is an adiabatic invariant. This property explains the ``equal'' sign in Clausius principle (Sf>=Si) in a purely mechanical way and suggests that the volume entropy might explain the ``larger than'' sign (i.e. the Law of Entropy Increase) if non adiabatic transformations were considered. Based on the principles of quantum mechanics here we prove that, provided the initial equilibrium satisfy the natural condition of decreasing ordering of probabilities, the expectation value of the volume entropy cannot decrease for arbitrary transformations performed by some external sources of work on a insulated system. This can be regarded as a rigorous quantum mechanical proof of the Second Law.
Entropy in self-similar shock profiles
Margolin, Len G.; Reisner, Jon Michael; Jordan, Pedro M.
2017-07-16
In this paper, we study the structure of a gaseous shock, and in particular the distribution of entropy within, in both a thermodynamics and a statistical mechanics context. The problem of shock structure has a long and distinguished history that we review. We employ the Navier–Stokes equations to construct a self–similar version of Becker’s solution for a shock assuming a particular (physically plausible) Prandtl number; that solution reproduces the well–known result of Morduchow & Libby that features a maximum of the equilibrium entropy inside the shock profile. We then construct an entropy profile, based on gas kinetic theory, that ismore » smooth and monotonically increasing. The extension of equilibrium thermodynamics to irreversible processes is based in part on the assumption of local thermodynamic equilibrium. We show that this assumption is not valid except for the weakest shocks. Finally, we conclude by hypothesizing a thermodynamic nonequilibrium entropy and demonstrating that it closely estimates the gas kinetic nonequilibrium entropy within a shock.« less
NASA Astrophysics Data System (ADS)
Jia, Rui-Sheng; Sun, Hong-Mei; Peng, Yan-Jun; Liang, Yong-Quan; Lu, Xin-Ming
2017-07-01
Microseismic monitoring is an effective means for providing early warning of rock or coal dynamical disasters, and its first step is microseismic event detection, although low SNR microseismic signals often cannot effectively be detected by routine methods. To solve this problem, this paper presents permutation entropy and a support vector machine to detect low SNR microseismic events. First, an extraction method of signal features based on multi-scale permutation entropy is proposed by studying the influence of the scale factor on the signal permutation entropy. Second, the detection model of low SNR microseismic events based on the least squares support vector machine is built by performing a multi-scale permutation entropy calculation for the collected vibration signals, constructing a feature vector set of signals. Finally, a comparative analysis of the microseismic events and noise signals in the experiment proves that the different characteristics of the two can be fully expressed by using multi-scale permutation entropy. The detection model of microseismic events combined with the support vector machine, which has the features of high classification accuracy and fast real-time algorithms, can meet the requirements of online, real-time extractions of microseismic events.
FRW Solutions and Holography from Uplifted AdS/CFT
DOE Office of Scientific and Technical Information (OSTI.GOV)
Dong, Xi; Horn, Bart; /Stanford U., ITP /Stanford U., Phys. Dept. /SLAC
2012-02-15
Starting from concrete AdS/CFT dual pairs, one can introduce ingredients which produce cosmological solutions, including metastable de Sitter and its decay to non-accelerating FRW. We present simple FRW solutions sourced by magnetic flavor branes and analyze correlation functions and particle and brane dynamics. To obtain a holographic description, we exhibit a time-dependent warped metric on the solution and interpret the resulting redshifted region as a Lorentzian low energy effective field theory in one fewer dimension. At finite times, this theory has a finite cutoff, a propagating lower dimensional graviton and a finite covariant entropy bound, but at late times themore » lower dimensional Planck mass and entropy go off to infinity in a way that is dominated by contributions from the low energy effective theory. This opens up the possibility of a precise dual at late times. We reproduce the time-dependent growth of the number of degrees of freedom in the system via a count of available microscopic states in the corresponding magnetic brane construction.« less
On the structure-bounded growth processes in plant populations.
Kilian, H G; Kazda, M; Király, F; Kaufmann, D; Kemkemer, R; Bartkowiak, D
2010-07-01
If growing cells in plants are considered to be composed of increments (ICs) an extended version of the law of mass action can be formulated. It evidences that growth of plants runs optimal if the reaction-entropy term (entropy times the absolute temperature) matches the contact energy of ICs. Since these energies are small, thermal molecular movements facilitate via relaxation the removal of structure disturbances. Stem diameter distributions exhibit extra fluctuations likely to be caused by permanent constraints. Since the signal-response system enables in principle perfect optimization only within finite-sized cell ensembles, plants comprising relatively large cell numbers form a network of size-limited subsystems. The maximal number of these constituents depends both on genetic and environmental factors. Accounting for logistical structure-dynamics interrelations, equations can be formulated to describe the bimodal growth curves of very different plants. The reproduction of the S-bended growth curves verifies that the relaxation modes with a broad structure-controlled distribution freeze successively until finally growth is fully blocked thus bringing about "continuous solidification".
Operational Resource Theory of Coherence.
Winter, Andreas; Yang, Dong
2016-03-25
We establish an operational theory of coherence (or of superposition) in quantum systems, by focusing on the optimal rate of performance of certain tasks. Namely, we introduce the two basic concepts-"coherence distillation" and "coherence cost"-in the processing quantum states under so-called incoherent operations [Baumgratz, Cramer, and Plenio, Phys. Rev. Lett. 113, 140401 (2014)]. We, then, show that, in the asymptotic limit of many copies of a state, both are given by simple single-letter formulas: the distillable coherence is given by the relative entropy of coherence (in other words, we give the relative entropy of coherence its operational interpretation), and the coherence cost by the coherence of formation, which is an optimization over convex decompositions of the state. An immediate corollary is that there exists no bound coherent state in the sense that one would need to consume coherence to create the state, but no coherence could be distilled from it. Further, we demonstrate that the coherence theory is generically an irreversible theory by a simple criterion that completely characterizes all reversible states.
How many universes are in the multiverse?
DOE Office of Scientific and Technical Information (OSTI.GOV)
Linde, Andrei; Vanchurin, Vitaly
2010-04-15
We argue that the total number of distinguishable locally Friedmann 'universes' generated by eternal inflation is proportional to the exponent of the entropy of inflationary perturbations and is limited by e{sup e3N}, where N is the number of e-folds of slow-roll posteternal inflation. For simplest models of chaotic inflation, N is approximately equal to de Sitter entropy at the end of eternal inflation; it can be exponentially large. However, not all of these universes can be observed by a local observer. In the presence of a cosmological constant {Lambda} the number of distinguishable universes is bounded by e{sup |{Lambda}|-3/4}. Inmore » the context of the string theory landscape, the overall number of different universes is expected to be exponentially greater than the total number of vacua in the landscape. We discuss the possibility that the strongest constraint on the number of distinguishable universes may be related not to the properties of the multiverse but to the properties of observers.« less
Why granular media are thermal after all
NASA Astrophysics Data System (ADS)
Liu, Mario; Jiang, Yimin
2017-06-01
Two approaches exist to account for granular behavior. The thermal one considers the total entropy, which includes microscopic degrees of freedom such as phonons; the athermal one (as with the Edward entropy) takes grains as elementary. Granular solid hydrodynamics (GSH) belongs to the first, DEM, granular kinetic theory and athermal statistical mechanics (ASM) to the second. A careful discussion of their conceptual differences is given here. Three noteworthy insights or results are: (1) While DEM and granular kinetic theory are well justified to take grains as elementary, any athermal entropic consideration is bound to run into trouble. (2) Many general principles are taken as invalid in granular media. Yet within the thermal approach, energy conservation and fluctuation-dissipation theorem remain valid, granular temperatures equilibrate, and phase space is well explored in a grain at rest. Hence these are abnormalities of the athermal approximation, not of granular media as such. (3) GSH is a wide-ranged continuum mechanical description of granular dynamics.
FRW solutions and holography from uplifted AdS/CFT systems
NASA Astrophysics Data System (ADS)
Dong, Xi; Horn, Bart; Matsuura, Shunji; Silverstein, Eva; Torroba, Gonzalo
2012-05-01
Starting from concrete AdS/CFT dual pairs, one can introduce ingredients which produce cosmological solutions, including metastable de Sitter and its decay to nonaccelerating Friedmann-Robertson-Walker. We present simple Friedmann-Robertson-Walker solutions sourced by magnetic flavor branes and analyze correlation functions and particle and brane dynamics. To obtain a holographic description, we exhibit a time-dependent warped metric on the solution and interpret the resulting redshifted region as a Lorentzian low energy effective field theory in one fewer dimension. At finite times, this theory has a finite cutoff, a propagating lower-dimensional graviton, and a finite covariant entropy bound, but at late times the lower-dimensional Planck mass and entropy go off to infinity in a way that is dominated by contributions from the low energy effective theory. This opens up the possibility of a precise dual at late times. We reproduce the time-dependent growth of the number of degrees of freedom in the system via a count of available microscopic states in the corresponding magnetic brane construction.
NASA Astrophysics Data System (ADS)
Wang, WenBin; Wu, ZiNiu; Wang, ChunFeng; Hu, RuiFeng
2013-11-01
A model based on a thermodynamic approach is proposed for predicting the dynamics of communicable epidemics assumed to be governed by controlling efforts of multiple scales so that an entropy is associated with the system. All the epidemic details are factored into a single and time-dependent coefficient, the functional form of this coefficient is found through four constraints, including notably the existence of an inflexion point and a maximum. The model is solved to give a log-normal distribution for the spread rate, for which a Shannon entropy can be defined. The only parameter, that characterizes the width of the distribution function, is uniquely determined through maximizing the rate of entropy production. This entropy-based thermodynamic (EBT) model predicts the number of hospitalized cases with a reasonable accuracy for SARS in the year 2003. This EBT model can be of use for potential epidemics such as avian influenza and H7N9 in China.
The Conditional Entropy Power Inequality for Bosonic Quantum Systems
NASA Astrophysics Data System (ADS)
De Palma, Giacomo; Trevisan, Dario
2018-06-01
We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under the heat semigroup evolution. The beam-splitter and the squeezing are the central elements of quantum optics, and can model the attenuation, the amplification and the noise of electromagnetic signals. This conditional Entropy Power Inequality will have a strong impact in quantum information and quantum cryptography. Among its many possible applications there is the proof of a new uncertainty relation for the conditional Wehrl entropy.
The Conditional Entropy Power Inequality for Bosonic Quantum Systems
NASA Astrophysics Data System (ADS)
De Palma, Giacomo; Trevisan, Dario
2018-01-01
We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under the heat semigroup evolution. The beam-splitter and the squeezing are the central elements of quantum optics, and can model the attenuation, the amplification and the noise of electromagnetic signals. This conditional Entropy Power Inequality will have a strong impact in quantum information and quantum cryptography. Among its many possible applications there is the proof of a new uncertainty relation for the conditional Wehrl entropy.
Entropy and generalized least square methods in assessment of the regional value of streamgages
Markus, M.; Vernon, Knapp H.; Tasker, Gary D.
2003-01-01
The Illinois State Water Survey performed a study to assess the streamgaging network in the State of Illinois. One of the important aspects of the study was to assess the regional value of each station through an assessment of the information transfer among gaging records for low, average, and high flow conditions. This analysis was performed for the main hydrologic regions in the State, and the stations were initially evaluated using a new approach based on entropy analysis. To determine the regional value of each station within a region, several information parameters, including total net information, were defined based on entropy. Stations were ranked based on the total net information. For comparison, the regional value of the same stations was assessed using the generalized least square regression (GLS) method, developed by the US Geological Survey. Finally, a hybrid combination of GLS and entropy was created by including a function of the negative net information as a penalty function in the GLS. The weights of the combined model were determined to maximize the average correlation with the results of GLS and entropy. The entropy and GLS methods were evaluated using the high-flow data from southern Illinois stations. The combined method was compared with the entropy and GLS approaches using the high-flow data from eastern Illinois stations. ?? 2003 Elsevier B.V. All rights reserved.
An entropy model to measure heterogeneity of pedestrian crowds using self-propelled agents
NASA Astrophysics Data System (ADS)
Rangel-Huerta, A.; Ballinas-Hernández, A. L.; Muñoz-Meléndez, A.
2017-05-01
An entropy model to characterize the heterogeneity of a pedestrian crowd in a counter-flow corridor is presented. Pedestrians are modeled as self-propelled autonomous agents that are able to perform maneuvers to avoid collisions based on a set of simple rules of perception and action. An observer can determine a probability distribution function of the displayed behavior of pedestrians based only on external information. Three types of pedestrian are modeled, relaxed, standard and hurried pedestrians depending on their preferences of turn and non-turn when walking. Thus, using these types of pedestrians two crowds can be simulated: homogeneous and heterogeneous crowds. Heterogeneity is measured in this research based on the entropy in function of time. For that, the entropy of a homogeneous crowd comprising standard pedestrians is used as reference. A number of simulations to measure entropy of pedestrian crowds were conducted by varying different combinations of types of pedestrians, initial simulation conditions of macroscopic flow, as well as density of the crowd. Results from these simulations show that our entropy model is sensitive enough to capture the effect of both the initial simulation conditions about the spatial distribution of pedestrians in a corridor, and the composition of a crowd. Also, a relevant finding is that entropy in function of density presents a phase transition in the critical region.
Long memory and volatility clustering: Is the empirical evidence consistent across stock markets?
NASA Astrophysics Data System (ADS)
Bentes, Sónia R.; Menezes, Rui; Mendes, Diana A.
2008-06-01
Long memory and volatility clustering are two stylized facts frequently related to financial markets. Traditionally, these phenomena have been studied based on conditionally heteroscedastic models like ARCH, GARCH, IGARCH and FIGARCH, inter alia. One advantage of these models is their ability to capture nonlinear dynamics. Another interesting manner to study the volatility phenomenon is by using measures based on the concept of entropy. In this paper we investigate the long memory and volatility clustering for the SP 500, NASDAQ 100 and Stoxx 50 indexes in order to compare the US and European Markets. Additionally, we compare the results from conditionally heteroscedastic models with those from the entropy measures. In the latter, we examine Shannon entropy, Renyi entropy and Tsallis entropy. The results corroborate the previous evidence of nonlinear dynamics in the time series considered.
NASA Astrophysics Data System (ADS)
Kulkarni, Girish; Subrahmanyam, V.; Jha, Anand K.
2016-06-01
We study how one-particle correlations transfer to manifest as two-particle correlations in the context of parametric down-conversion (PDC), a process in which a pump photon is annihilated to produce two entangled photons. We work in the polarization degree of freedom and show that for any two-qubit generation process that is both trace-preserving and entropy-nondecreasing, the concurrence C (ρ ) of the generated two-qubit state ρ follows an intrinsic upper bound with C (ρ )≤(1 +P )/2 , where P is the degree of polarization of the pump photon. We also find that for the class of two-qubit states that is restricted to have only two nonzero diagonal elements such that the effective dimensionality of the two-qubit state is the same as the dimensionality of the pump polarization state, the upper bound on concurrence is the degree of polarization itself, that is, C (ρ )≤P . Our work shows that the maximum manifestation of two-particle correlations as entanglement is dictated by one-particle correlations. The formalism developed in this work can be extended to include multiparticle systems and can thus have important implications towards deducing the upper bounds on multiparticle entanglement, for which no universally accepted measure exists.
Fundamental limits of repeaterless quantum communications
Pirandola, Stefano; Laurenza, Riccardo; Ottaviani, Carlo; Banchi, Leonardo
2017-01-01
Quantum communications promises reliable transmission of quantum information, efficient distribution of entanglement and generation of completely secure keys. For all these tasks, we need to determine the optimal point-to-point rates that are achievable by two remote parties at the ends of a quantum channel, without restrictions on their local operations and classical communication, which can be unlimited and two-way. These two-way assisted capacities represent the ultimate rates that are reachable without quantum repeaters. Here, by constructing an upper bound based on the relative entropy of entanglement and devising a dimension-independent technique dubbed ‘teleportation stretching', we establish these capacities for many fundamental channels, namely bosonic lossy channels, quantum-limited amplifiers, dephasing and erasure channels in arbitrary dimension. In particular, we exactly determine the fundamental rate-loss tradeoff affecting any protocol of quantum key distribution. Our findings set the limits of point-to-point quantum communications and provide precise and general benchmarks for quantum repeaters. PMID:28443624
Fundamental limits of repeaterless quantum communications.
Pirandola, Stefano; Laurenza, Riccardo; Ottaviani, Carlo; Banchi, Leonardo
2017-04-26
Quantum communications promises reliable transmission of quantum information, efficient distribution of entanglement and generation of completely secure keys. For all these tasks, we need to determine the optimal point-to-point rates that are achievable by two remote parties at the ends of a quantum channel, without restrictions on their local operations and classical communication, which can be unlimited and two-way. These two-way assisted capacities represent the ultimate rates that are reachable without quantum repeaters. Here, by constructing an upper bound based on the relative entropy of entanglement and devising a dimension-independent technique dubbed 'teleportation stretching', we establish these capacities for many fundamental channels, namely bosonic lossy channels, quantum-limited amplifiers, dephasing and erasure channels in arbitrary dimension. In particular, we exactly determine the fundamental rate-loss tradeoff affecting any protocol of quantum key distribution. Our findings set the limits of point-to-point quantum communications and provide precise and general benchmarks for quantum repeaters.
NASA Astrophysics Data System (ADS)
Liu, Haixing; Savić, Dragan; Kapelan, Zoran; Zhao, Ming; Yuan, Yixing; Zhao, Hongbin
2014-07-01
Flow entropy is a measure of uniformity of pipe flows in water distribution systems. By maximizing flow entropy one can identify reliable layouts or connectivity in networks. In order to overcome the disadvantage of the common definition of flow entropy that does not consider the impact of pipe diameter on reliability, an extended definition of flow entropy, termed as diameter-sensitive flow entropy, is proposed. This new methodology is then assessed by using other reliability methods, including Monte Carlo Simulation, a pipe failure probability model, and a surrogate measure (resilience index) integrated with water demand and pipe failure uncertainty. The reliability assessment is based on a sample of WDS designs derived from an optimization process for each of the two benchmark networks. Correlation analysis is used to evaluate quantitatively the relationship between entropy and reliability. To ensure reliability, a comparative analysis between the flow entropy and the new method is conducted. The results demonstrate that the diameter-sensitive flow entropy shows consistently much stronger correlation with the three reliability measures than simple flow entropy. Therefore, the new flow entropy method can be taken as a better surrogate measure for reliability and could be potentially integrated into the optimal design problem of WDSs. Sensitivity analysis results show that the velocity parameters used in the new flow entropy has no significant impact on the relationship between diameter-sensitive flow entropy and reliability.
Meirovitch, Hagai
2010-01-01
The commonly used simulation techniques, Metropolis Monte Carlo (MC) and molecular dynamics (MD) are of a dynamical type which enables one to sample system configurations i correctly with the Boltzmann probability, P(i)(B), while the value of P(i)(B) is not provided directly; therefore, it is difficult to obtain the absolute entropy, S approximately -ln P(i)(B), and the Helmholtz free energy, F. With a different simulation approach developed in polymer physics, a chain is grown step-by-step with transition probabilities (TPs), and thus their product is the value of the construction probability; therefore, the entropy is known. Because all exact simulation methods are equivalent, i.e. they lead to the same averages and fluctuations of physical properties, one can treat an MC or MD sample as if its members have rather been generated step-by-step. Thus, each configuration i of the sample can be reconstructed (from nothing) by calculating the TPs with which it could have been constructed. This idea applies also to bulk systems such as fluids or magnets. This approach has led earlier to the "local states" (LS) and the "hypothetical scanning" (HS) methods, which are approximate in nature. A recent development is the hypothetical scanning Monte Carlo (HSMC) (or molecular dynamics, HSMD) method which is based on stochastic TPs where all interactions are taken into account. In this respect, HSMC(D) can be viewed as exact and the only approximation involved is due to insufficient MC(MD) sampling for calculating the TPs. The validity of HSMC has been established by applying it first to liquid argon, TIP3P water, self-avoiding walks (SAW), and polyglycine models, where the results for F were found to agree with those obtained by other methods. Subsequently, HSMD was applied to mobile loops of the enzymes porcine pancreatic alpha-amylase and acetylcholinesterase in explicit water, where the difference in F between the bound and free states of the loop was calculated. Currently, HSMD is being extended for calculating the absolute and relative free energies of ligand-enzyme binding. We describe the whole approach and discuss future directions. 2009 John Wiley & Sons, Ltd.
Monogamy Inequality for Any Local Quantum Resource and Entanglement.
Camalet, S
2017-09-15
We derive a monogamy inequality for any local quantum resource and entanglement. It results from the fact that there is always a convex measure for a quantum resource, as shown here, and from the relation between entanglement and local entropy. One of its consequences is an entanglement monogamy different from that usually discussed. If the local resource is nonuniformity or coherence, it is satisfied by familiar resource and entanglement measures. The ensuing upper bound for the local coherence, determined by the entanglement, is independent of the basis used to define the coherence.
Has the QCD critical point been signaled by observations at the BNL relativistic heavy ion collider?
Lacey, Roy A; Ajitanand, N N; Alexander, J M; Chung, P; Holzmann, W G; Issah, M; Taranenko, A; Danielewicz, P; Stöcker, Horst
2007-03-02
The shear viscosity to entropy ratio (eta/s) is estimated for the hot and dense QCD matter created in Au+Au collisions at BNL Relativistic Heavy Ion Collider (square root[s_{NN}]=200 GeV). A very low value is found; eta/s approximately 0.1, which is close to the conjectured lower bound (1/4pi). It is argued that such a low value is indicative of thermodynamic trajectories for the decaying matter which lie close to the QCD critical end point.
Monogamy Inequality for Any Local Quantum Resource and Entanglement
NASA Astrophysics Data System (ADS)
Camalet, S.
2017-09-01
We derive a monogamy inequality for any local quantum resource and entanglement. It results from the fact that there is always a convex measure for a quantum resource, as shown here, and from the relation between entanglement and local entropy. One of its consequences is an entanglement monogamy different from that usually discussed. If the local resource is nonuniformity or coherence, it is satisfied by familiar resource and entanglement measures. The ensuing upper bound for the local coherence, determined by the entanglement, is independent of the basis used to define the coherence.
An entropy-based analysis of lane changing behavior: An interactive approach.
Kosun, Caglar; Ozdemir, Serhan
2017-05-19
As a novelty, this article proposes the nonadditive entropy framework for the description of driver behaviors during lane changing. The authors also state that this entropy framework governs the lane changing behavior in traffic flow in accordance with the long-range vehicular interactions and traffic safety. The nonadditive entropy framework is the new generalized theory of thermostatistical mechanics. Vehicular interactions during lane changing are considered within this framework. The interactive approach for the lane changing behavior of the drivers is presented in the traffic flow scenarios presented in the article. According to the traffic flow scenarios, 4 categories of traffic flow and driver behaviors are obtained. Through the scenarios, comparative analyses of nonadditive and additive entropy domains are also provided. Two quadrants of the categories belong to the nonadditive entropy; the rest are involved in the additive entropy domain. Driving behaviors are extracted and the scenarios depict that nonadditivity matches safe driving well, whereas additivity corresponds to unsafe driving. Furthermore, the cooperative traffic system is considered in nonadditivity where the long-range interactions are present. However, the uncooperative traffic system falls into the additivity domain. The analyses also state that there would be possible traffic flow transitions among the quadrants. This article shows that lane changing behavior could be generalized as nonadditive, with additivity as a special case, based on the given traffic conditions. The nearest and close neighbor models are well within the conventional additive entropy framework. In this article, both the long-range vehicular interactions and safe driving behavior in traffic are handled in the nonadditive entropy domain. It is also inferred that the Tsallis entropy region would correspond to mandatory lane changing behavior, whereas additive and either the extensive or nonextensive entropy region would match discretionary lane changing behavior. This article states that driver behaviors would be in the nonadditive entropy domain to provide a safe traffic stream and hence with vehicle accident prevention in mind.
Quantum thermodynamics and quantum entanglement entropies in an expanding universe
NASA Astrophysics Data System (ADS)
Farahmand, Mehrnoosh; Mohammadzadeh, Hosein; Mehri-Dehnavi, Hossein
2017-05-01
We investigate an asymptotically spatially flat Robertson-Walker space-time from two different perspectives. First, using von Neumann entropy, we evaluate the entanglement generation due to the encoded information in space-time. Then, we work out the entropy of particle creation based on the quantum thermodynamics of the scalar field on the underlying space-time. We show that the general behavior of both entropies are the same. Therefore, the entanglement can be applied to the customary quantum thermodynamics of the universe. Also, using these entropies, we can recover some information about the parameters of space-time.
Measuring Gaussian quantum information and correlations using the Rényi entropy of order 2.
Adesso, Gerardo; Girolami, Davide; Serafini, Alessio
2012-11-09
We demonstrate that the Rényi-2 entropy provides a natural measure of information for any multimode Gaussian state of quantum harmonic systems, operationally linked to the phase-space Shannon sampling entropy of the Wigner distribution of the state. We prove that, in the Gaussian scenario, such an entropy satisfies the strong subadditivity inequality, a key requirement for quantum information theory. This allows us to define and analyze measures of Gaussian entanglement and more general quantum correlations based on such an entropy, which are shown to satisfy relevant properties such as monogamy.
NASA Astrophysics Data System (ADS)
Zhao, Hui; Qu, Weilu; Qiu, Weiting
2018-03-01
In order to evaluate sustainable development level of resource-based cities, an evaluation method with Shapely entropy and Choquet integral is proposed. First of all, a systematic index system is constructed, the importance of each attribute is calculated based on the maximum Shapely entropy principle, and then the Choquet integral is introduced to calculate the comprehensive evaluation value of each city from the bottom up, finally apply this method to 10 typical resource-based cities in China. The empirical results show that the evaluation method is scientific and reasonable, which provides theoretical support for the sustainable development path and reform direction of resource-based cities.
Particle physics catalysis of thermal big bang nucleosynthesis.
Pospelov, Maxim
2007-06-08
We point out that the existence of metastable, tau>10(3) s, negatively charged electroweak-scale particles (X-) alters the predictions for lithium and other primordial elemental abundances for A>4 via the formation of bound states with nuclei during big bang nucleosynthesis. In particular, we show that the bound states of X- with helium, formed at temperatures of about T=10(8) K, lead to the catalytic enhancement of 6Li production, which is 8 orders of magnitude more efficient than the standard channel. In particle physics models where subsequent decay of X- does not lead to large nonthermal big bang nucleosynthesis effects, this directly translates to the level of sensitivity to the number density of long-lived X- particles (tau>10(5) s) relative to entropy of nX-/s less, approximately <3x10(-17), which is one of the most stringent probes of electroweak scale remnants known to date.
Highly entangled states with almost no secrecy.
Christandl, Matthias; Schuch, Norbert; Winter, Andreas
2010-06-18
In this Letter we illuminate the relation between entanglement and secrecy by providing the first example of a quantum state that is highly entangled, but from which, nevertheless, almost no secrecy can be extracted. More precisely, we provide two bounds on the bipartite entanglement of the totally antisymmetric state in dimension d×d. First, we show that the amount of secrecy that can be extracted from the state is low; to be precise it is bounded by O(1/d). Second, we show that the state is highly entangled in the sense that we need a large amount of singlets to create the state: entanglement cost is larger than a constant, independent of d. In order to obtain our results we use representation theory, linear programming, and the entanglement measure known as squashed entanglement. Our findings also clarify the relation between the squashed entanglement and the relative entropy of entanglement.
Extracting quantum coherence via steering
Hu, Xueyuan; Fan, Heng
2016-01-01
As the precious resource for quantum information processing, quantum coherence can be created remotely if the involved two sites are quantum correlated. It can be expected that the amount of coherence created should depend on the quantity of the shared quantum correlation, which is also a resource. Here, we establish an operational connection between coherence induced by steering and the quantum correlation. We find that the steering-induced coherence quantified by such as relative entropy of coherence and trace-norm of coherence is bounded from above by a known quantum correlation measure defined as the one-side measurement-induced disturbance. The condition that the upper bound saturated by the induced coherence varies for different measures of coherence. The tripartite scenario is also studied and similar conclusion can be obtained. Our results provide the operational connections between local and non-local resources in quantum information processing. PMID:27682450
NASA Astrophysics Data System (ADS)
Mao, Chao; Chen, Shou
2017-01-01
According to the traditional entropy value method still have low evaluation accuracy when evaluating the performance of mining projects, a performance evaluation model of mineral project founded on improved entropy is proposed. First establish a new weight assignment model founded on compatible matrix analysis of analytic hierarchy process (AHP) and entropy value method, when the compatibility matrix analysis to achieve consistency requirements, if it has differences between subjective weights and objective weights, moderately adjust both proportions, then on this basis, the fuzzy evaluation matrix for performance evaluation. The simulation experiments show that, compared with traditional entropy and compatible matrix analysis method, the proposed performance evaluation model of mining project based on improved entropy value method has higher accuracy assessment.
Marsh, J. N.; Wallace, K. D.; McCarthy, J. E.; Wickerhauser, M. V.; Maurizi, B. N.; Lanza, G. M.; Wickline, S. A.; Hughes, M. S.
2011-01-01
Previously, we reported new methods for ultrasound signal characterization using entropy, Hf; a generalized entropy, the Renyi entropy, If(r); and a limiting form of Renyi entropy suitable for real-time calculation, If,∞. All of these quantities demonstrated significantly more sensitivity to subtle changes in scattering architecture than energy-based methods in certain settings. In this study, the real-time calculable limit of the Renyi entropy, If,∞, is applied for the imaging of angiogenic murine neovasculature in a breast cancer xenograft using a targeted contrast agent. It is shown that this approach may be used to detect reliably the accumulation of targeted nanoparticles at five minutes post-injection in this in vivo model. PMID:20679020
Generalized permutation entropy analysis based on the two-index entropic form S q , δ
NASA Astrophysics Data System (ADS)
Xu, Mengjia; Shang, Pengjian
2015-05-01
Permutation entropy (PE) is a novel measure to quantify the complexity of nonlinear time series. In this paper, we propose a generalized permutation entropy ( P E q , δ ) based on the recently postulated entropic form, S q , δ , which was proposed as an unification of the well-known Sq of nonextensive-statistical mechanics and S δ , a possibly appropriate candidate for the black-hole entropy. We find that P E q , δ with appropriate parameters can amplify minor changes and trends of complexities in comparison to PE. Experiments with this generalized permutation entropy method are performed with both synthetic and stock data showing its power. Results show that P E q , δ is an exponential function of q and the power ( k ( δ ) ) is a constant if δ is determined. Some discussions about k ( δ ) are provided. Besides, we also find some interesting results about power law.
Generalized sample entropy analysis for traffic signals based on similarity measure
NASA Astrophysics Data System (ADS)
Shang, Du; Xu, Mengjia; Shang, Pengjian
2017-05-01
Sample entropy is a prevailing method used to quantify the complexity of a time series. In this paper a modified method of generalized sample entropy and surrogate data analysis is proposed as a new measure to assess the complexity of a complex dynamical system such as traffic signals. The method based on similarity distance presents a different way of signals patterns match showing distinct behaviors of complexity. Simulations are conducted over synthetic data and traffic signals for providing the comparative study, which is provided to show the power of the new method. Compared with previous sample entropy and surrogate data analysis, the new method has two main advantages. The first one is that it overcomes the limitation about the relationship between the dimension parameter and the length of series. The second one is that the modified sample entropy functions can be used to quantitatively distinguish time series from different complex systems by the similar measure.
Effect of extreme data loss on heart rate signals quantified by entropy analysis
NASA Astrophysics Data System (ADS)
Li, Yu; Wang, Jun; Li, Jin; Liu, Dazhao
2015-02-01
The phenomenon of data loss always occurs in the analysis of large databases. Maintaining the stability of analysis results in the event of data loss is very important. In this paper, we used a segmentation approach to generate a synthetic signal that is randomly wiped from data according to the Gaussian distribution and the exponential distribution of the original signal. Then, the logistic map is used as verification. Finally, two methods of measuring entropy-base-scale entropy and approximate entropy-are comparatively analyzed. Our results show the following: (1) Two key parameters-the percentage and the average length of removed data segments-can change the sequence complexity according to logistic map testing. (2) The calculation results have preferable stability for base-scale entropy analysis, which is not sensitive to data loss. (3) The loss percentage of HRV signals should be controlled below the range (p = 30 %), which can provide useful information in clinical applications.
Role of information theoretic uncertainty relations in quantum theory
DOE Office of Scientific and Technical Information (OSTI.GOV)
Jizba, Petr, E-mail: p.jizba@fjfi.cvut.cz; ITP, Freie Universität Berlin, Arnimallee 14, D-14195 Berlin; Dunningham, Jacob A., E-mail: J.Dunningham@sussex.ac.uk
2015-04-15
Uncertainty relations based on information theory for both discrete and continuous distribution functions are briefly reviewed. We extend these results to account for (differential) Rényi entropy and its related entropy power. This allows us to find a new class of information-theoretic uncertainty relations (ITURs). The potency of such uncertainty relations in quantum mechanics is illustrated with a simple two-energy-level model where they outperform both the usual Robertson–Schrödinger uncertainty relation and Shannon entropy based uncertainty relation. In the continuous case the ensuing entropy power uncertainty relations are discussed in the context of heavy tailed wave functions and Schrödinger cat states. Again,more » improvement over both the Robertson–Schrödinger uncertainty principle and Shannon ITUR is demonstrated in these cases. Further salient issues such as the proof of a generalized entropy power inequality and a geometric picture of information-theoretic uncertainty relations are also discussed.« less
Fozouni, Niloufar; Chopp, Michael; Nejad-Davarani, Siamak P.; Zhang, Zheng Gang; Lehman, Norman L.; Gu, Steven; Ueno, Yuji; Lu, Mei; Ding, Guangliang; Li, Lian; Hu, Jiani; Bagher-Ebadian, Hassan; Hearshen, David; Jiang, Quan
2013-01-01
Background To overcome the limitations of conventional diffusion tensor magnetic resonance imaging resulting from the assumption of a Gaussian diffusion model for characterizing voxels containing multiple axonal orientations, Shannon's entropy was employed to evaluate white matter structure in human brain and in brain remodeling after traumatic brain injury (TBI) in a rat. Methods Thirteen healthy subjects were investigated using a Q-ball based DTI data sampling scheme. FA and entropy values were measured in white matter bundles, white matter fiber crossing areas, different gray matter (GM) regions and cerebrospinal fluid (CSF). Axonal densities' from the same regions of interest (ROIs) were evaluated in Bielschowsky and Luxol fast blue stained autopsy (n = 30) brain sections by light microscopy. As a case demonstration, a Wistar rat subjected to TBI and treated with bone marrow stromal cells (MSC) 1 week after TBI was employed to illustrate the superior ability of entropy over FA in detecting reorganized crossing axonal bundles as confirmed by histological analysis with Bielschowsky and Luxol fast blue staining. Results Unlike FA, entropy was less affected by axonal orientation and more affected by axonal density. A significant agreement (r = 0.91) was detected between entropy values from in vivo human brain and histologically measured axonal density from post mortum from the same brain structures. The MSC treated TBI rat demonstrated that the entropy approach is superior to FA in detecting axonal remodeling after injury. Compared with FA, entropy detected new axonal remodeling regions with crossing axons, confirmed with immunohistological staining. Conclusions Entropy measurement is more effective in distinguishing axonal remodeling after injury, when compared with FA. Entropy is also more sensitive to axonal density than axonal orientation, and thus may provide a more accurate reflection of axonal changes that occur in neurological injury and disease. PMID:24143186
Fozouni, Niloufar; Chopp, Michael; Nejad-Davarani, Siamak P; Zhang, Zheng Gang; Lehman, Norman L; Gu, Steven; Ueno, Yuji; Lu, Mei; Ding, Guangliang; Li, Lian; Hu, Jiani; Bagher-Ebadian, Hassan; Hearshen, David; Jiang, Quan
2013-01-01
To overcome the limitations of conventional diffusion tensor magnetic resonance imaging resulting from the assumption of a Gaussian diffusion model for characterizing voxels containing multiple axonal orientations, Shannon's entropy was employed to evaluate white matter structure in human brain and in brain remodeling after traumatic brain injury (TBI) in a rat. Thirteen healthy subjects were investigated using a Q-ball based DTI data sampling scheme. FA and entropy values were measured in white matter bundles, white matter fiber crossing areas, different gray matter (GM) regions and cerebrospinal fluid (CSF). Axonal densities' from the same regions of interest (ROIs) were evaluated in Bielschowsky and Luxol fast blue stained autopsy (n = 30) brain sections by light microscopy. As a case demonstration, a Wistar rat subjected to TBI and treated with bone marrow stromal cells (MSC) 1 week after TBI was employed to illustrate the superior ability of entropy over FA in detecting reorganized crossing axonal bundles as confirmed by histological analysis with Bielschowsky and Luxol fast blue staining. Unlike FA, entropy was less affected by axonal orientation and more affected by axonal density. A significant agreement (r = 0.91) was detected between entropy values from in vivo human brain and histologically measured axonal density from post mortum from the same brain structures. The MSC treated TBI rat demonstrated that the entropy approach is superior to FA in detecting axonal remodeling after injury. Compared with FA, entropy detected new axonal remodeling regions with crossing axons, confirmed with immunohistological staining. Entropy measurement is more effective in distinguishing axonal remodeling after injury, when compared with FA. Entropy is also more sensitive to axonal density than axonal orientation, and thus may provide a more accurate reflection of axonal changes that occur in neurological injury and disease.
Beyond the Shannon–Khinchin formulation: The composability axiom and the universal-group entropy
DOE Office of Scientific and Technical Information (OSTI.GOV)
Tempesta, Piergiulio, E-mail: p.tempesta@fis.ucm.es
2016-02-15
The notion of entropy is ubiquitous both in natural and social sciences. In the last two decades, a considerable effort has been devoted to the study of new entropic forms, which generalize the standard Boltzmann–Gibbs (BG) entropy and could be applicable in thermodynamics, quantum mechanics and information theory. In Khinchin (1957), by extending previous ideas of Shannon (1948) and Shannon and Weaver (1949), Khinchin proposed a characterization of the BG entropy, based on four requirements, nowadays known as the Shannon–Khinchin (SK) axioms. The purpose of this paper is twofold. First, we show that there exists an intrinsic group-theoretical structure behindmore » the notion of entropy. It comes from the requirement of composability of an entropy with respect to the union of two statistically independent systems, that we propose in an axiomatic formulation. Second, we show that there exists a simple universal family of trace-form entropies. This class contains many well known examples of entropies and infinitely many new ones, a priori multi-parametric. Due to its specific relation with Lazard’s universal formal group of algebraic topology, the new general entropy introduced in this work will be called the universal-group entropy. A new example of multi-parametric entropy is explicitly constructed.« less
Finite-time braiding exponents
NASA Astrophysics Data System (ADS)
Budišić, Marko; Thiffeault, Jean-Luc
2015-08-01
Topological entropy of a dynamical system is an upper bound for the sum of positive Lyapunov exponents; in practice, it is strongly indicative of the presence of mixing in a subset of the domain. Topological entropy can be computed by partition methods, by estimating the maximal growth rate of material lines or other material elements, or by counting the unstable periodic orbits of the flow. All these methods require detailed knowledge of the velocity field that is not always available, for example, when ocean flows are measured using a small number of floating sensors. We propose an alternative calculation, applicable to two-dimensional flows, that uses only a sparse set of flow trajectories as its input. To represent the sparse set of trajectories, we use braids, algebraic objects that record how trajectories exchange positions with respect to a projection axis. Material curves advected by the flow are represented as simplified loop coordinates. The exponential rate at which a braid stretches loops over a finite time interval is the Finite-Time Braiding Exponent (FTBE). We study FTBEs through numerical simulations of the Aref Blinking Vortex flow, as a representative of a general class of flows having a single invariant component with positive topological entropy. The FTBEs approach the value of the topological entropy from below as the length and number of trajectories is increased; we conjecture that this result holds for a general class of ergodic, mixing systems. Furthermore, FTBEs are computed robustly with respect to the numerical time step, details of braid representation, and choice of initial conditions. We find that, in the class of systems we describe, trajectories can be re-used to form different braids, which greatly reduces the amount of data needed to assess the complexity of the flow.
Finite-time braiding exponents.
Budišić, Marko; Thiffeault, Jean-Luc
2015-08-01
Topological entropy of a dynamical system is an upper bound for the sum of positive Lyapunov exponents; in practice, it is strongly indicative of the presence of mixing in a subset of the domain. Topological entropy can be computed by partition methods, by estimating the maximal growth rate of material lines or other material elements, or by counting the unstable periodic orbits of the flow. All these methods require detailed knowledge of the velocity field that is not always available, for example, when ocean flows are measured using a small number of floating sensors. We propose an alternative calculation, applicable to two-dimensional flows, that uses only a sparse set of flow trajectories as its input. To represent the sparse set of trajectories, we use braids, algebraic objects that record how trajectories exchange positions with respect to a projection axis. Material curves advected by the flow are represented as simplified loop coordinates. The exponential rate at which a braid stretches loops over a finite time interval is the Finite-Time Braiding Exponent (FTBE). We study FTBEs through numerical simulations of the Aref Blinking Vortex flow, as a representative of a general class of flows having a single invariant component with positive topological entropy. The FTBEs approach the value of the topological entropy from below as the length and number of trajectories is increased; we conjecture that this result holds for a general class of ergodic, mixing systems. Furthermore, FTBEs are computed robustly with respect to the numerical time step, details of braid representation, and choice of initial conditions. We find that, in the class of systems we describe, trajectories can be re-used to form different braids, which greatly reduces the amount of data needed to assess the complexity of the flow.
Rogue waves and entropy consumption
NASA Astrophysics Data System (ADS)
Hadjihoseini, Ali; Lind, Pedro G.; Mori, Nobuhito; Hoffmann, Norbert P.; Peinke, Joachim
2017-11-01
Based on data from the Sea of Japan and the North Sea the occurrence of rogue waves is analyzed by a scale-dependent stochastic approach, which interlinks fluctuations of waves for different spacings. With this approach we are able to determine a stochastic cascade process, which provides information of the general multipoint statistics. Furthermore the evolution of single trajectories in scale, which characterize wave height fluctuations in the surroundings of a chosen location, can be determined. The explicit knowledge of the stochastic process enables to assign entropy values to all wave events. We show that for these entropies the integral fluctuation theorem, a basic law of non-equilibrium thermodynamics, is valid. This implies that positive and negative entropy events must occur. Extreme events like rogue waves are characterized as negative entropy events. The statistics of these entropy fluctuations changes with the wave state, thus for the Sea of Japan the statistics of the entropies has a more pronounced tail for negative entropy values, indicating a higher probability of rogue waves.
Communication, Correlation and Complementarity
NASA Astrophysics Data System (ADS)
Schumacher, Benjamin Wade
1990-01-01
In quantum communication, a sender prepares a quantum system in a state corresponding to his message and conveys it to a receiver, who performs a measurement on it. The receiver acquires information about the message based on the outcome of his measurement. Since the state of a single quantum system is not always completely determinable from measurement, quantum mechanics limits the information capacity of such channels. According to a theorem of Kholevo, the amount of information conveyed by the channel can be no greater than the entropy of the ensemble of possible physical signals. The connection between information and entropy allows general theorems to be proved regarding the energy requirements of communication. For example, it can be shown that one particular quantum coding scheme, called thermal coding, uses energy with maximum efficiency. A close analogy between communication and quantum correlation can be made using Everett's notion of relative states. Kholevo's theorem can be used to prove that the mutual information of a pair of observables on different systems is bounded by the entropy of the state of each system. This confirms and extends an old conjecture of Everett. The complementarity of quantum observables can be described by information-theoretic uncertainty relations, several of which have been previously derived. These relations imply limits on the degree to which different messages can be coded in complementary observables of a single channel. Complementarity also restricts the amount of information that can be recovered from a given channel using a given decoding observable. Information inequalities can be derived which are analogous to the well-known Bell inequalities for correlated quantum systems. These inequalities are satisfied for local hidden variable theories but are violated by quantum systems, even where the correlation is weak. These information inequalities are metric inequalities for an "information distance", and their structure can be made exactly analogous to that of the familiar covariance Bell inequalities by introducing a "covariance distance". Similar inequalities derived for successive measurements on a single system are also violated in quantum mechanics.
Filter-based multiscale entropy analysis of complex physiological time series.
Xu, Yuesheng; Zhao, Liang
2013-08-01
Multiscale entropy (MSE) has been widely and successfully used in analyzing the complexity of physiological time series. We reinterpret the averaging process in MSE as filtering a time series by a filter of a piecewise constant type. From this viewpoint, we introduce filter-based multiscale entropy (FME), which filters a time series to generate multiple frequency components, and then we compute the blockwise entropy of the resulting components. By choosing filters adapted to the feature of a given time series, FME is able to better capture its multiscale information and to provide more flexibility for studying its complexity. Motivated by the heart rate turbulence theory, which suggests that the human heartbeat interval time series can be described in piecewise linear patterns, we propose piecewise linear filter multiscale entropy (PLFME) for the complexity analysis of the time series. Numerical results from PLFME are more robust to data of various lengths than those from MSE. The numerical performance of the adaptive piecewise constant filter multiscale entropy without prior information is comparable to that of PLFME, whose design takes prior information into account.
Entropy-Based Registration of Point Clouds Using Terrestrial Laser Scanning and Smartphone GPS.
Chen, Maolin; Wang, Siying; Wang, Mingwei; Wan, Youchuan; He, Peipei
2017-01-20
Automatic registration of terrestrial laser scanning point clouds is a crucial but unresolved topic that is of great interest in many domains. This study combines terrestrial laser scanner with a smartphone for the coarse registration of leveled point clouds with small roll and pitch angles and height differences, which is a novel sensor combination mode for terrestrial laser scanning. The approximate distance between two neighboring scan positions is firstly calculated with smartphone GPS coordinates. Then, 2D distribution entropy is used to measure the distribution coherence between the two scans and search for the optimal initial transformation parameters. To this end, we propose a method called Iterative Minimum Entropy (IME) to correct initial transformation parameters based on two criteria: the difference between the average and minimum entropy and the deviation from the minimum entropy to the expected entropy. Finally, the presented method is evaluated using two data sets that contain tens of millions of points from panoramic and non-panoramic, vegetation-dominated and building-dominated cases and can achieve high accuracy and efficiency.
Irreversible entropy model for damage diagnosis in resistors
DOE Office of Scientific and Technical Information (OSTI.GOV)
Cuadras, Angel, E-mail: angel.cuadras@upc.edu; Crisóstomo, Javier; Ovejas, Victoria J.
2015-10-28
We propose a method to characterize electrical resistor damage based on entropy measurements. Irreversible entropy and the rate at which it is generated are more convenient parameters than resistance for describing damage because they are essentially positive in virtue of the second law of thermodynamics, whereas resistance may increase or decrease depending on the degradation mechanism. Commercial resistors were tested in order to characterize the damage induced by power surges. Resistors were biased with constant and pulsed voltage signals, leading to power dissipation in the range of 4–8 W, which is well above the 0.25 W nominal power to initiate failure. Entropymore » was inferred from the added power and temperature evolution. A model is proposed to understand the relationship among resistance, entropy, and damage. The power surge dissipates into heat (Joule effect) and damages the resistor. The results show a correlation between entropy generation rate and resistor failure. We conclude that damage can be conveniently assessed from irreversible entropy generation. Our results for resistors can be easily extrapolated to other systems or machines that can be modeled based on their resistance.« less
Entropy Measurement for Biometric Verification Systems.
Lim, Meng-Hui; Yuen, Pong C
2016-05-01
Biometric verification systems are designed to accept multiple similar biometric measurements per user due to inherent intrauser variations in the biometric data. This is important to preserve reasonable acceptance rate of genuine queries and the overall feasibility of the recognition system. However, such acceptance of multiple similar measurements decreases the imposter's difficulty of obtaining a system-acceptable measurement, thus resulting in a degraded security level. This deteriorated security needs to be measurable to provide truthful security assurance to the users. Entropy is a standard measure of security. However, the entropy formula is applicable only when there is a single acceptable possibility. In this paper, we develop an entropy-measuring model for biometric systems that accepts multiple similar measurements per user. Based on the idea of guessing entropy, the proposed model quantifies biometric system security in terms of adversarial guessing effort for two practical attacks. Excellent agreement between analytic and experimental simulation-based measurement results on a synthetic and a benchmark face dataset justify the correctness of our model and thus the feasibility of the proposed entropy-measuring approach.
Dispersion entropy for the analysis of resting-state MEG regularity in Alzheimer's disease.
Azami, Hamed; Rostaghi, Mostafa; Fernandez, Alberto; Escudero, Javier
2016-08-01
Alzheimer's disease (AD) is a progressive degenerative brain disorder affecting memory, thinking, behaviour and emotion. It is the most common form of dementia and a big social problem in western societies. The analysis of brain activity may help to diagnose this disease. Changes in entropy methods have been reported useful in research studies to characterize AD. We have recently proposed dispersion entropy (DisEn) as a very fast and powerful tool to quantify the irregularity of time series. The aim of this paper is to evaluate the ability of DisEn, in comparison with fuzzy entropy (FuzEn), sample entropy (SampEn), and permutation entropy (PerEn), to discriminate 36 AD patients from 26 elderly control subjects using resting-state magnetoencephalogram (MEG) signals. The results obtained by DisEn, FuzEn, and SampEn, unlike PerEn, show that the AD patients' signals are more regular than controls' time series. The p-values obtained by DisEn, FuzEn, SampEn, and PerEn based methods demonstrate the superiority of DisEn over PerEn, SampEn, and PerEn. Moreover, the computation time for the newly proposed DisEn-based method is noticeably less than for the FuzEn, SampEn, and PerEn based approaches.
NASA Astrophysics Data System (ADS)
He, Jiayi; Shang, Pengjian; Xiong, Hui
2018-06-01
Stocks, as the concrete manifestation of financial time series with plenty of potential information, are often used in the study of financial time series. In this paper, we utilize the stock data to recognize their patterns through out the dissimilarity matrix based on modified cross-sample entropy, then three-dimensional perceptual maps of the results are provided through multidimensional scaling method. Two modified multidimensional scaling methods are proposed in this paper, that is, multidimensional scaling based on Kronecker-delta cross-sample entropy (MDS-KCSE) and multidimensional scaling based on permutation cross-sample entropy (MDS-PCSE). These two methods use Kronecker-delta based cross-sample entropy and permutation based cross-sample entropy to replace the distance or dissimilarity measurement in classical multidimensional scaling (MDS). Multidimensional scaling based on Chebyshev distance (MDSC) is employed to provide a reference for comparisons. Our analysis reveals a clear clustering both in synthetic data and 18 indices from diverse stock markets. It implies that time series generated by the same model are easier to have similar irregularity than others, and the difference in the stock index, which is caused by the country or region and the different financial policies, can reflect the irregularity in the data. In the synthetic data experiments, not only the time series generated by different models can be distinguished, the one generated under different parameters of the same model can also be detected. In the financial data experiment, the stock indices are clearly divided into five groups. Through analysis, we find that they correspond to five regions, respectively, that is, Europe, North America, South America, Asian-Pacific (with the exception of mainland China), mainland China and Russia. The results also demonstrate that MDS-KCSE and MDS-PCSE provide more effective divisions in experiments than MDSC.
Entropic Imaging of Cataract Lens: An In Vitro Study
Shung, K. Kirk; Tsui, Po-Hsiang; Fang, Jui; Ma, Hsiang-Yang; Wu, Shuicai; Lin, Chung-Chih
2014-01-01
Phacoemulsification is a common surgical method for treating advanced cataracts. Determining the optimal phacoemulsification energy depends on the hardness of the lens involved. Previous studies have shown that it is possible to evaluate lens hardness via ultrasound parametric imaging based on statistical models that require data to follow a specific distribution. To make the method more system-adaptive, nonmodel-based imaging approach may be necessary in the visualization of lens hardness. This study investigated the feasibility of applying an information theory derived parameter – Shannon entropy from ultrasound backscatter to quantify lens hardness. To determine the physical significance of entropy, we performed computer simulations to investigate the relationship between the signal-to-noise ratio (SNR) based on the Rayleigh distribution and Shannon entropy. Young's modulus was measured in porcine lenses, in which cataracts had been artificially induced by the immersion in formalin solution in vitro. A 35-MHz ultrasound transducer was used to scan the cataract lenses for entropy imaging. The results showed that the entropy is 4.8 when the backscatter data form a Rayleigh distribution corresponding to an SNR of 1.91. The Young's modulus of the lens increased from approximately 8 to 100 kPa when we increased the immersion time from 40 to 160 min (correlation coefficient r = 0.99). Furthermore, the results indicated that entropy imaging seemed to facilitate visualizing different degrees of lens hardening. The mean entropy value increased from 2.7 to 4.0 as the Young's modulus increased from 8 to 100 kPa (r = 0.85), suggesting that entropy imaging may have greater potential than that of conventional statistical parametric imaging in determining the optimal energy to apply during phacoemulsification. PMID:24760103
Increased resting-state brain entropy in Alzheimer's disease.
Xue, Shao-Wei; Guo, Yonghu
2018-03-07
Entropy analysis of resting-state functional MRI (R-fMRI) is a novel approach to characterize brain temporal dynamics and facilitates the identification of abnormal brain activity caused by several disease conditions. However, Alzheimer's disease (AD)-related brain entropy mapping based on R-fMRI has not been assessed. Here, we measured the sample entropy and voxel-wise connectivity of the network degree centrality (DC) of the intrinsic brain activity acquired by R-fMRI in 26 patients with AD and 26 healthy controls. Compared with the controls, AD patients showed increased entropy in the middle temporal gyrus and the precentral gyrus and also showed decreased DC in the precuneus. Moreover, the magnitude of the negative correlation between local brain activity (entropy) and network connectivity (DC) was increased in AD patients in comparison with healthy controls. These findings provide new evidence on AD-related brain entropy alterations.
Microscopic insights into the NMR relaxation based protein conformational entropy meter
Kasinath, Vignesh; Sharp, Kim A.; Wand, A. Joshua
2013-01-01
Conformational entropy is a potentially important thermodynamic parameter contributing to protein function. Quantitative measures of conformational entropy are necessary for an understanding of its role but have been difficult to obtain. An empirical method that utilizes changes in conformational dynamics as a proxy for changes in conformational entropy has recently been introduced. Here we probe the microscopic origins of the link between conformational dynamics and conformational entropy using molecular dynamics simulations. Simulation of seven pro! teins gave an excellent correlation with measures of side-chain motion derived from NMR relaxation. The simulations show that the motion of methyl-bearing side-chains are sufficiently coupled to that of other side chains to serve as excellent reporters of the overall side-chain conformational entropy. These results tend to validate the use of experimentally accessible measures of methyl motion - the NMR-derived generalized order parameters - as a proxy from which to derive changes in protein conformational entropy. PMID:24007504
Geometric entropy and edge modes of the electromagnetic field
NASA Astrophysics Data System (ADS)
Donnelly, William; Wall, Aron C.
2016-11-01
We calculate the vacuum entanglement entropy of Maxwell theory in a class of curved spacetimes by Kaluza-Klein reduction of the theory onto a two-dimensional base manifold. Using two-dimensional duality, we express the geometric entropy of the electromagnetic field as the entropy of a tower of scalar fields, constant electric and magnetic fluxes, and a contact term, whose leading-order divergence was discovered by Kabat. The complete contact term takes the form of one negative scalar degree of freedom confined to the entangling surface. We show that the geometric entropy agrees with a statistical definition of entanglement entropy that includes edge modes: classical solutions determined by their boundary values on the entangling surface. This resolves a long-standing puzzle about the statistical interpretation of the contact term in the entanglement entropy. We discuss the implications of this negative term for black hole thermodynamics and the renormalization of Newton's constant.
NASA Technical Reports Server (NTRS)
Carpenter, Mark H.; Fisher, Travis C.; Nielsen, Eric J.; Frankel, Steven H.
2013-01-01
Nonlinear entropy stability and a summation-by-parts framework are used to derive provably stable, polynomial-based spectral collocation methods of arbitrary order. The new methods are closely related to discontinuous Galerkin spectral collocation methods commonly known as DGFEM, but exhibit a more general entropy stability property. Although the new schemes are applicable to a broad class of linear and nonlinear conservation laws, emphasis herein is placed on the entropy stability of the compressible Navier-Stokes equations.
Entropy of measurement and erasure: Szilard's membrane model revisited
NASA Astrophysics Data System (ADS)
Leff, Harvey S.; Rex, Andrew F.
1994-11-01
It is widely believed that measurement is accompanied by irreversible entropy increase. This conventional wisdom is based in part on Szilard's 1929 study of entropy decrease in a thermodynamic system by intelligent intervention (i.e., a Maxwell's demon) and Brillouin's association of entropy with information. Bennett subsequently argued that information acquisition is not necessarily irreversible, but information erasure must be dissipative (Landauer's principle). Inspired by the ensuing debate, we revisit the membrane model introduced by Szilard and find that it can illustrate and clarify (1) reversible measurement, (2) information storage, (3) decoupling of the memory from the system being measured, and (4) entropy increase associated with memory erasure and resetting.
Fault detection and diagnosis for gas turbines based on a kernelized information entropy model.
Wang, Weiying; Xu, Zhiqiang; Tang, Rui; Li, Shuying; Wu, Wei
2014-01-01
Gas turbines are considered as one kind of the most important devices in power engineering and have been widely used in power generation, airplanes, and naval ships and also in oil drilling platforms. However, they are monitored without man on duty in the most cases. It is highly desirable to develop techniques and systems to remotely monitor their conditions and analyze their faults. In this work, we introduce a remote system for online condition monitoring and fault diagnosis of gas turbine on offshore oil well drilling platforms based on a kernelized information entropy model. Shannon information entropy is generalized for measuring the uniformity of exhaust temperatures, which reflect the overall states of the gas paths of gas turbine. In addition, we also extend the entropy to compute the information quantity of features in kernel spaces, which help to select the informative features for a certain recognition task. Finally, we introduce the information entropy based decision tree algorithm to extract rules from fault samples. The experiments on some real-world data show the effectiveness of the proposed algorithms.
Epoch-based Entropy for Early Screening of Alzheimer's Disease.
Houmani, N; Dreyfus, G; Vialatte, F B
2015-12-01
In this paper, we introduce a novel entropy measure, termed epoch-based entropy. This measure quantifies disorder of EEG signals both at the time level and spatial level, using local density estimation by a Hidden Markov Model on inter-channel stationary epochs. The investigation is led on a multi-centric EEG database recorded from patients at an early stage of Alzheimer's disease (AD) and age-matched healthy subjects. We investigate the classification performances of this method, its robustness to noise, and its sensitivity to sampling frequency and to variations of hyperparameters. The measure is compared to two alternative complexity measures, Shannon's entropy and correlation dimension. The classification accuracies for the discrimination of AD patients from healthy subjects were estimated using a linear classifier designed on a development dataset, and subsequently tested on an independent test set. Epoch-based entropy reached a classification accuracy of 83% on the test dataset (specificity = 83.3%, sensitivity = 82.3%), outperforming the two other complexity measures. Furthermore, it was shown to be more stable to hyperparameter variations, and less sensitive to noise and sampling frequency disturbances than the other two complexity measures.
Fault Detection and Diagnosis for Gas Turbines Based on a Kernelized Information Entropy Model
Wang, Weiying; Xu, Zhiqiang; Tang, Rui; Li, Shuying; Wu, Wei
2014-01-01
Gas turbines are considered as one kind of the most important devices in power engineering and have been widely used in power generation, airplanes, and naval ships and also in oil drilling platforms. However, they are monitored without man on duty in the most cases. It is highly desirable to develop techniques and systems to remotely monitor their conditions and analyze their faults. In this work, we introduce a remote system for online condition monitoring and fault diagnosis of gas turbine on offshore oil well drilling platforms based on a kernelized information entropy model. Shannon information entropy is generalized for measuring the uniformity of exhaust temperatures, which reflect the overall states of the gas paths of gas turbine. In addition, we also extend the entropy to compute the information quantity of features in kernel spaces, which help to select the informative features for a certain recognition task. Finally, we introduce the information entropy based decision tree algorithm to extract rules from fault samples. The experiments on some real-world data show the effectiveness of the proposed algorithms. PMID:25258726
Li, Jing Xin; Yang, Li; Yang, Lei; Zhang, Chao; Huo, Zhao Min; Chen, Min Hao; Luan, Xiao Feng
2018-03-01
Quantitative evaluation of ecosystem service is a primary premise for rational resources exploitation and sustainable development. Examining ecosystem services flow provides a scientific method to quantity ecosystem services. We built an assessment indicator system based on land cover/land use under the framework of four types of ecosystem services. The types of ecosystem services flow were reclassified. Using entropy theory, disorder degree and developing trend of indicators and urban ecosystem were quantitatively assessed. Beijing was chosen as the study area, and twenty-four indicators were selected for evaluation. The results showed that the entropy value of Beijing urban ecosystem during 2004 to 2015 was 0.794 and the entropy flow was -0.024, suggesting a large disordered degree and near verge of non-health. The system got maximum values for three times, while the mean annual variation of the system entropy value increased gradually in three periods, indicating that human activities had negative effects on urban ecosystem. Entropy flow reached minimum value in 2007, implying the environmental quality was the best in 2007. The determination coefficient for the fitting function of total permanent population in Beijing and urban ecosystem entropy flow was 0.921, indicating that urban ecosystem health was highly correlated with total permanent population.
Bayesian framework inspired no-reference region-of-interest quality measure for brain MRI images
Osadebey, Michael; Pedersen, Marius; Arnold, Douglas; Wendel-Mitoraj, Katrina
2017-01-01
Abstract. We describe a postacquisition, attribute-based quality assessment method for brain magnetic resonance imaging (MRI) images. It is based on the application of Bayes theory to the relationship between entropy and image quality attributes. The entropy feature image of a slice is segmented into low- and high-entropy regions. For each entropy region, there are three separate observations of contrast, standard deviation, and sharpness quality attributes. A quality index for a quality attribute is the posterior probability of an entropy region given any corresponding region in a feature image where quality attribute is observed. Prior belief in each entropy region is determined from normalized total clique potential (TCP) energy of the slice. For TCP below the predefined threshold, the prior probability for a region is determined by deviation of its percentage composition in the slice from a standard normal distribution built from 250 MRI volume data provided by Alzheimer’s Disease Neuroimaging Initiative. For TCP above the threshold, the prior is computed using a mathematical model that describes the TCP–noise level relationship in brain MRI images. Our proposed method assesses the image quality of each entropy region and the global image. Experimental results demonstrate good correlation with subjective opinions of radiologists for different types and levels of quality distortions. PMID:28630885
Harmonic analysis of electric locomotive and traction power system based on wavelet singular entropy
NASA Astrophysics Data System (ADS)
Dun, Xiaohong
2018-05-01
With the rapid development of high-speed railway and heavy-haul transport, the locomotive and traction power system has become the main harmonic source of China's power grid. In response to this phenomenon, the system's power quality issues need timely monitoring, assessment and governance. Wavelet singular entropy is an organic combination of wavelet transform, singular value decomposition and information entropy theory, which combines the unique advantages of the three in signal processing: the time-frequency local characteristics of wavelet transform, singular value decomposition explores the basic modal characteristics of data, and information entropy quantifies the feature data. Based on the theory of singular value decomposition, the wavelet coefficient matrix after wavelet transform is decomposed into a series of singular values that can reflect the basic characteristics of the original coefficient matrix. Then the statistical properties of information entropy are used to analyze the uncertainty of the singular value set, so as to give a definite measurement of the complexity of the original signal. It can be said that wavelet entropy has a good application prospect in fault detection, classification and protection. The mat lab simulation shows that the use of wavelet singular entropy on the locomotive and traction power system harmonic analysis is effective.
Optimization of a Circular Microchannel With Entropy Generation Minimization Method
NASA Astrophysics Data System (ADS)
Jafari, Arash; Ghazali, Normah Mohd
2010-06-01
New advances in micro and nano scales are being realized and the contributions of micro and nano heat dissipation devices are of high importance in this novel technology development. Past studies showed that microchannel design depends on its thermal resistance and pressure drop. However, entropy generation minimization (EGM) as a new optimization theory stated that the rate of entropy generation should be also optimized. Application of EGM in microchannel heat sink design is reviewed and discussed in this paper. Latest principles for deriving the entropy generation relations are discussed to present how this approach can be achieved. An optimization procedure using EGM method with the entropy generation rate is derived for a circular microchannel heat sink based upon thermal resistance and pressure drop. The equations are solved using MATLAB and the obtained results are compared to similar past studies. The effects of channel diameter, number of channels, heat flux, and pumping power on the entropy generation rate and Reynolds number are investigated. Analytical correlations are utilized for heat transfer and friction coefficients. A minimum entropy generation has been observed for N = 40 and channel diameter of 90μm. It is concluded that for N = 40 and channel hydraulic diameter of 90μm, the circular microchannel heat sink is on its optimum operating point based on second law of thermodynamics.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Mathur, Samir D., E-mail: mathur.16@osu.edu
The black hole information paradox forces us into a strange situation: we must find a way to break the semiclassical approximation in a domain where no quantum gravity effects would normally be expected. Traditional quantizations of gravity do not exhibit any such breakdown, and this forces us into a difficult corner: either we must give up quantum mechanics or we must accept the existence of troublesome 'remnants'. In string theory, however, the fundamental quanta are extended objects, and it turns out that the bound states of such objects acquire a size that grows with the number of quanta in themore » bound state. The interior of the black hole gets completely altered to a 'fuzzball' structure, and information is able to escape in radiation from the hole. The semiclassical approximation can break at macroscopic scales due to the large entropy of the hole: the measure in the path integral competes with the classical action, instead of giving a subleading correction. Putting this picture of black hole microstates together with ideas about entangled states leads to a natural set of conjectures on many long-standing questions in gravity: the significance of Rindler and de Sitter entropies, the notion of black hole complementarity, and the fate of an observer falling into a black hole. - Highlights: Black-Right-Pointing-Pointer The information paradox is a serious problem. Black-Right-Pointing-Pointer To solve it we need to find 'hair' on black holes. Black-Right-Pointing-Pointer In string theory we find 'hair' by the fuzzball construction. Black-Right-Pointing-Pointer Fuzzballs help to resolve many other issues in gravity.« less
Quantitative characterization of brazing performance for Sn-plated silver alloy fillers
NASA Astrophysics Data System (ADS)
Wang, Xingxing; Peng, Jin; Cui, Datian
2017-12-01
Two types of AgCuZnSn fillers were prepared based on BAg50CuZn and BAg34CuZnSn alloy through a combinative process of electroplating and thermal diffusion. The models of wetting entropy and joint strength entropy of AgCuZnSn filler metals were established. The wetting entropy of the Sn-plated silver brazing alloys are lower than the traditional fillers, and its joint strength entropy value is slightly higher than the latter. The wetting entropy value of the Sn-plated brazing alloys and traditional filler metal are similar to the change trend of the wetting area. The trend of the joint strength entropy value with those fillers are consisted with the tensile strength of the stainless steel joints with the increase of Sn content.
Marsh, Jon N; Wallace, Kirk D; McCarthy, John E; Wickerhauser, Mladen V; Maurizi, Brian N; Lanza, Gregory M; Wickline, Samuel A; Hughes, Michael S
2010-08-01
Previously, we reported new methods for ultrasound signal characterization using entropy, H(f); a generalized entropy, the Renyi entropy, I(f)(r); and a limiting form of Renyi entropy suitable for real-time calculation, I(f),(infinity). All of these quantities demonstrated significantly more sensitivity to subtle changes in scattering architecture than energy-based methods in certain settings. In this study, the real-time calculable limit of the Renyi entropy, I(f),(infinity), is applied for the imaging of angiogenic murine neovasculature in a breast cancer xenograft using a targeted contrast agent. It is shown that this approach may be used to reliably detect the accumulation of targeted nanoparticles at five minutes post-injection in this in vivo model.
General monogamy of Tsallis q -entropy entanglement in multiqubit systems
NASA Astrophysics Data System (ADS)
Luo, Yu; Tian, Tian; Shao, Lian-He; Li, Yongming
2016-06-01
In this paper, we study the monogamy inequality of Tsallis q -entropy entanglement. We first provide an analytic formula of Tsallis q -entropy entanglement in two-qubit systems for 5/-√{13 } 2 ≤q ≤5/+√{13 } 2 . The analytic formula of Tsallis q -entropy entanglement in 2 ⊗d system is also obtained and we show that Tsallis q -entropy entanglement satisfies a set of hierarchical monogamy equalities. Furthermore, we prove the squared Tsallis q -entropy entanglement follows a general inequality in the qubit systems. Based on the monogamy relations, a set of multipartite entanglement indicators is constructed, which can detect all genuine multiqubit entangled states even in the case of N -tangle vanishes. Moreover, we study some examples in multipartite higher-dimensional system for the monogamy inequalities.
An adaptive technique to maximize lossless image data compression of satellite images
NASA Technical Reports Server (NTRS)
Stewart, Robert J.; Lure, Y. M. Fleming; Liou, C. S. Joe
1994-01-01
Data compression will pay an increasingly important role in the storage and transmission of image data within NASA science programs as the Earth Observing System comes into operation. It is important that the science data be preserved at the fidelity the instrument and the satellite communication systems were designed to produce. Lossless compression must therefore be applied, at least, to archive the processed instrument data. In this paper, we present an analysis of the performance of lossless compression techniques and develop an adaptive approach which applied image remapping, feature-based image segmentation to determine regions of similar entropy and high-order arithmetic coding to obtain significant improvements over the use of conventional compression techniques alone. Image remapping is used to transform the original image into a lower entropy state. Several techniques were tested on satellite images including differential pulse code modulation, bi-linear interpolation, and block-based linear predictive coding. The results of these experiments are discussed and trade-offs between computation requirements and entropy reductions are used to identify the optimum approach for a variety of satellite images. Further entropy reduction can be achieved by segmenting the image based on local entropy properties then applying a coding technique which maximizes compression for the region. Experimental results are presented showing the effect of different coding techniques for regions of different entropy. A rule-base is developed through which the technique giving the best compression is selected. The paper concludes that maximum compression can be achieved cost effectively and at acceptable performance rates with a combination of techniques which are selected based on image contextual information.
Shearlet-based measures of entropy and complexity for two-dimensional patterns
NASA Astrophysics Data System (ADS)
Brazhe, Alexey
2018-06-01
New spatial entropy and complexity measures for two-dimensional patterns are proposed. The approach is based on the notion of disequilibrium and is built on statistics of directional multiscale coefficients of the fast finite shearlet transform. Shannon entropy and Jensen-Shannon divergence measures are employed. Both local and global spatial complexity and entropy estimates can be obtained, thus allowing for spatial mapping of complexity in inhomogeneous patterns. The algorithm is validated in numerical experiments with a gradually decaying periodic pattern and Ising surfaces near critical state. It is concluded that the proposed algorithm can be instrumental in describing a wide range of two-dimensional imaging data, textures, or surfaces, where an understanding of the level of order or randomness is desired.
Consistent Application of the Boltzmann Distribution to Residual Entropy in Crystals
ERIC Educational Resources Information Center
Kozliak, Evguenii I.
2007-01-01
Four different approaches to residual entropy (the entropy remaining in crystals comprised of nonsymmetric molecules like CO, N[subscript 2]O, FClO[subscript 3], and H[subscript 2]O as temperatures approach 0 K) are analyzed and a new method of its calculation is developed based on application of the Boltzmann distribution. The inherent connection…
Entropy Filtered Density Function for Large Eddy Simulation of Turbulent Reacting Flows
NASA Astrophysics Data System (ADS)
Safari, Mehdi
Analysis of local entropy generation is an effective means to optimize the performance of energy and combustion systems by minimizing the irreversibilities in transport processes. Large eddy simulation (LES) is employed to describe entropy transport and generation in turbulent reacting flows. The entropy transport equation in LES contains several unclosed terms. These are the subgrid scale (SGS) entropy flux and entropy generation caused by irreversible processes: heat conduction, mass diffusion, chemical reaction and viscous dissipation. The SGS effects are taken into account using a novel methodology based on the filtered density function (FDF). This methodology, entitled entropy FDF (En-FDF), is developed and utilized in the form of joint entropy-velocity-scalar-turbulent frequency FDF and the marginal scalar-entropy FDF, both of which contain the chemical reaction effects in a closed form. The former constitutes the most comprehensive form of the En-FDF and provides closure for all the unclosed filtered moments. This methodology is applied for LES of a turbulent shear layer involving transport of passive scalars. Predictions show favor- able agreements with the data generated by direct numerical simulation (DNS) of the same layer. The marginal En-FDF accounts for entropy generation effects as well as scalar and entropy statistics. This methodology is applied to a turbulent nonpremixed jet flame (Sandia Flame D) and predictions are validated against experimental data. In both flows, sources of irreversibility are predicted and analyzed.
Entropy, complexity, and Markov diagrams for random walk cancer models.
Newton, Paul K; Mason, Jeremy; Hurt, Brian; Bethel, Kelly; Bazhenova, Lyudmila; Nieva, Jorge; Kuhn, Peter
2014-12-19
The notion of entropy is used to compare the complexity associated with 12 common cancers based on metastatic tumor distribution autopsy data. We characterize power-law distributions, entropy, and Kullback-Liebler divergence associated with each primary cancer as compared with data for all cancer types aggregated. We then correlate entropy values with other measures of complexity associated with Markov chain dynamical systems models of progression. The Markov transition matrix associated with each cancer is associated with a directed graph model where nodes are anatomical locations where a metastatic tumor could develop, and edge weightings are transition probabilities of progression from site to site. The steady-state distribution corresponds to the autopsy data distribution. Entropy correlates well with the overall complexity of the reduced directed graph structure for each cancer and with a measure of systemic interconnectedness of the graph, called graph conductance. The models suggest that grouping cancers according to their entropy values, with skin, breast, kidney, and lung cancers being prototypical high entropy cancers, stomach, uterine, pancreatic and ovarian being mid-level entropy cancers, and colorectal, cervical, bladder, and prostate cancers being prototypical low entropy cancers, provides a potentially useful framework for viewing metastatic cancer in terms of predictability, complexity, and metastatic potential.
Entropy, complexity, and Markov diagrams for random walk cancer models
NASA Astrophysics Data System (ADS)
Newton, Paul K.; Mason, Jeremy; Hurt, Brian; Bethel, Kelly; Bazhenova, Lyudmila; Nieva, Jorge; Kuhn, Peter
2014-12-01
The notion of entropy is used to compare the complexity associated with 12 common cancers based on metastatic tumor distribution autopsy data. We characterize power-law distributions, entropy, and Kullback-Liebler divergence associated with each primary cancer as compared with data for all cancer types aggregated. We then correlate entropy values with other measures of complexity associated with Markov chain dynamical systems models of progression. The Markov transition matrix associated with each cancer is associated with a directed graph model where nodes are anatomical locations where a metastatic tumor could develop, and edge weightings are transition probabilities of progression from site to site. The steady-state distribution corresponds to the autopsy data distribution. Entropy correlates well with the overall complexity of the reduced directed graph structure for each cancer and with a measure of systemic interconnectedness of the graph, called graph conductance. The models suggest that grouping cancers according to their entropy values, with skin, breast, kidney, and lung cancers being prototypical high entropy cancers, stomach, uterine, pancreatic and ovarian being mid-level entropy cancers, and colorectal, cervical, bladder, and prostate cancers being prototypical low entropy cancers, provides a potentially useful framework for viewing metastatic cancer in terms of predictability, complexity, and metastatic potential.
NASA Astrophysics Data System (ADS)
Suparmi, A.; Cari, C.; Nur Pratiwi, Beta; Arya Nugraha, Dewanta
2017-01-01
D dimensional Schrodinger equation for the mixed Manning Rosen potential was investigated using supersymmetric quantum mechanics. We obtained the energy eigenvalues from radial part solution and wavefunctions in radial and angular parts solution. From the lowest radial wavefunctions, we evaluated the Shannon entropy information using Matlab software. Based on the entropy densities demonstrated graphically, we obtained that the wave of position information entropy density moves right when the value of potential parameter q increases, while its wave moves left with the increase of parameter α. The wave of momentum information entropy densities were expressed in graphs. We observe that its amplitude increase with increasing parameter q and α
Investigation of FeNiCrWMn - a new high entropy alloy
NASA Astrophysics Data System (ADS)
Buluc, G.; Florea, I.; Bălţătescu, O.; Florea, R. M.; Carcea, I.
2015-11-01
The term of high entropy alloys started from the analysis of multicomponent alloys, which were produced at an experimental level since 1995 by developing a new concept related to the development of metallic materials. Recent developments in the field of high-entropy alloys have revealed that they have versatile properties like: ductility, toughness, hardness and corrosion resistance [1]. Up until now, it has been demonstrated that the explored this alloys are feasible to be synthesized, processed and analyzed contrary to the misunderstanding based on traditional experiences. Moreover, there are many opportunities in this field for academic studies and industrial applications [1, 2]. As the combinations of composition and process for producing high entropy alloys are numerous and each high entropy alloy has its own microstructure and properties to be identified and understood, the research work is truly limitless. The novelty of these alloys consists of chemical composition. These alloys have been named high entropy alloys due to the atomic scale mixing entropies higher than traditional alloys. In this paper, I will present the microscopy and the mechanical properties of high entropy alloy FeNiCrWMn.
Hydrodynamic & Transport Properties of Dirac Materials in the Quantum Limit
NASA Astrophysics Data System (ADS)
Gochan, Matthew; Bedell, Kevin
Dirac materials are a versatile class of materials in which an abundance of unique physical phenomena can be observed. Such materials are found in all dimensions, with the shared property that their low-energy fermionic excitations behave as massless Dirac fermions and are therefore governed by the Dirac equation. The most popular Dirac material, its two dimensional version in graphene, is the focus of this work. We seek a deeper understanding of the interactions in the quantum limit within graphene. Specifically, we derive hydrodynamic and transport properties, such as the conductivity, viscosity, and spin diffusion, in the low temperature regime where electron-electron scattering is dominant. To conclude, we look at the so-called universal lower bound conjectured by the anti-de Sitter/conformal field theory (AdS/CFT) correspondence for the ratio of shear viscosity to entropy density ratio. The lower bound, given by η / s >= ℏ / (4 πkB) , is supposedly obeyed by all quantum fluids. This leads us to ask whether or not graphene can be considered a quantum fluid and perhaps a ''nearly perfect fluid''(NPF) if this is the case, is it possible to find a violation of this bound at low temperatures.
Transfer Entropy as a Log-Likelihood Ratio
NASA Astrophysics Data System (ADS)
Barnett, Lionel; Bossomaier, Terry
2012-09-01
Transfer entropy, an information-theoretic measure of time-directed information transfer between joint processes, has steadily gained popularity in the analysis of complex stochastic dynamics in diverse fields, including the neurosciences, ecology, climatology, and econometrics. We show that for a broad class of predictive models, the log-likelihood ratio test statistic for the null hypothesis of zero transfer entropy is a consistent estimator for the transfer entropy itself. For finite Markov chains, furthermore, no explicit model is required. In the general case, an asymptotic χ2 distribution is established for the transfer entropy estimator. The result generalizes the equivalence in the Gaussian case of transfer entropy and Granger causality, a statistical notion of causal influence based on prediction via vector autoregression, and establishes a fundamental connection between directed information transfer and causality in the Wiener-Granger sense.
Transfer entropy as a log-likelihood ratio.
Barnett, Lionel; Bossomaier, Terry
2012-09-28
Transfer entropy, an information-theoretic measure of time-directed information transfer between joint processes, has steadily gained popularity in the analysis of complex stochastic dynamics in diverse fields, including the neurosciences, ecology, climatology, and econometrics. We show that for a broad class of predictive models, the log-likelihood ratio test statistic for the null hypothesis of zero transfer entropy is a consistent estimator for the transfer entropy itself. For finite Markov chains, furthermore, no explicit model is required. In the general case, an asymptotic χ2 distribution is established for the transfer entropy estimator. The result generalizes the equivalence in the Gaussian case of transfer entropy and Granger causality, a statistical notion of causal influence based on prediction via vector autoregression, and establishes a fundamental connection between directed information transfer and causality in the Wiener-Granger sense.
Surface entropy of liquids via a direct Monte Carlo approach - Application to liquid Si
NASA Technical Reports Server (NTRS)
Wang, Z. Q.; Stroud, D.
1990-01-01
Two methods are presented for a direct Monte Carlo evaluation of the surface entropy S(s) of a liquid interacting by specified, volume-independent potentials. The first method is based on an application of the approach of Ferrenberg and Swendsen (1988, 1989) to Monte Carlo simulations at two different temperatures; it gives much more reliable results for S(s) in liquid Si than previous calculations based on numerical differentiation. The second method expresses the surface entropy directly as a canonical average at fixed temperature.
Infrared image segmentation method based on spatial coherence histogram and maximum entropy
NASA Astrophysics Data System (ADS)
Liu, Songtao; Shen, Tongsheng; Dai, Yao
2014-11-01
In order to segment the target well and suppress background noises effectively, an infrared image segmentation method based on spatial coherence histogram and maximum entropy is proposed. First, spatial coherence histogram is presented by weighting the importance of the different position of these pixels with the same gray-level, which is obtained by computing their local density. Then, after enhancing the image by spatial coherence histogram, 1D maximum entropy method is used to segment the image. The novel method can not only get better segmentation results, but also have a faster computation time than traditional 2D histogram-based segmentation methods.
Rényi entropies and observables.
Lesche, Bernhard
2004-01-01
Evidence is given that Rényi entropies of macroscopic thermodynamic systems defined on the bases of probabilities of microstates cannot be related to observables. The notion of observable is clarified.
Zhao, Yong; Hong, Wen-Xue
2011-11-01
Fast, nondestructive and accurate identification of special quality eggs is an urgent problem. The present paper proposed a new feature extraction method based on symbol entropy to identify near infrared spectroscopy of special quality eggs. The authors selected normal eggs, free range eggs, selenium-enriched eggs and zinc-enriched eggs as research objects and measured the near-infrared diffuse reflectance spectra in the range of 12 000-4 000 cm(-1). Raw spectra were symbolically represented with aggregation approximation algorithm and symbolic entropy was extracted as feature vector. An error-correcting output codes multiclass support vector machine classifier was designed to identify the spectrum. Symbolic entropy feature is robust when parameter changed and the highest recognition rate reaches up to 100%. The results show that the identification method of special quality eggs using near-infrared is feasible and the symbol entropy can be used as a new feature extraction method of near-infrared spectra.
Delchini, Marc O.; Ragusa, Jean C.; Ferguson, Jim
2017-02-17
A viscous regularization technique, based on the local entropy residual, was proposed by Delchini et al. (2015) to stabilize the nonequilibrium-diffusion Grey Radiation-Hydrodynamic equations using an artificial viscosity technique. This viscous regularization is modulated by the local entropy production and is consistent with the entropy minimum principle. However, Delchini et al. (2015) only based their work on the hyperbolic parts of the Grey Radiation-Hydrodynamic equations and thus omitted the relaxation and diffusion terms present in the material energy and radiation energy equations. Here in this paper, we extend the theoretical grounds for the method and derive an entropy minimum principlemore » for the full set of nonequilibrium-diffusion Grey Radiation-Hydrodynamic equations. This further strengthens the applicability of the entropy viscosity method as a stabilization technique for radiation-hydrodynamic shock simulations. Radiative shock calculations using constant and temperature-dependent opacities are compared against semi-analytical reference solutions, and we present a procedure to perform spatial convergence studies of such simulations.« less
Gradient Dynamics and Entropy Production Maximization
NASA Astrophysics Data System (ADS)
Janečka, Adam; Pavelka, Michal
2018-01-01
We compare two methods for modeling dissipative processes, namely gradient dynamics and entropy production maximization. Both methods require similar physical inputs-how energy (or entropy) is stored and how it is dissipated. Gradient dynamics describes irreversible evolution by means of dissipation potential and entropy, it automatically satisfies Onsager reciprocal relations as well as their nonlinear generalization (Maxwell-Onsager relations), and it has statistical interpretation. Entropy production maximization is based on knowledge of free energy (or another thermodynamic potential) and entropy production. It also leads to the linear Onsager reciprocal relations and it has proven successful in thermodynamics of complex materials. Both methods are thermodynamically sound as they ensure approach to equilibrium, and we compare them and discuss their advantages and shortcomings. In particular, conditions under which the two approaches coincide and are capable of providing the same constitutive relations are identified. Besides, a commonly used but not often mentioned step in the entropy production maximization is pinpointed and the condition of incompressibility is incorporated into gradient dynamics.
Entropy of hydrological systems under small samples: Uncertainty and variability
NASA Astrophysics Data System (ADS)
Liu, Dengfeng; Wang, Dong; Wang, Yuankun; Wu, Jichun; Singh, Vijay P.; Zeng, Xiankui; Wang, Lachun; Chen, Yuanfang; Chen, Xi; Zhang, Liyuan; Gu, Shenghua
2016-01-01
Entropy theory has been increasingly applied in hydrology in both descriptive and inferential ways. However, little attention has been given to the small-sample condition widespread in hydrological practice, where either hydrological measurements are limited or are even nonexistent. Accordingly, entropy estimated under this condition may incur considerable bias. In this study, small-sample condition is considered and two innovative entropy estimators, the Chao-Shen (CS) estimator and the James-Stein-type shrinkage (JSS) estimator, are introduced. Simulation tests are conducted with common distributions in hydrology, that lead to the best-performing JSS estimator. Then, multi-scale moving entropy-based hydrological analyses (MM-EHA) are applied to indicate the changing patterns of uncertainty of streamflow data collected from the Yangtze River and the Yellow River, China. For further investigation into the intrinsic property of entropy applied in hydrological uncertainty analyses, correlations of entropy and other statistics at different time-scales are also calculated, which show connections between the concept of uncertainty and variability.
Fluid/gravity correspondence for massive gravity
NASA Astrophysics Data System (ADS)
Pan, Wen-Jian; Huang, Yong-Chang
2016-11-01
In this paper, we investigate the fluid/gravity correspondence in the framework of massive Einstein gravity. Treating the gravitational mass terms as an effective energy-momentum tensor and utilizing the Petrov-like boundary condition on a timelike hypersurface, we find that the perturbation effects of massive gravity in bulk can be completely governed by the incompressible Navier-Stokes equation living on the cutoff surface under the near horizon and nonrelativistic limits. Furthermore, we have concisely computed the ratio of dynamical viscosity to entropy density for two massive Einstein gravity theories, and found that they still saturate the Kovtun-Son-Starinets (KSS) bound.
Bekenstein inequalities and nonlinear electrodynamics
NASA Astrophysics Data System (ADS)
Peñafiel, M. L.; Falciano, F. T.
2017-12-01
Bekenstein and Mayo proposed a generalized bound for the entropy, which implies some inequalities between the charge, energy, angular momentum, and size of the macroscopic system. Dain has shown that Maxwell's electrodynamics satisfies all three inequalities. We investigate the validity of these relations in the context of nonlinear electrodynamics and show that Born-Infeld electrodynamics satisfies all of them. However, contrary to the linear theory, there is no rigidity statement in Born-Infeld. We study the physical meaning and the relationship between these inequalities, and in particular, we analyze the connection between the energy-angular momentum inequality and causality.
NASA Astrophysics Data System (ADS)
Ghikas, Demetris P. K.; Oikonomou, Fotios D.
2018-04-01
Using the generalized entropies which depend on two parameters we propose a set of quantitative characteristics derived from the Information Geometry based on these entropies. Our aim, at this stage, is to construct first some fundamental geometric objects which will be used in the development of our geometrical framework. We first establish the existence of a two-parameter family of probability distributions. Then using this family we derive the associated metric and we state a generalized Cramer-Rao Inequality. This gives a first two-parameter classification of complex systems. Finally computing the scalar curvature of the information manifold we obtain a further discrimination of the corresponding classes. Our analysis is based on the two-parameter family of generalized entropies of Hanel and Thurner (2011).
Hu, Dehua; Liu, Qing; Tisdale, Jeremy; ...
2015-04-15
This paper reports Seebeck effects driven by both surface polarization difference and entropy difference by using intramolecular charge-transfer states in n-type and p-type conjugated polymers, namely IIDT and IIDDT, based on vertical conductor/polymer/conductor thin-film devices. Large Seebeck coefficients of -898 V/K and 1300 V/K from are observed from n-type IIDT p-type IIDDT, respectively, when the charge-transfer states are generated by a white light illumination of 100 mW/cm2. Simultaneously, electrical conductivities are increased from almost insulating states in dark condition to conducting states under photoexcitation in both n-type IIDT and p-type IIDDT devices. We find that the intramolecular charge-transfer states canmore » largely enhance Seebeck effects in the n-type IIDT and p-type IIDDT devices driven by both surface polarization difference and entropy difference. Furthermore, the Seebeck effects can be shifted between polarization and entropy regimes when electrical conductivities are changed. This reveals a new concept to develop Seebeck effects by controlling polarization and entropy regimes based on charge-transfer states in vertical conductor/polymer/conductor thin-film devices.« less
NASA Astrophysics Data System (ADS)
Sjögreen, Björn; Yee, H. C.
2018-07-01
The Sjogreen and Yee [31] high order entropy conservative numerical method for compressible gas dynamics is extended to include discontinuities and also extended to equations of ideal magnetohydrodynamics (MHD). The basic idea is based on Tadmor's [40] original work for inviscid perfect gas flows. For the MHD four formulations of the MHD are considered: (a) the conservative MHD, (b) the Godunov [14] non-conservative form, (c) the Janhunen [19] - MHD with magnetic field source terms, and (d) a MHD with source terms by Brackbill and Barnes [5]. Three forms of the high order entropy numerical fluxes for the MHD in the finite difference framework are constructed. They are based on the extension of the low order form of Chandrashekar and Klingenberg [9], and two forms with modifications of the Winters and Gassner [49] numerical fluxes. For flows containing discontinuities and multiscale turbulence fluctuations the high order entropy conservative numerical fluxes as the new base scheme under the Yee and Sjogreen [31] and Kotov et al. [21,22] high order nonlinear filter approach is developed. The added nonlinear filter step on the high order centered entropy conservative spatial base scheme is only utilized at isolated computational regions, while maintaining high accuracy almost everywhere for long time integration of unsteady flows and DNS and LES of turbulence computations. Representative test cases for both smooth flows and problems containing discontinuities for the gas dynamics and the ideal MHD are included. The results illustrate the improved stability by using the high order entropy conservative numerical flux as the base scheme instead of the pure high order central scheme.
Modular Hamiltonians for deformed half-spaces and the averaged null energy condition
Faulkner, Thomas; Leigh, Robert G.; Parrikar, Onkar; ...
2016-09-08
We study modular Hamiltonians corresponding to the vacuum state for deformed half-spaces in relativistic quantum field theories on R 1,d-1. We show that in addition to the usual boost generator, there is a contribution to the modular Hamiltonian at first order in the shape deformation, proportional to the integral of the null components of the stress tensor along the Rindler horizon. We use this fact along with monotonicity of relative entropy to prove the averaged null energy condition in Minkowski space-time. This subsequently gives a new proof of the Hofman-Maldacena bounds on the parameters appearing in CFT three-point functions. Ourmore » main technical advance involves adapting newly developed perturbative methods for calculating entanglement entropy to the problem at hand. Our methods were recently used to prove certain results on the shape dependence of entanglement in CFTs and here we generalize these results to excited states and real time dynamics. Finally, we discuss the AdS/CFT counterpart of this result, making connection with the recently proposed gravitational dual for modular Hamiltonians in holographic theories.« less
NASA Astrophysics Data System (ADS)
Kadam, Guru Prakash; Mishra, Hiranmaya
2015-09-01
We estimate dissipative properties, viz., shear and bulk viscosities of hadronic matter using relativistic Boltzmann equation in relaxation time approximation within the framework of excluded-volume hadron resonance gas (EHRG) model. We find that at zero baryon chemical potential the shear viscosity to entropy ratio (η /s ) decreases with temperature while at finite baryon chemical potential this ratio shows the same behavior as a function of temperature but reaches close to the Kovtun-Son-Starinets (KSS) bound. Further along the chemical freezeout curve, ratio η /s is almost constant apart from small initial monotonic rise. This observation may have some relevance to the experimental finding that the differential elliptic flow of charged hadrons does not change considerably at lower center-of-mass energy. We further find that bulk viscosity to entropy density (ζ /s ) decreases with temperature while this ratio has higher value at finite baryon chemical potential at higher temperature. Along the freezeout curve ζ /s decreases monotonically at lower center-of-mass energy and then saturates.
Modular Hamiltonians for deformed half-spaces and the averaged null energy condition
NASA Astrophysics Data System (ADS)
Faulkner, Thomas; Leigh, Robert G.; Parrikar, Onkar; Wang, Huajia
2016-09-01
We study modular Hamiltonians corresponding to the vacuum state for deformed half-spaces in relativistic quantum field theories on {{R}}^{1,d-1} . We show that in addition to the usual boost generator, there is a contribution to the modular Hamiltonian at first order in the shape deformation, proportional to the integral of the null components of the stress tensor along the Rindler horizon. We use this fact along with monotonicity of relative entropy to prove the averaged null energy condition in Minkowski space-time. This subsequently gives a new proof of the Hofman-Maldacena bounds on the parameters appearing in CFT three-point functions. Our main technical advance involves adapting newly developed perturbative methods for calculating entanglement entropy to the problem at hand. These methods were recently used to prove certain results on the shape dependence of entanglement in CFTs and here we generalize these results to excited states and real time dynamics. We also discuss the AdS/CFT counterpart of this result, making connection with the recently proposed gravitational dual for modular Hamiltonians in holographic theories.
DNA interaction studies of sesamol (3,4-methylenedioxyphenol) food additive.
Kashanian, Soheila; Tahmasian Ghobadi, Ameneh; Roshanfekr, Hamideh; Shariati, Zohreh
2013-02-01
The interaction of native calf thymus DNA (CT-DNA) with sesamol (3,4-methylenedioxyphenol) in Tris-HCl buffer at neutral pH 7.4 was monitored by absorption spectrophotometry, viscometry and spectrofluorometry. It is found that sesamol molecules could interact with DNA outside and/or groove binding modes, as are evidenced by: hyperchromism in UV absorption band, very slow decrease in specific viscosity of DNA, and small increase in the fluorescence of methylene blue (MB)-DNA solutions in the presence of increasing amounts of sesamol, which indicates that it is able to partially release the bound MB. Furthermore, the enthalpy and entropy of the reaction between sesamol and CT-DNA showed that the reaction is enthalpy-favored and entropy-disfavored (ΔH = -174.08 kJ mol(-1); ΔS = -532.92 J mol(-1) K(-1)). The binding constant was determined using absorption measurement and found to be 2.7 × 10(4) M(-1); its magnitude suggests that sesamol interacts to DNA with a high affinity.
Universal corner entanglement of Dirac fermions and gapless bosons from the continuum to the lattice
NASA Astrophysics Data System (ADS)
Helmes, Johannes; Hayward Sierens, Lauren E.; Chandran, Anushya; Witczak-Krempa, William; Melko, Roger G.
2016-09-01
A quantum critical (QC) fluid exhibits universal subleading corrections to the area law of its entanglement entropies. In two dimensions, when the partition involves a corner of angle θ , the subleading term is logarithmic with coefficient aα(θ ) for the α -Rényi entropy. In the smooth limit θ →π ,a1(θ ) yields the central charge of the stress tensor when the QC point is described by a conformal field theory (CFT). For general Rényi indices and angles, aα(θ ) is richer and few general results exist. We study aα(θ ) focusing on two benchmark CFTs, the free Dirac fermion and boson. We perform numerical lattice calculations to obtain high precision results in θ ,α regimes hitherto unexplored. We derive field theory estimates for aα(θ ) , including exact results, and demonstrate an excellent quantitative match with our numerical calculations. We also develop and test strong lower bounds, which apply to both free and interacting QC systems. Finally, we comment on the near collapse of aα(θ ) for various theories, including interacting O (N ) models.
Aqueous phase hydrogenation of phenol catalyzed by Pd and PdAg on ZrO 2
DOE Office of Scientific and Technical Information (OSTI.GOV)
Resende, Karen A.; Hori, Carla E.; Noronha, Fabio B.
The impact of particle size of ZrO 2-supported Pd and of alloying with Ag was explored for hydrogenation of phenol in aqueous phase. Kinetic assessments were performed in a batch reactor, on monometallic Pd/ZrO 2 samples with different Pd loadings (0.5%, 1% and 2%), as well as on a 1% PdAg/ZrO 2 sample. The catalytic activity normalized to accessible Pd (turnover frequency, TOF) increased with the particle size of Pd. Reaction orders in phenol and H 2 and lower activation energies suggest that smaller particles bind the reacting substrates more strongly, leading to higher surface coverages by phenol. But, surprisingly,more » smaller Pd particles exhibited lower TOFs. The lower activity of the small Pd particles is attributed to lower activation entropies for the strongly bound species. Furthermore, the presence of Ag increased the catalyst activity by decreasing the apparent energy of activation and increasing the coverages of phenol and H 2, without negatively affecting the activation entropy.« less
Entanglement dynamics in short- and long-range harmonic oscillators
NASA Astrophysics Data System (ADS)
Nezhadhaghighi, M. Ghasemi; Rajabpour, M. A.
2014-11-01
We study the time evolution of the entanglement entropy in the short- and long-range-coupled harmonic oscillators that have well-defined continuum limit field theories. We first introduce a method to calculate the entanglement evolution in generic coupled harmonic oscillators after quantum quench. Then we study the entanglement evolution after quantum quench in harmonic systems in which the couplings decay effectively as 1 /rd +α with the distance r . After quenching the mass from a nonzero value to zero we calculate numerically the time evolution of von Neumann and Rényi entropies. We show that for 1 <α <2 we have a linear growth of entanglement and then saturation independent of the initial state. For 0 <α <1 depending on the initial state we can have logarithmic growth or just fluctuation of entanglement. We also calculate the mutual information dynamics of two separated individual harmonic oscillators. Our findings suggest that in our system there is no particular connection between having a linear growth of entanglement after quantum quench and having a maximum group velocity or generalized Lieb-Robinson bound.
NASA Astrophysics Data System (ADS)
Knobles, David; Stotts, Steven; Sagers, Jason
2012-03-01
Why can one obtain from similar measurements a greater amount of information about cosmological parameters than seabed parameters in ocean waveguides? The cosmological measurements are in the form of a power spectrum constructed from spatial correlations of temperature fluctuations within the microwave background radiation. The seabed acoustic measurements are in the form of spatial correlations along the length of a spatial aperture. This study explores the above question from the perspective of posterior probability distributions obtained from maximizing a relative entropy functional. An answer is in part that the seabed in shallow ocean environments generally has large temporal and spatial inhomogeneities, whereas the early universe was a nearly homogeneous cosmological soup with small but important fluctuations. Acoustic propagation models used in shallow water acoustics generally do not capture spatial and temporal variability sufficiently well, which leads to model error dominating the statistical inference problem. This is not the case in cosmology. Further, the physics of the acoustic modes in cosmology is that of a standing wave with simple initial conditions, whereas for underwater acoustics it is a traveling wave in a strongly inhomogeneous bounded medium.
A study of the Boltzmann and Gibbs entropies in the context of a stochastic toy model
NASA Astrophysics Data System (ADS)
Malgieri, Massimiliano; Onorato, Pasquale; De Ambrosis, Anna
2018-05-01
In this article we reconsider a stochastic toy model of thermal contact, first introduced in Onorato et al (2017 Eur. J. Phys. 38 045102), showing its educational potential for clarifying some current issues in the foundations of thermodynamics. The toy model can be realized in practice using dice and coins, and can be seen as representing thermal coupling of two subsystems with energy bounded from above. The system is used as a playground for studying the different behaviours of the Boltzmann and Gibbs temperatures and entropies in the approach to steady state. The process that models thermal contact between the two subsystems can be proved to be an ergodic, reversible Markov chain; thus the dynamics produces an equilibrium distribution in which the weight of each state is proportional to its multiplicity in terms of microstates. Each one of the two subsystems, taken separately, is formally equivalent to an Ising spin system in the non-interacting limit. The model is intended for educational purposes, and the level of readership of the article is aimed at advanced undergraduates.
Aqueous phase hydrogenation of phenol catalyzed by Pd and PdAg on ZrO 2
Resende, Karen A.; Hori, Carla E.; Noronha, Fabio B.; ...
2017-08-05
The impact of particle size of ZrO 2-supported Pd and of alloying with Ag was explored for hydrogenation of phenol in aqueous phase. Kinetic assessments were performed in a batch reactor, on monometallic Pd/ZrO 2 samples with different Pd loadings (0.5%, 1% and 2%), as well as on a 1% PdAg/ZrO 2 sample. The catalytic activity normalized to accessible Pd (turnover frequency, TOF) increased with the particle size of Pd. Reaction orders in phenol and H 2 and lower activation energies suggest that smaller particles bind the reacting substrates more strongly, leading to higher surface coverages by phenol. But, surprisingly,more » smaller Pd particles exhibited lower TOFs. The lower activity of the small Pd particles is attributed to lower activation entropies for the strongly bound species. Furthermore, the presence of Ag increased the catalyst activity by decreasing the apparent energy of activation and increasing the coverages of phenol and H 2, without negatively affecting the activation entropy.« less
Modular Hamiltonians for deformed half-spaces and the averaged null energy condition
DOE Office of Scientific and Technical Information (OSTI.GOV)
Faulkner, Thomas; Leigh, Robert G.; Parrikar, Onkar
We study modular Hamiltonians corresponding to the vacuum state for deformed half-spaces in relativistic quantum field theories on R 1,d-1. We show that in addition to the usual boost generator, there is a contribution to the modular Hamiltonian at first order in the shape deformation, proportional to the integral of the null components of the stress tensor along the Rindler horizon. We use this fact along with monotonicity of relative entropy to prove the averaged null energy condition in Minkowski space-time. This subsequently gives a new proof of the Hofman-Maldacena bounds on the parameters appearing in CFT three-point functions. Ourmore » main technical advance involves adapting newly developed perturbative methods for calculating entanglement entropy to the problem at hand. Our methods were recently used to prove certain results on the shape dependence of entanglement in CFTs and here we generalize these results to excited states and real time dynamics. Finally, we discuss the AdS/CFT counterpart of this result, making connection with the recently proposed gravitational dual for modular Hamiltonians in holographic theories.« less
The maximum entropy production principle: two basic questions.
Martyushev, Leonid M
2010-05-12
The overwhelming majority of maximum entropy production applications to ecological and environmental systems are based on thermodynamics and statistical physics. Here, we discuss briefly maximum entropy production principle and raises two questions: (i) can this principle be used as the basis for non-equilibrium thermodynamics and statistical mechanics and (ii) is it possible to 'prove' the principle? We adduce one more proof which is most concise today.
Entropy production during hadronization of a quark-gluon plasma
NASA Astrophysics Data System (ADS)
Biró, Tamás S.; Schram, Zsolt; Jenkovszky, László
2018-02-01
We revisit some physical pictures for the hadronization of quark-gluon plasma, concentrating on the problem of entropy production during processes where the number of degrees of freedom is seemingly reduced due to color confinement. Based on observations on Regge trajectories we propose not having an infinite tower of hadronic resonances. We discuss possible entropy production mechanisms far from equilibrium in terms of stochastic dynamics.
Entanglement entropy and entanglement spectrum of the Kitaev model.
Yao, Hong; Qi, Xiao-Liang
2010-08-20
In this letter, we obtain an exact formula for the entanglement entropy of the ground state and all excited states of the Kitaev model. Remarkably, the entanglement entropy can be expressed in a simple separable form S = SG+SF, with SF the entanglement entropy of a free Majorana fermion system and SG that of a Z2 gauge field. The Z2 gauge field part contributes to the universal "topological entanglement entropy" of the ground state while the fermion part is responsible for the nonlocal entanglement carried by the Z2 vortices (visons) in the non-Abelian phase. Our result also enables the calculation of the entire entanglement spectrum and the more general Renyi entropy of the Kitaev model. Based on our results we propose a new quantity to characterize topologically ordered states--the capacity of entanglement, which can distinguish the st ates with and without topologically protected gapless entanglement spectrum.
Spin-phase-space-entropy production
NASA Astrophysics Data System (ADS)
Santos, Jader P.; Céleri, Lucas C.; Brito, Frederico; Landi, Gabriel T.; Paternostro, Mauro
2018-05-01
Quantifying the degree of irreversibility of an open system dynamics represents a problem of both fundamental and applied relevance. Even though a well-known framework exists for thermal baths, the results give diverging results in the limit of zero temperature and are also not readily extended to nonequilibrium reservoirs, such as dephasing baths. Aimed at filling this gap, in this paper we introduce a phase-space-entropy production framework for quantifying the irreversibility of spin systems undergoing Lindblad dynamics. The theory is based on the spin Husimi-Q function and its corresponding phase-space entropy, known as Wehrl entropy. Unlike the von Neumann entropy production rate, we show that in our framework, the Wehrl entropy production rate remains valid at any temperature and is also readily extended to arbitrary nonequilibrium baths. As an application, we discuss the irreversibility associated with the interaction of a two-level system with a single-photon pulse, a problem which cannot be treated using the conventional approach.
Entropy of black holes with multiple horizons
NASA Astrophysics Data System (ADS)
He, Yun; Ma, Meng-Sen; Zhao, Ren
2018-05-01
We examine the entropy of black holes in de Sitter space and black holes surrounded by quintessence. These black holes have multiple horizons, including at least the black hole event horizon and a horizon outside it (cosmological horizon for de Sitter black holes and "quintessence horizon" for the black holes surrounded by quintessence). Based on the consideration that the two horizons are not independent each other, we conjecture that the total entropy of these black holes should not be simply the sum of entropies of the two horizons, but should have an extra term coming from the correlations between the two horizons. Different from our previous works, in this paper we consider the cosmological constant as the variable and employ an effective method to derive the explicit form of the entropy. We also try to discuss the thermodynamic stabilities of these black holes according to the entropy and the effective temperature.
Compression based entropy estimation of heart rate variability on multiple time scales.
Baumert, Mathias; Voss, Andreas; Javorka, Michal
2013-01-01
Heart rate fluctuates beat by beat in a complex manner. The aim of this study was to develop a framework for entropy assessment of heart rate fluctuations on multiple time scales. We employed the Lempel-Ziv algorithm for lossless data compression to investigate the compressibility of RR interval time series on different time scales, using a coarse-graining procedure. We estimated the entropy of RR interval time series of 20 young and 20 old subjects and also investigated the compressibility of randomly shuffled surrogate RR time series. The original RR time series displayed significantly smaller compression entropy values than randomized RR interval data. The RR interval time series of older subjects showed significantly different entropy characteristics over multiple time scales than those of younger subjects. In conclusion, data compression may be useful approach for multiscale entropy assessment of heart rate variability.
Entropy factor for randomness quantification in neuronal data.
Rajdl, K; Lansky, P; Kostal, L
2017-11-01
A novel measure of neural spike train randomness, an entropy factor, is proposed. It is based on the Shannon entropy of the number of spikes in a time window and can be seen as an analogy to the Fano factor. Theoretical properties of the new measure are studied for equilibrium renewal processes and further illustrated on gamma and inverse Gaussian probability distributions of interspike intervals. Finally, the entropy factor is evaluated from the experimental records of spontaneous activity in macaque primary visual cortex and compared to its theoretical behavior deduced for the renewal process models. Both theoretical and experimental results show substantial differences between the Fano and entropy factors. Rather paradoxically, an increase in the variability of spike count is often accompanied by an increase of its predictability, as evidenced by the entropy factor. Copyright © 2017 The Authors. Published by Elsevier Ltd.. All rights reserved.
NASA Astrophysics Data System (ADS)
Kandrup, Henry E.
1988-06-01
This paper reexamines the statistical quantum field theory of a free, minimally coupled, real scalar field Φ in a statically bounded, classical Friedmann cosmology, where the time-dependent scale factor Ω(t) tends to constant values Ω1 and Ω2 for t
Semiclassical (qft) and Quantum (string) Rotating Black Holes and Their Evaporation:. New Results
NASA Astrophysics Data System (ADS)
Bouchareb, A.; Ramón Medrano, M.; Sánchez, N. G.
Combination of both quantum field theory (QFT) and string theory in curved backgrounds in a consistent framework, the string analogue model, allows us to provide a full picture of the Kerr-Newman black hole and its evaporation going beyond the current picture. We compute the quantum emission cross-section of strings by a Kerr-Newman black hole (KNbh). It shows the black hole emission at the Hawking temperature Tsem in the early stage of evaporation and the new string emission featuring a Hagedorn transition into a string state of temperature Ts at the last stages. New bounds on J and Q emerge in the quantum string regime (besides the known ones of the classical/semiclassical QFT regime). The last state of evaporation of a semiclassical Kerr-Newman black hole with mass M > mPl, angular momentum J and charge Q is a string state of temperature Ts, string mass Ms, J = 0 and Q = 0, decaying as usual quantum strings do into all kinds of particles. (Naturally, in this framework, there is no loss of information, (there is no paradox at all).) We compute the string entropy Ss(m, j) from the microscopic string density of states of mass m and spin mode j, ρ(m, j). (Besides the Hagedorn transition at Ts) we find for high j (extremal string states j → m2α‧c), a new phase transition at a temperature Tsj = √ {j/hbar }Ts, higher than Ts. By precisely identifying the semiclassical and quantum (string) gravity regimes, we find a new formula for the Kerr black hole entropy Ssem(M, J), as a function of the usual Bekenstein-Hawking entropy S sem(0). For M ≫ mPl and J < GM2/c, S sem(0) is the leading term, but for high angular momentum, (nearly extremal case J = GM2/c), a gravitational phase transition operates and the whole entropy Ssem is drastically different from the Bekenstein-Hawking entropy S sem(0). This new extremal black hole transition occurs at a temperature Tsem J = (J/ℏ)Tsem, higher than the Hawking temperature Tsem.
Minimal entropy approximation for cellular automata
NASA Astrophysics Data System (ADS)
Fukś, Henryk
2014-02-01
We present a method for the construction of approximate orbits of measures under the action of cellular automata which is complementary to the local structure theory. The local structure theory is based on the idea of Bayesian extension, that is, construction of a probability measure consistent with given block probabilities and maximizing entropy. If instead of maximizing entropy one minimizes it, one can develop another method for the construction of approximate orbits, at the heart of which is the iteration of finite-dimensional maps, called minimal entropy maps. We present numerical evidence that the minimal entropy approximation sometimes outperforms the local structure theory in characterizing the properties of cellular automata. The density response curve for elementary CA rule 26 is used to illustrate this claim.
Entropy of adsorption of mixed surfactants from solutions onto the air/water interface
Chen, L.-W.; Chen, J.-H.; Zhou, N.-F.
1995-01-01
The partial molar entropy change for mixed surfactant molecules adsorbed from solution at the air/water interface has been investigated by surface thermodynamics based upon the experimental surface tension isotherms at various temperatures. Results for different surfactant mixtures of sodium dodecyl sulfate and sodium tetradecyl sulfate, decylpyridinium chloride and sodium alkylsulfonates have shown that the partial molar entropy changes for adsorption of the mixed surfactants were generally negative and decreased with increasing adsorption to a minimum near the maximum adsorption and then increased abruptly. The entropy decrease can be explained by the adsorption-orientation of surfactant molecules in the adsorbed monolayer and the abrupt entropy increase at the maximum adsorption is possible due to the strong repulsion between the adsorbed molecules.
Entropy, complexity, and Markov diagrams for random walk cancer models
Newton, Paul K.; Mason, Jeremy; Hurt, Brian; Bethel, Kelly; Bazhenova, Lyudmila; Nieva, Jorge; Kuhn, Peter
2014-01-01
The notion of entropy is used to compare the complexity associated with 12 common cancers based on metastatic tumor distribution autopsy data. We characterize power-law distributions, entropy, and Kullback-Liebler divergence associated with each primary cancer as compared with data for all cancer types aggregated. We then correlate entropy values with other measures of complexity associated with Markov chain dynamical systems models of progression. The Markov transition matrix associated with each cancer is associated with a directed graph model where nodes are anatomical locations where a metastatic tumor could develop, and edge weightings are transition probabilities of progression from site to site. The steady-state distribution corresponds to the autopsy data distribution. Entropy correlates well with the overall complexity of the reduced directed graph structure for each cancer and with a measure of systemic interconnectedness of the graph, called graph conductance. The models suggest that grouping cancers according to their entropy values, with skin, breast, kidney, and lung cancers being prototypical high entropy cancers, stomach, uterine, pancreatic and ovarian being mid-level entropy cancers, and colorectal, cervical, bladder, and prostate cancers being prototypical low entropy cancers, provides a potentially useful framework for viewing metastatic cancer in terms of predictability, complexity, and metastatic potential. PMID:25523357
On the Consequences of Clausius-Duhem Inequality for Electrolyte Solutions
NASA Astrophysics Data System (ADS)
Reis, Martina; Bassi, Adalberto Bono Maurizio Sacchi
2014-03-01
Based on the fundamentals of thermo-statics, non-equilibrium thermodynamics theories frequently employ an entropy inequality, where the entropy flux is collinear to the heat flux, and the entropy supply is proportional to the energy supply. Although this assumption is suitable for many material bodies, e.g. heat-conducting viscous fluids, there is a class of materials for which these assumptions are not valid. By assuming that the entropy flux and the entropy supply are constitutive quantities, in this work it is demonstrated that the entropy flux for a reacting ionic mixture of non-volatile solutes presents a non-collinear term due to the diffusive fluxes. The consequences of the collinearity between the entropy flux and the heat flux, as well as the proportionality of the entropy supply and the energy supply on the stability of chemical systems are also investigated. Furthermore, by considering an electrolyte solution of non-volatile solutes in phase equilibrium with water vapor, and the constitutive nature of the entropy flux, the stability of a vapor-electrolyte solution interface is studied. Despite this work only deals with electrolyte solutions, the results presented can be easily extended to more complex chemical reacting systems. The first author acknowledges financial support from CNPq (National Counsel of Technological and Scientific Development).
Efficiency bounds for nonequilibrium heat engines
DOE Office of Scientific and Technical Information (OSTI.GOV)
Mehta, Pankaj; Polkovnikov, Anatoli, E-mail: asp@bu.edu
2013-05-15
We analyze the efficiency of thermal engines (either quantum or classical) working with a single heat reservoir like an atmosphere. The engine first gets an energy intake, which can be done in an arbitrary nonequilibrium way e.g. combustion of fuel. Then the engine performs the work and returns to the initial state. We distinguish two general classes of engines where the working body first equilibrates within itself and then performs the work (ergodic engine) or when it performs the work before equilibrating (non-ergodic engine). We show that in both cases the second law of thermodynamics limits their efficiency. For ergodicmore » engines we find a rigorous upper bound for the efficiency, which is strictly smaller than the equivalent Carnot efficiency. I.e. the Carnot efficiency can be never achieved in single reservoir heat engines. For non-ergodic engines the efficiency can be higher and can exceed the equilibrium Carnot bound. By extending the fundamental thermodynamic relation to nonequilibrium processes, we find a rigorous thermodynamic bound for the efficiency of both ergodic and non-ergodic engines and show that it is given by the relative entropy of the nonequilibrium and initial equilibrium distributions. These results suggest a new general strategy for designing more efficient engines. We illustrate our ideas by using simple examples. -- Highlights: ► Derived efficiency bounds for heat engines working with a single reservoir. ► Analyzed both ergodic and non-ergodic engines. ► Showed that non-ergodic engines can be more efficient. ► Extended fundamental thermodynamic relation to arbitrary nonequilibrium processes.« less
Entanglement entropy and the colored Jones polynomial
NASA Astrophysics Data System (ADS)
Balasubramanian, Vijay; DeCross, Matthew; Fliss, Jackson; Kar, Arjun; Leigh, Robert G.; Parrikar, Onkar
2018-05-01
We study the multi-party entanglement structure of states in Chern-Simons theory created by performing the path integral on 3-manifolds with linked torus boundaries, called link complements. For gauge group SU(2), the wavefunctions of these states (in a particular basis) are the colored Jones polynomials of the corresponding links. We first review the case of U(1) Chern-Simons theory where these are stabilizer states, a fact we use to re-derive an explicit formula for the entanglement entropy across a general link bipartition. We then present the following results for SU(2) Chern-Simons theory: (i) The entanglement entropy for a bipartition of a link gives a lower bound on the genus of surfaces in the ambient S 3 separating the two sublinks. (ii) All torus links (namely, links which can be drawn on the surface of a torus) have a GHZ-like entanglement structure — i.e., partial traces leave a separable state. By contrast, through explicit computation, we test in many examples that hyperbolic links (namely, links whose complements admit hyperbolic structures) have W-like entanglement — i.e., partial traces leave a non-separable state. (iii) Finally, we consider hyperbolic links in the complexified SL(2,C) Chern-Simons theory, which is closely related to 3d Einstein gravity with a negative cosmological constant. In the limit of small Newton constant, we discuss how the entanglement structure is controlled by the Neumann-Zagier potential on the moduli space of hyperbolic structures on the link complement.
Bubble Entropy: An Entropy Almost Free of Parameters.
Manis, George; Aktaruzzaman, Md; Sassi, Roberto
2017-11-01
Objective : A critical point in any definition of entropy is the selection of the parameters employed to obtain an estimate in practice. We propose a new definition of entropy aiming to reduce the significance of this selection. Methods: We call the new definition Bubble Entropy . Bubble Entropy is based on permutation entropy, where the vectors in the embedding space are ranked. We use the bubble sort algorithm for the ordering procedure and count instead the number of swaps performed for each vector. Doing so, we create a more coarse-grained distribution and then compute the entropy of this distribution. Results: Experimental results with both real and synthetic HRV signals showed that bubble entropy presents remarkable stability and exhibits increased descriptive and discriminating power compared to all other definitions, including the most popular ones. Conclusion: The definition proposed is almost free of parameters. The most common ones are the scale factor r and the embedding dimension m . In our definition, the scale factor is totally eliminated and the importance of m is significantly reduced. The proposed method presents increased stability and discriminating power. Significance: After the extensive use of some entropy measures in physiological signals, typical values for their parameters have been suggested, or at least, widely used. However, the parameters are still there, application and dataset dependent, influencing the computed value and affecting the descriptive power. Reducing their significance or eliminating them alleviates the problem, decoupling the method from the data and the application, and eliminating subjective factors. Objective : A critical point in any definition of entropy is the selection of the parameters employed to obtain an estimate in practice. We propose a new definition of entropy aiming to reduce the significance of this selection. Methods: We call the new definition Bubble Entropy . Bubble Entropy is based on permutation entropy, where the vectors in the embedding space are ranked. We use the bubble sort algorithm for the ordering procedure and count instead the number of swaps performed for each vector. Doing so, we create a more coarse-grained distribution and then compute the entropy of this distribution. Results: Experimental results with both real and synthetic HRV signals showed that bubble entropy presents remarkable stability and exhibits increased descriptive and discriminating power compared to all other definitions, including the most popular ones. Conclusion: The definition proposed is almost free of parameters. The most common ones are the scale factor r and the embedding dimension m . In our definition, the scale factor is totally eliminated and the importance of m is significantly reduced. The proposed method presents increased stability and discriminating power. Significance: After the extensive use of some entropy measures in physiological signals, typical values for their parameters have been suggested, or at least, widely used. However, the parameters are still there, application and dataset dependent, influencing the computed value and affecting the descriptive power. Reducing their significance or eliminating them alleviates the problem, decoupling the method from the data and the application, and eliminating subjective factors.
The pressure and entropy of a unitary Fermi gas with particle-hole fluctuation
NASA Astrophysics Data System (ADS)
Gong, Hao; Ruan, Xiao-Xia; Zong, Hong-Shi
2018-01-01
We calculate the pressure and entropy of a unitary Fermi gas based on universal relations combined with our previous prediction of energy which was calculated within the framework of the non-self-consistent T-matrix approximation with particle-hole fluctuation. The resulting entropy and pressure are compared with the experimental data and the theoretical results without induced interaction. For entropy, we find good agreement between our results with particle-hole fluctuation and the experimental measurements reported by ENS group and MIT experiment. For pressure, our results suffer from a systematic upshift compared to MIT data.
Towards operational interpretations of generalized entropies
NASA Astrophysics Data System (ADS)
Topsøe, Flemming
2010-12-01
The driving force behind our study has been to overcome the difficulties you encounter when you try to extend the clear and convincing operational interpretations of classical Boltzmann-Gibbs-Shannon entropy to other notions, especially to generalized entropies as proposed by Tsallis. Our approach is philosophical, based on speculations regarding the interplay between truth, belief and knowledge. The main result demonstrates that, accepting philosophically motivated assumptions, the only possible measures of entropy are those suggested by Tsallis - which, as we know, include classical entropy. This result constitutes, so it seems, a more transparent interpretation of entropy than previously available. However, further research to clarify the assumptions is still needed. Our study points to the thesis that one should never consider the notion of entropy in isolation - in order to enable a rich and technically smooth study, further concepts, such as divergence, score functions and descriptors or controls should be included in the discussion. This will clarify the distinction between Nature and Observer and facilitate a game theoretical discussion. The usefulness of this distinction and the subsequent exploitation of game theoretical results - such as those connected with the notion of Nash equilibrium - is demonstrated by a discussion of the Maximum Entropy Principle.
A Comparison of Multiscale Permutation Entropy Measures in On-Line Depth of Anesthesia Monitoring
Li, Xiaoli; Li, Duan; Li, Yongwang; Ursino, Mauro
2016-01-01
Objective Multiscale permutation entropy (MSPE) is becoming an interesting tool to explore neurophysiological mechanisms in recent years. In this study, six MSPE measures were proposed for on-line depth of anesthesia (DoA) monitoring to quantify the anesthetic effect on the real-time EEG recordings. The performance of these measures in describing the transient characters of simulated neural populations and clinical anesthesia EEG were evaluated and compared. Methods Six MSPE algorithms—derived from Shannon permutation entropy (SPE), Renyi permutation entropy (RPE) and Tsallis permutation entropy (TPE) combined with the decomposition procedures of coarse-graining (CG) method and moving average (MA) analysis—were studied. A thalamo-cortical neural mass model (TCNMM) was used to generate noise-free EEG under anesthesia to quantitatively assess the robustness of each MSPE measure against noise. Then, the clinical anesthesia EEG recordings from 20 patients were analyzed with these measures. To validate their effectiveness, the ability of six measures were compared in terms of tracking the dynamical changes in EEG data and the performance in state discrimination. The Pearson correlation coefficient (R) was used to assess the relationship among MSPE measures. Results CG-based MSPEs failed in on-line DoA monitoring at multiscale analysis. In on-line EEG analysis, the MA-based MSPE measures at 5 decomposed scales could track the transient changes of EEG recordings and statistically distinguish the awake state, unconsciousness and recovery of consciousness (RoC) state significantly. Compared to single-scale SPE and RPE, MSPEs had better anti-noise ability and MA-RPE at scale 5 performed best in this aspect. MA-TPE outperformed other measures with faster tracking speed of the loss of unconsciousness. Conclusions MA-based multiscale permutation entropies have the potential for on-line anesthesia EEG analysis with its simple computation and sensitivity to drug effect changes. CG-based multiscale permutation entropies may fail to describe the characteristics of EEG at high decomposition scales. PMID:27723803
A Comparison of Multiscale Permutation Entropy Measures in On-Line Depth of Anesthesia Monitoring.
Su, Cui; Liang, Zhenhu; Li, Xiaoli; Li, Duan; Li, Yongwang; Ursino, Mauro
2016-01-01
Multiscale permutation entropy (MSPE) is becoming an interesting tool to explore neurophysiological mechanisms in recent years. In this study, six MSPE measures were proposed for on-line depth of anesthesia (DoA) monitoring to quantify the anesthetic effect on the real-time EEG recordings. The performance of these measures in describing the transient characters of simulated neural populations and clinical anesthesia EEG were evaluated and compared. Six MSPE algorithms-derived from Shannon permutation entropy (SPE), Renyi permutation entropy (RPE) and Tsallis permutation entropy (TPE) combined with the decomposition procedures of coarse-graining (CG) method and moving average (MA) analysis-were studied. A thalamo-cortical neural mass model (TCNMM) was used to generate noise-free EEG under anesthesia to quantitatively assess the robustness of each MSPE measure against noise. Then, the clinical anesthesia EEG recordings from 20 patients were analyzed with these measures. To validate their effectiveness, the ability of six measures were compared in terms of tracking the dynamical changes in EEG data and the performance in state discrimination. The Pearson correlation coefficient (R) was used to assess the relationship among MSPE measures. CG-based MSPEs failed in on-line DoA monitoring at multiscale analysis. In on-line EEG analysis, the MA-based MSPE measures at 5 decomposed scales could track the transient changes of EEG recordings and statistically distinguish the awake state, unconsciousness and recovery of consciousness (RoC) state significantly. Compared to single-scale SPE and RPE, MSPEs had better anti-noise ability and MA-RPE at scale 5 performed best in this aspect. MA-TPE outperformed other measures with faster tracking speed of the loss of unconsciousness. MA-based multiscale permutation entropies have the potential for on-line anesthesia EEG analysis with its simple computation and sensitivity to drug effect changes. CG-based multiscale permutation entropies may fail to describe the characteristics of EEG at high decomposition scales.
Autonomous entropy-based intelligent experimental design
NASA Astrophysics Data System (ADS)
Malakar, Nabin Kumar
2011-07-01
The aim of this thesis is to explore the application of probability and information theory in experimental design, and to do so in a way that combines what we know about inference and inquiry in a comprehensive and consistent manner. Present day scientific frontiers involve data collection at an ever-increasing rate. This requires that we find a way to collect the most relevant data in an automated fashion. By following the logic of the scientific method, we couple an inference engine with an inquiry engine to automate the iterative process of scientific learning. The inference engine involves Bayesian machine learning techniques to estimate model parameters based upon both prior information and previously collected data, while the inquiry engine implements data-driven exploration. By choosing an experiment whose distribution of expected results has the maximum entropy, the inquiry engine selects the experiment that maximizes the expected information gain. The coupled inference and inquiry engines constitute an autonomous learning method for scientific exploration. We apply it to a robotic arm to demonstrate the efficacy of the method. Optimizing inquiry involves searching for an experiment that promises, on average, to be maximally informative. If the set of potential experiments is described by many parameters, the search involves a high-dimensional entropy space. In such cases, a brute force search method will be slow and computationally expensive. We develop an entropy-based search algorithm, called nested entropy sampling, to select the most informative experiment. This helps to reduce the number of computations necessary to find the optimal experiment. We also extended the method of maximizing entropy, and developed a method of maximizing joint entropy so that it could be used as a principle of collaboration between two robots. This is a major achievement of this thesis, as it allows the information-based collaboration between two robotic units towards a same goal in an automated fashion.
Steepest entropy ascent quantum thermodynamic model of electron and phonon transport
NASA Astrophysics Data System (ADS)
Li, Guanchen; von Spakovsky, Michael R.; Hin, Celine
2018-01-01
An advanced nonequilibrium thermodynamic model for electron and phonon transport is formulated based on the steepest-entropy-ascent quantum thermodynamics framework. This framework, based on the principle of steepest entropy ascent (or the equivalent maximum entropy production principle), inherently satisfies the laws of thermodynamics and mechanics and is applicable at all temporal and spatial scales even in the far-from-equilibrium realm. Specifically, the model is proven to recover the Boltzmann transport equations in the near-equilibrium limit and the two-temperature model of electron-phonon coupling when no dispersion is assumed. The heat and mass transport at a temperature discontinuity across a homogeneous interface where the dispersion and coupling of electron and phonon transport are both considered are then modeled. Local nonequilibrium system evolution and nonquasiequilibrium interactions are predicted and the results discussed.
Differential effects of gender on entropy perception
NASA Astrophysics Data System (ADS)
Satcharoen, Kleddao
2017-12-01
The purpose of this research is to examine differences in perception of entropy (color intensity) between male and female computer users. The objectives include identifying gender-based differences in entropy intention and exploring the potential effects of these differences (if any) on user interface design. The research is an effort to contribute to an emerging field of interest in gender as it relates to science, engineering and technology (SET), particularly user interface design. Currently, there is limited evidence on the role of gender in user interface design and in use of technology generally, with most efforts at gender-differentiated or customized design based on stereotypes and assumptions about female use of technology or the assumption of a default position based on male preferences. Image entropy was selected as a potential characteristic where gender could be a factor in perception because of known differences in color perception acuity between male and female individuals, even where there is no known color perception abnormality (which is more common with males). Although the literature review suggested that training could offset differences in color perception and identification, tests in untrained subject groups routinely show that females are more able to identify, match, and differentiate colors, and that there is a stronger emotional and psychosocial association of color for females. Since image entropy is associated with information content and image salience, the ability to identify areas of high entropy could make a difference in user perception and technological capabilities.
Wavelet entropy of BOLD time series: An application to Rolandic epilepsy.
Gupta, Lalit; Jansen, Jacobus F A; Hofman, Paul A M; Besseling, René M H; de Louw, Anton J A; Aldenkamp, Albert P; Backes, Walter H
2017-12-01
To assess the wavelet entropy for the characterization of intrinsic aberrant temporal irregularities in the time series of resting-state blood-oxygen-level-dependent (BOLD) signal fluctuations. Further, to evaluate the temporal irregularities (disorder/order) on a voxel-by-voxel basis in the brains of children with Rolandic epilepsy. The BOLD time series was decomposed using the discrete wavelet transform and the wavelet entropy was calculated. Using a model time series consisting of multiple harmonics and nonstationary components, the wavelet entropy was compared with Shannon and spectral (Fourier-based) entropy. As an application, the wavelet entropy in 22 children with Rolandic epilepsy was compared to 22 age-matched healthy controls. The images were obtained by performing resting-state functional magnetic resonance imaging (fMRI) using a 3T system, an 8-element receive-only head coil, and an echo planar imaging pulse sequence ( T2*-weighted). The wavelet entropy was also compared to spectral entropy, regional homogeneity, and Shannon entropy. Wavelet entropy was found to identify the nonstationary components of the model time series. In Rolandic epilepsy patients, a significantly elevated wavelet entropy was observed relative to controls for the whole cerebrum (P = 0.03). Spectral entropy (P = 0.41), regional homogeneity (P = 0.52), and Shannon entropy (P = 0.32) did not reveal significant differences. The wavelet entropy measure appeared more sensitive to detect abnormalities in cerebral fluctuations represented by nonstationary effects in the BOLD time series than more conventional measures. This effect was observed in the model time series as well as in Rolandic epilepsy. These observations suggest that the brains of children with Rolandic epilepsy exhibit stronger nonstationary temporal signal fluctuations than controls. 2 Technical Efficacy: Stage 3 J. Magn. Reson. Imaging 2017;46:1728-1737. © 2017 International Society for Magnetic Resonance in Medicine.
Adjusting protein graphs based on graph entropy.
Peng, Sheng-Lung; Tsay, Yu-Wei
2014-01-01
Measuring protein structural similarity attempts to establish a relationship of equivalence between polymer structures based on their conformations. In several recent studies, researchers have explored protein-graph remodeling, instead of looking a minimum superimposition for pairwise proteins. When graphs are used to represent structured objects, the problem of measuring object similarity become one of computing the similarity between graphs. Graph theory provides an alternative perspective as well as efficiency. Once a protein graph has been created, its structural stability must be verified. Therefore, a criterion is needed to determine if a protein graph can be used for structural comparison. In this paper, we propose a measurement for protein graph remodeling based on graph entropy. We extend the concept of graph entropy to determine whether a graph is suitable for representing a protein. The experimental results suggest that when applied, graph entropy helps a conformational on protein graph modeling. Furthermore, it indirectly contributes to protein structural comparison if a protein graph is solid.