Predictive uncertainty in auditory sequence processing

PubMed Central

Hansen, Niels Chr.; Pearce, Marcus T.

2014-01-01

Previous studies of auditory expectation have focused on the expectedness perceived by listeners retrospectively in response to events. In contrast, this research examines predictive uncertainty—a property of listeners' prospective state of expectation prior to the onset of an event. We examine the information-theoretic concept of Shannon entropy as a model of predictive uncertainty in music cognition. This is motivated by the Statistical Learning Hypothesis, which proposes that schematic expectations reflect probabilistic relationships between sensory events learned implicitly through exposure. Using probability estimates from an unsupervised, variable-order Markov model, 12 melodic contexts high in entropy and 12 melodic contexts low in entropy were selected from two musical repertoires differing in structural complexity (simple and complex). Musicians and non-musicians listened to the stimuli and provided explicit judgments of perceived uncertainty (explicit uncertainty). We also examined an indirect measure of uncertainty computed as the entropy of expectedness distributions obtained using a classical probe-tone paradigm where listeners rated the perceived expectedness of the final note in a melodic sequence (inferred uncertainty). Finally, we simulate listeners' perception of expectedness and uncertainty using computational models of auditory expectation. A detailed model comparison indicates which model parameters maximize fit to the data and how they compare to existing models in the literature. The results show that listeners experience greater uncertainty in high-entropy musical contexts than low-entropy contexts. This effect is particularly apparent for inferred uncertainty and is stronger in musicians than non-musicians. Consistent with the Statistical Learning Hypothesis, the results suggest that increased domain-relevant training is associated with an increasingly accurate cognitive model of probabilistic structure in music. PMID:25295018

Inferring Markov chains: Bayesian estimation, model comparison, entropy rate, and out-of-class modeling.

PubMed

Strelioff, Christopher C; Crutchfield, James P; Hübler, Alfred W

2007-07-01

Markov chains are a natural and well understood tool for describing one-dimensional patterns in time or space. We show how to infer kth order Markov chains, for arbitrary k , from finite data by applying Bayesian methods to both parameter estimation and model-order selection. Extending existing results for multinomial models of discrete data, we connect inference to statistical mechanics through information-theoretic (type theory) techniques. We establish a direct relationship between Bayesian evidence and the partition function which allows for straightforward calculation of the expectation and variance of the conditional relative entropy and the source entropy rate. Finally, we introduce a method that uses finite data-size scaling with model-order comparison to infer the structure of out-of-class processes.

Temporal polyethism, life expectancy, and entropy of workers of the ant Ectatomma vizottoi Almeida, 1987 (Formicidae: Ectatomminae).

PubMed

Santana Vieira, Alexsandro; Desidério Fernandes, Wedson; Fernando Antonialli-Junior, William

2010-05-01

We investigated the changes in the behavioral repertoire over the course of life and determined the life expectancy and entropy of workers of the ant Ectatomma vizottoi. Newly emerged ants were individually marked with model airplane paint for observation of behaviors and determination of the age and life expectancy. Ants were divided into two groups: young and old workers. The 36 behaviors observed were divided into eight categories. Workers exhibit a clear division of tasks throughout their lives, with young workers performing more tasks inside the colony and old workers, outside, unlike species that have small colonies. This species also exhibits an intermediate life expectancy compared to workers of other species that are also intermediary in size. This supports the hypothesis of a relationship between size and maximum life expectancy, but it also suggests that other factors may also be acting in concert. Entropy value shows a high mortality rate during the first life intervals.

Archaeon and archaeal virus diversity classification via sequence entropy and fractal dimension

NASA Astrophysics Data System (ADS)

Tremberger, George, Jr.; Gallardo, Victor; Espinoza, Carola; Holden, Todd; Gadura, N.; Cheung, E.; Schneider, P.; Lieberman, D.; Cheung, T.

2010-09-01

Archaea are important potential candidates in astrobiology as their metabolism includes solar, inorganic and organic energy sources. Archaeal viruses would also be expected to be present in a sustainable archaeal exobiological community. Genetic sequence Shannon entropy and fractal dimension can be used to establish a two-dimensional measure for classification and phylogenetic study of these organisms. A sequence fractal dimension can be calculated from a numerical series consisting of the atomic numbers of each nucleotide. Archaeal 16S and 23S ribosomal RNA sequences were studied. Outliers in the 16S rRNA fractal dimension and entropy plot were found to be halophilic archaea. Positive correlation (R-square ~ 0.75, N = 18) was observed between fractal dimension and entropy across the studied species. The 16S ribosomal RNA sequence entropy correlates with the 23S ribosomal RNA sequence entropy across species with R-square 0.93, N = 18. Entropy values correspond positively with branch lengths of a published phylogeny. The studied archaeal virus sequences have high fractal dimensions of 2.02 or more. A comparison of selected extremophile sequences with archaeal sequences from the Humboldt Marine Ecosystem database (Wood-Hull Oceanography Institute, MIT) suggests the presence of continuous sequence expression as inferred from distributions of entropy and fractal dimension, consistent with the diversity expected in an exobiological archaeal community.

Resolution of Probabilistic Weather Forecasts with Application in Disease Management.

PubMed

Hughes, G; McRoberts, N; Burnett, F J

2017-02-01

Predictive systems in disease management often incorporate weather data among the disease risk factors, and sometimes this comes in the form of forecast weather data rather than observed weather data. In such cases, it is useful to have an evaluation of the operational weather forecast, in addition to the evaluation of the disease forecasts provided by the predictive system. Typically, weather forecasts and disease forecasts are evaluated using different methodologies. However, the information theoretic quantity expected mutual information provides a basis for evaluating both kinds of forecast. Expected mutual information is an appropriate metric for the average performance of a predictive system over a set of forecasts. Both relative entropy (a divergence, measuring information gain) and specific information (an entropy difference, measuring change in uncertainty) provide a basis for the assessment of individual forecasts.

Entropy functional and the holographic attractor mechanism

DOE PAGES

Cabo-Bizet, Alejandro; Kol, Uri; Pando Zayas, Leopoldo A.; ...

2018-05-01

We provide a field theory interpretation of the attractor mechanism for asymptotically AdS4 dyonic BPS black holes whose entropy is captured by the supersymmetric index of the twisted ABJM theory at Chern-Simons level one. We holographically compute the renormalized off-shell quantum effective action in the twisted ABJM theory as a function of the supersymmetric fermion masses and the arbitrary vacuum expectation values of the dimension one scalar bilinear operators and show that extremizing the effective action with respect to the vacuum expectation values of the dimension one scalar bilinears is equivalent to the attractor mechanism in the bulk. In fact,more » we show that the holographic quantum effective action coincides with the entropy functional and, therefore, its value at the extremum reproduces the black hole entropy.« less

Thermal expansion anomaly regulated by entropy.

PubMed

Liu, Zi-Kui; Wang, Yi; Shang, ShunLi

2014-11-13

Thermal expansion, defined as the temperature dependence of volume under constant pressure, is a common phenomenon in nature and originates from anharmonic lattice dynamics. However, it has been poorly understood how thermal expansion can show anomalies such as colossal positive, zero, or negative thermal expansion (CPTE, ZTE, or NTE), especially in quantitative terms. Here we show that changes in configurational entropy due to metastable micro(scopic)states can lead to quantitative prediction of these anomalies. We integrate the Maxwell relation, statistic mechanics, and first-principles calculations to demonstrate that when the entropy is increased by pressure, NTE occurs such as in Invar alloy (Fe3Pt, for example), silicon, ice, and water, and when the entropy is decreased dramatically by pressure, CPTE is expected such as in anti-Invar cerium, ice and water. Our findings provide a theoretic framework to understand and predict a broad range of anomalies in nature in addition to thermal expansion, which may include gigantic electrocaloric and electromechanical responses, anomalously reduced thermal conductivity, and spin distributions.

Thermal Expansion Anomaly Regulated by Entropy

NASA Astrophysics Data System (ADS)

Liu, Zi-Kui; Wang, Yi; Shang, Shunli

2014-11-01

Thermal expansion, defined as the temperature dependence of volume under constant pressure, is a common phenomenon in nature and originates from anharmonic lattice dynamics. However, it has been poorly understood how thermal expansion can show anomalies such as colossal positive, zero, or negative thermal expansion (CPTE, ZTE, or NTE), especially in quantitative terms. Here we show that changes in configurational entropy due to metastable micro(scopic)states can lead to quantitative prediction of these anomalies. We integrate the Maxwell relation, statistic mechanics, and first-principles calculations to demonstrate that when the entropy is increased by pressure, NTE occurs such as in Invar alloy (Fe3Pt, for example), silicon, ice, and water, and when the entropy is decreased dramatically by pressure, CPTE is expected such as in anti-Invar cerium, ice and water. Our findings provide a theoretic framework to understand and predict a broad range of anomalies in nature in addition to thermal expansion, which may include gigantic electrocaloric and electromechanical responses, anomalously reduced thermal conductivity, and spin distributions.

On variational definition of quantum entropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Belavkin, Roman V.

Entropy of distribution P can be defined in at least three different ways: 1) as the expectation of the Kullback-Leibler (KL) divergence of P from elementary δ-measures (in this case, it is interpreted as expected surprise); 2) as a negative KL-divergence of some reference measure ν from the probability measure P; 3) as the supremum of Shannon’s mutual information taken over all channels such that P is the output probability, in which case it is dual of some transportation problem. In classical (i.e. commutative) probability, all three definitions lead to the same quantity, providing only different interpretations of entropy. Inmore » non-commutative (i.e. quantum) probability, however, these definitions are not equivalent. In particular, the third definition, where the supremum is taken over all entanglements of two quantum systems with P being the output state, leads to the quantity that can be twice the von Neumann entropy. It was proposed originally by V. Belavkin and Ohya [1] and called the proper quantum entropy, because it allows one to define quantum conditional entropy that is always non-negative. Here we extend these ideas to define also quantum counterpart of proper cross-entropy and cross-information. We also show inequality for the values of classical and quantum information.« less

SUPERMODEL ANALYSIS OF A1246 AND J255: ON THE EVOLUTION OF GALAXY CLUSTERS FROM HIGH TO LOW ENTROPY STATES

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fusco-Femiano, R.; Lapi, A., E-mail: roberto.fuscofemiano@iaps.inaf.it

2015-02-10

We present an analysis of high-quality X-ray data out to the virial radius for the two galaxy clusters A1246 and GMBCG J255.34805+64.23661 (J255) by means of our entropy-based SuperModel. For A1246 we find that the spherically averaged entropy profile of the intracluster medium (ICM) progressively flattens outward, and that a nonthermal pressure component amounting to ≈20% of the total is required to support hydrostatic equilibrium in the outskirts; there we also estimate a modest value C ≈ 1.6 of the ICM clumping factor. These findings agree with previous analyses on other cool-core, relaxed clusters, and lend further support to themore » picture by Lapi et al. that relates the entropy flattening, the development of the nonthermal pressure component, and the azimuthal variation of ICM properties to weakening boundary shocks. In this scenario clusters are born in a high-entropy state throughout, and are expected to develop on similar timescales a low-entropy state both at the center due to cooling, and in the outskirts due to weakening shocks. However, the analysis of J255 testifies how such a typical evolutionary course can be interrupted or even reversed by merging especially at intermediate redshift, as predicted by Cavaliere et al. In fact, a merger has rejuvenated the ICM of this cluster at z ≈ 0.45 by reestablishing a high-entropy state in the outskirts, while leaving intact or erasing only partially the low-entropy, cool core at the center.« less

ECG contamination of EEG signals: effect on entropy.

PubMed

Chakrabarti, Dhritiman; Bansal, Sonia

2016-02-01

Entropy™ is a proprietary algorithm which uses spectral entropy analysis of electroencephalographic (EEG) signals to produce indices which are used as a measure of depth of hypnosis. We describe a report of electrocardiographic (ECG) contamination of EEG signals leading to fluctuating erroneous Entropy values. An explanation is provided for mechanism behind this observation by describing the spread of ECG signals in head and neck and its influence on EEG/Entropy by correlating the observation with the published Entropy algorithm. While the Entropy algorithm has been well conceived, there are still instances in which it can produce erroneous values. Such erroneous values and their cause may be identified by close scrutiny of the EEG waveform if Entropy values seem out of sync with that expected at given anaesthetic levels.

The nucleotide composition of microbial genomes indicates differential patterns of selection on core and accessory genomes.

PubMed

Bohlin, Jon; Eldholm, Vegard; Pettersson, John H O; Brynildsrud, Ola; Snipen, Lars

2017-02-10

The core genome consists of genes shared by the vast majority of a species and is therefore assumed to have been subjected to substantially stronger purifying selection than the more mobile elements of the genome, also known as the accessory genome. Here we examine intragenic base composition differences in core genomes and corresponding accessory genomes in 36 species, represented by the genomes of 731 bacterial strains, to assess the impact of selective forces on base composition in microbes. We also explore, in turn, how these results compare with findings for whole genome intragenic regions. We found that GC content in coding regions is significantly higher in core genomes than accessory genomes and whole genomes. Likewise, GC content variation within coding regions was significantly lower in core genomes than in accessory genomes and whole genomes. Relative entropy in coding regions, measured as the difference between observed and expected trinucleotide frequencies estimated from mononucleotide frequencies, was significantly higher in the core genomes than in accessory and whole genomes. Relative entropy was positively associated with coding region GC content within the accessory genomes, but not within the corresponding coding regions of core or whole genomes. The higher intragenic GC content and relative entropy, as well as the lower GC content variation, observed in the core genomes is most likely associated with selective constraints. It is unclear whether the positive association between GC content and relative entropy in the more mobile accessory genomes constitutes signatures of selection or selective neutral processes.

Information Entropy Analysis of the H1N1 Genetic Code

NASA Astrophysics Data System (ADS)

Martwick, Andy

2010-03-01

During the current H1N1 pandemic, viral samples are being obtained from large numbers of infected people world-wide and are being sequenced on the NCBI Influenza Virus Resource Database. The information entropy of the sequences was computed from the probability of occurrence of each nucleotide base at every position of each set of sequences using Shannon's definition of information entropy, [ H=∑bpb,2( 1pb ) ] where H is the observed information entropy at each nucleotide position and pb is the probability of the base pair of the nucleotides A, C, G, U. Information entropy of the current H1N1 pandemic is compared to reference human and swine H1N1 entropy. As expected, the current H1N1 entropy is in a low entropy state and has a very large mutation potential. Using the entropy method in mature genes we can identify low entropy regions of nucleotides that generally correlate to critical protein function.

Maximum Relative Entropy of Coherence: An Operational Coherence Measure.

PubMed

Bu, Kaifeng; Singh, Uttam; Fei, Shao-Ming; Pati, Arun Kumar; Wu, Junde

2017-10-13

The operational characterization of quantum coherence is the cornerstone in the development of the resource theory of coherence. We introduce a new coherence quantifier based on maximum relative entropy. We prove that the maximum relative entropy of coherence is directly related to the maximum overlap with maximally coherent states under a particular class of operations, which provides an operational interpretation of the maximum relative entropy of coherence. Moreover, we show that, for any coherent state, there are examples of subchannel discrimination problems such that this coherent state allows for a higher probability of successfully discriminating subchannels than that of all incoherent states. This advantage of coherent states in subchannel discrimination can be exactly characterized by the maximum relative entropy of coherence. By introducing a suitable smooth maximum relative entropy of coherence, we prove that the smooth maximum relative entropy of coherence provides a lower bound of one-shot coherence cost, and the maximum relative entropy of coherence is equivalent to the relative entropy of coherence in the asymptotic limit. Similar to the maximum relative entropy of coherence, the minimum relative entropy of coherence has also been investigated. We show that the minimum relative entropy of coherence provides an upper bound of one-shot coherence distillation, and in the asymptotic limit the minimum relative entropy of coherence is equivalent to the relative entropy of coherence.

Towards a second law for Lovelock theories

NASA Astrophysics Data System (ADS)

Bhattacharyya, Sayantani; Haehl, Felix M.; Kundu, Nilay; Loganayagam, R.; Rangamani, Mukund

2017-03-01

In classical general relativity described by Einstein-Hilbert gravity, black holes behave as thermodynamic objects. In particular, the laws of black hole mechanics can be interpreted as laws of thermodynamics. The first law of black hole mechanics extends to higher derivative theories via the Noether charge construction of Wald. One also expects the statement of the second law, which in Einstein-Hilbert theory owes to Hawking's area theorem, to extend to higher derivative theories. To argue for this however one needs a notion of entropy for dynamical black holes, which the Noether charge construction does not provide. We propose such an entropy function for the family of Lovelock theories, treating the higher derivative terms as perturbations to the Einstein-Hilbert theory. Working around a dynamical black hole solution, and making no assumptions about the amplitude of departure from equilibrium, we construct a candidate entropy functional valid to all orders in the low energy effective field theory. This entropy functional satisfies a second law, modulo a certain subtle boundary term, which deserves further investigation in non-spherically symmetric situations.

Entropic manifestations of topological order in three dimensions

NASA Astrophysics Data System (ADS)

Bullivant, Alex; Pachos, Jiannis K.

2016-03-01

We evaluate the entanglement entropy of exactly solvable Hamiltonians corresponding to general families of three-dimensional topological models. We show that the modification to the entropic area law due to three-dimensional topological properties is richer than the two-dimensional case. In addition to the reduction of the entropy caused by a nonzero vacuum expectation value of contractible loop operators, a topological invariant emerges that increases the entropy if the model consists of nontrivially braiding anyons. As a result the three-dimensional topological entanglement entropy provides only partial information about the two entropic topological invariants.

Casimir self-entropy of a spherical electromagnetic δ -function shell

NASA Astrophysics Data System (ADS)

Milton, Kimball A.; Kalauni, Pushpa; Parashar, Prachi; Li, Yang

2017-10-01

In this paper we continue our program of computing Casimir self-entropies of idealized electrical bodies. Here we consider an electromagnetic δ -function sphere ("semitransparent sphere") whose electric susceptibility has a transverse polarization with arbitrary strength. Dispersion is incorporated by a plasma-like model. In the strong-coupling limit, a perfectly conducting spherical shell is realized. We compute the entropy for both low and high temperatures. The transverse electric self-entropy is negative as expected, but the transverse magnetic self-entropy requires ultraviolet and infrared renormalization (subtraction), and, surprisingly, is only positive for sufficiently strong coupling. Results are robust under different regularization schemes. These rather surprising findings require further investigation.

Foreign exchange rate entropy evolution during financial crises

NASA Astrophysics Data System (ADS)

Stosic, Darko; Stosic, Dusan; Ludermir, Teresa; de Oliveira, Wilson; Stosic, Tatijana

2016-05-01

This paper examines the effects of financial crises on foreign exchange (FX) markets, where entropy evolution is measured for different exchange rates, using the time-dependent block entropy method. Empirical results suggest that financial crises are associated with significant increase of exchange rate entropy, reflecting instability in FX market dynamics. In accordance with phenomenological expectations, it is found that FX markets with large liquidity and large trading volume are more inert - they recover quicker from a crisis than markets with small liquidity and small trading volume. Moreover, our numerical analysis shows that periods of economic uncertainty are preceded by periods of low entropy values, which may serve as a tool for anticipating the onset of financial crises.

Relating different quantum generalizations of the conditional Rényi entropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tomamichel, Marco; School of Physics, The University of Sydney, Sydney 2006; Berta, Mario

2014-08-15

Recently a new quantum generalization of the Rényi divergence and the corresponding conditional Rényi entropies was proposed. Here, we report on a surprising relation between conditional Rényi entropies based on this new generalization and conditional Rényi entropies based on the quantum relative Rényi entropy that was used in previous literature. Our result generalizes the well-known duality relation H(A|B) + H(A|C) = 0 of the conditional von Neumann entropy for tripartite pure states to Rényi entropies of two different kinds. As a direct application, we prove a collection of inequalities that relate different conditional Rényi entropies and derive a new entropicmore » uncertainty relation.« less

Entropy Production in Field Theories without Time-Reversal Symmetry: Quantifying the Non-Equilibrium Character of Active Matter

NASA Astrophysics Data System (ADS)

Nardini, Cesare; Fodor, Étienne; Tjhung, Elsen; van Wijland, Frédéric; Tailleur, Julien; Cates, Michael E.

2017-04-01

Active-matter systems operate far from equilibrium because of the continuous energy injection at the scale of constituent particles. At larger scales, described by coarse-grained models, the global entropy production rate S quantifies the probability ratio of forward and reversed dynamics and hence the importance of irreversibility at such scales: It vanishes whenever the coarse-grained dynamics of the active system reduces to that of an effective equilibrium model. We evaluate S for a class of scalar stochastic field theories describing the coarse-grained density of self-propelled particles without alignment interactions, capturing such key phenomena as motility-induced phase separation. We show how the entropy production can be decomposed locally (in real space) or spectrally (in Fourier space), allowing detailed examination of the spatial structure and correlations that underly departures from equilibrium. For phase-separated systems, the local entropy production is concentrated mainly on interfaces, with a bulk contribution that tends to zero in the weak-noise limit. In homogeneous states, we find a generalized Harada-Sasa relation that directly expresses the entropy production in terms of the wave-vector-dependent deviation from the fluctuation-dissipation relation between response functions and correlators. We discuss extensions to the case where the particle density is coupled to a momentum-conserving solvent and to situations where the particle current, rather than the density, should be chosen as the dynamical field. We expect the new conceptual tools developed here to be broadly useful in the context of active matter, allowing one to distinguish when and where activity plays an essential role in the dynamics.

On quantum Rényi entropies: A new generalization and some properties

NASA Astrophysics Data System (ADS)

Müller-Lennert, Martin; Dupuis, Frédéric; Szehr, Oleg; Fehr, Serge; Tomamichel, Marco

2013-12-01

The Rényi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies, or mutual information, and have found many applications in information theory and beyond. Various generalizations of Rényi entropies to the quantum setting have been proposed, most prominently Petz's quasi-entropies and Renner's conditional min-, max-, and collision entropy. However, these quantum extensions are incompatible and thus unsatisfactory. We propose a new quantum generalization of the family of Rényi entropies that contains the von Neumann entropy, min-entropy, collision entropy, and the max-entropy as special cases, thus encompassing most quantum entropies in use today. We show several natural properties for this definition, including data-processing inequalities, a duality relation, and an entropic uncertainty relation.

Excess entropy scaling for the segmental and global dynamics of polyethylene melts.

PubMed

Voyiatzis, Evangelos; Müller-Plathe, Florian; Böhm, Michael C

2014-11-28

The range of validity of the Rosenfeld and Dzugutov excess entropy scaling laws is analyzed for unentangled linear polyethylene chains. We consider two segmental dynamical quantities, i.e. the bond and the torsional relaxation times, and two global ones, i.e. the chain diffusion coefficient and the viscosity. The excess entropy is approximated by either a series expansion of the entropy in terms of the pair correlation function or by an equation of state for polymers developed in the context of the self associating fluid theory. For the whole range of temperatures and chain lengths considered, the two estimates of the excess entropy are linearly correlated. The scaled bond and torsional relaxation times fall into a master curve irrespective of the chain length and the employed scaling scheme. Both quantities depend non-linearly on the excess entropy. For a fixed chain length, the reduced diffusion coefficient and viscosity scale linearly with the excess entropy. An empirical reduction to a chain length-independent master curve is accessible for both dynamic quantities. The Dzugutov scheme predicts an increased value of the scaled diffusion coefficient with increasing chain length which contrasts physical expectations. The origin of this trend can be traced back to the density dependence of the scaling factors. This finding has not been observed previously for Lennard-Jones chain systems (Macromolecules, 2013, 46, 8710-8723). Thus, it limits the applicability of the Dzugutov approach to polymers. In connection with diffusion coefficients and viscosities, the Rosenfeld scaling law appears to be of higher quality than the Dzugutov approach. An empirical excess entropy scaling is also proposed which leads to a chain length-independent correlation. It is expected to be valid for polymers in the Rouse regime.

Uncertainties have a meaning: Information entropy as a quality measure for 3-D geological models

NASA Astrophysics Data System (ADS)

Wellmann, J. Florian; Regenauer-Lieb, Klaus

2012-03-01

Analyzing, visualizing and communicating uncertainties are important issues as geological models can never be fully determined. To date, there exists no general approach to quantify uncertainties in geological modeling. We propose here to use information entropy as an objective measure to compare and evaluate model and observational results. Information entropy was introduced in the 50s and defines a scalar value at every location in the model for predictability. We show that this method not only provides a quantitative insight into model uncertainties but, due to the underlying concept of information entropy, can be related to questions of data integration (i.e. how is the model quality interconnected with the used input data) and model evolution (i.e. does new data - or a changed geological hypothesis - optimize the model). In other words information entropy is a powerful measure to be used for data assimilation and inversion. As a first test of feasibility, we present the application of the new method to the visualization of uncertainties in geological models, here understood as structural representations of the subsurface. Applying the concept of information entropy on a suite of simulated models, we can clearly identify (a) uncertain regions within the model, even for complex geometries; (b) the overall uncertainty of a geological unit, which is, for example, of great relevance in any type of resource estimation; (c) a mean entropy for the whole model, important to track model changes with one overall measure. These results cannot easily be obtained with existing standard methods. The results suggest that information entropy is a powerful method to visualize uncertainties in geological models, and to classify the indefiniteness of single units and the mean entropy of a model quantitatively. Due to the relationship of this measure to the missing information, we expect the method to have a great potential in many types of geoscientific data assimilation problems — beyond pure visualization.

A new and trustworthy formalism to compute entropy in quantum systems

NASA Astrophysics Data System (ADS)

Ansari, Mohammad

Entropy is nonlinear in density matrix and as such its evaluation in open quantum system has not been fully understood. Recently a quantum formalism was proposed by Ansari and Nazarov that evaluates entropy using parallel time evolutions of multiple worlds. We can use this formalism to evaluate entropy flow in a photovoltaic cells coupled to thermal reservoirs and cavity modes. Recently we studied the full counting statistics of energy transfers in such systems. This rigorously proves a nontrivial correspondence between energy exchanges and entropy changes in quantum systems, which only in systems without entanglement can be simplified to the textbook second law of thermodynamics. We evaluate the flow of entropy using this formalism. In the presence of entanglement, however, interestingly much less information is exchanged than what we expected. This increases the upper limit capacity for information transfer and its conversion to energy for next generation devices in mesoscopic physics.

Coherence and entanglement measures based on Rényi relative entropies

NASA Astrophysics Data System (ADS)

Zhu, Huangjun; Hayashi, Masahito; Chen, Lin

2017-11-01

We study systematically resource measures of coherence and entanglement based on Rényi relative entropies, which include the logarithmic robustness of coherence, geometric coherence, and conventional relative entropy of coherence together with their entanglement analogues. First, we show that each Rényi relative entropy of coherence is equal to the corresponding Rényi relative entropy of entanglement for any maximally correlated state. By virtue of this observation, we establish a simple operational connection between entanglement measures and coherence measures based on Rényi relative entropies. We then prove that all these coherence measures, including the logarithmic robustness of coherence, are additive. Accordingly, all these entanglement measures are additive for maximally correlated states. In addition, we derive analytical formulas for Rényi relative entropies of entanglement of maximally correlated states and bipartite pure states, which reproduce a number of classic results on the relative entropy of entanglement and logarithmic robustness of entanglement in a unified framework. Several nontrivial bounds for Rényi relative entropies of coherence (entanglement) are further derived, which improve over results known previously. Moreover, we determine all states whose relative entropy of coherence is equal to the logarithmic robustness of coherence. As an application, we provide an upper bound for the exact coherence distillation rate, which is saturated for pure states.

Linearity of holographic entanglement entropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Almheiri, Ahmed; Dong, Xi; Swingle, Brian

Here, we consider the question of whether the leading contribution to the entanglement entropy in holographic CFTs is truly given by the expectation value of a linear operator as is suggested by the Ryu-Takayanagi formula. We investigate this property by computing the entanglement entropy, via the replica trick, in states dual to superpositions of macroscopically distinct geometries and find it consistent with evaluating the expectation value of the area operator within such states. However, we find that this fails once the number of semi-classical states in the superposition grows exponentially in the central charge of the CFT. Moreover, in certainmore » such scenarios we find that the choice of surface on which to evaluate the area operator depends on the density matrix of the entire CFT. This nonlinearity is enforced in the bulk via the homology prescription of Ryu-Takayanagi. We thus conclude that the homology constraint is not a linear property in the CFT. We also discuss the existence of entropy operators in general systems with a large number of degrees of freedom.« less

Linearity of holographic entanglement entropy

DOE PAGES

Almheiri, Ahmed; Dong, Xi; Swingle, Brian

2017-02-14

Here, we consider the question of whether the leading contribution to the entanglement entropy in holographic CFTs is truly given by the expectation value of a linear operator as is suggested by the Ryu-Takayanagi formula. We investigate this property by computing the entanglement entropy, via the replica trick, in states dual to superpositions of macroscopically distinct geometries and find it consistent with evaluating the expectation value of the area operator within such states. However, we find that this fails once the number of semi-classical states in the superposition grows exponentially in the central charge of the CFT. Moreover, in certainmore » such scenarios we find that the choice of surface on which to evaluate the area operator depends on the density matrix of the entire CFT. This nonlinearity is enforced in the bulk via the homology prescription of Ryu-Takayanagi. We thus conclude that the homology constraint is not a linear property in the CFT. We also discuss the existence of entropy operators in general systems with a large number of degrees of freedom.« less

Whole-Lesion Apparent Diffusion Coefficient-Based Entropy-Related Parameters for Characterizing Cervical Cancers: Initial Findings.

PubMed

Guan, Yue; Li, Weifeng; Jiang, Zhuoran; Chen, Ying; Liu, Song; He, Jian; Zhou, Zhengyang; Ge, Yun

2016-12-01

This study aimed to develop whole-lesion apparent diffusion coefficient (ADC)-based entropy-related parameters of cervical cancer to preliminarily assess intratumoral heterogeneity of this lesion in comparison to adjacent normal cervical tissues. A total of 51 women (mean age, 49 years) with cervical cancers confirmed by biopsy underwent 3-T pelvic diffusion-weighted magnetic resonance imaging with b values of 0 and 800 s/mm 2 prospectively. ADC-based entropy-related parameters including first-order entropy and second-order entropies were derived from the whole tumor volume as well as adjacent normal cervical tissues. Intraclass correlation coefficient, Wilcoxon test with Bonferroni correction, Kruskal-Wallis test, and receiver operating characteristic curve were used for statistical analysis. All the parameters showed excellent interobserver agreement (all intraclass correlation coefficients  > 0.900). Entropy, entropy(H) 0 , entropy(H) 45 , entropy(H) 90 , entropy(H) 135 , and entropy(H) mean were significantly higher, whereas entropy(H) range and entropy(H) std were significantly lower in cervical cancers compared to adjacent normal cervical tissues (all P <.0001). Kruskal-Wallis test showed that there were no significant differences among the values of various second-order entropies including entropy(H) 0, entropy(H) 45 , entropy(H) 90 , entropy(H) 135 , and entropy(H) mean. All second-order entropies had larger area under the receiver operating characteristic curve than first-order entropy in differentiating cervical cancers from adjacent normal cervical tissues. Further, entropy(H) 45 , entropy(H) 90 , entropy(H) 135 , and entropy(H) mean had the same largest area under the receiver operating characteristic curve of 0.867. Whole-lesion ADC-based entropy-related parameters of cervical cancers were developed successfully, which showed initial potential in characterizing intratumoral heterogeneity in comparison to adjacent normal cervical tissues. Copyright © 2016 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

Entropy and entropy production in Fokker–Plank equation under the generalized fluctuation–dissipation relation

NASA Astrophysics Data System (ADS)

Guo, Ran

2018-04-01

In this paper, we investigate the definition of the entropy in the Fokker–Planck equation under the generalized fluctuation–dissipation relation (FDR), which describes a Brownian particle moving in a complex medium with friction and multiplicative noise. The friction and the noise are related by the generalized FDR. The entropy for such a system is defined first. According to the definition of the entropy, we calculate the entropy production and the entropy flux. Lastly, we make a numerical calculation to display the results in figures.

On S-mixing entropy of quantum channels

NASA Astrophysics Data System (ADS)

Mukhamedov, Farrukh; Watanabe, Noboru

2018-06-01

In this paper, an S-mixing entropy of quantum channels is introduced as a generalization of Ohya's S-mixing entropy. We investigate several properties of the introduced entropy. Moreover, certain relations between the S-mixing entropy and the existing map and output entropies of quantum channels are investigated as well. These relations allowed us to find certain connections between separable states and the introduced entropy. Hence, there is a sufficient condition to detect entangled states. Moreover, several properties of the introduced entropy are investigated. Besides, entropies of qubit and phase-damping channels are calculated.

Second sound experiments in superfluid 3He-A1 phase in high magnetic fields

NASA Astrophysics Data System (ADS)

Bastea, Marina

The Asb1 phase of sp3He is the first observed magnetic superfluid, stable only in the presence of an external magnetic field. Due to the broken relative gauge and spin rotational symmetry, the two associated collective modes, the second sound and the longitudinal spin waves are expected to appear as a single mode which we call the spin-entropy wave. Our work is focused on consistently mapping the behavior of the spin-entropy wave in the superfluid Asb{1} phase of sp3He, under a wide range of experimental conditions. Our results address fundamental questions such as the identification of the order parameter symmetry in the superfluid states, the nature of the pairing state in the Asb1 phase and the superfluid density anisotropy. We extensively investigated the propagation of the spin-entropy wave as a function of temperature, magnetic field between 1 and 8 Tesla and liquid pressure up to 30 bar. Our results show that the superfluid density is directly proportional to the magnitude of the external field in the specified range, as predicted by theory. We discovered that in the vicinity of the transition to the Asb2 phase, over a fairly large temperature range, the spin-entropy wave suffers a divergent attenuation. The observed effects were suggested as evidence for the presence of a minority condensate population, "down spin" pairs, specific for the Asb2 phase, as predicted by Monien and Tewordt. We measured the superfluid density dependence on the pressure between 10 and 30 bar and directly related it to the fourth order coefficients of the Ginzburg-Landau free energy expansion. The pressure dependence of three of these coefficients and their strong coupling corrections was found to be consistent with the theoretical predictions of Sauls and Serene. Our results support the identification of the A phase as the Anderson-Brinkman-Morel axial state and provide an important consistency check for the phase diagram carried out by groups at USC and Cornell. We performed experiments in two different geometries (cylindrical and rectangular) for two relative orientations of the external field and the wave propagation direction, to measure the anisotropy of the superfluid density. We found that the spin-entropy wave propagation exhibits a non-linear character when the external field is perpendicular to the wave-vector. We modeled the textural configuration and the expected response of the system based on the free energy minimization criterion. The results of our theoretical model are in very good agreement with the experimental data.

Supersymmetric Rényi entropy and defect operators

NASA Astrophysics Data System (ADS)

Nishioka, Tatsuma; Yaakov, Itamar

2017-11-01

We describe the defect operator interpretation of the supersymmetric Rényi entropies of superconformal field theories in three, four and five dimensions. The operators involved are supersymmetric codimension-two defects in an auxiliary Z_n gauge theory coupled to n copies of the SCFT. We compute the exact expectation values of such operators using localization, and compare the results to the supersymmetric Rényi entropy. The agreement between the two implies a relationship between the partition function on a squashed sphere and the one on a round sphere in the presence of defects.

Breakdown of the equal area law for holographic entanglement entropy

NASA Astrophysics Data System (ADS)

McCarthy, Fiona; Kubizňák, David; Mann, Robert B.

2017-11-01

We investigate a holographic version of Maxwell's equal area law analogous to that for the phase transition in the black hole temperature/black hole entropy plane of a charged AdS black hole. We consider proposed area laws for both the black hole temperature/holographic entanglement entropy plane and the black hole temperature/2- point correlation function plane. Despite recent claims to the contrary, we demonstrate numerically that neither proposal is valid. We argue that there is no physical reason to expect such a construction in these planes.

Thermodynamics and computation during collective motion near criticality

NASA Astrophysics Data System (ADS)

Crosato, Emanuele; Spinney, Richard E.; Nigmatullin, Ramil; Lizier, Joseph T.; Prokopenko, Mikhail

2018-01-01

We study self-organization of collective motion as a thermodynamic phenomenon in the context of the first law of thermodynamics. It is expected that the coherent ordered motion typically self-organises in the presence of changes in the (generalized) internal energy and of (generalized) work done on, or extracted from, the system. We aim to explicitly quantify changes in these two quantities in a system of simulated self-propelled particles and contrast them with changes in the system's configuration entropy. In doing so, we adapt a thermodynamic formulation of the curvatures of the internal energy and the work, with respect to two parameters that control the particles' alignment. This allows us to systematically investigate the behavior of the system by varying the two control parameters to drive the system across a kinetic phase transition. Our results identify critical regimes and show that during the phase transition, where the configuration entropy of the system decreases, the rates of change of the work and of the internal energy also decrease, while their curvatures diverge. Importantly, the reduction of entropy achieved through expenditure of work is shown to peak at criticality. We relate this both to a thermodynamic efficiency and the significance of the increased order with respect to a computational path. Additionally, this study provides an information-geometric interpretation of the curvature of the internal energy as the difference between two curvatures: the curvature of the free entropy, captured by the Fisher information, and the curvature of the configuration entropy.

Temporal information entropy of the Blood-Oxygenation Level-Dependent signals increases in the activated human primary visual cortex

NASA Astrophysics Data System (ADS)

DiNuzzo, Mauro; Mascali, Daniele; Moraschi, Marta; Bussu, Giorgia; Maraviglia, Bruno; Mangia, Silvia; Giove, Federico

2017-02-01

Time-domain analysis of blood-oxygenation level-dependent (BOLD) signals allows the identification of clusters of voxels responding to photic stimulation in primary visual cortex (V1). However, the characterization of information encoding into temporal properties of the BOLD signals of an activated cluster is poorly investigated. Here, we used Shannon entropy to determine spatial and temporal information encoding in the BOLD signal within the most strongly activated area of the human visual cortex during a hemifield photic stimulation. We determined the distribution profile of BOLD signals during epochs at rest and under stimulation within small (19-121 voxels) clusters designed to include only voxels driven by the stimulus as highly and uniformly as possible. We found consistent and significant increases (2-4% on average) in temporal information entropy during activation in contralateral but not ipsilateral V1, which was mirrored by an expected loss of spatial information entropy. These opposite changes coexisted with increases in both spatial and temporal mutual information (i.e. dependence) in contralateral V1. Thus, we showed that the first cortical stage of visual processing is characterized by a specific spatiotemporal rearrangement of intracluster BOLD responses. Our results indicate that while in the space domain BOLD maps may be incapable of capturing the functional specialization of small neuronal populations due to relatively low spatial resolution, some information encoding may still be revealed in the temporal domain by an increase of temporal information entropy.

AdS and dS Entropy from String Junctions or The Function of Junction Conjunctions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Silverstein, Eva M

Flux compactifications of string theory exhibiting the possibility of discretely tuning the cosmological constant to small values have been constructed. The highly tuned vacua in this discretuum have curvature radii which scale as large powers of the flux quantum numbers, exponential in the number of cycles in the compactification. By the arguments of Susskind/Witten (in the AdS case) and Gibbons/Hawking (in the dS case), we expect correspondingly large entropies associated with these vacua. If they are to provide a dual description of these vacua on their Coulomb branch, branes traded for the flux need to account for this entropy atmore » the appropriate energy scale. In this note, we argue that simple string junctions and webs ending on the branes can account for this large entropy, obtaining a rough estimate for junction entropy that agrees with the existing rough estimates for the spacing of the discretuum. In particular, the brane entropy can account for the (A)dS entropy far away from string scale correspondence limits.« less

Statistical Mechanical Proof of the Second Law of Thermodynamics based on Volume Entropy

NASA Astrophysics Data System (ADS)

Campisi, Michele

2007-10-01

As pointed out in [M. Campisi. Stud. Hist. Phil. M. P. 36 (2005) 275-290] the volume entropy (that is the logarithm of the volume of phase space enclosed by the constant energy hyper-surface) provides a good mechanical analogue of thermodynamic entropy because it satisfies the heat theorem and it is an adiabatic invariant. This property explains the ``equal'' sign in Clausius principle (Sf>=Si) in a purely mechanical way and suggests that the volume entropy might explain the ``larger than'' sign (i.e. the Law of Entropy Increase) if non adiabatic transformations were considered. Based on the principles of quantum mechanics here we prove that, provided the initial equilibrium satisfy the natural condition of decreasing ordering of probabilities, the expectation value of the volume entropy cannot decrease for arbitrary transformations performed by some external sources of work on a insulated system. This can be regarded as a rigorous quantum mechanical proof of the Second Law.

Direct 4D reconstruction of parametric images incorporating anato-functional joint entropy.

PubMed

Tang, Jing; Kuwabara, Hiroto; Wong, Dean F; Rahmim, Arman

2010-08-07

We developed an anatomy-guided 4D closed-form algorithm to directly reconstruct parametric images from projection data for (nearly) irreversible tracers. Conventional methods consist of individually reconstructing 2D/3D PET data, followed by graphical analysis on the sequence of reconstructed image frames. The proposed direct reconstruction approach maintains the simplicity and accuracy of the expectation-maximization (EM) algorithm by extending the system matrix to include the relation between the parametric images and the measured data. A closed-form solution was achieved using a different hidden complete-data formulation within the EM framework. Furthermore, the proposed method was extended to maximum a posterior reconstruction via incorporation of MR image information, taking the joint entropy between MR and parametric PET features as the prior. Using realistic simulated noisy [(11)C]-naltrindole PET and MR brain images/data, the quantitative performance of the proposed methods was investigated. Significant improvements in terms of noise versus bias performance were demonstrated when performing direct parametric reconstruction, and additionally upon extending the algorithm to its Bayesian counterpart using the MR-PET joint entropy measure.

On variational expressions for quantum relative entropies

NASA Astrophysics Data System (ADS)

Berta, Mario; Fawzi, Omar; Tomamichel, Marco

2017-12-01

Distance measures between quantum states like the trace distance and the fidelity can naturally be defined by optimizing a classical distance measure over all measurement statistics that can be obtained from the respective quantum states. In contrast, Petz showed that the measured relative entropy, defined as a maximization of the Kullback-Leibler divergence over projective measurement statistics, is strictly smaller than Umegaki's quantum relative entropy whenever the states do not commute. We extend this result in two ways. First, we show that Petz' conclusion remains true if we allow general positive operator-valued measures. Second, we extend the result to Rényi relative entropies and show that for non-commuting states the sandwiched Rényi relative entropy is strictly larger than the measured Rényi relative entropy for α \\in (1/2, \\infty ) and strictly smaller for α \\in [0,1/2). The latter statement provides counterexamples for the data processing inequality of the sandwiched Rényi relative entropy for α < 1/2. Our main tool is a new variational expression for the measured Rényi relative entropy, which we further exploit to show that certain lower bounds on quantum conditional mutual information are superadditive.

Influence of measurement error on Maxwell's demon

NASA Astrophysics Data System (ADS)

Sørdal, Vegard; Bergli, Joakim; Galperin, Y. M.

2017-06-01

In any general cycle of measurement, feedback, and erasure, the measurement will reduce the entropy of the system when information about the state is obtained, while erasure, according to Landauer's principle, is accompanied by a corresponding increase in entropy due to the compression of logical and physical phase space. The total process can in principle be fully reversible. A measurement error reduces the information obtained and the entropy decrease in the system. The erasure still gives the same increase in entropy, and the total process is irreversible. Another consequence of measurement error is that a bad feedback is applied, which further increases the entropy production if the proper protocol adapted to the expected error rate is not applied. We consider the effect of measurement error on a realistic single-electron box Szilard engine, and we find the optimal protocol for the cycle as a function of the desired power P and error ɛ .

Truly work-like work extraction via a single-shot analysis.

PubMed

Aberg, Johan

2013-01-01

The work content of non-equilibrium systems in relation to a heat bath is often analysed in terms of expectation values of an underlying random work variable. However, when optimizing the expectation value of the extracted work, the resulting extraction process is subject to intrinsic fluctuations, uniquely determined by the Hamiltonian and the initial distribution of the system. These fluctuations can be of the same order as the expected work content per se, in which case the extracted energy is unpredictable, thus intuitively more heat-like than work-like. This raises the question of the 'truly' work-like energy that can be extracted. Here we consider an alternative that corresponds to an essentially fluctuation-free extraction. We show that this quantity can be expressed in terms of a one-shot relative entropy measure introduced in information theory. This suggests that the relations between information theory and statistical mechanics, as illustrated by concepts like Maxwell's demon, Szilard engines and Landauer's principle, extends to the single-shot regime.

Max Planck and the birth of the quantum hypothesis

NASA Astrophysics Data System (ADS)

Nauenberg, Michael

2016-09-01

Based on the functional dependence of entropy on energy, and on Wien's distribution for black-body radiation, Max Planck obtained a formula for this radiation by an interpolation relation that fitted the experimental measurements of thermal radiation at the Physikalisch Technishe Reichanstalt (PTR) in Berlin in the late 19th century. Surprisingly, his purely phenomenological result turned out to be not just an approximation, as would have been expected, but an exact relation. To obtain a physical interpretation for his formula, Planck then turned to Boltzmann's 1877 paper on the statistical interpretation of entropy, which led him to introduce the fundamental concept of energy discreteness into physics. A novel aspect of our account that has been missed in previous historical studies of Planck's discovery is to show that Planck could have found his phenomenological formula partially derived in Boltzmann's paper in terms of a variational parameter. But the dependence of this parameter on temperature is not contained in this paper, and it was first derived by Planck.

Entropy and complexity analysis of hydrogenic Rydberg atoms

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lopez-Rosa, S.; Departamento de Fisica Aplicada II, Universidad de Sevilla, 41012-Sevilla; Toranzo, I. V.

The internal disorder of hydrogenic Rydberg atoms as contained in their position and momentum probability densities is examined by means of the following information-theoretic spreading quantities: the radial and logarithmic expectation values, the Shannon entropy, and the Fisher information. As well, the complexity measures of Cramer-Rao, Fisher-Shannon, and Lopez Ruiz-Mancini-Calvet types are investigated in both reciprocal spaces. The leading term of these quantities is rigorously calculated by use of the asymptotic properties of the concomitant entropic functionals of the Laguerre and Gegenbauer orthogonal polynomials which control the wavefunctions of the Rydberg states in both position and momentum spaces. The associatedmore » generalized Heisenberg-like, logarithmic and entropic uncertainty relations are also given. Finally, application to linear (l= 0), circular (l=n- 1), and quasicircular (l=n- 2) states is explicitly done.« less

Lepton asymmetry, neutrino spectral distortions, and big bang nucleosynthesis

NASA Astrophysics Data System (ADS)

Grohs, E.; Fuller, George M.; Kishimoto, C. T.; Paris, Mark W.

2017-03-01

We calculate Boltzmann neutrino energy transport with self-consistently coupled nuclear reactions through the weak-decoupling-nucleosynthesis epoch in an early universe with significant lepton numbers. We find that the presence of lepton asymmetry enhances processes which give rise to nonthermal neutrino spectral distortions. Our results reveal how asymmetries in energy and entropy density uniquely evolve for different transport processes and neutrino flavors. The enhanced distortions in the neutrino spectra alter the expected big bang nucleosynthesis light element abundance yields relative to those in the standard Fermi-Dirac neutrino distribution cases. These yields, sensitive to the shapes of the neutrino energy spectra, are also sensitive to the phasing of the growth of distortions and entropy flow with time/scale factor. We analyze these issues and speculate on new sensitivity limits of deuterium and helium to lepton number.

Relative entropy equals bulk relative entropy

DOE PAGES

Jafferis, Daniel L.; Lewkowycz, Aitor; Maldacena, Juan; ...

2016-06-01

We consider the gravity dual of the modular Hamiltonian associated to a general subregion of a boundary theory. We use it to argue that the relative entropy of nearby states is given by the relative entropy in the bulk, to leading order in the bulk gravitational coupling. We also argue that the boundary modular flow is dual to the bulk modular flow in the entanglement wedge, with implications for entanglement wedge reconstruction.

Autonomous entropy-based intelligent experimental design

NASA Astrophysics Data System (ADS)

Malakar, Nabin Kumar

2011-07-01

The aim of this thesis is to explore the application of probability and information theory in experimental design, and to do so in a way that combines what we know about inference and inquiry in a comprehensive and consistent manner. Present day scientific frontiers involve data collection at an ever-increasing rate. This requires that we find a way to collect the most relevant data in an automated fashion. By following the logic of the scientific method, we couple an inference engine with an inquiry engine to automate the iterative process of scientific learning. The inference engine involves Bayesian machine learning techniques to estimate model parameters based upon both prior information and previously collected data, while the inquiry engine implements data-driven exploration. By choosing an experiment whose distribution of expected results has the maximum entropy, the inquiry engine selects the experiment that maximizes the expected information gain. The coupled inference and inquiry engines constitute an autonomous learning method for scientific exploration. We apply it to a robotic arm to demonstrate the efficacy of the method. Optimizing inquiry involves searching for an experiment that promises, on average, to be maximally informative. If the set of potential experiments is described by many parameters, the search involves a high-dimensional entropy space. In such cases, a brute force search method will be slow and computationally expensive. We develop an entropy-based search algorithm, called nested entropy sampling, to select the most informative experiment. This helps to reduce the number of computations necessary to find the optimal experiment. We also extended the method of maximizing entropy, and developed a method of maximizing joint entropy so that it could be used as a principle of collaboration between two robots. This is a major achievement of this thesis, as it allows the information-based collaboration between two robotic units towards a same goal in an automated fashion.

Some Consequences of an Analysis of the Kelvin-Clausius Entropy Formulation Based on Traditional Axiomatics

NASA Astrophysics Data System (ADS)

Jesudason, Christopher G.

2003-09-01

Recently, there have appeared interesting correctives or challenges [Entropy 1999, 1, 111-147] to the Second law formulations, especially in the interpretation of the Clausius equivalent transformations, closely related in area to extensions of the Clausius principle to irreversible processes [Chem. Phys. Lett. 1988, 143(1), 65-70]. Since the traditional formulations are central to science, a brief analysis of some of these newer theories along traditional lines is attempted, based on well-attested axioms which have formed the basis of equilibrium thermodynamics. It is deduced that the Clausius analysis leading to the law of increasing entropy does not follow from the given axioms but it can be proved that for irreversible transitions, the total entropy change of the system and thermal reservoirs (the "Universe") is not negative, even for the case when the reservoirs are not at the same temperature as the system during heat transfer. On the basis of two new simple theorems and three corollaries derived for the correlation between irreversible and reversible pathways and the traditional axiomatics, it is shown that a sequence of reversible states can never be used to describe a corresponding sequence of irreversible states for at least closed systems, thereby restricting the principle of local equilibrium. It is further shown that some of the newer irreversible entropy forms given exhibit some paradoxical properties relative to the standard axiomatics. It is deduced that any reconciliation between the traditional approach and novel theories lie in creating a well defined set of axioms to which all theoretical developments should attempt to be based on unless proven not be useful, in which case there should be consensus in removing such axioms from theory. Clausius' theory of equivalent transformations do not contradict the traditional understanding of heat- work efficiency. It is concluded that the intuitively derived assumptions over the last two centuries seem to be reasonably well grounded, requiring perhaps some minor elaboration to the concepts of (i) system, (ii) the mechanism of heat transfer, and (iii) the environment, which would be expected to evolve with time in any case. If new generalizations at variance with Clausius' concepts are presented, then these ideas could be expected to require a different axiomatic basis than the one for equilibrium theory, and this difference must be stated at the outset of any new development. So far such empirically self-consistent axiomatic developments are not very much in evidence.

Relative entropy of steering: on its definition and properties

NASA Astrophysics Data System (ADS)

Kaur, Eneet; Wilde, Mark M.

2017-11-01

In Gallego and Aolita (2015 Phys. Rev. X 5 041008), the authors proposed a definition for the relative entropy of steering and showed that the resulting quantity is a convex steering monotone. Here we advocate for a different definition for relative entropy of steering, based on well grounded concerns coming from quantum Shannon theory. We prove that this modified relative entropy of steering is a convex steering monotone. Furthermore, we establish that it is uniformly continuous and faithful, in both cases giving quantitative bounds that should be useful in applications. We also consider a restricted relative entropy of steering which is relevant for the case in which the free operations in the resource theory of steering have a more restricted form (the restricted operations could be more relevant in practical scenarios). The restricted relative entropy of steering is convex, monotone with respect to these restricted operations, uniformly continuous, and faithful.

Entropy-Based Registration of Point Clouds Using Terrestrial Laser Scanning and Smartphone GPS.

PubMed

Chen, Maolin; Wang, Siying; Wang, Mingwei; Wan, Youchuan; He, Peipei

2017-01-20

Automatic registration of terrestrial laser scanning point clouds is a crucial but unresolved topic that is of great interest in many domains. This study combines terrestrial laser scanner with a smartphone for the coarse registration of leveled point clouds with small roll and pitch angles and height differences, which is a novel sensor combination mode for terrestrial laser scanning. The approximate distance between two neighboring scan positions is firstly calculated with smartphone GPS coordinates. Then, 2D distribution entropy is used to measure the distribution coherence between the two scans and search for the optimal initial transformation parameters. To this end, we propose a method called Iterative Minimum Entropy (IME) to correct initial transformation parameters based on two criteria: the difference between the average and minimum entropy and the deviation from the minimum entropy to the expected entropy. Finally, the presented method is evaluated using two data sets that contain tens of millions of points from panoramic and non-panoramic, vegetation-dominated and building-dominated cases and can achieve high accuracy and efficiency.

Exact Holography of Massive M2-brane Theories and Entanglement Entropy

NASA Astrophysics Data System (ADS)

Jang, Dongmin; Kim, Yoonbai; Kwon, O.-Kab; Tolla, D. D.

2018-01-01

We test the gauge/gravity duality between the N = 6 mass-deformed ABJM theory with Uk(N) × U-k(N) gauge symmetry and the 11-dimensional supergravity on LLM geometries with SO(4)=ℤk × SO(4)=ℤk isometry. Our analysis is based on the evaluation of vacuum expectation values of chiral primary operators from the supersymmetric vacua of mass-deformed ABJM theory and from the implementation of Kaluza-Klein (KK) holography to the LLM geometries. We focus on the chiral primary operator (CPO) with conformal dimension Δ = 1. The non-vanishing vacuum expectation value (vev) implies the breaking of conformal symmetry. In that case, we show that the variation of the holographic entanglement entropy (HEE) from it's value in the CFT, is related to the non-vanishing one-point function due to the relevant deformation as well as the source field. Applying Ryu Takayanagi's HEE conjecture to the 4-dimensional gravity solutions, which are obtained from the KK reduction of the 11-dimensional LLM solutions, we calculate the variation of the HEE. We show how the vev and the value of the source field determine the HEE.

Entanglement distribution in multi-particle systems in terms of unified entropy.

PubMed

Luo, Yu; Zhang, Fu-Gang; Li, Yongming

2017-04-25

We investigate the entanglement distribution in multi-particle systems in terms of unified (q, s)-entropy. We find that for any tripartite mixed state, the unified (q, s)-entropy entanglement of assistance follows a polygamy relation. This polygamy relation also holds in multi-particle systems. Furthermore, a generalized monogamy relation is provided for unified (q, s)-entropy entanglement in the multi-qubit system.

Effect of entropy on anomalous transport in ITG-modes of magneto-plasma

NASA Astrophysics Data System (ADS)

Yaqub Khan, M.; Qaiser Manzoor, M.; Haq, A. ul; Iqbal, J.

2017-04-01

The ideal gas equation and S={{c}v}log ≤ft(P/ρ \\right) (where S is entropy, P is pressure and ρ is the mass density) define the interconnection of entropy with the temperature and density of plasma. Therefore, different phenomena relating to plasma and entropy need to be investigated. By employing the Braginskii transport equations for a nonuniform electron-ion magnetoplasma, two new parameters—the entropy distribution function and the entropy gradient drift—are defined, a new dispersion relation is obtained, and the dependence of anomalous transport on entropy is also proved. Some results, like monotonicity, the entropy principle and the second law of thermodynamics, are proved with a new definition of entropy. This work will open new horizons in fusion processes, not only by controlling entropy in tokamak plasmas—particularly in the pedestal regions of the H-mode and space plasmas—but also in engineering sciences.

Efficient optimization of the quantum relative entropy

NASA Astrophysics Data System (ADS)

Fawzi, Hamza; Fawzi, Omar

2018-04-01

Many quantum information measures can be written as an optimization of the quantum relative entropy between sets of states. For example, the relative entropy of entanglement of a state is the minimum relative entropy to the set of separable states. The various capacities of quantum channels can also be written in this way. We propose a unified framework to numerically compute these quantities using off-the-shelf semidefinite programming solvers, exploiting the approximation method proposed in Fawzi, Saunderson and Parrilo (2017 arXiv: 1705.00812). As a notable application, this method allows us to provide numerical counterexamples for a proposed lower bound on the quantum conditional mutual information in terms of the relative entropy of recovery.

Bayesian cross-entropy methodology for optimal design of validation experiments

NASA Astrophysics Data System (ADS)

Jiang, X.; Mahadevan, S.

2006-07-01

An important concern in the design of validation experiments is how to incorporate the mathematical model in the design in order to allow conclusive comparisons of model prediction with experimental output in model assessment. The classical experimental design methods are more suitable for phenomena discovery and may result in a subjective, expensive, time-consuming and ineffective design that may adversely impact these comparisons. In this paper, an integrated Bayesian cross-entropy methodology is proposed to perform the optimal design of validation experiments incorporating the computational model. The expected cross entropy, an information-theoretic distance between the distributions of model prediction and experimental observation, is defined as a utility function to measure the similarity of two distributions. A simulated annealing algorithm is used to find optimal values of input variables through minimizing or maximizing the expected cross entropy. The measured data after testing with the optimum input values are used to update the distribution of the experimental output using Bayes theorem. The procedure is repeated to adaptively design the required number of experiments for model assessment, each time ensuring that the experiment provides effective comparison for validation. The methodology is illustrated for the optimal design of validation experiments for a three-leg bolted joint structure and a composite helicopter rotor hub component.

Low Streamflow Forcasting using Minimum Relative Entropy

NASA Astrophysics Data System (ADS)

Cui, H.; Singh, V. P.

2013-12-01

Minimum relative entropy spectral analysis is derived in this study, and applied to forecast streamflow time series. Proposed method extends the autocorrelation in the manner that the relative entropy of underlying process is minimized so that time series data can be forecasted. Different prior estimation, such as uniform, exponential and Gaussian assumption, is taken to estimate the spectral density depending on the autocorrelation structure. Seasonal and nonseasonal low streamflow series obtained from Colorado River (Texas) under draught condition is successfully forecasted using proposed method. Minimum relative entropy determines spectral of low streamflow series with higher resolution than conventional method. Forecasted streamflow is compared to the prediction using Burg's maximum entropy spectral analysis (MESA) and Configurational entropy. The advantage and disadvantage of each method in forecasting low streamflow is discussed.

Randomized shortest-path problems: two related models.

PubMed

Saerens, Marco; Achbany, Youssef; Fouss, François; Yen, Luh

2009-08-01

This letter addresses the problem of designing the transition probabilities of a finite Markov chain (the policy) in order to minimize the expected cost for reaching a destination node from a source node while maintaining a fixed level of entropy spread throughout the network (the exploration). It is motivated by the following scenario. Suppose you have to route agents through a network in some optimal way, for instance, by minimizing the total travel cost-nothing particular up to now-you could use a standard shortest-path algorithm. Suppose, however, that you want to avoid pure deterministic routing policies in order, for instance, to allow some continual exploration of the network, avoid congestion, or avoid complete predictability of your routing strategy. In other words, you want to introduce some randomness or unpredictability in the routing policy (i.e., the routing policy is randomized). This problem, which will be called the randomized shortest-path problem (RSP), is investigated in this work. The global level of randomness of the routing policy is quantified by the expected Shannon entropy spread throughout the network and is provided a priori by the designer. Then, necessary conditions to compute the optimal randomized policy-minimizing the expected routing cost-are derived. Iterating these necessary conditions, reminiscent of Bellman's value iteration equations, allows computing an optimal policy, that is, a set of transition probabilities in each node. Interestingly and surprisingly enough, this first model, while formulated in a totally different framework, is equivalent to Akamatsu's model ( 1996 ), appearing in transportation science, for a special choice of the entropy constraint. We therefore revisit Akamatsu's model by recasting it into a sum-over-paths statistical physics formalism allowing easy derivation of all the quantities of interest in an elegant, unified way. For instance, it is shown that the unique optimal policy can be obtained by solving a simple linear system of equations. This second model is therefore more convincing because of its computational efficiency and soundness. Finally, simulation results obtained on simple, illustrative examples show that the models behave as expected.

Classicality condition on a system observable in a quantum measurement and a relative-entropy conservation law

NASA Astrophysics Data System (ADS)

Kuramochi, Yui; Ueda, Masahito

2015-03-01

We consider the information flow on a system observable X corresponding to a positive-operator-valued measure under a quantum measurement process Y described by a completely positive instrument from the viewpoint of the relative entropy. We establish a sufficient condition for the relative-entropy conservation law which states that the average decrease in the relative entropy of the system observable X equals the relative entropy of the measurement outcome of Y , i.e., the information gain due to measurement. This sufficient condition is interpreted as an assumption of classicality in the sense that there exists a sufficient statistic in a joint successive measurement of Y followed by X such that the probability distribution of the statistic coincides with that of a single measurement of X for the premeasurement state. We show that in the case when X is a discrete projection-valued measure and Y is discrete, the classicality condition is equivalent to the relative-entropy conservation for arbitrary states. The general theory on the relative-entropy conservation is applied to typical quantum measurement models, namely, quantum nondemolition measurement, destructive sharp measurements on two-level systems, a photon counting, a quantum counting, homodyne and heterodyne measurements. These examples except for the nondemolition and photon-counting measurements do not satisfy the known Shannon-entropy conservation law proposed by Ban [M. Ban, J. Phys. A: Math. Gen. 32, 1643 (1999), 10.1088/0305-4470/32/9/012], implying that our approach based on the relative entropy is applicable to a wider class of quantum measurements.

How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems.

PubMed

Hanel, Rudolf; Thurner, Stefan; Gell-Mann, Murray

2014-05-13

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and Markovian systems in statistical mechanics, information theory, and statistics. For several decades there has been an ongoing controversy over whether the notion of the maximum entropy principle can be extended in a meaningful way to nonextensive, nonergodic, and complex statistical systems and processes. In this paper we start by reviewing how Boltzmann-Gibbs-Shannon entropy is related to multiplicities of independent random processes. We then show how the relaxation of independence naturally leads to the most general entropies that are compatible with the first three Shannon-Khinchin axioms, the (c,d)-entropies. We demonstrate that the MEP is a perfectly consistent concept for nonergodic and complex statistical systems if their relative entropy can be factored into a generalized multiplicity and a constraint term. The problem of finding such a factorization reduces to finding an appropriate representation of relative entropy in a linear basis. In a particular example we show that path-dependent random processes with memory naturally require specific generalized entropies. The example is to our knowledge the first exact derivation of a generalized entropy from the microscopic properties of a path-dependent random process.

Merging Clusters, Cluster Outskirts, and Large Scale Filaments

NASA Astrophysics Data System (ADS)

Randall, Scott; Alvarez, Gabriella; Bulbul, Esra; Jones, Christine; Forman, William; Su, Yuanyuan; Miller, Eric D.; Bourdin, Herve; Scott Randall

2018-01-01

Recent X-ray observations of the outskirts of clusters show that entropy profiles of the intracluster medium (ICM) generally flatten and lie below what is expected from purely gravitational structure formation near the cluster's virial radius. Possible explanations include electron/ion non-equilibrium, accretion shocks that weaken during cluster formation, and the presence of unresolved cool gas clumps. Some of these mechanisms are expected to correlate with large scale structure (LSS), such that the entropy is lower in regions where the ICM interfaces with LSS filaments and, presumably, the warm-hot intergalactic medium (WHIM). Major, binary cluster mergers are expected to take place at the intersection of LSS filaments, with the merger axis initially oriented along a filament. We present results from deep X-ray observations of the virialization regions of binary, early-stage merging clusters, including a possible detection of the dense end of the WHIM along a LSS filament.

Lepton asymmetry, neutrino spectral distortions, and big bang nucleosynthesis

DOE PAGES

Grohs, E.; Fuller, George M.; Kishimoto, C. T.; ...

2017-03-03

In this paper, we calculate Boltzmann neutrino energy transport with self-consistently coupled nuclear reactions through the weak-decoupling-nucleosynthesis epoch in an early universe with significant lepton numbers. We find that the presence of lepton asymmetry enhances processes which give rise to nonthermal neutrino spectral distortions. Our results reveal how asymmetries in energy and entropy density uniquely evolve for different transport processes and neutrino flavors. The enhanced distortions in the neutrino spectra alter the expected big bang nucleosynthesis light element abundance yields relative to those in the standard Fermi-Dirac neutrino distribution cases. These yields, sensitive to the shapes of the neutrino energymore » spectra, are also sensitive to the phasing of the growth of distortions and entropy flow with time/scale factor. Finally, we analyze these issues and speculate on new sensitivity limits of deuterium and helium to lepton number.« less

Lepton asymmetry, neutrino spectral distortions, and big bang nucleosynthesis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Grohs, E.; Fuller, George M.; Kishimoto, C. T.

In this paper, we calculate Boltzmann neutrino energy transport with self-consistently coupled nuclear reactions through the weak-decoupling-nucleosynthesis epoch in an early universe with significant lepton numbers. We find that the presence of lepton asymmetry enhances processes which give rise to nonthermal neutrino spectral distortions. Our results reveal how asymmetries in energy and entropy density uniquely evolve for different transport processes and neutrino flavors. The enhanced distortions in the neutrino spectra alter the expected big bang nucleosynthesis light element abundance yields relative to those in the standard Fermi-Dirac neutrino distribution cases. These yields, sensitive to the shapes of the neutrino energymore » spectra, are also sensitive to the phasing of the growth of distortions and entropy flow with time/scale factor. Finally, we analyze these issues and speculate on new sensitivity limits of deuterium and helium to lepton number.« less

Gradient Dynamics and Entropy Production Maximization

NASA Astrophysics Data System (ADS)

Janečka, Adam; Pavelka, Michal

2018-01-01

We compare two methods for modeling dissipative processes, namely gradient dynamics and entropy production maximization. Both methods require similar physical inputs-how energy (or entropy) is stored and how it is dissipated. Gradient dynamics describes irreversible evolution by means of dissipation potential and entropy, it automatically satisfies Onsager reciprocal relations as well as their nonlinear generalization (Maxwell-Onsager relations), and it has statistical interpretation. Entropy production maximization is based on knowledge of free energy (or another thermodynamic potential) and entropy production. It also leads to the linear Onsager reciprocal relations and it has proven successful in thermodynamics of complex materials. Both methods are thermodynamically sound as they ensure approach to equilibrium, and we compare them and discuss their advantages and shortcomings. In particular, conditions under which the two approaches coincide and are capable of providing the same constitutive relations are identified. Besides, a commonly used but not often mentioned step in the entropy production maximization is pinpointed and the condition of incompressibility is incorporated into gradient dynamics.

Dynamics of glass-forming liquids. XIX. Rise and decay of field induced anisotropy in the non-linear regime

NASA Astrophysics Data System (ADS)

Young-Gonzales, Amanda R.; Samanta, Subarna; Richert, Ranko

2015-09-01

For glycerol and three monohydroxy alcohols, we have measured the non-linear dielectric effects resulting from the application and removal of a high dc bias electric field. The field effects are detected by virtue of a small amplitude harmonic field, from which time resolved changes in the dielectric loss are derived. The changes in permittivity are dominated by modifications of the time constants (rather than amplitudes) which display two contributions: a heating-like decrease of relaxation times that originates from the time dependent field when the bias is switched on and off and a slowing down of the dynamics resulting from the field induced reduction of configurational entropy. As observed for the electro-optical Kerr effect, the rise of the entropy change is slower than its decay, a feature that we rationalize on the basis of the quadratic dependence of the entropy change on polarization. For glycerol, the observed steady state level of the field induced shift of the glass transition temperature (+84 mK) matches the expectation based on the entropy change and its impact on dynamics via the Adam-Gibbs relation (+88 mK). For the alcohols, these non-linear effects rise and decay on the time scales of the prominent dielectric Debye process, underscoring the relation of these features to polarization anisotropy, opposed to mechanical or enthalpy relaxation which are orders of magnitude faster in these systems. A model is discussed which captures the observed magnitudes as well as time dependences in a near quantitative fashion. It is demonstrated that the high bias field modifies the response of polarization to the ac field, including a temporary change in the low field susceptibility.

Role of information theoretic uncertainty relations in quantum theory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jizba, Petr, E-mail: p.jizba@fjfi.cvut.cz; ITP, Freie Universität Berlin, Arnimallee 14, D-14195 Berlin; Dunningham, Jacob A., E-mail: J.Dunningham@sussex.ac.uk

2015-04-15

Uncertainty relations based on information theory for both discrete and continuous distribution functions are briefly reviewed. We extend these results to account for (differential) Rényi entropy and its related entropy power. This allows us to find a new class of information-theoretic uncertainty relations (ITURs). The potency of such uncertainty relations in quantum mechanics is illustrated with a simple two-energy-level model where they outperform both the usual Robertson–Schrödinger uncertainty relation and Shannon entropy based uncertainty relation. In the continuous case the ensuing entropy power uncertainty relations are discussed in the context of heavy tailed wave functions and Schrödinger cat states. Again,more » improvement over both the Robertson–Schrödinger uncertainty principle and Shannon ITUR is demonstrated in these cases. Further salient issues such as the proof of a generalized entropy power inequality and a geometric picture of information-theoretic uncertainty relations are also discussed.« less

Classical many-particle systems with unique disordered ground states

NASA Astrophysics Data System (ADS)

Zhang, G.; Stillinger, F. H.; Torquato, S.

2017-10-01

Classical ground states (global energy-minimizing configurations) of many-particle systems are typically unique crystalline structures, implying zero enumeration entropy of distinct patterns (aside from trivial symmetry operations). By contrast, the few previously known disordered classical ground states of many-particle systems are all high-entropy (highly degenerate) states. Here we show computationally that our recently proposed "perfect-glass" many-particle model [Sci. Rep. 6, 36963 (2016), 10.1038/srep36963] possesses disordered classical ground states with a zero entropy: a highly counterintuitive situation . For all of the system sizes, parameters, and space dimensions that we have numerically investigated, the disordered ground states are unique such that they can always be superposed onto each other or their mirror image. At low energies, the density of states obtained from simulations matches those calculated from the harmonic approximation near a single ground state, further confirming ground-state uniqueness. Our discovery provides singular examples in which entropy and disorder are at odds with one another. The zero-entropy ground states provide a unique perspective on the celebrated Kauzmann-entropy crisis in which the extrapolated entropy of a supercooled liquid drops below that of the crystal. We expect that our disordered unique patterns to be of value in fields beyond glass physics, including applications in cryptography as pseudorandom functions with tunable computational complexity.

Black Hole Entropy Calculated via Wavefunction Approximations on a Schwarzschild Spacetime

DTIC Science & Technology

2015-05-18

dimension of μA is kg2m2s−2 which is the expected dimension . The μ2B has an extra unit of length in the numerator but is also divided by another factor...phenomena. The two ideas were General Relativity (GR) and Quantum Mechanics (QM). General relativity describes physics on large scales with masses the size...operator ̂L = ̂r × ̂p. These operators can be written in three dimensions in a compact way by using the del operator4 ∇ = ∂xî+ ∂y ĵ + ∂zk̂, ̂p

Uncertainty relations with quantum memory for the Wehrl entropy

NASA Astrophysics Data System (ADS)

De Palma, Giacomo

2018-03-01

We prove two new fundamental uncertainty relations with quantum memory for the Wehrl entropy. The first relation applies to the bipartite memory scenario. It determines the minimum conditional Wehrl entropy among all the quantum states with a given conditional von Neumann entropy and proves that this minimum is asymptotically achieved by a suitable sequence of quantum Gaussian states. The second relation applies to the tripartite memory scenario. It determines the minimum of the sum of the Wehrl entropy of a quantum state conditioned on the first memory quantum system with the Wehrl entropy of the same state conditioned on the second memory quantum system and proves that also this minimum is asymptotically achieved by a suitable sequence of quantum Gaussian states. The Wehrl entropy of a quantum state is the Shannon differential entropy of the outcome of a heterodyne measurement performed on the state. The heterodyne measurement is one of the main measurements in quantum optics and lies at the basis of one of the most promising protocols for quantum key distribution. These fundamental entropic uncertainty relations will be a valuable tool in quantum information and will, for example, find application in security proofs of quantum key distribution protocols in the asymptotic regime and in entanglement witnessing in quantum optics.

Quantifying selection and diversity in viruses by entropy methods, with application to the haemagglutinin of H3N2 influenza

PubMed Central

Pan, Keyao; Deem, Michael W.

2011-01-01

Many viruses evolve rapidly. For example, haemagglutinin (HA) of the H3N2 influenza A virus evolves to escape antibody binding. This evolution of the H3N2 virus means that people who have previously been exposed to an influenza strain may be infected by a newly emerged virus. In this paper, we use Shannon entropy and relative entropy to measure the diversity and selection pressure by an antibody in each amino acid site of H3 HA between the 1992–1993 season and the 2009–2010 season. Shannon entropy and relative entropy are two independent state variables that we use to characterize H3N2 evolution. The entropy method estimates future H3N2 evolution and migration using currently available H3 HA sequences. First, we show that the rate of evolution increases with the virus diversity in the current season. The Shannon entropy of the sequence in the current season predicts relative entropy between sequences in the current season and those in the next season. Second, a global migration pattern of H3N2 is assembled by comparing the relative entropy flows of sequences sampled in China, Japan, the USA and Europe. We verify this entropy method by describing two aspects of historical H3N2 evolution. First, we identify 54 amino acid sites in HA that have evolved in the past to evade the immune system. Second, the entropy method shows that epitopes A and B on the top of HA evolve most vigorously to escape antibody binding. Our work provides a novel entropy-based method to predict and quantify future H3N2 evolution and to describe the evolutionary history of H3N2. PMID:21543352

CHANDRA and XMM-NEWTON observations of the bimodal PLANCK SZ-detected clustered CKG345.40-39.34 (A3716) with high and low entropy subcluster cores

DOE PAGES

Andrade-Santos, Felipe; Jones, Christine; Forman, William R.; ...

2015-04-22

Here, we present results from Chandra, XMM-Newton, and ROSAT observations of the Planck SZ-detected cluster A3716 (PLCKG345.40-39.34-G345). We show that G345 is, in fact, two subclusters separated on the sky by 400 kpc. We measure the subclusters' gas temperatures (~2–3 keV), total (~1–2 × 10 14more » $${{M}_{\\odot }}$$) and gas (~1–2 × 10 13 $${{M}_{\\odot }}$$) masses, gas mass fraction within r500, entropy profiles, and X-ray luminosities (~10 43 erg s -1). Using the gas density and temperature profiles for both subclusters, we show that there is good (0.8σ) agreement between the expected Sunyaev–Zel'dovich signal predicted from the X-ray data and that measured from the Planck mission, and better agreement within 0.6σ when we re-computed the Planck value assuming a two component cluster model, with relative amplitudes fixed based on the X-ray data. Dynamical analysis shows that the two galaxy subclusters are very likely ($$\\gt 97\\%$$ probability) gravitationally bound, and in the most likely scenario, the subclusters will undergo core passage in 500 ± 200 Myr. The northern subcluster is centrally peaked and has a low entropy core, while the southern subcluster has a high central entropy. Finally, the high central entropy in the southern subcluster can be explained either by the mergers of several groups, as suggested by the presence of five giant ellipticals or by active galactic nucleus energy injection, as suggested by the presence of a strong radio source in one of its massive elliptical galaxies, or by a combination of both processes.« less

Wavelet entropy characterization of elevated intracranial pressure.

PubMed

Xu, Peng; Scalzo, Fabien; Bergsneider, Marvin; Vespa, Paul; Chad, Miller; Hu, Xiao

2008-01-01

Intracranial Hypertension (ICH) often occurs for those patients with traumatic brain injury (TBI), stroke, tumor, etc. Pathology of ICH is still controversial. In this work, we used wavelet entropy and relative wavelet entropy to study the difference existed between normal and hypertension states of ICP for the first time. The wavelet entropy revealed the similar findings as the approximation entropy that entropy during ICH state is smaller than that in normal state. Moreover, with wavelet entropy, we can see that ICH state has the more focused energy in the low wavelet frequency band (0-3.1 Hz) than the normal state. The relative wavelet entropy shows that the energy distribution in the wavelet bands between these two states is actually different. Based on these results, we suggest that ICH may be formed by the re-allocation of oscillation energy within brain.

Maps on positive operators preserving Rényi type relative entropies and maximal f-divergences

NASA Astrophysics Data System (ADS)

Gaál, Marcell; Nagy, Gergő

2018-02-01

In this paper, we deal with two quantum relative entropy preserver problems on the cones of positive (either positive definite or positive semidefinite) operators. The first one is related to a quantum Rényi relative entropy like quantity which plays an important role in classical-quantum channel decoding. The second one is connected to the so-called maximal f-divergences introduced by D. Petz and M. B. Ruskai who considered this quantity as a generalization of the usual Belavkin-Staszewski relative entropy. We emphasize in advance that all the results are obtained for finite-dimensional Hilbert spaces.

Bayesian or Laplacien inference, entropy and information theory and information geometry in data and signal processing

NASA Astrophysics Data System (ADS)

Mohammad-Djafari, Ali

2015-01-01

The main object of this tutorial article is first to review the main inference tools using Bayesian approach, Entropy, Information theory and their corresponding geometries. This review is focused mainly on the ways these tools have been used in data, signal and image processing. After a short introduction of the different quantities related to the Bayes rule, the entropy and the Maximum Entropy Principle (MEP), relative entropy and the Kullback-Leibler divergence, Fisher information, we will study their use in different fields of data and signal processing such as: entropy in source separation, Fisher information in model order selection, different Maximum Entropy based methods in time series spectral estimation and finally, general linear inverse problems.

Direct measurement of weakly nonequilibrium system entropy is consistent with Gibbs–Shannon form

PubMed Central

2017-01-01

Stochastic thermodynamics extends classical thermodynamics to small systems in contact with one or more heat baths. It can account for the effects of thermal fluctuations and describe systems far from thermodynamic equilibrium. A basic assumption is that the expression for Shannon entropy is the appropriate description for the entropy of a nonequilibrium system in such a setting. Here we measure experimentally this function in a system that is in local but not global equilibrium. Our system is a micron-scale colloidal particle in water, in a virtual double-well potential created by a feedback trap. We measure the work to erase a fraction of a bit of information and show that it is bounded by the Shannon entropy for a two-state system. Further, by measuring directly the reversibility of slow protocols, we can distinguish unambiguously between protocols that can and cannot reach the expected thermodynamic bounds. PMID:29073017

Suzaku observations of low surface brightness cluster Abell 1631

NASA Astrophysics Data System (ADS)

Babazaki, Yasunori; Mitsuishi, Ikuyuki; Ota, Naomi; Sasaki, Shin; Böhringer, Hans; Chon, Gayoung; Pratt, Gabriel W.; Matsumoto, Hironori

2018-04-01

We present analysis results for a nearby galaxy cluster Abell 1631 at z = 0.046 using the X-ray observatory Suzaku. This cluster is categorized as a low X-ray surface brightness cluster. To study the dynamical state of the cluster, we conduct four-pointed Suzaku observations and investigate physical properties of the Mpc-scale hot gas associated with the A 1631 cluster for the first time. Unlike relaxed clusters, the X-ray image shows no strong peak at the center and an irregular morphology. We perform spectral analysis and investigate the radial profiles of the gas temperature, density, and entropy out to approximately 1.5 Mpc in the east, north, west, and south directions by combining with the XMM-Newton data archive. The measured gas density in the central region is relatively low (a few ×10-4 cm-3) at the given temperature (˜2.9 keV) compared with X-ray-selected clusters. The entropy profile and value within the central region (r < 0.1 r200) are found to be flatter and higher (≳400 keV cm2). The observed bolometric luminosity is approximately three times lower than that expected from the luminosity-temperature relation in previous studies of relaxed clusters. These features are also observed in another low surface brightness cluster, Abell 76. The spatial distributions of galaxies and the hot gas appear to be different. The X-ray luminosity is relatively lower than that expected from the velocity dispersion. A post-merger scenario may explain the observed results.

Suzaku observations of low surface brightness cluster Abell 1631

NASA Astrophysics Data System (ADS)

Babazaki, Yasunori; Mitsuishi, Ikuyuki; Ota, Naomi; Sasaki, Shin; Böhringer, Hans; Chon, Gayoung; Pratt, Gabriel W.; Matsumoto, Hironori

2018-06-01

We present analysis results for a nearby galaxy cluster Abell 1631 at z = 0.046 using the X-ray observatory Suzaku. This cluster is categorized as a low X-ray surface brightness cluster. To study the dynamical state of the cluster, we conduct four-pointed Suzaku observations and investigate physical properties of the Mpc-scale hot gas associated with the A 1631 cluster for the first time. Unlike relaxed clusters, the X-ray image shows no strong peak at the center and an irregular morphology. We perform spectral analysis and investigate the radial profiles of the gas temperature, density, and entropy out to approximately 1.5 Mpc in the east, north, west, and south directions by combining with the XMM-Newton data archive. The measured gas density in the central region is relatively low (a few ×10-4 cm-3) at the given temperature (˜2.9 keV) compared with X-ray-selected clusters. The entropy profile and value within the central region (r < 0.1 r200) are found to be flatter and higher (≳400 keV cm2). The observed bolometric luminosity is approximately three times lower than that expected from the luminosity-temperature relation in previous studies of relaxed clusters. These features are also observed in another low surface brightness cluster, Abell 76. The spatial distributions of galaxies and the hot gas appear to be different. The X-ray luminosity is relatively lower than that expected from the velocity dispersion. A post-merger scenario may explain the observed results.

An information-theoretic approach to assess practical identifiability of parametric dynamical systems.

PubMed

Pant, Sanjay; Lombardi, Damiano

2015-10-01

A new approach for assessing parameter identifiability of dynamical systems in a Bayesian setting is presented. The concept of Shannon entropy is employed to measure the inherent uncertainty in the parameters. The expected reduction in this uncertainty is seen as the amount of information one expects to gain about the parameters due to the availability of noisy measurements of the dynamical system. Such expected information gain is interpreted in terms of the variance of a hypothetical measurement device that can measure the parameters directly, and is related to practical identifiability of the parameters. If the individual parameters are unidentifiable, correlation between parameter combinations is assessed through conditional mutual information to determine which sets of parameters can be identified together. The information theoretic quantities of entropy and information are evaluated numerically through a combination of Monte Carlo and k-nearest neighbour methods in a non-parametric fashion. Unlike many methods to evaluate identifiability proposed in the literature, the proposed approach takes the measurement-noise into account and is not restricted to any particular noise-structure. Whilst computationally intensive for large dynamical systems, it is easily parallelisable and is non-intrusive as it does not necessitate re-writing of the numerical solvers of the dynamical system. The application of such an approach is presented for a variety of dynamical systems--ranging from systems governed by ordinary differential equations to partial differential equations--and, where possible, validated against results previously published in the literature. Copyright © 2015 Elsevier Inc. All rights reserved.

Efficient Bayesian experimental design for contaminant source identification

NASA Astrophysics Data System (ADS)

Zhang, Jiangjiang; Zeng, Lingzao; Chen, Cheng; Chen, Dingjiang; Wu, Laosheng

2015-01-01

In this study, an efficient full Bayesian approach is developed for the optimal sampling well location design and source parameters identification of groundwater contaminants. An information measure, i.e., the relative entropy, is employed to quantify the information gain from concentration measurements in identifying unknown parameters. In this approach, the sampling locations that give the maximum expected relative entropy are selected as the optimal design. After the sampling locations are determined, a Bayesian approach based on Markov Chain Monte Carlo (MCMC) is used to estimate unknown parameters. In both the design and estimation, the contaminant transport equation is required to be solved many times to evaluate the likelihood. To reduce the computational burden, an interpolation method based on the adaptive sparse grid is utilized to construct a surrogate for the contaminant transport equation. The approximated likelihood can be evaluated directly from the surrogate, which greatly accelerates the design and estimation process. The accuracy and efficiency of our approach are demonstrated through numerical case studies. It is shown that the methods can be used to assist in both single sampling location and monitoring network design for contaminant source identifications in groundwater.

Min-entropy uncertainty relation for finite-size cryptography

NASA Astrophysics Data System (ADS)

Ng, Nelly Huei Ying; Berta, Mario; Wehner, Stephanie

2012-10-01

Apart from their foundational significance, entropic uncertainty relations play a central role in proving the security of quantum cryptographic protocols. Of particular interest are therefore relations in terms of the smooth min-entropy for Bennett-Brassard 1984 (BB84) and six-state encodings. The smooth min-entropy Hminɛ(X/B) quantifies the negative logarithm of the probability for an attacker B to guess X, except with a small failure probability ɛ. Previously, strong uncertainty relations were obtained which are valid in the limit of large block lengths. Here, we prove an alternative uncertainty relation in terms of the smooth min-entropy that is only marginally less strong but has the crucial property that it can be applied to rather small block lengths. This paves the way for a practical implementation of many cryptographic protocols. As part of our proof we show tight uncertainty relations for a family of Rényi entropies that may be of independent interest.

Thermodynamics of the Coma Cluster Outskirts

NASA Astrophysics Data System (ADS)

Simionescu, A.; Werner, N.; Urban, O.; Allen, S. W.; Fabian, A. C.; Mantz, A.; Matsushita, K.; Nulsen, P. E. J.; Sanders, J. S.; Sasaki, T.; Sato, T.; Takei, Y.; Walker, S. A.

2013-09-01

We present results from a large mosaic of Suzaku observations of the Coma Cluster, the nearest and X-ray brightest hot (~8 keV), dynamically active, non-cool core system, focusing on the thermodynamic properties of the intracluster medium on large scales. For azimuths not aligned with an infalling subcluster toward the southwest, our measured temperature and X-ray brightness profiles exhibit broadly consistent radial trends, with the temperature decreasing from about 8.5 keV at the cluster center to about 2 keV at a radius of 2 Mpc, which is the edge of our detection limit. The southwest merger significantly boosts the surface brightness, allowing us to detect X-ray emission out to ~2.2 Mpc along this direction. Apart from the southwestern infalling subcluster, the surface brightness profiles show multiple edges around radii of 30-40 arcmin. The azimuthally averaged temperature profile, as well as the deprojected density and pressure profiles, all show a sharp drop consistent with an outwardly-propagating shock front located at 40 arcmin, corresponding to the outermost edge of the giant radio halo observed at 352 MHz with the Westerbork Synthesis Radio Telescope. The shock front may be powering this radio emission. A clear entropy excess inside of r 500 reflects the violent merging events linked with these morphological features. Beyond r 500, the entropy profiles of the Coma Cluster along the relatively relaxed directions are consistent with the power-law behavior expected from simple models of gravitational large-scale structure formation. The pressure is also in agreement at these radii with the expected values measured from Sunyaev-Zel'dovich data from the Planck satellite. However, due to the large uncertainties associated with the Coma Cluster measurements, we cannot yet exclude an entropy flattening in this system consistent with that seen in more relaxed cool core clusters.

Some New Properties of Quantum Correlations

NASA Astrophysics Data System (ADS)

Liu, Feng; Li, Fei; Wei, Yunxia

2017-02-01

Quantum coherence measures the correlation between different measurement results in a single-system, while entanglement and quantum discord measure the correlation among different subsystems in a multipartite system. In this paper, we focus on the relative entropy form of them, and obtain three new properties of them as follows: 1) General forms of maximally coherent states for the relative entropy coherence, 2) Linear monogamy of the relative entropy entanglement, and 3) Subadditivity of quantum discord. Here, the linear monogamy is defined as there is a small constant as the upper bound on the sum of the relative entropy entanglement in subsystems.

Expectation values of twist fields and universal entanglement saturation of the free massive boson

NASA Astrophysics Data System (ADS)

Blondeau-Fournier, Olivier; Doyon, Benjamin

2017-07-01

The evaluation of vacuum expectation values (VEVs) in massive integrable quantum field theory (QFT) is a nontrivial renormalization-group ‘connection problem’—relating large and short distance asymptotics—and is in general unsolved. This is particularly relevant in the context of entanglement entropy, where VEVs of branch-point twist fields give universal saturation predictions. We propose a new method to compute VEVs of twist fields associated to continuous symmetries in QFT. The method is based on a differential equation in the continuous symmetry parameter, and gives VEVs as infinite form-factor series which truncate at two-particle level in free QFT. We verify the method by studying U(1) twist fields in free models, which are simply related to the branch-point twist fields. We provide the first exact formulae for the VEVs of such fields in the massive uncompactified free boson model, checking against an independent calculation based on angular quantization. We show that logarithmic terms, overlooked in the original work of Callan and Wilczek (1994 Phys. Lett. B 333 55-61), appear both in the massless and in the massive situations. This implies that, in agreement with numerical form-factor observations by Bianchini and Castro-Alvaredo (2016 Nucl. Phys. B 913 879-911), the standard power-law short-distance behavior is corrected by a logarithmic factor. We discuss how this gives universal formulae for the saturation of entanglement entropy of a single interval in near-critical harmonic chains, including loglog corrections.

Design of new face-centered cubic high entropy alloys by thermodynamic calculation

NASA Astrophysics Data System (ADS)

Choi, Won-Mi; Jung, Seungmun; Jo, Yong Hee; Lee, Sunghak; Lee, Byeong-Joo

2017-09-01

A new face-centered cubic (fcc) high entropy alloy system with non-equiatomic compositions has been designed by utilizing a CALculation of PHAse Diagram (CALPHAD) - type thermodynamic calculation technique. The new alloy system is based on the representative fcc high entropy alloy, the Cantor alloy which is an equiatomic Co- Cr-Fe-Mn-Ni five-component alloy, but fully or partly replace the cobalt by vanadium and is of non-equiatomic compositions. Alloy compositions expected to have an fcc single-phase structure between 700 °C and melting temperatures are proposed. All the proposed alloys are experimentally confirmed to have the fcc single-phase during materials processes (> 800 °C), through an X-ray diffraction analysis. It is shown that there are more chances to find fcc single-phase high entropy alloys if paying attention to non-equiatomic composition regions and that the CALPHAD thermodynamic calculation can be an efficient tool for it. An alloy design technique based on thermodynamic calculation is demonstrated and the applicability and limitation of the approach as a design tool for high entropy alloys is discussed.

Melting curves and entropy of fusion of body-centered cubic tungsten under pressure

NASA Astrophysics Data System (ADS)

Liu, Chun-Mei; Chen, Xiang-Rong; Xu, Chao; Cai, Ling-Cang; Jing, Fu-Qian

2012-07-01

The melting curves and entropy of fusion of body-centered cubic (bcc) tungsten (W) under pressure are investigated via molecular dynamics (MD) simulations with extended Finnis-Sinclair (EFS) potential. The zero pressure melting point obtained is better than other theoretical results by MD simulations with the embedded-atom-method (EAM), Finnis-Sinclair (FS) and modified EAM potentials, and by ab initio MD simulations. Our radial distribution function and running coordination number analyses indicate that apart from the expected increase in disorder, the main change on going from solid to liquid is thus a slight decrease in coordination number. Our entropy of fusion of W during melting, ΔS, at zero pressure, 7.619 J/mol.K, is in good agreement with the experimental and other theoretical data. We found that, with the increasing pressure, the entropy of fusion ΔS decreases fast first and then oscillates with pressure; when the pressure is higher than 100 GPa, the entropy of fusion ΔS is about 6.575 ± 0.086 J/mol.K, which shows less pressure effect.

On the relation between correlation dimension, approximate entropy and sample entropy parameters, and a fast algorithm for their calculation

NASA Astrophysics Data System (ADS)

Zurek, Sebastian; Guzik, Przemyslaw; Pawlak, Sebastian; Kosmider, Marcin; Piskorski, Jaroslaw

2012-12-01

We explore the relation between correlation dimension, approximate entropy and sample entropy parameters, which are commonly used in nonlinear systems analysis. Using theoretical considerations we identify the points which are shared by all these complexity algorithms and show explicitly that the above parameters are intimately connected and mutually interdependent. A new geometrical interpretation of sample entropy and correlation dimension is provided and the consequences for the interpretation of sample entropy, its relative consistency and some of the algorithms for parameter selection for this quantity are discussed. To get an exact algorithmic relation between the three parameters we construct a very fast algorithm for simultaneous calculations of the above, which uses the full time series as the source of templates, rather than the usual 10%. This algorithm can be used in medical applications of complexity theory, as it can calculate all three parameters for a realistic recording of 104 points within minutes with the use of an average notebook computer.

Stokes-Einstein relation and excess entropy in Al-rich Al-Cu melts

NASA Astrophysics Data System (ADS)

Pasturel, A.; Jakse, N.

2016-07-01

We investigate the conditions for the validity of the Stokes-Einstein relation that connects diffusivity to viscosity in melts using entropy-scaling relationships developed by Rosenfeld. Employing ab initio molecular dynamics simulations to determine transport and structural properties of liquid Al1-xCux alloys (with composition x ≤ 0.4), we first show that reduced self-diffusion coefficients and viscosities, according to Rosenfeld's formulation, scale with the two-body approximation of the excess entropy except the reduced viscosity for x = 0.4. Then, we use our findings to evidence that the Stokes-Einstein relation using effective atomic radii is not valid in these alloys while its validity can be related to the temperature dependence of the partial pair-excess entropies of both components. Finally, we derive a relation between the ratio of the self-diffusivities of the components and the ratio of their pair excess entropies.

On the entropy variation in the scenario of entropic gravity

NASA Astrophysics Data System (ADS)

Xiao, Yong; Bai, Shi-Yang

2018-05-01

In the scenario of entropic gravity, entropy varies as a function of the location of the matter, while the tendency to increase entropy appears as gravity. We concentrate on studying the entropy variation of a typical gravitational system with different relative positions between the mass and the gravitational source. The result is that the entropy of the system doesn't increase when the mass is displaced closer to the gravitational source. In this way it disproves the proposal of entropic gravity from thermodynamic entropy. It doesn't exclude the possibility that gravity originates from non-thermodynamic entropy like entanglement entropy.

Entropy of single-file water in (6,6) carbon nanotubes.

PubMed

Waghe, Aparna; Rasaiah, Jayendran C; Hummer, Gerhard

2012-07-28

We used molecular dynamics simulations to investigate the thermodynamics of filling of a (6,6) open carbon nanotube (diameter D = 0.806 nm) solvated in TIP3P water over a temperature range from 280 K to 320 K at atmospheric pressure. In simulations of tubes with slightly weakened carbon-water attractive interactions, we observed multiple filling and emptying events. From the water occupancy statistics, we directly obtained the free energy of filling, and from its temperature dependence the entropy of filling. We found a negative entropy of about -1.3 k(B) per molecule for filling the nanotube with a hydrogen-bonded single-file chain of water molecules. The entropy of filling is nearly independent of the strength of the attractive carbon-water interactions over the range studied. In contrast, the energy of transfer depends strongly on the carbon-water attraction strength. These results are in good agreement with entropies of about -0.5 k(B) per water molecule obtained from grand-canonical Monte Carlo calculations of water in quasi-infinite tubes in vacuum under periodic boundary conditions. Overall, for realistic carbon-water interactions we expect that at ambient conditions filling of a (6,6) carbon nanotube open to a water reservoir is driven by a favorable decrease in energy, and opposed by a small loss of water entropy.

Characterization of time series via Rényi complexity-entropy curves

NASA Astrophysics Data System (ADS)

Jauregui, M.; Zunino, L.; Lenzi, E. K.; Mendes, R. S.; Ribeiro, H. V.

2018-05-01

One of the most useful tools for distinguishing between chaotic and stochastic time series is the so-called complexity-entropy causality plane. This diagram involves two complexity measures: the Shannon entropy and the statistical complexity. Recently, this idea has been generalized by considering the Tsallis monoparametric generalization of the Shannon entropy, yielding complexity-entropy curves. These curves have proven to enhance the discrimination among different time series related to stochastic and chaotic processes of numerical and experimental nature. Here we further explore these complexity-entropy curves in the context of the Rényi entropy, which is another monoparametric generalization of the Shannon entropy. By combining the Rényi entropy with the proper generalization of the statistical complexity, we associate a parametric curve (the Rényi complexity-entropy curve) with a given time series. We explore this approach in a series of numerical and experimental applications, demonstrating the usefulness of this new technique for time series analysis. We show that the Rényi complexity-entropy curves enable the differentiation among time series of chaotic, stochastic, and periodic nature. In particular, time series of stochastic nature are associated with curves displaying positive curvature in a neighborhood of their initial points, whereas curves related to chaotic phenomena have a negative curvature; finally, periodic time series are represented by vertical straight lines.

Cosmological Entropy Bounds

NASA Astrophysics Data System (ADS)

Brustein, R.

I review some basic facts about entropy bounds in general and about cosmological entropy bounds. Then I review the causal entropy bound, the conditions for its validity and its application to the study of cosmological singularities. This article is based on joint work with Gabriele Veneziano and subsequent related research.

Entanglement entropy in causal set theory

NASA Astrophysics Data System (ADS)

Sorkin, Rafael D.; Yazdi, Yasaman K.

2018-04-01

Entanglement entropy is now widely accepted as having deep connections with quantum gravity. It is therefore desirable to understand it in the context of causal sets, especially since they provide in a natural manner the UV cutoff needed to render entanglement entropy finite. Formulating a notion of entanglement entropy in a causal set is not straightforward because the type of canonical hypersurface-data on which its definition typically relies is not available. Instead, we appeal to the more global expression given in Sorkin (2012 (arXiv:1205.2953)) which, for a Gaussian scalar field, expresses the entropy of a spacetime region in terms of the field’s correlation function within that region (its ‘Wightman function’ W(x, x') ). Carrying this formula over to the causal set, one obtains an entropy which is both finite and of a Lorentz invariant nature. We evaluate this global entropy-expression numerically for certain regions (primarily order-intervals or ‘causal diamonds’) within causal sets of 1  +  1 dimensions. For the causal-set counterpart of the entanglement entropy, we obtain, in the first instance, a result that follows a (spacetime) volume law instead of the expected (spatial) area law. We find, however, that one obtains an area law if one truncates the commutator function (‘Pauli–Jordan operator’) and the Wightman function by projecting out the eigenmodes of the Pauli–Jordan operator whose eigenvalues are too close to zero according to a geometrical criterion which we describe more fully below. In connection with these results and the questions they raise, we also study the ‘entropy of coarse-graining’ generated by thinning out the causal set, and we compare it with what one obtains by similarly thinning out a chain of harmonic oscillators, finding the same, ‘universal’ behaviour in both cases.

Increased resting-state brain entropy in Alzheimer's disease.

PubMed

Xue, Shao-Wei; Guo, Yonghu

2018-03-07

Entropy analysis of resting-state functional MRI (R-fMRI) is a novel approach to characterize brain temporal dynamics and facilitates the identification of abnormal brain activity caused by several disease conditions. However, Alzheimer's disease (AD)-related brain entropy mapping based on R-fMRI has not been assessed. Here, we measured the sample entropy and voxel-wise connectivity of the network degree centrality (DC) of the intrinsic brain activity acquired by R-fMRI in 26 patients with AD and 26 healthy controls. Compared with the controls, AD patients showed increased entropy in the middle temporal gyrus and the precentral gyrus and also showed decreased DC in the precuneus. Moreover, the magnitude of the negative correlation between local brain activity (entropy) and network connectivity (DC) was increased in AD patients in comparison with healthy controls. These findings provide new evidence on AD-related brain entropy alterations.

Shortening a loop can increase protein native state entropy.

PubMed

Gavrilov, Yulian; Dagan, Shlomi; Levy, Yaakov

2015-12-01

Protein loops are essential structural elements that influence not only function but also protein stability and folding rates. It was recently reported that shortening a loop in the AcP protein may increase its native state conformational entropy. This effect on the entropy of the folded state can be much larger than the lower entropic penalty of ordering a shorter loop upon folding, and can therefore result in a more pronounced stabilization than predicted by polymer model for loop closure entropy. In this study, which aims at generalizing the effect of loop length shortening on native state dynamics, we use all-atom molecular dynamics simulations to study how gradual shortening a very long or solvent-exposed loop region in four different proteins can affect their stability. For two proteins, AcP and Ubc7, we show an increase in native state entropy in addition to the known effect of the loop length on the unfolded state entropy. However, for two permutants of SH3 domain, shortening a loop results only with the expected change in the entropy of the unfolded state, which nicely reproduces the observed experimental stabilization. Here, we show that an increase in the native state entropy following loop shortening is not unique to the AcP protein, yet nor is it a general rule that applies to all proteins following the truncation of any loop. This modification of the loop length on the folded state and on the unfolded state may result with a greater effect on protein stability. © 2015 Wiley Periodicals, Inc.

Learning Probabilities From Random Observables in High Dimensions: The Maximum Entropy Distribution and Others

NASA Astrophysics Data System (ADS)

Obuchi, Tomoyuki; Cocco, Simona; Monasson, Rémi

2015-11-01

We consider the problem of learning a target probability distribution over a set of N binary variables from the knowledge of the expectation values (with this target distribution) of M observables, drawn uniformly at random. The space of all probability distributions compatible with these M expectation values within some fixed accuracy, called version space, is studied. We introduce a biased measure over the version space, which gives a boost increasing exponentially with the entropy of the distributions and with an arbitrary inverse `temperature' Γ . The choice of Γ allows us to interpolate smoothly between the unbiased measure over all distributions in the version space (Γ =0) and the pointwise measure concentrated at the maximum entropy distribution (Γ → ∞ ). Using the replica method we compute the volume of the version space and other quantities of interest, such as the distance R between the target distribution and the center-of-mass distribution over the version space, as functions of α =(log M)/N and Γ for large N. Phase transitions at critical values of α are found, corresponding to qualitative improvements in the learning of the target distribution and to the decrease of the distance R. However, for fixed α the distance R does not vary with Γ which means that the maximum entropy distribution is not closer to the target distribution than any other distribution compatible with the observable values. Our results are confirmed by Monte Carlo sampling of the version space for small system sizes (N≤ 10).

Do planets remember how they formed?

NASA Astrophysics Data System (ADS)

Kipping, David

2018-01-01

One of the most directly observable features of a transiting multiplanet system is their size-ordering when ranked in orbital separation. Kepler has revealed a rich diversity of outcomes, from perfectly ordered systems, like Kepler-80, to ostensibly disordered systems, like Kepler-20. Under the hypothesis that systems are born via preferred formation pathways, one might reasonably expect non-random size-orderings reflecting these processes. However, subsequent dynamical evolution, often chaotic and turbulent in nature, may erode this information and so here we ask - do systems remember how they formed? To address this, we devise a model to define the entropy of a planetary system's size-ordering, by first comparing differences between neighbouring planets and then extending to accommodate differences across the chain. We derive closed-form solutions for many of the microstate occupancies and provide public code with look-up tables to compute entropy for up to 10-planet systems. All three proposed entropy definitions exhibit the expected property that their credible interval increases with respect to a proxy for time. We find that the observed Kepler multis display a highly significant deficit in entropy compared to a randomly generated population. Incorporating a filter for systems deemed likely to be dynamically packed, we show that this result is robust against the possibility of missing planets too. Put together, our work establishes that Kepler systems do indeed remember something of their younger years and highlights the value of information theory for exoplanetary science.

Ergodicity, Maximum Entropy Production, and Steepest Entropy Ascent in the Proofs of Onsager's Reciprocal Relations

NASA Astrophysics Data System (ADS)

Benfenati, Francesco; Beretta, Gian Paolo

2018-04-01

We show that to prove the Onsager relations using the microscopic time reversibility one necessarily has to make an ergodic hypothesis, or a hypothesis closely linked to that. This is true in all the proofs of the Onsager relations in the literature: from the original proof by Onsager, to more advanced proofs in the context of linear response theory and the theory of Markov processes, to the proof in the context of the kinetic theory of gases. The only three proofs that do not require any kind of ergodic hypothesis are based on additional hypotheses on the macroscopic evolution: Ziegler's maximum entropy production principle (MEPP), the principle of time reversal invariance of the entropy production, or the steepest entropy ascent principle (SEAP).

Entanglement entropy flow and the Ward identity.

PubMed

Rosenhaus, Vladimir; Smolkin, Michael

2014-12-31

We derive differential equations for the flow of entanglement entropy as a function of the metric and the couplings of the theory. The variation of the universal part of entanglement entropy under a local Weyl transformation is related to the variation under a local change in the couplings. We show that this relation is, in fact, equivalent to the trace Ward identity. As a concrete application of our formalism, we express the entanglement entropy for massive free fields as a two-point function of the energy-momentum tensor.

How many universes are in the multiverse?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Linde, Andrei; Vanchurin, Vitaly

2010-04-15

We argue that the total number of distinguishable locally Friedmann 'universes' generated by eternal inflation is proportional to the exponent of the entropy of inflationary perturbations and is limited by e{sup e3N}, where N is the number of e-folds of slow-roll posteternal inflation. For simplest models of chaotic inflation, N is approximately equal to de Sitter entropy at the end of eternal inflation; it can be exponentially large. However, not all of these universes can be observed by a local observer. In the presence of a cosmological constant {Lambda} the number of distinguishable universes is bounded by e{sup |{Lambda}|-3/4}. Inmore » the context of the string theory landscape, the overall number of different universes is expected to be exponentially greater than the total number of vacua in the landscape. We discuss the possibility that the strongest constraint on the number of distinguishable universes may be related not to the properties of the multiverse but to the properties of observers.« less

An alternative expression to the Sackur-Tetrode entropy formula for an ideal gas

NASA Astrophysics Data System (ADS)

Nagata, Shoichi

2018-03-01

An expression for the entropy of a monoatomic classical ideal gas is known as the Sackur-Tetrode equation. This pioneering investigation about 100 years ago incorporates quantum considerations. The purpose of this paper is to provide an alternative expression for the entropy in terms of the Heisenberg uncertainty relation. The analysis is made on the basis of fluctuation theory, for a canonical system in thermal equilibrium at temperature T. This new formula indicates manifestly that the entropy of macroscopic world is recognized as a measure of uncertainty in microscopic quantum world. The entropy in the Sackur-Tetrode equation can be re-interpreted from a different perspective viewpoint. The emphasis is on the connection between the entropy and the uncertainty relation in quantum consideration.

A robust algorithm for automated target recognition using precomputed radar cross sections

NASA Astrophysics Data System (ADS)

Ehrman, Lisa M.; Lanterman, Aaron D.

2004-09-01

Passive radar is an emerging technology that offers a number of unique benefits, including covert operation. Many such systems are already capable of detecting and tracking aircraft. The goal of this work is to develop a robust algorithm for adding automated target recognition (ATR) capabilities to existing passive radar systems. In previous papers, we proposed conducting ATR by comparing the precomputed RCS of known targets to that of detected targets. To make the precomputed RCS as accurate as possible, a coordinated flight model is used to estimate aircraft orientation. Once the aircraft's position and orientation are known, it is possible to determine the incident and observed angles on the aircraft, relative to the transmitter and receiver. This makes it possible to extract the appropriate radar cross section (RCS) from our simulated database. This RCS is then scaled to account for propagation losses and the receiver's antenna gain. A Rician likelihood model compares these expected signals from different targets to the received target profile. We have previously employed Monte Carlo runs to gauge the probability of error in the ATR algorithm; however, generation of a statistically significant set of Monte Carlo runs is computationally intensive. As an alternative to Monte Carlo runs, we derive the relative entropy (also known as Kullback-Liebler distance) between two Rician distributions. Since the probability of Type II error in our hypothesis testing problem can be expressed as a function of the relative entropy via Stein's Lemma, this provides us with a computationally efficient method for determining an upper bound on our algorithm's performance. It also provides great insight into the types of classification errors we can expect from our algorithm. This paper compares the numerically approximated probability of Type II error with the results obtained from a set of Monte Carlo runs.

Does horizon entropy satisfy a quantum null energy conjecture?

NASA Astrophysics Data System (ADS)

Fu, Zicao; Marolf, Donald

2016-12-01

A modern version of the idea that the area of event horizons gives 4G times an entropy is the Hubeny-Rangamani causal holographic information (CHI) proposal for holographic field theories. Given a region R of a holographic QFTs, CHI computes A/4G on a certain cut of an event horizon in the gravitational dual. The result is naturally interpreted as a coarse-grained entropy for the QFT. CHI is known to be finitely greater than the fine-grained Hubeny-Rangamani-Takayanagi (HRT) entropy when \\partial R lies on a Killing horizon of the QFT spacetime, and in this context satisfies other non-trivial properties expected of an entropy. Here we present evidence that it also satisfies the quantum null energy condition (QNEC), which bounds the second derivative of the entropy of a quantum field theory on one side of a non-expanding null surface by the flux of stress-energy across the surface. In particular, we show CHI to satisfy the QNEC in 1  +  1 holographic CFTs when evaluated in states dual to conical defects in AdS3. This surprising result further supports the idea that CHI defines a useful notion of coarse-grained holographic entropy, and suggests unprecedented bounds on the rate at which bulk horizon generators emerge from a caustic. To supplement our motivation, we include an appendix deriving a corresponding coarse-grained generalized second law for 1  +  1 holographic CFTs perturbatively coupled to dilaton gravity.

Entropy production in a box: Analysis of instabilities in confined hydrothermal systems

NASA Astrophysics Data System (ADS)

Börsing, N.; Wellmann, J. F.; Niederau, J.; Regenauer-Lieb, K.

2017-09-01

We evaluate if the concept of thermal entropy production can be used as a measure to characterize hydrothermal convection in a confined porous medium as a valuable, thermodynamically motivated addition to the standard Rayleigh number analysis. Entropy production has been used widely in the field of mechanical and chemical engineering as a way to characterize the thermodynamic state and irreversibility of an investigated system. Pioneering studies have since adapted these concepts to natural systems, and we apply this measure here to investigate the specific case of hydrothermal convection in a "box-shaped" confined porous medium, as a simplified analog for, e.g., hydrothermal convection in deep geothermal aquifers. We perform various detailed numerical experiments to assess the response of the convective system to changing boundary conditions or domain aspect ratios, and then determine the resulting entropy production for each experiment. In systems close to the critical Rayleigh number, we derive results that are in accordance to the analytically derived predictions. At higher Rayleigh numbers, however, we observe multiple possible convection modes, and the analysis of the integrated entropy production reveals distinct curves of entropy production that provide an insight into the hydrothermal behavior in the system, both for cases of homogeneous materials, as well as for heterogeneous spatial material distributions. We conclude that the average thermal entropy production characterizes the internal behavior of hydrothermal systems with a meaningful thermodynamic measure, and we expect that it can be useful for the investigation of convection systems in many similar hydrogeological and geophysical settings.

Entanglement Entropy of Black Holes.

PubMed

Solodukhin, Sergey N

2011-01-01

The entanglement entropy is a fundamental quantity, which characterizes the correlations between sub-systems in a larger quantum-mechanical system. For two sub-systems separated by a surface the entanglement entropy is proportional to the area of the surface and depends on the UV cutoff, which regulates the short-distance correlations. The geometrical nature of entanglement-entropy calculation is particularly intriguing when applied to black holes when the entangling surface is the black-hole horizon. I review a variety of aspects of this calculation: the useful mathematical tools such as the geometry of spaces with conical singularities and the heat kernel method, the UV divergences in the entropy and their renormalization, the logarithmic terms in the entanglement entropy in four and six dimensions and their relation to the conformal anomalies. The focus in the review is on the systematic use of the conical singularity method. The relations to other known approaches such as 't Hooft's brick-wall model and the Euclidean path integral in the optical metric are discussed in detail. The puzzling behavior of the entanglement entropy due to fields, which non-minimally couple to gravity, is emphasized. The holographic description of the entanglement entropy of the blackhole horizon is illustrated on the two- and four-dimensional examples. Finally, I examine the possibility to interpret the Bekenstein-Hawking entropy entirely as the entanglement entropy.

Entanglement Entropy of Black Holes

NASA Astrophysics Data System (ADS)

Solodukhin, Sergey N.

2011-10-01

The entanglement entropy is a fundamental quantity, which characterizes the correlations between sub-systems in a larger quantum-mechanical system. For two sub-systems separated by a surface the entanglement entropy is proportional to the area of the surface and depends on the UV cutoff, which regulates the short-distance correlations. The geometrical nature of entanglement-entropy calculation is particularly intriguing when applied to black holes when the entangling surface is the black-hole horizon. I review a variety of aspects of this calculation: the useful mathematical tools such as the geometry of spaces with conical singularities and the heat kernel method, the UV divergences in the entropy and their renormalization, the logarithmic terms in the entanglement entropy in four and six dimensions and their relation to the conformal anomalies. The focus in the review is on the systematic use of the conical singularity method. The relations to other known approaches such as 't Hooft's brick-wall model and the Euclidean path integral in the optical metric are discussed in detail. The puzzling behavior of the entanglement entropy due to fields, which non-minimally couple to gravity, is emphasized. The holographic description of the entanglement entropy of the blackhole horizon is illustrated on the two- and four-dimensional examples. Finally, I examine the possibility to interpret the Bekenstein-Hawking entropy entirely as the entanglement entropy.

Numerical estimation of the relative entropy of entanglement

NASA Astrophysics Data System (ADS)

Zinchenko, Yuriy; Friedland, Shmuel; Gour, Gilad

2010-11-01

We propose a practical algorithm for the calculation of the relative entropy of entanglement (REE), defined as the minimum relative entropy between a state and the set of states with positive partial transpose. Our algorithm is based on a practical semidefinite cutting plane approach. In low dimensions the implementation of the algorithm in matlab provides an estimation for the REE with an absolute error smaller than 10-3.

Campbell's Rule for Estimating Entropy Changes

ERIC Educational Resources Information Center

Jensen, William B.

2004-01-01

Campbell's rule for estimating entropy changes is discussed in relation to an earlier article by Norman Craig, where it was proposed that the approximate value of the entropy of reaction was related to net moles of gas consumed or generated. It was seen that the average for Campbell's data set was lower than that for Craig's data set and…

Psychological Entropy: A Framework for Understanding Uncertainty-Related Anxiety

ERIC Educational Resources Information Center

Hirsh, Jacob B.; Mar, Raymond A.; Peterson, Jordan B.

2012-01-01

Entropy, a concept derived from thermodynamics and information theory, describes the amount of uncertainty and disorder within a system. Self-organizing systems engage in a continual dialogue with the environment and must adapt themselves to changing circumstances to keep internal entropy at a manageable level. We propose the entropy model of…

Determining Dynamical Path Distributions usingMaximum Relative Entropy

DTIC Science & Technology

2015-05-31

entropy to a one-dimensional continuum labeled by a parameter η. The resulting η-entropies are equivalent to those proposed by Renyi [12] or by Tsallis [13...1995). [12] A. Renyi , “On measures of entropy and information,”Proc. 4th Berkeley Simposium on Mathematical Statistics and Probability, Vol 1, p. 547-461

Searching for a C-function on the three-dimensional sphere

NASA Astrophysics Data System (ADS)

Beneventano, C. G.; Cavero-Peláez, I.; D'Ascanio, D.; Santangelo, E. M.

2017-11-01

We present a detailed analytic study on the three-dimensional sphere of the most popular candidates for C-functions, both for Dirac and scalar free massive fields. We discuss to which extent the effective action, the Rényi entanglement entropy and the renormalized entanglement entropy fulfill the conditions expected from C-functions. In view of the absence of a good candidate in the case of the scalar field, we introduce a new candidate, which we call the modified effective action, and analyze its pros and cons.

Holographic charged Rényi entropies

NASA Astrophysics Data System (ADS)

Belin, Alexandre; Hung, Ling-Yan; Maloney, Alexander; Matsuura, Shunji; Myers, Robert C.; Sierens, Todd

2013-12-01

We construct a new class of entanglement measures by extending the usual definition of Rényi entropy to include a chemical potential. These charged Rényi entropies measure the degree of entanglement in different charge sectors of the theory and are given by Euclidean path integrals with the insertion of a Wilson line encircling the entangling surface. We compute these entropies for a spherical entangling surface in CFT's with holographic duals, where they are related to entropies of charged black holes with hyperbolic horizons. We also compute charged Rényi entropies in free field theories.

Entropy of balance - some recent results

PubMed Central

2010-01-01

Background Entropy when applied to biological signals is expected to reflect the state of the biological system. However the physiological interpretation of the entropy is not always straightforward. When should high entropy be interpreted as a healthy sign, and when as marker of deteriorating health? We address this question for the particular case of human standing balance and the Center of Pressure data. Methods We have measured and analyzed balance data of 136 participants (young, n = 45; elderly, n = 91) comprising in all 1085 trials, and calculated the Sample Entropy (SampEn) for medio-lateral (M/L) and anterior-posterior (A/P) Center of Pressure (COP) together with the Hurst self-similariy (ss) exponent α using Detrended Fluctuation Analysis (DFA). The COP was measured with a force plate in eight 30 seconds trials with eyes closed, eyes open, foam, self-perturbation and nudge conditions. Results 1) There is a significant difference in SampEn for the A/P-direction between the elderly and the younger groups Old > young. 2) For the elderly we have in general A/P > M/L. 3) For the younger group there was no significant A/P-M/L difference with the exception for the nudge trials where we had the reverse situation, A/P < M/L. 4) For the elderly we have, Eyes Closed > Eyes Open. 5) In case of the Hurst ss-exponent we have for the elderly, M/L > A/P. Conclusions These results seem to be require some modifications of the more or less established attention-constraint interpretation of entropy. This holds that higher entropy correlates with a more automatic and a less constrained mode of balance control, and that a higher entropy reflects, in this sense, a more efficient balancing. PMID:20670457

Performance Expectations of Closed-Brayton-Cycle Heat Exchangers in 100-kWe Nuclear Space Power Systems

NASA Technical Reports Server (NTRS)

Barrett, Michael J.

2003-01-01

Performance expectations of closed-Brayton-cycle heat exchangers to be used in 100-kWe nuclear space power systems were forecast. Proposed cycle state points for a system supporting a mission to three of Jupiter s moons required effectiveness values for the heat-source exchanger, recuperator and rejection exchanger (gas cooler) of 0.98,0.95 and 0.97, respectively. Performance parameters such as number of thermal units (Nm), equivalent thermal conductance (UA), and entropy generation numbers (Ns) varied from 11 to 19,23 to 39 kWK, and 0.019 to 0.023 for some standard heat exchanger configurations. Pressure-loss contributions to entropy generation were significant; the largest frictional contribution was 114% of the heat-transfer irreversibility. Using conventional recuperator designs, the 0.95 effectiveness proved difficult to achieve without exceeding other performance targets; a metallic, plate-fin counterflow solution called for 15% more mass and 33% higher pressure-loss than the target values. Two types of gas-coolers showed promise. Single-pass counterflow and multipass cross-counterflow arrangements both met the 0.97 effectiveness requirement. Potential reliability-related advantages of the cross-countefflow design were noted. Cycle modifications, enhanced heat transfer techniques and incorporation of advanced materials were suggested options to reduce system development risk. Carbon-carbon sheeting or foam proved an attractive option to improve overall performance.

Performance Expectations of Closed-Brayton-Cycle Heat Exchangers in 100-kWe Nuclear Space Power Systems

NASA Technical Reports Server (NTRS)

Barrett, Michael J.

2003-01-01

Performance expectations of closed-Brayton-cycle heat exchangers to be used in 100-k We nuclear space power systems were forecast. Proposed cycle state points for a system supporting a mission to three of Jupiter's moons required effectiveness values for the heat-source exchanger, recuperator and rejection exchanger (gas cooler) of 0.98, 0.95, and 0.97, respectively. Performance parameters such as number of thermal units (Ntu), equivalent thermal conductance (UA), and entropy generation numbers (Ns) varied from 11 to 19, 23 to 39 kW/K, and 0.019 to 0.023 for some standard heat exchanger configurations. Pressure-loss contributions to entropy generation were significant; the largest frictional contribution was 114% of the heat transfer irreversibility. Using conventional recuperator designs, the 0.95 effectiveness proved difficult to achieve without exceeding other performance targets; a metallic, plate-fin counterflow solution called for 15% more mass and 33% higher pressure-loss than the target values. Two types of gas-coolers showed promise. Single-pass counterflow and multipass cross-counterflow arrangements both met the 0.97 effectiveness requirement. Potential reliability-related advantages of the cross-counterflow design were noted. Cycle modifications, enhanced heat transfer techniques and incorporation of advanced materials were suggested options to reduce system development risk. Carbon-carbon sheeting or foam proved an attractive option to improve overall performance.

Quantum Rényi relative entropies affirm universality of thermodynamics.

PubMed

Misra, Avijit; Singh, Uttam; Bera, Manabendra Nath; Rajagopal, A K

2015-10-01

We formulate a complete theory of quantum thermodynamics in the Rényi entropic formalism exploiting the Rényi relative entropies, starting from the maximum entropy principle. In establishing the first and second laws of quantum thermodynamics, we have correctly identified accessible work and heat exchange in both equilibrium and nonequilibrium cases. The free energy (internal energy minus temperature times entropy) remains unaltered, when all the entities entering this relation are suitably defined. Exploiting Rényi relative entropies we have shown that this "form invariance" holds even beyond equilibrium and has profound operational significance in isothermal process. These results reduce to the Gibbs-von Neumann results when the Rényi entropic parameter α approaches 1. Moreover, it is shown that the universality of the Carnot statement of the second law is the consequence of the form invariance of the free energy, which is in turn the consequence of maximum entropy principle. Further, the Clausius inequality, which is the precursor to the Carnot statement, is also shown to hold based on the data processing inequalities for the traditional and sandwiched Rényi relative entropies. Thus, we find that the thermodynamics of nonequilibrium state and its deviation from equilibrium together determine the thermodynamic laws. This is another important manifestation of the concepts of information theory in thermodynamics when they are extended to the quantum realm. Our work is a substantial step towards formulating a complete theory of quantum thermodynamics and corresponding resource theory.

The specific entropy of elliptical galaxies: an explanation for profile-shape distance indicators?

NASA Astrophysics Data System (ADS)

Lima Neto, G. B.; Gerbal, D.; Márquez, I.

1999-10-01

Dynamical systems in equilibrium have a stationary entropy; we suggest that elliptical galaxies, as stellar systems in a stage of quasi-equilibrium, may have in principle a unique specific entropy. This uniqueness, a priori unknown, should be reflected in correlations between the fundamental parameters describing the mass (light) distribution in galaxies. Following recent photometrical work on elliptical galaxies by Caon et al., Graham & Colless and Prugniel & Simien, we use the Sérsic law to describe the light profile and an analytical approximation to its three-dimensional deprojection. The specific entropy is then calculated, supposing that the galaxy behaves as a spherical, isotropic, one-component system in hydrostatic equilibrium, obeying the ideal-gas equations of state. We predict a relation between the three parameters of the Sérsic law linked to the specific entropy, defining a surface in the parameter space, an `Entropic Plane', by analogy with the well-known Fundamental Plane. We have analysed elliptical galaxies in two rich clusters of galaxies (Coma and ABCG 85) and a group of galaxies (associated with NGC 4839, near Coma). We show that, for a given cluster, the galaxies follow closely a relation predicted by the constant specific entropy hypothesis with a typical dispersion (one standard deviation) of 9.5per cent around the mean value of the specific entropy. Moreover, assuming that the specific entropy is also the same for galaxies of different clusters, we are able to derive relative distances between Coma, ABGC 85, and the group of NGC 4839. If the errors are due only to the determination of the specific entropy (about 10per cent), then the error in the relative distance determination should be less than 20per cent for rich clusters. We suggest that the unique specific entropy may provide a physical explanation for the distance indicators based on the Sérsic profile put forward by Young & Currie and recently discussed by Binggeli & Jerjen.

Power-law scaling for macroscopic entropy and microscopic complexity: Evidence from human movement and posture

NASA Astrophysics Data System (ADS)

Hong, S. Lee; Bodfish, James W.; Newell, Karl M.

2006-03-01

We investigated the relationship between macroscopic entropy and microscopic complexity of the dynamics of body rocking and sitting still across adults with stereotyped movement disorder and mental retardation (profound and severe) against controls matched for age, height, and weight. This analysis was performed through the examination of center of pressure (COP) motion on the mediolateral (side-to-side) and anteroposterior (fore-aft) dimensions and the entropy of the relative phase between the two dimensions of motion. Intentional body rocking and stereotypical body rocking possessed similar slopes for their respective frequency spectra, but differences were revealed during maintenance of sitting postures. The dynamics of sitting in the control group produced lower spectral slopes and higher complexity (approximate entropy). In the controls, the higher complexity found on each dimension of motion was related to a weaker coupling between dimensions. Information entropy of the relative phase between the two dimensions of COP motion and irregularity (complexity) of their respective motions fitted a power-law function, revealing a relationship between macroscopic entropy and microscopic complexity across both groups and behaviors. This power-law relation affords the postulation that the organization of movement and posture dynamics occurs as a fractal process.

Stokes–Einstein relation and excess entropy in Al-rich Al-Cu melts

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pasturel, A.; Jakse, N.

We investigate the conditions for the validity of the Stokes-Einstein relation that connects diffusivity to viscosity in melts using entropy-scaling relationships developed by Rosenfeld. Employing ab initio molecular dynamics simulations to determine transport and structural properties of liquid Al{sub 1−x}Cu{sub x} alloys (with composition x ≤ 0.4), we first show that reduced self-diffusion coefficients and viscosities, according to Rosenfeld's formulation, scale with the two-body approximation of the excess entropy except the reduced viscosity for x = 0.4. Then, we use our findings to evidence that the Stokes-Einstein relation using effective atomic radii is not valid in these alloys while its validity can be relatedmore » to the temperature dependence of the partial pair-excess entropies of both components. Finally, we derive a relation between the ratio of the self-diffusivities of the components and the ratio of their pair excess entropies.« less

Free Energy, Enthalpy and Entropy from Implicit Solvent End-Point Simulations.

PubMed

Fogolari, Federico; Corazza, Alessandra; Esposito, Gennaro

2018-01-01

Free energy is the key quantity to describe the thermodynamics of biological systems. In this perspective we consider the calculation of free energy, enthalpy and entropy from end-point molecular dynamics simulations. Since the enthalpy may be calculated as the ensemble average over equilibrated simulation snapshots the difficulties related to free energy calculation are ultimately related to the calculation of the entropy of the system and in particular of the solvent entropy. In the last two decades implicit solvent models have been used to circumvent the problem and to take into account solvent entropy implicitly in the solvation terms. More recently outstanding advancement in both implicit solvent models and in entropy calculations are making the goal of free energy estimation from end-point simulations more feasible than ever before. We review briefly the basic theory and discuss the advancements in light of practical applications.

Relating quantum coherence and correlations with entropy-based measures.

PubMed

Wang, Xiao-Li; Yue, Qiu-Ling; Yu, Chao-Hua; Gao, Fei; Qin, Su-Juan

2017-09-21

Quantum coherence and quantum correlations are important quantum resources for quantum computation and quantum information. In this paper, using entropy-based measures, we investigate the relationships between quantum correlated coherence, which is the coherence between subsystems, and two main kinds of quantum correlations as defined by quantum discord as well as quantum entanglement. In particular, we show that quantum discord and quantum entanglement can be well characterized by quantum correlated coherence. Moreover, we prove that the entanglement measure formulated by quantum correlated coherence is lower and upper bounded by the relative entropy of entanglement and the entanglement of formation, respectively, and equal to the relative entropy of entanglement for all the maximally correlated states.

Biseparability of noisy pseudopure, W and GHZ states using conditional quantum relative Tsallis entropy

NASA Astrophysics Data System (ADS)

Nayak, Anantha S.; Sudha; Usha Devi, A. R.; Rajagopal, A. K.

2017-02-01

We employ the conditional version of sandwiched Tsallis relative entropy to determine 1:N-1 separability range in the noisy one-parameter families of pseudopure and Werner-like N-qubit W, GHZ states. The range of the noisy parameter, for which the conditional sandwiched Tsallis relative entropy is positive, reveals perfect agreement with the necessary and sufficient criteria for separability in the 1:N-1 partition of these one parameter noisy states.

On entropic uncertainty relations in the presence of a minimal length

NASA Astrophysics Data System (ADS)

Rastegin, Alexey E.

2017-07-01

Entropic uncertainty relations for the position and momentum within the generalized uncertainty principle are examined. Studies of this principle are motivated by the existence of a minimal observable length. Then the position and momentum operators satisfy the modified commutation relation, for which more than one algebraic representation is known. One of them is described by auxiliary momentum so that the momentum and coordinate wave functions are connected by the Fourier transform. However, the probability density functions of the physically true and auxiliary momenta are different. As the corresponding entropies differ, known entropic uncertainty relations are changed. Using differential Shannon entropies, we give a state-dependent formulation with correction term. State-independent uncertainty relations are obtained in terms of the Rényi entropies and the Tsallis entropies with binning. Such relations allow one to take into account a finiteness of measurement resolution.

Permutation entropy of finite-length white-noise time series.

PubMed

Little, Douglas J; Kane, Deb M

2016-08-01

Permutation entropy (PE) is commonly used to discriminate complex structure from white noise in a time series. While the PE of white noise is well understood in the long time-series limit, analysis in the general case is currently lacking. Here the expectation value and variance of white-noise PE are derived as functions of the number of ordinal pattern trials, N, and the embedding dimension, D. It is demonstrated that the probability distribution of the white-noise PE converges to a χ^{2} distribution with D!-1 degrees of freedom as N becomes large. It is further demonstrated that the PE variance for an arbitrary time series can be estimated as the variance of a related metric, the Kullback-Leibler entropy (KLE), allowing the qualitative N≫D! condition to be recast as a quantitative estimate of the N required to achieve a desired PE calculation precision. Application of this theory to statistical inference is demonstrated in the case of an experimentally obtained noise series, where the probability of obtaining the observed PE value was calculated assuming a white-noise time series. Standard statistical inference can be used to draw conclusions whether the white-noise null hypothesis can be accepted or rejected. This methodology can be applied to other null hypotheses, such as discriminating whether two time series are generated from different complex system states.

Evidence of the big fix

NASA Astrophysics Data System (ADS)

Hamada, Yuta; Kawai, Hikaru; Kawana, Kiyoharu

2014-06-01

We give an evidence of the Big Fix. The theory of wormholes and multiverse suggests that the parameters of the Standard Model are fixed in such a way that the total entropy at the late stage of the universe is maximized, which we call the maximum entropy principle. In this paper, we discuss how it can be confirmed by the experimental data, and we show that it is indeed true for the Higgs vacuum expectation value vh. We assume that the baryon number is produced by the sphaleron process, and that the current quark masses, the gauge couplings and the Higgs self-coupling are fixed when we vary vh. It turns out that the existence of the atomic nuclei plays a crucial role to maximize the entropy. This is reminiscent of the anthropic principle, however it is required by the fundamental law in our case.

Observation of Dipolar Spin-Exchange Interactions with Polar Molecules in a Lattice

DTIC Science & Technology

2013-01-01

extend beyond nearest neighbours. This allows coherent spin dynamics to persist even for gases with relatively high entropy and low lattice filling...dynamics to persist even for gases with relatively high entropy and low lat- tice filling. While measured effects of dipolar interactions in ultracold...limits superexchange to nearest-neighbor interactions and requires extremely low temperature and entropy . In contrast, long-range dipolar

Atomic force microscope studies of fullerene films - Highly stable C60 fcc (311) free surfaces

NASA Technical Reports Server (NTRS)

Snyder, Eric J.; Tong, William M.; Williams, R. S.; Anz, Samir J.; Anderson, Mark S.

1991-01-01

Atomic force microscopy and X-ray diffractometry were used to study 1500 A-thick films of pure C60 grown by sublimation in ultrahigh vacuum onto a CaF2 (111) substrte. Topographs of the films did not reveal the expected close-packed structures, but they showed instead large regions that correspond to a face-centered cubic (311) surface and distortions of this surface. The open (311) structure may have a relatively low free energy because the low packing density contributes to a high entropy of the exposed surface.

Observation of polyamorphism in the phase change alloy Ge1Sb2Te4

NASA Astrophysics Data System (ADS)

Kalkan, B.; Sen, S.; Cho, J.-Y.; Joo, Y.-C.; Clark, S. M.

2012-10-01

A high-pressure synchrotron x-ray diffraction study of the phase change alloy Ge1Sb2Te4 demonstrates the existence of a polyamorphic phase transition between the "as deposited" low density amorphous (LDA) phase and a high density amorphous (HDA) phase at ˜10 GPa. The entropy of the HDA phase is expected to be higher than that of the LDA phase resulting in a negative Clapeyron slope for this transition. These phase relations may enable the polyamorphic transition to play a role in the memory and data storage applications.

Maximum entropy approach to statistical inference for an ocean acoustic waveguide.

PubMed

Knobles, D P; Sagers, J D; Koch, R A

2012-02-01

A conditional probability distribution suitable for estimating the statistical properties of ocean seabed parameter values inferred from acoustic measurements is derived from a maximum entropy principle. The specification of the expectation value for an error function constrains the maximization of an entropy functional. This constraint determines the sensitivity factor (β) to the error function of the resulting probability distribution, which is a canonical form that provides a conservative estimate of the uncertainty of the parameter values. From the conditional distribution, marginal distributions for individual parameters can be determined from integration over the other parameters. The approach is an alternative to obtaining the posterior probability distribution without an intermediary determination of the likelihood function followed by an application of Bayes' rule. In this paper the expectation value that specifies the constraint is determined from the values of the error function for the model solutions obtained from a sparse number of data samples. The method is applied to ocean acoustic measurements taken on the New Jersey continental shelf. The marginal probability distribution for the values of the sound speed ratio at the surface of the seabed and the source levels of a towed source are examined for different geoacoustic model representations. © 2012 Acoustical Society of America

Clausius entropy for arbitrary bifurcate null surfaces

NASA Astrophysics Data System (ADS)

Baccetti, Valentina; Visser, Matt

2014-02-01

Jacobson’s thermodynamic derivation of the Einstein equations was originally applied only to local Rindler horizons. But at least some parts of that construction can usefully be extended to give meaningful results for arbitrary bifurcate null surfaces. As presaged in Jacobson’s original article, this more general construction sharply brings into focus the questions: is entropy objectively ‘real’? Or is entropy in some sense subjective and observer-dependent? These innocent questions open a Pandora’s box of often inconclusive debate. A consensus opinion, though certainly not universally held, seems to be that Clausius entropy (thermodynamic entropy, defined via a Clausius relation {\\rm{d}}S = \\unicode{x111} Q/T) should be objectively real, but that the ontological status of statistical entropy (Shannon or von Neumann entropy) is much more ambiguous, and much more likely to be observer-dependent. This question is particularly pressing when it comes to understanding Bekenstein entropy (black hole entropy). To perhaps further add to the confusion, we shall argue that even the Clausius entropy can often be observer-dependent. In the current article we shall conclusively demonstrate that one can meaningfully assign a notion of Clausius entropy to arbitrary bifurcate null surfaces—effectively defining a ‘virtual Clausius entropy’ for arbitrary ‘virtual (local) causal horizons’. As an application, we see that we can implement a version of the generalized second law (GSL) for this virtual Clausius entropy. This version of GSL can be related to certain (nonstandard) integral variants of the null energy condition. Because the concepts involved are rather subtle, we take some effort in being careful and explicit in developing our framework. In future work we will apply this construction to generalize Jacobson’s derivation of the Einstein equations.

Gacs quantum algorithmic entropy in infinite dimensional Hilbert spaces

DOE Office of Scientific and Technical Information (OSTI.GOV)

Benatti, Fabio, E-mail: benatti@ts.infn.it; Oskouei, Samad Khabbazi, E-mail: kh.oskuei@ut.ac.ir; Deh Abad, Ahmad Shafiei, E-mail: shafiei@khayam.ut.ac.ir

We extend the notion of Gacs quantum algorithmic entropy, originally formulated for finitely many qubits, to infinite dimensional quantum spin chains and investigate the relation of this extension with two quantum dynamical entropies that have been proposed in recent years.

Modeling the Overalternating Bias with an Asymmetric Entropy Measure

PubMed Central

Gronchi, Giorgio; Raglianti, Marco; Noventa, Stefano; Lazzeri, Alessandro; Guazzini, Andrea

2016-01-01

Psychological research has found that human perception of randomness is biased. In particular, people consistently show the overalternating bias: they rate binary sequences of symbols (such as Heads and Tails in coin flipping) with an excess of alternation as more random than prescribed by the normative criteria of Shannon's entropy. Within data mining for medical applications, Marcellin proposed an asymmetric measure of entropy that can be ideal to account for such bias and to quantify subjective randomness. We fitted Marcellin's entropy and Renyi's entropy (a generalized form of uncertainty measure comprising many different kinds of entropies) to experimental data found in the literature with the Differential Evolution algorithm. We observed a better fit for Marcellin's entropy compared to Renyi's entropy. The fitted asymmetric entropy measure also showed good predictive properties when applied to different datasets of randomness-related tasks. We concluded that Marcellin's entropy can be a parsimonious and effective measure of subjective randomness that can be useful in psychological research about randomness perception. PMID:27458418

Entropy for the Complexity of Physiological Signal Dynamics.

PubMed

Zhang, Xiaohua Douglas

2017-01-01

Recently, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of biological dynamics. Portable noninvasive medical devices are crucial to capture individual characteristics of biological dynamics. The wearable noninvasive medical devices and the analysis/management of related digital medical data will revolutionize the management and treatment of diseases, subsequently resulting in the establishment of a new healthcare system. One of the key features that can be extracted from the data obtained by wearable noninvasive medical device is the complexity of physiological signals, which can be represented by entropy of biological dynamics contained in the physiological signals measured by these continuous monitoring medical devices. Thus, in this chapter I present the major concepts of entropy that are commonly used to measure the complexity of biological dynamics. The concepts include Shannon entropy, Kolmogorov entropy, Renyi entropy, approximate entropy, sample entropy, and multiscale entropy. I also demonstrate an example of using entropy for the complexity of glucose dynamics.

THERMODYNAMICS OF THE COMA CLUSTER OUTSKIRTS

DOE Office of Scientific and Technical Information (OSTI.GOV)

Simionescu, A.; Werner, N.; Urban, O.

2013-09-20

We present results from a large mosaic of Suzaku observations of the Coma Cluster, the nearest and X-ray brightest hot ({approx}8 keV), dynamically active, non-cool core system, focusing on the thermodynamic properties of the intracluster medium on large scales. For azimuths not aligned with an infalling subcluster toward the southwest, our measured temperature and X-ray brightness profiles exhibit broadly consistent radial trends, with the temperature decreasing from about 8.5 keV at the cluster center to about 2 keV at a radius of 2 Mpc, which is the edge of our detection limit. The southwest merger significantly boosts the surface brightness,more » allowing us to detect X-ray emission out to {approx}2.2 Mpc along this direction. Apart from the southwestern infalling subcluster, the surface brightness profiles show multiple edges around radii of 30-40 arcmin. The azimuthally averaged temperature profile, as well as the deprojected density and pressure profiles, all show a sharp drop consistent with an outwardly-propagating shock front located at 40 arcmin, corresponding to the outermost edge of the giant radio halo observed at 352 MHz with the Westerbork Synthesis Radio Telescope. The shock front may be powering this radio emission. A clear entropy excess inside of r{sub 500} reflects the violent merging events linked with these morphological features. Beyond r{sub 500}, the entropy profiles of the Coma Cluster along the relatively relaxed directions are consistent with the power-law behavior expected from simple models of gravitational large-scale structure formation. The pressure is also in agreement at these radii with the expected values measured from Sunyaev-Zel'dovich data from the Planck satellite. However, due to the large uncertainties associated with the Coma Cluster measurements, we cannot yet exclude an entropy flattening in this system consistent with that seen in more relaxed cool core clusters.« less

Maximum Entropy for the International Division of Labor.

PubMed

Lei, Hongmei; Chen, Ying; Li, Ruiqi; He, Deli; Zhang, Jiang

2015-01-01

As a result of the international division of labor, the trade value distribution on different products substantiated by international trade flows can be regarded as one country's strategy for competition. According to the empirical data of trade flows, countries may spend a large fraction of export values on ubiquitous and competitive products. Meanwhile, countries may also diversify their exports share on different types of products to reduce the risk. In this paper, we report that the export share distribution curves can be derived by maximizing the entropy of shares on different products under the product's complexity constraint once the international market structure (the country-product bipartite network) is given. Therefore, a maximum entropy model provides a good fit to empirical data. The empirical data is consistent with maximum entropy subject to a constraint on the expected value of the product complexity for each country. One country's strategy is mainly determined by the types of products this country can export. In addition, our model is able to fit the empirical export share distribution curves of nearly every country very well by tuning only one parameter.

Maximum Entropy for the International Division of Labor

PubMed Central

Lei, Hongmei; Chen, Ying; Li, Ruiqi; He, Deli; Zhang, Jiang

2015-01-01

As a result of the international division of labor, the trade value distribution on different products substantiated by international trade flows can be regarded as one country’s strategy for competition. According to the empirical data of trade flows, countries may spend a large fraction of export values on ubiquitous and competitive products. Meanwhile, countries may also diversify their exports share on different types of products to reduce the risk. In this paper, we report that the export share distribution curves can be derived by maximizing the entropy of shares on different products under the product’s complexity constraint once the international market structure (the country-product bipartite network) is given. Therefore, a maximum entropy model provides a good fit to empirical data. The empirical data is consistent with maximum entropy subject to a constraint on the expected value of the product complexity for each country. One country’s strategy is mainly determined by the types of products this country can export. In addition, our model is able to fit the empirical export share distribution curves of nearly every country very well by tuning only one parameter. PMID:26172052

Entropy and the driving force for the filling of carbon nanotubes with water.

PubMed

Pascal, Tod A; Goddard, William A; Jung, Yousung

2011-07-19

The spontaneous filling of hydrophobic carbon nanotubes (CNTs) by water observed both experimentally and from simulations is counterintuitive because confinement is generally expected to decrease both entropy and bonding, and remains largely unexplained. Here we report the entropy, enthalpy, and free energy extracted from molecular dynamics simulations of water confined in CNTs from 0.8 to 2.7-nm diameters. We find for all sizes that water inside the CNTs is more stable than in the bulk, but the nature of the favorable confinement of water changes dramatically with CNT diameter. Thus we find (i) an entropy (both rotational and translational) stabilized, vapor-like phase of water for small CNTs (0.8-1.0 nm), (ii) an enthalpy stabilized, ice-like phase for medium-sized CNTs (1.1-1.2 nm), and (iii) a bulk-like liquid phase for tubes larger than 1.4 nm, stabilized by the increased translational entropy as the waters sample a larger configurational space. Simulations with structureless coarse-grained water models further reveal that the observed free energies and sequence of transitions arise from the tetrahedral structure of liquid water. These results offer a broad theoretical basis for understanding water transport through CNTs and other nanostructures important in nanofluidics, nanofiltrations, and desalination.

Entropy and the driving force for the filling of carbon nanotubes with water

PubMed Central

Pascal, Tod A.; Goddard, William A.; Jung, Yousung

2011-01-01

The spontaneous filling of hydrophobic carbon nanotubes (CNTs) by water observed both experimentally and from simulations is counterintuitive because confinement is generally expected to decrease both entropy and bonding, and remains largely unexplained. Here we report the entropy, enthalpy, and free energy extracted from molecular dynamics simulations of water confined in CNTs from 0.8 to 2.7-nm diameters. We find for all sizes that water inside the CNTs is more stable than in the bulk, but the nature of the favorable confinement of water changes dramatically with CNT diameter. Thus we find (i) an entropy (both rotational and translational) stabilized, vapor-like phase of water for small CNTs (0.8–1.0 nm), (ii) an enthalpy stabilized, ice-like phase for medium-sized CNTs (1.1–1.2 nm), and (iii) a bulk-like liquid phase for tubes larger than 1.4 nm, stabilized by the increased translational entropy as the waters sample a larger configurational space. Simulations with structureless coarse-grained water models further reveal that the observed free energies and sequence of transitions arise from the tetrahedral structure of liquid water. These results offer a broad theoretical basis for understanding water transport through CNTs and other nanostructures important in nanofluidics, nanofiltrations, and desalination. PMID:21709268

From Maximum Entropy Models to Non-Stationarity and Irreversibility

NASA Astrophysics Data System (ADS)

Cofre, Rodrigo; Cessac, Bruno; Maldonado, Cesar

The maximum entropy distribution can be obtained from a variational principle. This is important as a matter of principle and for the purpose of finding approximate solutions. One can exploit this fact to obtain relevant information about the underlying stochastic process. We report here in recent progress in three aspects to this approach.1- Biological systems are expected to show some degree of irreversibility in time. Based on the transfer matrix technique to find the spatio-temporal maximum entropy distribution, we build a framework to quantify the degree of irreversibility of any maximum entropy distribution.2- The maximum entropy solution is characterized by a functional called Gibbs free energy (solution of the variational principle). The Legendre transformation of this functional is the rate function, which controls the speed of convergence of empirical averages to their ergodic mean. We show how the correct description of this functional is determinant for a more rigorous characterization of first and higher order phase transitions.3- We assess the impact of a weak time-dependent external stimulus on the collective statistics of spiking neuronal networks. We show how to evaluate this impact on any higher order spatio-temporal correlation. RC supported by ERC advanced Grant ``Bridges'', BC: KEOPS ANR-CONICYT, Renvision and CM: CONICYT-FONDECYT No. 3140572.

Statistics of Infima and Stopping Times of Entropy Production and Applications to Active Molecular Processes

NASA Astrophysics Data System (ADS)

Neri, Izaak; Roldán, Édgar; Jülicher, Frank

2017-01-01

We study the statistics of infima, stopping times, and passage probabilities of entropy production in nonequilibrium steady states, and we show that they are universal. We consider two examples of stopping times: first-passage times of entropy production and waiting times of stochastic processes, which are the times when a system reaches a given state for the first time. Our main results are as follows: (i) The distribution of the global infimum of entropy production is exponential with mean equal to minus Boltzmann's constant; (ii) we find exact expressions for the passage probabilities of entropy production; (iii) we derive a fluctuation theorem for stopping-time distributions of entropy production. These results have interesting implications for stochastic processes that can be discussed in simple colloidal systems and in active molecular processes. In particular, we show that the timing and statistics of discrete chemical transitions of molecular processes, such as the steps of molecular motors, are governed by the statistics of entropy production. We also show that the extreme-value statistics of active molecular processes are governed by entropy production; for example, we derive a relation between the maximal excursion of a molecular motor against the direction of an external force and the infimum of the corresponding entropy-production fluctuations. Using this relation, we make predictions for the distribution of the maximum backtrack depth of RNA polymerases, which follow from our universal results for entropy-production infima.

An Information-Theoretic-based Evolutionary Approach for the Dynamic Search Path Planning Problem

DTIC Science & Technology

2014-05-01

0 12 ,min TT TT EEE EE (18) where 0E and iTE are the initial system entropy and the expected entropy...xlsp 10,| (8) c z f z zc z f z z p p p p 1 1; 0,0, zz EE (10) Posterior zone z target occupancy belief for an s-success l...heuristics (1 and 2) shown at the end of time horizon T is defined as follows: 21 0 2 0 1 0 21 21 ,min,max TT TT TT TT EEE EEEE gg gg TRIG 21

A trade-off between local and distributed information processing associated with remote episodic versus semantic memory.

PubMed

Heisz, Jennifer J; Vakorin, Vasily; Ross, Bernhard; Levine, Brian; McIntosh, Anthony R

2014-01-01

Episodic memory and semantic memory produce very different subjective experiences yet rely on overlapping networks of brain regions for processing. Traditional approaches for characterizing functional brain networks emphasize static states of function and thus are blind to the dynamic information processing within and across brain regions. This study used information theoretic measures of entropy to quantify changes in the complexity of the brain's response as measured by magnetoencephalography while participants listened to audio recordings describing past personal episodic and general semantic events. Personal episodic recordings evoked richer subjective mnemonic experiences and more complex brain responses than general semantic recordings. Critically, we observed a trade-off between the relative contribution of local versus distributed entropy, such that personal episodic recordings produced relatively more local entropy whereas general semantic recordings produced relatively more distributed entropy. Changes in the relative contributions of local and distributed entropy to the total complexity of the system provides a potential mechanism that allows the same network of brain regions to represent cognitive information as either specific episodes or more general semantic knowledge.

Entropic inequalities for a class of quantum secret-sharing states

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sarvepalli, Pradeep

It is well known that von Neumann entropy is nonmonotonic, unlike Shannon entropy (which is monotonically nondecreasing). Consequently, it is difficult to relate the entropies of the subsystems of a given quantum state. In this paper, we show that if we consider quantum secret-sharing states arising from a class of monotone span programs, then we can partially recover the monotonicity of entropy for the so-called unauthorized sets. Furthermore, we can show for these quantum states that the entropy of the authorized sets is monotonically nonincreasing.

Entropy in the interior of a higher-dimensional black hole

NASA Astrophysics Data System (ADS)

Yang, Jian-Zhi; Liu, Wen-Biao

2018-07-01

Recently Christodoulou and Rovelli brought out a sensible description for the black hole volume as the largest volume. Later the entropy related to this volume in a 4-dimensional Schwarzschild black hole was investigated, which showed that such entropy is proportional to the surface area of the black hole. We will probe into these issues in the context of higher-dimensional case. It is found that the proportion between this entropy and the Bekenstein-Hawking entropy will go down through dramatic change along with the increase of spacetime dimension.

Dissecting Protein Configurational Entropy into Conformational and Vibrational Contributions.

PubMed

Chong, Song-Ho; Ham, Sihyun

2015-10-01

Quantifying how the rugged nature of the underlying free-energy landscape determines the entropic cost a protein must incur upon folding and ligand binding is a challenging problem. Here, we present a novel computational approach that dissects the protein configurational entropy on the basis of the classification of protein dynamics on the landscape into two separate components: short-term vibrational dynamics related to individual free-energy wells and long-term conformational dynamics associated with transitions between wells. We apply this method to separate the configurational entropy of the protein villin headpiece subdomain into its conformational and vibrational components. We find that the change in configurational entropy upon folding is dominated by the conformational entropy despite the fact that the magnitude of the vibrational entropy is the significantly larger component in each of the folded and unfolded states, which is in accord with the previous empirical estimations. The straightforward applicability of our method to unfolded proteins promises a wide range of applications, including those related to intrinsically disordered proteins.

Spatiotemporal Dependency of Age-Related Changes in Brain Signal Variability

PubMed Central

McIntosh, A. R.; Vakorin, V.; Kovacevic, N.; Wang, H.; Diaconescu, A.; Protzner, A. B.

2014-01-01

Recent theoretical and empirical work has focused on the variability of network dynamics in maturation. Such variability seems to reflect the spontaneous formation and dissolution of different functional networks. We sought to extend these observations into healthy aging. Two different data sets, one EEG (total n = 48, ages 18–72) and one magnetoencephalography (n = 31, ages 20–75) were analyzed for such spatiotemporal dependency using multiscale entropy (MSE) from regional brain sources. In both data sets, the changes in MSE were timescale dependent, with higher entropy at fine scales and lower at more coarse scales with greater age. The signals were parsed further into local entropy, related to information processed within a regional source, and distributed entropy (information shared between two sources, i.e., functional connectivity). Local entropy increased for most regions, whereas the dominant change in distributed entropy was age-related reductions across hemispheres. These data further the understanding of changes in brain signal variability across the lifespan, suggesting an inverted U-shaped curve, but with an important qualifier. Unlike earlier in maturation, where the changes are more widespread, changes in adulthood show strong spatiotemporal dependence. PMID:23395850

Entropy bound of local quantum field theory with generalized uncertainty principle

NASA Astrophysics Data System (ADS)

Kim, Yong-Wan; Lee, Hyung Won; Myung, Yun Soo

2009-03-01

We study the entropy bound for local quantum field theory (LQFT) with generalized uncertainty principle. The generalized uncertainty principle provides naturally a UV cutoff to the LQFT as gravity effects. Imposing the non-gravitational collapse condition as the UV-IR relation, we find that the maximal entropy of a bosonic field is limited by the entropy bound A 3 / 4 rather than A with A the boundary area.

Entropy of nonrotating isolated horizons in Lovelock theory from loop quantum gravity

NASA Astrophysics Data System (ADS)

Wang, Jing-Bo; Huang, Chao-Guang; Li, Lin

2016-08-01

In this paper, the BF theory method is applied to the nonrotating isolated horizons in Lovelock theory. The final entropy matches the Wald entropy formula for this theory. We also confirm the conclusion obtained by Bodendorfer et al. that the entropy is related to the flux operator rather than the area operator in general diffeomorphic-invariant theory. Supported by National Natural Science Foundation of China (11275207)

Relative entropy of entanglement and restricted measurements.

PubMed

Piani, M

2009-10-16

We introduce variants of relative entropy of entanglement based on the optimal distinguishability from unentangled states by means of restricted measurements. In this way we are able to prove that the standard regularized entropy of entanglement is strictly positive for all multipartite entangled states. This implies that the asymptotic creation of a multipartite entangled state by means of local operations and classical communication always requires the consumption of a nonlocal resource at a strictly positive rate.

Rényi entropies characterizing the shape and the extension of the phase space representation of quantum wave functions in disordered systems.

PubMed

Varga, Imre; Pipek, János

2003-08-01

We discuss some properties of the generalized entropies, called Rényi entropies, and their application to the case of continuous distributions. In particular, it is shown that these measures of complexity can be divergent; however, their differences are free from these divergences, thus enabling them to be good candidates for the description of the extension and the shape of continuous distributions. We apply this formalism to the projection of wave functions onto the coherent state basis, i.e., to the Husimi representation. We also show how the localization properties of the Husimi distribution on average can be reconstructed from its marginal distributions that are calculated in position and momentum space in the case when the phase space has no structure, i.e., no classical limit can be defined. Numerical simulations on a one-dimensional disordered system corroborate our expectations.

Mixture models with entropy regularization for community detection in networks

NASA Astrophysics Data System (ADS)

Chang, Zhenhai; Yin, Xianjun; Jia, Caiyan; Wang, Xiaoyang

2018-04-01

Community detection is a key exploratory tool in network analysis and has received much attention in recent years. NMM (Newman's mixture model) is one of the best models for exploring a range of network structures including community structure, bipartite and core-periphery structures, etc. However, NMM needs to know the number of communities in advance. Therefore, in this study, we have proposed an entropy regularized mixture model (called EMM), which is capable of inferring the number of communities and identifying network structure contained in a network, simultaneously. In the model, by minimizing the entropy of mixing coefficients of NMM using EM (expectation-maximization) solution, the small clusters contained little information can be discarded step by step. The empirical study on both synthetic networks and real networks has shown that the proposed model EMM is superior to the state-of-the-art methods.

Nature of phase transitions in crystalline and amorphous GeTe-Sb2Te3 phase change materials.

PubMed

Kalkan, B; Sen, S; Clark, S M

2011-09-28

The thermodynamic nature of phase stabilities and transformations are investigated in crystalline and amorphous Ge(1)Sb(2)Te(4) (GST124) phase change materials as a function of pressure and temperature using high-resolution synchrotron x-ray diffraction in a diamond anvil cell. The phase transformation sequences upon compression, for cubic and hexagonal GST124 phases are found to be: cubic → amorphous → orthorhombic → bcc and hexagonal → orthorhombic → bcc. The Clapeyron slopes for melting of the hexagonal and bcc phases are negative and positive, respectively, resulting in a pressure dependent minimum in the liquidus. When taken together, the phase equilibria relations are consistent with the presence of polyamorphism in this system with the as-deposited amorphous GST phase being the low entropy low-density amorphous phase and the laser melt-quenched and high-pressure amorphized GST being the high entropy high-density amorphous phase. The metastable phase boundary between these two polyamorphic phases is expected to have a negative Clapeyron slope. © 2011 American Institute of Physics

Thermodynamics and the structure of quantum theory

NASA Astrophysics Data System (ADS)

Krumm, Marius; Barnum, Howard; Barrett, Jonathan; Müller, Markus P.

2017-04-01

Despite its enormous empirical success, the formalism of quantum theory still raises fundamental questions: why is nature described in terms of complex Hilbert spaces, and what modifications of it could we reasonably expect to find in some regimes of physics? Here we address these questions by studying how compatibility with thermodynamics constrains the structure of quantum theory. We employ two postulates that any probabilistic theory with reasonable thermodynamic behaviour should arguably satisfy. In the framework of generalised probabilistic theories, we show that these postulates already imply important aspects of quantum theory, like self-duality and analogues of projective measurements, subspaces and eigenvalues. However, they may still admit a class of theories beyond quantum mechanics. Using a thought experiment by von Neumann, we show that these theories admit a consistent thermodynamic notion of entropy, and prove that the second law holds for projective measurements and mixing procedures. Furthermore, we study additional entropy-like quantities based on measurement probabilities and convex decomposition probabilities, and uncover a relation between one of these quantities and Sorkin’s notion of higher-order interference.

Efficient Transfer Entropy Analysis of Non-Stationary Neural Time Series

PubMed Central

Vicente, Raul; Díaz-Pernas, Francisco J.; Wibral, Michael

2014-01-01

Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of interest in neuroscience. Estimating transfer entropy from two processes requires the observation of multiple realizations of these processes to estimate associated probability density functions. To obtain these necessary observations, available estimators typically assume stationarity of processes to allow pooling of observations over time. This assumption however, is a major obstacle to the application of these estimators in neuroscience as observed processes are often non-stationary. As a solution, Gomez-Herrero and colleagues theoretically showed that the stationarity assumption may be avoided by estimating transfer entropy from an ensemble of realizations. Such an ensemble of realizations is often readily available in neuroscience experiments in the form of experimental trials. Thus, in this work we combine the ensemble method with a recently proposed transfer entropy estimator to make transfer entropy estimation applicable to non-stationary time series. We present an efficient implementation of the approach that is suitable for the increased computational demand of the ensemble method's practical application. In particular, we use a massively parallel implementation for a graphics processing unit to handle the computationally most heavy aspects of the ensemble method for transfer entropy estimation. We test the performance and robustness of our implementation on data from numerical simulations of stochastic processes. We also demonstrate the applicability of the ensemble method to magnetoencephalographic data. While we mainly evaluate the proposed method for neuroscience data, we expect it to be applicable in a variety of fields that are concerned with the analysis of information transfer in complex biological, social, and artificial systems. PMID:25068489

Entropic Inference

NASA Astrophysics Data System (ADS)

Caticha, Ariel

2011-03-01

In this tutorial we review the essential arguments behing entropic inference. We focus on the epistemological notion of information and its relation to the Bayesian beliefs of rational agents. The problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), includes as special cases both MaxEnt and Bayes' rule, and therefore unifies the two themes of these workshops—the Maximum Entropy and the Bayesian methods—into a single general inference scheme.

Group entropies, correlation laws, and zeta functions.

PubMed

Tempesta, Piergiulio

2011-08-01

The notion of group entropy is proposed. It enables the unification and generaliztion of many different definitions of entropy known in the literature, such as those of Boltzmann-Gibbs, Tsallis, Abe, and Kaniadakis. Other entropic functionals are introduced, related to nontrivial correlation laws characterizing universality classes of systems out of equilibrium when the dynamics is weakly chaotic. The associated thermostatistics are discussed. The mathematical structure underlying our construction is that of formal group theory, which provides the general structure of the correlations among particles and dictates the associated entropic functionals. As an example of application, the role of group entropies in information theory is illustrated and generalizations of the Kullback-Leibler divergence are proposed. A new connection between statistical mechanics and zeta functions is established. In particular, Tsallis entropy is related to the classical Riemann zeta function.

Nonparametric entropy estimation using kernel densities.

PubMed

Lake, Douglas E

2009-01-01

The entropy of experimental data from the biological and medical sciences provides additional information over summary statistics. Calculating entropy involves estimates of probability density functions, which can be effectively accomplished using kernel density methods. Kernel density estimation has been widely studied and a univariate implementation is readily available in MATLAB. The traditional definition of Shannon entropy is part of a larger family of statistics, called Renyi entropy, which are useful in applications that require a measure of the Gaussianity of data. Of particular note is the quadratic entropy which is related to the Friedman-Tukey (FT) index, a widely used measure in the statistical community. One application where quadratic entropy is very useful is the detection of abnormal cardiac rhythms, such as atrial fibrillation (AF). Asymptotic and exact small-sample results for optimal bandwidth and kernel selection to estimate the FT index are presented and lead to improved methods for entropy estimation.

Analysis of the Influence of Complexity and Entropy of Odorant on Fractal Dynamics and Entropy of EEG Signal.

PubMed

Namazi, Hamidreza; Akrami, Amin; Nazeri, Sina; Kulish, Vladimir V

2016-01-01

An important challenge in brain research is to make out the relation between the features of olfactory stimuli and the electroencephalogram (EEG) signal. Yet, no one has discovered any relation between the structures of olfactory stimuli and the EEG signal. This study investigates the relation between the structures of EEG signal and the olfactory stimulus (odorant). We show that the complexity of the EEG signal is coupled with the molecular complexity of the odorant, where more structurally complex odorant causes less fractal EEG signal. Also, odorant having higher entropy causes the EEG signal to have lower approximate entropy. The method discussed here can be applied and investigated in case of patients with brain diseases as the rehabilitation purpose.

Analysis of the Influence of Complexity and Entropy of Odorant on Fractal Dynamics and Entropy of EEG Signal

PubMed Central

Akrami, Amin; Nazeri, Sina

2016-01-01

An important challenge in brain research is to make out the relation between the features of olfactory stimuli and the electroencephalogram (EEG) signal. Yet, no one has discovered any relation between the structures of olfactory stimuli and the EEG signal. This study investigates the relation between the structures of EEG signal and the olfactory stimulus (odorant). We show that the complexity of the EEG signal is coupled with the molecular complexity of the odorant, where more structurally complex odorant causes less fractal EEG signal. Also, odorant having higher entropy causes the EEG signal to have lower approximate entropy. The method discussed here can be applied and investigated in case of patients with brain diseases as the rehabilitation purpose. PMID:27699169

On Use of Multi-Chambered Fission Detectors for In-Core, Neutron Spectroscopy

NASA Astrophysics Data System (ADS)

Roberts, Jeremy A.

2018-01-01

Presented is a short, computational study on the potential use of multichambered fission detectors for in-core, neutron spectroscopy. Motivated by the development of very small fission chambers at CEA in France and at Kansas State University in the U.S., it was assumed in this preliminary analysis that devices can be made small enough to avoid flux perturbations and that uncertainties related to measurements can be ignored. It was hypothesized that a sufficient number of chambers with unique reactants can act as a real-time, foilactivation experiment. An unfolding scheme based on maximizing (Shannon) entropy was used to produce a flux spectrum from detector signals that requires no prior information. To test the method, integral, detector responses were generated for singleisotope detectors of various Th, U, Np, Pu, Am, and Cs isotopes using a simplified, pressurized-water reactor spectrum and fluxweighted, microscopic, fission cross sections, in the WIMS-69 multigroup format. An unfolded spectrum was found from subsets of these responses that had a maximum entropy while reproducing the responses considered and summing to one (that is, they were normalized). Several nuclide subsets were studied, and, as expected, the results indicate inclusion of more nuclides leads to better spectra but with diminishing improvements, with the best-case spectrum having an average, relative, group-wise error of approximately 51%. Furthermore, spectra found from minimum-norm and Tihkonov-regularization inversion were of lower quality than the maximum entropy solutions. Finally, the addition of thermal-neutron filters (here, Cd and Gd) provided substantial improvement over unshielded responses alone. The results, as a whole, suggest that in-core, neutron spectroscopy is at least marginally feasible.

Entropy change of biological dynamics in COPD.

PubMed

Jin, Yu; Chen, Chang; Cao, Zhixin; Sun, Baoqing; Lo, Iek Long; Liu, Tzu-Ming; Zheng, Jun; Sun, Shixue; Shi, Yan; Zhang, Xiaohua Douglas

2017-01-01

In this century, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of large amount of data in human physiological signals. Entropy is a key metric for quantifying the irregularity contained in physiological signals. In this review, we focus on how entropy changes in various physiological signals in COPD. Our review concludes that the entropy change relies on the types of physiological signals under investigation. For major physiological signals related to respiratory diseases, such as airflow, heart rate variability, and gait variability, the entropy of a patient with COPD is lower than that of a healthy person. However, in case of hormone secretion and respiratory sound, the entropy of a patient is higher than that of a healthy person. For mechanomyogram signal, the entropy increases with the increased severity of COPD. This result should give valuable guidance for the use of entropy for physiological signals measured by wearable medical device as well as for further research on entropy in COPD.

Visualizing Entropy

NASA Astrophysics Data System (ADS)

Lechner, Joseph H.

1999-10-01

This report describes two classroom activities that help students visualize the abstract concept of entropy and apply the second law of thermodynamics to real situations. (i) A sealed "rainbow tube" contains six smaller vessels, each filled with a different brightly colored solution (low entropy). When the tube is inverted, the solutions mix together and react to form an amorphous precipitate (high entropy). The change from low entropy to high entropy is irreversible as long as the tube remains sealed. (ii) When U.S. currency is withdrawn from circulation, intact bills (low entropy) are shredded into small fragments (high entropy). Shredding is quick and easy; the reverse process is clearly nonspontaneous. It is theoretically possible, but it is time-consuming and energy-intensive, to reassemble one bill from a pile that contains fragments of hundreds of bills. We calculate the probability P of drawing pieces of only one specific bill from a mixture containing one pound of bills, each shredded into n fragments. This result can be related to Boltzmann's entropy formula S?=klnW.

Lower and upper bounds for entanglement of Rényi-α entropy.

PubMed

Song, Wei; Chen, Lin; Cao, Zhuo-Liang

2016-12-23

Entanglement Rényi-α entropy is an entanglement measure. It reduces to the standard entanglement of formation when α tends to 1. We derive analytical lower and upper bounds for the entanglement Rényi-α entropy of arbitrary dimensional bipartite quantum systems. We also demonstrate the application our bound for some concrete examples. Moreover, we establish the relation between entanglement Rényi-α entropy and some other entanglement measures.

The Conditional Entropy Power Inequality for Bosonic Quantum Systems

NASA Astrophysics Data System (ADS)

De Palma, Giacomo; Trevisan, Dario

2018-06-01

We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under the heat semigroup evolution. The beam-splitter and the squeezing are the central elements of quantum optics, and can model the attenuation, the amplification and the noise of electromagnetic signals. This conditional Entropy Power Inequality will have a strong impact in quantum information and quantum cryptography. Among its many possible applications there is the proof of a new uncertainty relation for the conditional Wehrl entropy.

The Conditional Entropy Power Inequality for Bosonic Quantum Systems

NASA Astrophysics Data System (ADS)

De Palma, Giacomo; Trevisan, Dario

2018-01-01

We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under the heat semigroup evolution. The beam-splitter and the squeezing are the central elements of quantum optics, and can model the attenuation, the amplification and the noise of electromagnetic signals. This conditional Entropy Power Inequality will have a strong impact in quantum information and quantum cryptography. Among its many possible applications there is the proof of a new uncertainty relation for the conditional Wehrl entropy.

Defining chaos.

PubMed

Hunt, Brian R; Ott, Edward

2015-09-01

In this paper, we propose, discuss, and illustrate a computationally feasible definition of chaos which can be applied very generally to situations that are commonly encountered, including attractors, repellers, and non-periodically forced systems. This definition is based on an entropy-like quantity, which we call "expansion entropy," and we define chaos as occurring when this quantity is positive. We relate and compare expansion entropy to the well-known concept of topological entropy to which it is equivalent under appropriate conditions. We also present example illustrations, discuss computational implementations, and point out issues arising from attempts at giving definitions of chaos that are not entropy-based.

Entropy-aware projected Landweber reconstruction for quantized block compressive sensing of aerial imagery

NASA Astrophysics Data System (ADS)

Liu, Hao; Li, Kangda; Wang, Bing; Tang, Hainie; Gong, Xiaohui

2017-01-01

A quantized block compressive sensing (QBCS) framework, which incorporates the universal measurement, quantization/inverse quantization, entropy coder/decoder, and iterative projected Landweber reconstruction, is summarized. Under the QBCS framework, this paper presents an improved reconstruction algorithm for aerial imagery, QBCS, with entropy-aware projected Landweber (QBCS-EPL), which leverages the full-image sparse transform without Wiener filter and an entropy-aware thresholding model for wavelet-domain image denoising. Through analyzing the functional relation between the soft-thresholding factors and entropy-based bitrates for different quantization methods, the proposed model can effectively remove wavelet-domain noise of bivariate shrinkage and achieve better image reconstruction quality. For the overall performance of QBCS reconstruction, experimental results demonstrate that the proposed QBCS-EPL algorithm significantly outperforms several existing algorithms. With the experiment-driven methodology, the QBCS-EPL algorithm can obtain better reconstruction quality at a relatively moderate computational cost, which makes it more desirable for aerial imagery applications.

Lossless quantum data compression with exponential penalization: an operational interpretation of the quantum Rényi entropy.

PubMed

Bellomo, Guido; Bosyk, Gustavo M; Holik, Federico; Zozor, Steeve

2017-11-07

Based on the problem of quantum data compression in a lossless way, we present here an operational interpretation for the family of quantum Rényi entropies. In order to do this, we appeal to a very general quantum encoding scheme that satisfies a quantum version of the Kraft-McMillan inequality. Then, in the standard situation, where one is intended to minimize the usual average length of the quantum codewords, we recover the known results, namely that the von Neumann entropy of the source bounds the average length of the optimal codes. Otherwise, we show that by invoking an exponential average length, related to an exponential penalization over large codewords, the quantum Rényi entropies arise as the natural quantities relating the optimal encoding schemes with the source description, playing an analogous role to that of von Neumann entropy.

Entropy-variation with resistance in a quantized RLC circuit derived by the generalized Hellmann-Feynman theorem

NASA Astrophysics Data System (ADS)

Fan, Hong-Yi; Xu, Xue-Xiang; Hu, Li-Yun

2010-06-01

By virtue of the generalized Hellmann-Feynman theorem for the ensemble average, we obtain the internal energy and average energy consumed by the resistance R in a quantized resistance-inductance-capacitance (RLC) electric circuit. We also calculate the entropy-variation with R. The relation between entropy and R is also derived. By the use of figures we indeed see that the entropy increases with the increment of R.

Evaluating convex roof entanglement measures.

PubMed

Tóth, Géza; Moroder, Tobias; Gühne, Otfried

2015-04-24

We show a powerful method to compute entanglement measures based on convex roof constructions. In particular, our method is applicable to measures that, for pure states, can be written as low order polynomials of operator expectation values. We show how to compute the linear entropy of entanglement, the linear entanglement of assistance, and a bound on the dimension of the entanglement for bipartite systems. We discuss how to obtain the convex roof of the three-tangle for three-qubit states. We also show how to calculate the linear entropy of entanglement and the quantum Fisher information based on partial information or device independent information. We demonstrate the usefulness of our method by concrete examples.

Entanglement entropy in a one-dimensional disordered interacting system: the role of localization.

PubMed

Berkovits, Richard

2012-04-27

The properties of the entanglement entropy (EE) in one-dimensional disordered interacting systems are studied. Anderson localization leaves a clear signature on the average EE, as it saturates on the length scale exceeding the localization length. This is verified by numerically calculating the EE for an ensemble of disordered realizations using the density matrix renormalization group method. A heuristic expression describing the dependence of the EE on the localization length, which takes into account finite-size effects, is proposed. This is used to extract the localization length as a function of the interaction strength. The localization length dependence on the interaction fits nicely with the expectations.

Lattice Vibrations Boost Demagnetization Entropy in Shape Memory Alloy

DOE PAGES

Stonaha, Paul J.; Manley, Michael E.; Bruno, Nick; ...

2015-10-07

Magnetocaloric (MC) materials present an avenue for chemical-free, solid state refrigeration through cooling via adiabatic demagnetization. We have used inelastic neutron scattering to measure the lattice dynamics in the MC material Ni 45Co 5Mn 36.6In 13.4. Upon heating across TC, the material exhibits an anomalous increase in phonon entropy of 0.17 0.04 k_B/atom, which is nine times larger than expected from conventional thermal expansion. We find that the phonon softening is focused in a transverse optic phonon, and we present the results of first-principle calculations which predict a strong coupling between lattice distortions and magnetic excitations.

Entropic criterion for model selection

NASA Astrophysics Data System (ADS)

Tseng, Chih-Yuan

2006-10-01

Model or variable selection is usually achieved through ranking models according to the increasing order of preference. One of methods is applying Kullback-Leibler distance or relative entropy as a selection criterion. Yet that will raise two questions, why use this criterion and are there any other criteria. Besides, conventional approaches require a reference prior, which is usually difficult to get. Following the logic of inductive inference proposed by Caticha [Relative entropy and inductive inference, in: G. Erickson, Y. Zhai (Eds.), Bayesian Inference and Maximum Entropy Methods in Science and Engineering, AIP Conference Proceedings, vol. 707, 2004 (available from arXiv.org/abs/physics/0311093)], we show relative entropy to be a unique criterion, which requires no prior information and can be applied to different fields. We examine this criterion by considering a physical problem, simple fluids, and results are promising.

Dynamic tuning by hydrostatic pressure of magnetocaloric properties to Ericsson like cycles

NASA Astrophysics Data System (ADS)

Gaztañaga, P.; Sacanell, J.; Leyva, A. G.; Quintero, M.

2018-03-01

A method to increase the relative cooling power to be used in Ericsson like refrigeration cycles is presented. The technique is based in the modification of the magnetic properties by the application of hydrostatic pressure on magnetic samples. The main advantage is to reach larger values of the magnetic entropy change in a wider temperature region (the so-called "table like" behavior). The study was carried out in a manganite belonging to the family of La0.625-yNdyCa0.375MnO3, and some conclusions were compared with the expected behavior in other materials extracted from literature.

Entropy production and nonlinear Fokker-Planck equations.

PubMed

Casas, G A; Nobre, F D; Curado, E M F

2012-12-01

The entropy time rate of systems described by nonlinear Fokker-Planck equations--which are directly related to generalized entropic forms--is analyzed. Both entropy production, associated with irreversible processes, and entropy flux from the system to its surroundings are studied. Some examples of known generalized entropic forms are considered, and particularly, the flux and production of the Boltzmann-Gibbs entropy, obtained from the linear Fokker-Planck equation, are recovered as particular cases. Since nonlinear Fokker-Planck equations are appropriate for the dynamical behavior of several physical phenomena in nature, like many within the realm of complex systems, the present analysis should be applicable to irreversible processes in a large class of nonlinear systems, such as those described by Tsallis and Kaniadakis entropies.

Convexity of the entanglement entropy of SU(2N)-symmetric fermions with attractive interactions.

PubMed

Drut, Joaquín E; Porter, William J

2015-02-06

The positivity of the probability measure of attractively interacting systems of 2N-component fermions enables the derivation of an exact convexity property for the ground-state energy of such systems. Using analogous arguments, applied to path-integral expressions for the entanglement entropy derived recently, we prove nonperturbative analytic relations for the Rényi entropies of those systems. These relations are valid for all subsystem sizes, particle numbers, and dimensions, and in arbitrary external trapping potentials.

Statistical mechanical theory for steady state systems. II. Reciprocal relations and the second entropy.

PubMed

Attard, Phil

2005-04-15

The concept of second entropy is introduced for the dynamic transitions between macrostates. It is used to develop a theory for fluctuations in velocity, and is exemplified by deriving Onsager reciprocal relations for Brownian motion. The cases of free, driven, and pinned Brownian particles are treated in turn, and Stokes' law is derived. The second entropy analysis is applied to the general case of thermodynamic fluctuations, and the Onsager reciprocal relations for these are derived using the method. The Green-Kubo formulas for the transport coefficients emerge from the analysis, as do Langevin dynamics.

Rényi entropy, abundance distribution, and the equivalence of ensembles.

PubMed

Mora, Thierry; Walczak, Aleksandra M

2016-05-01

Distributions of abundances or frequencies play an important role in many fields of science, from biology to sociology, as does the Rényi entropy, which measures the diversity of a statistical ensemble. We derive a mathematical relation between the abundance distribution and the Rényi entropy, by analogy with the equivalence of ensembles in thermodynamics. The abundance distribution is mapped onto the density of states, and the Rényi entropy to the free energy. The two quantities are related in the thermodynamic limit by a Legendre transform, by virtue of the equivalence between the micro-canonical and canonical ensembles. In this limit, we show how the Rényi entropy can be constructed geometrically from rank-frequency plots. This mapping predicts that non-concave regions of the rank-frequency curve should result in kinks in the Rényi entropy as a function of its order. We illustrate our results on simple examples, and emphasize the limitations of the equivalence of ensembles when a thermodynamic limit is not well defined. Our results help choose reliable diversity measures based on the experimental accuracy of the abundance distributions in particular frequency ranges.

Packing Regularities in Biological Structures Relate to Their Dynamics

PubMed Central

Jernigan, Robert L.; Kloczkowski, Andrzej

2007-01-01

The high packing density inside proteins leads to certain geometric regularities and also is one of the most important contributors to the high extent of cooperativity manifested by proteins in their cohesive domain motions. The orientations between neighboring non-bonded residues in proteins substantially follow the similar geometric regularities, regardless of whether the residues are on the surface or buried - a direct result of hydrophobicity forces. These orientations are relatively fixed and correspond closely to small deformations from those of the face-centered cubic lattice, which is the way in which identical spheres pack at the highest density. Packing density also is related to the extent of conservation of residues, and we show this relationship for residue packing densities by averaging over a large sample or residue packings. There are three regimes: 1) over a broad range of packing densities the relationship between sequence entropy and inverse packing density is nearly linear, 2) over a limited range of low packing densities the sequence entropy is nearly constant, and 3) at extremely low packing densities the sequence entropy is highly variable. These packing results provide important justification for the simple elastic network models that have been shown for a large number of proteins to represent protein dynamics so successfully, even when the models are extremely coarse-grained. Elastic network models for polymeric chains are simple and could be combined with these protein elastic networks to represent partially denatured parts of proteins. Finally, we show results of applications of the elastic network model to study the functional motions of the ribosome, based on its known structure. These results indicate expected correlations among its components for the step-wise processing steps in protein synthesis, and suggest ways to use these elastic network models to develop more detailed mechanisms - an important possibility, since most experiments yield only static structures. PMID:16957327

Entropy emission properties of near-extremal Reissner-Nordström black holes

NASA Astrophysics Data System (ADS)

Hod, Shahar

2016-05-01

Bekenstein and Mayo have revealed an interesting property of evaporating (3 +1 )-dimensional Schwarzschild black holes: their entropy emission rates S˙Sch are related to their energy emission rates P by the simple relation S˙Sch=CSch×(P /ℏ)1/2, where CSch is a numerically computed dimensionless coefficient. Remembering that (1 +1 )-dimensional perfect black-body emitters are characterized by the same functional relation, S˙1 +1=C1 +1×(P /ℏ)1/2 [with C1 +1=(π /3 )1/2], Bekenstein and Mayo have concluded that, in their entropy emission properties, (3 +1 )-dimensional Schwarzschild black holes behave effectively as (1 +1 )-dimensional entropy emitters. Later studies have shown that this intriguing property is actually a generic feature of all radiating (D +1 )-dimensional Schwarzschild black holes. One naturally wonders whether all black holes behave as simple (1 +1 )-dimensional entropy emitters? In order to address this interesting question, we shall study in this paper the entropy emission properties of Reissner-Nordström black holes. We shall show, in particular, that the physical properties which characterize the neutral sector of the Hawking emission spectra of these black holes can be studied analytically in the near-extremal TBH→0 regime (here TBH is the Bekenstein-Hawking temperature of the black hole). We find that the Hawking radiation spectra of massless neutral scalar fields and coupled electromagnetic-gravitational fields are characterized by the nontrivial entropy-energy relations S˙RNScalar=-CRNScalar×(A P3/ℏ3)1/4ln (A P /ℏ) and S˙RN Elec -Grav=-CRNElec -Grav×(A4P9/ℏ9)1 /10ln (A P /ℏ) in the near-extremal TBH→0 limit (here {CRNScalar,CRNElec -Grav} are analytically calculated dimensionless coefficients and A is the surface area of the Reissner-Nordström black hole). Our analytical results therefore indicate that not all black holes behave as simple (1 +1 )-dimensional entropy emitters.

Entropy change of biological dynamics in COPD

PubMed Central

Cao, Zhixin; Sun, Baoqing; Lo, Iek Long; Liu, Tzu-Ming; Zheng, Jun; Sun, Shixue; Shi, Yan; Zhang, Xiaohua Douglas

2017-01-01

In this century, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of large amount of data in human physiological signals. Entropy is a key metric for quantifying the irregularity contained in physiological signals. In this review, we focus on how entropy changes in various physiological signals in COPD. Our review concludes that the entropy change relies on the types of physiological signals under investigation. For major physiological signals related to respiratory diseases, such as airflow, heart rate variability, and gait variability, the entropy of a patient with COPD is lower than that of a healthy person. However, in case of hormone secretion and respiratory sound, the entropy of a patient is higher than that of a healthy person. For mechanomyogram signal, the entropy increases with the increased severity of COPD. This result should give valuable guidance for the use of entropy for physiological signals measured by wearable medical device as well as for further research on entropy in COPD. PMID:29066881

Informational basis of sensory adaptation: entropy and single-spike efficiency in rat barrel cortex.

PubMed

Adibi, Mehdi; Clifford, Colin W G; Arabzadeh, Ehsan

2013-09-11

We showed recently that exposure to whisker vibrations enhances coding efficiency in rat barrel cortex despite increasing correlations in variability (Adibi et al., 2013). Here, to understand how adaptation achieves this improvement in sensory representation, we decomposed the stimulus information carried in neuronal population activity into its fundamental components in the framework of information theory. In the context of sensory coding, these components are the entropy of the responses across the entire stimulus set (response entropy) and the entropy of the responses conditional on the stimulus (conditional response entropy). We found that adaptation decreased response entropy and conditional response entropy at both the level of single neurons and the pooled activity of neuronal populations. However, the net effect of adaptation was to increase the mutual information because the drop in the conditional entropy outweighed the drop in the response entropy. The information transmitted by a single spike also increased under adaptation. As population size increased, the information content of individual spikes declined but the relative improvement attributable to adaptation was maintained.

The Holographic Entropy Cone

DOE PAGES

Bao, Ning; Nezami, Sepehr; Ooguri, Hirosi; ...

2015-09-21

We initiate a systematic enumeration and classification of entropy inequalities satisfied by the Ryu-Takayanagi formula for conformal field theory states with smooth holographic dual geometries. For 2, 3, and 4 regions, we prove that the strong subadditivity and the monogamy of mutual information give the complete set of inequalities. This is in contrast to the situation for generic quantum systems, where a complete set of entropy inequalities is not known for 4 or more regions. We also find an infinite new family of inequalities applicable to 5 or more regions. The set of all holographic entropy inequalities bounds the phasemore » space of Ryu-Takayanagi entropies, defining the holographic entropy cone. We characterize this entropy cone by reducing geometries to minimal graph models that encode the possible cutting and gluing relations of minimal surfaces. We find that, for a fixed number of regions, there are only finitely many independent entropy inequalities. To establish new holographic entropy inequalities, we introduce a combinatorial proof technique that may also be of independent interest in Riemannian geometry and graph theory.« less

Efficient Computation of Small-Molecule Configurational Binding Entropy and Free Energy Changes by Ensemble Enumeration

PubMed Central

2013-01-01

Here we present a novel, end-point method using the dead-end-elimination and A* algorithms to efficiently and accurately calculate the change in free energy, enthalpy, and configurational entropy of binding for ligand–receptor association reactions. We apply the new approach to the binding of a series of human immunodeficiency virus (HIV-1) protease inhibitors to examine the effect ensemble reranking has on relative accuracy as well as to evaluate the role of the absolute and relative ligand configurational entropy losses upon binding in affinity differences for structurally related inhibitors. Our results suggest that most thermodynamic parameters can be estimated using only a small fraction of the full configurational space, and we see significant improvement in relative accuracy when using an ensemble versus single-conformer approach to ligand ranking. We also find that using approximate metrics based on the single-conformation enthalpy differences between the global minimum energy configuration in the bound as well as unbound states also correlates well with experiment. Using a novel, additive entropy expansion based on conditional mutual information, we also analyze the source of ligand configurational entropy loss upon binding in terms of both uncoupled per degree of freedom losses as well as changes in coupling between inhibitor degrees of freedom. We estimate entropic free energy losses of approximately +24 kcal/mol, 12 kcal/mol of which stems from loss of translational and rotational entropy. Coupling effects contribute only a small fraction to the overall entropy change (1–2 kcal/mol) but suggest differences in how inhibitor dihedral angles couple to each other in the bound versus unbound states. The importance of accounting for flexibility in drug optimization and design is also discussed. PMID:24250277

Statistical mechanical theory of liquid entropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wallace, D.C.

The multiparticle correlation expansion for the entropy of a classical monatomic liquid is presented. This entropy expresses the physical picture in which there is no free particle motion, but rather, each atom moves within a cage formed by its neighbors. The liquid expansion, including only pair correlations, gives an excellent account of the experimental entropy of most liquid metals, of liquid argon, and the hard sphere liquid. The pair correlation entropy is well approximated by a universal function of temperature. Higher order correlation entropy, due to n-particle irreducible correlations for n{ge}3, is significant in only a few liquid metals, andmore » its occurrence suggests the presence of n-body forces. When the liquid theory is applied to the study of melting, the author discovers the important classification of normal and anomalous melting, according to whether there is not or is a significant change in the electronic structure upon melting, and he discovers the universal disordering entropy for melting of a monatomic crystal. Interesting directions for future research are: extension to include orientational correlations of molecules, theoretical calculation of the entropy of water, application to the entropy of the amorphous state, and correlational entropy of compressed argon. The author clarifies the relation among different entropy expansions in the recent literature.« less

Beyond the Shannon–Khinchin formulation: The composability axiom and the universal-group entropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tempesta, Piergiulio, E-mail: p.tempesta@fis.ucm.es

2016-02-15

The notion of entropy is ubiquitous both in natural and social sciences. In the last two decades, a considerable effort has been devoted to the study of new entropic forms, which generalize the standard Boltzmann–Gibbs (BG) entropy and could be applicable in thermodynamics, quantum mechanics and information theory. In Khinchin (1957), by extending previous ideas of Shannon (1948) and Shannon and Weaver (1949), Khinchin proposed a characterization of the BG entropy, based on four requirements, nowadays known as the Shannon–Khinchin (SK) axioms. The purpose of this paper is twofold. First, we show that there exists an intrinsic group-theoretical structure behindmore » the notion of entropy. It comes from the requirement of composability of an entropy with respect to the union of two statistically independent systems, that we propose in an axiomatic formulation. Second, we show that there exists a simple universal family of trace-form entropies. This class contains many well known examples of entropies and infinitely many new ones, a priori multi-parametric. Due to its specific relation with Lazard’s universal formal group of algebraic topology, the new general entropy introduced in this work will be called the universal-group entropy. A new example of multi-parametric entropy is explicitly constructed.« less

Formal groups and Z-entropies

PubMed Central

2016-01-01

We shall prove that the celebrated Rényi entropy is the first example of a new family of infinitely many multi-parametric entropies. We shall call them the Z-entropies. Each of them, under suitable hypotheses, generalizes the celebrated entropies of Boltzmann and Rényi. A crucial aspect is that every Z-entropy is composable (Tempesta 2016 Ann. Phys. 365, 180–197. (doi:10.1016/j.aop.2015.08.013)). This property means that the entropy of a system which is composed of two or more independent systems depends, in all the associated probability space, on the choice of the two systems only. Further properties are also required to describe the composition process in terms of a group law. The composability axiom, introduced as a generalization of the fourth Shannon–Khinchin axiom (postulating additivity), is a highly non-trivial requirement. Indeed, in the trace-form class, the Boltzmann entropy and Tsallis entropy are the only known composable cases. However, in the non-trace form class, the Z-entropies arise as new entropic functions possessing the mathematical properties necessary for information-theoretical applications, in both classical and quantum contexts. From a mathematical point of view, composability is intimately related to formal group theory of algebraic topology. The underlying group-theoretical structure determines crucially the statistical properties of the corresponding entropies. PMID:27956871

Consistent maximum entropy representations of pipe flow networks

NASA Astrophysics Data System (ADS)

Waldrip, Steven H.; Niven, Robert K.; Abel, Markus; Schlegel, Michael

2017-06-01

The maximum entropy method is used to predict flows on water distribution networks. This analysis extends the water distribution network formulation of Waldrip et al. (2016) Journal of Hydraulic Engineering (ASCE), by the use of a continuous relative entropy defined on a reduced parameter set. This reduction in the parameters that the entropy is defined over ensures consistency between different representations of the same network. The performance of the proposed reduced parameter method is demonstrated with a one-loop network case study.

Entropy Stable Spectral Collocation Schemes for the Navier-Stokes Equations: Discontinuous Interfaces

NASA Technical Reports Server (NTRS)

Carpenter, Mark H.; Fisher, Travis C.; Nielsen, Eric J.; Frankel, Steven H.

2013-01-01

Nonlinear entropy stability and a summation-by-parts framework are used to derive provably stable, polynomial-based spectral collocation methods of arbitrary order. The new methods are closely related to discontinuous Galerkin spectral collocation methods commonly known as DGFEM, but exhibit a more general entropy stability property. Although the new schemes are applicable to a broad class of linear and nonlinear conservation laws, emphasis herein is placed on the entropy stability of the compressible Navier-Stokes equations.

Detecting entanglement with Jarzynski's equality

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hide, Jenny; Vedral, Vlatko; Centre for Quantum Technologies, National University of Singapore, 3 Science Drive 2, Singapore 117543

2010-06-15

We present a method for detecting the entanglement of a state using nonequilibrium processes. A comparison of relative entropies allows us to construct an entanglement witness. The relative entropy can further be related to the quantum Jarzynski equality, allowing nonequilibrium work to be used in entanglement detection. To exemplify our results, we consider two different spin chains.

Strain hardening in startup shear of long-chain branched polymer solutions.

PubMed

Liu, Gengxin; Cheng, Shiwang; Lee, Hyojoon; Ma, Hongwei; Xu, Hongde; Chang, Taihyun; Quirk, Roderic P; Wang, Shi-Qing

2013-08-09

We show for the first time that entangled polymeric liquids containing long-chain branching can exhibit strain hardening upon startup shear. As the significant long-chain branching impedes chain disentanglement, Gaussian coils between entanglements can deform to reach the finite extensibility limit where the intrachain retraction force exceeds the value expected from the usual conformational entropy loss evaluated based on Gaussian chain statistics. The phenomenon is expected to lead to further theoretical understanding.

Modeling Loop Entropy

PubMed Central

Chirikjian, Gregory S.

2011-01-01

Proteins fold from a highly disordered state into a highly ordered one. Traditionally, the folding problem has been stated as one of predicting ‘the’ tertiary structure from sequential information. However, new evidence suggests that the ensemble of unfolded forms may not be as disordered as once believed, and that the native form of many proteins may not be described by a single conformation, but rather an ensemble of its own. Quantifying the relative disorder in the folded and unfolded ensembles as an entropy difference may therefore shed light on the folding process. One issue that clouds discussions of ‘entropy’ is that many different kinds of entropy can be defined: entropy associated with overall translational and rotational Brownian motion, configurational entropy, vibrational entropy, conformational entropy computed in internal or Cartesian coordinates (which can even be different from each other), conformational entropy computed on a lattice; each of the above with different solvation and solvent models; thermodynamic entropy measured experimentally, etc. The focus of this work is the conformational entropy of coil/loop regions in proteins. New mathematical modeling tools for the approximation of changes in conformational entropy during transition from unfolded to folded ensembles are introduced. In particular, models for computing lower and upper bounds on entropy for polymer models of polypeptide coils both with and without end constraints are presented. The methods reviewed here include kinematics (the mathematics of rigid-body motions), classical statistical mechanics and information theory. PMID:21187223

Subgrid-scale Condensation Modeling for Entropy-based Large Eddy Simulations of Clouds

NASA Astrophysics Data System (ADS)

Kaul, C. M.; Schneider, T.; Pressel, K. G.; Tan, Z.

2015-12-01

An entropy- and total water-based formulation of LES thermodynamics, such as that used by the recently developed code PyCLES, is advantageous from physical and numerical perspectives. However, existing closures for subgrid-scale thermodynamic fluctuations assume more traditional choices for prognostic thermodynamic variables, such as liquid potential temperature, and are not directly applicable to entropy-based modeling. Since entropy and total water are generally nonlinearly related to diagnosed quantities like temperature and condensate amounts, neglecting their small-scale variability can lead to bias in simulation results. Here we present the development of a subgrid-scale condensation model suitable for use with entropy-based thermodynamic formulations.

Reversible and irreversible heat transfer by radiation

NASA Astrophysics Data System (ADS)

del Río, Fernando; de la Selva, Sara María Teresa

2015-05-01

The theme of heat transfer by radiation is absent from most textbooks on thermodynamics, and its treatment in the applied literature presents some basic discrepancies concerning the validity of the Clausius relation between the quantity of heat exchanged, δ Q, and the accompanying entropy change, dS. We review the reversible and irreversible heat transfers by radiation to clarify the validity of the Clausius relation, and we show that in both cases, the Clausius relation is obeyed, as it should be. We also deal with radiation diluted by the presence of matter, introducing a dilution coefficient, ϕ, and an irreversibility factor, χ (φ ). This treatment requires the use of the correct relation between energy and heat fluxes, the spectral fluxes of energy and entropy, and Planck’s equation for the entropy of monochromatic radiation. For the irreversible case of diluted radiation, we recover the ratio between the fluxes of heat and entropy that agree with Clausius’ inequality, including an irreversibility factor, (4/3)χ (φ ). An improved modification for the explicit function χ (φ ) is given. As an illustration, the fluxes of energy and entropy from the Sun to the Earth are obtained. We also calculate the fluxes re-emitted by the Earth, taking into account the greenhouse effect. We find the value of 1.258 W{{m}-2}{{K}-1} for the re-emitted entropy flux after the radiation has been thermalized, which is much larger than the incident flux, in agreement with other authors.

Universal bounds on the time evolution of entanglement entropy.

PubMed

Avery, Steven G; Paulos, Miguel F

2014-12-05

Using relative entropy, we derive bounds on the time rate of change of geometric entanglement entropy for any relativistic quantum field theory in any dimension. The bounds apply to both mixed and pure states, and may be extended to curved space. We illustrate the bounds in a few examples and comment on potential applications and future extensions.

Entanglement entropy in a boundary impurity model.

PubMed

Levine, G C

2004-12-31

Boundary impurities are known to dramatically alter certain bulk properties of (1+1)-dimensional strongly correlated systems. The entanglement entropy of a zero temperature Luttinger liquid bisected by a single impurity is computed using a novel finite size scaling or bosonization scheme. For a Luttinger liquid of length 2L and UV cutoff epsilon, the boundary impurity correction (deltaSimp) to the logarithmic entanglement entropy (Sent proportional, variant lnL/epsilon scales as deltaSimp approximately yrlnL/epsilon, where yr is the renormalized backscattering coupling constant. In this way, the entanglement entropy within a region is related to scattering through the region's boundary. In the repulsive case (g<1), deltaSimp diverges (negatively) suggesting that the entropy vanishes. Our results are consistent with the recent conjecture that entanglement entropy decreases irreversibly along renormalization group flow.

General monogamy of Tsallis q -entropy entanglement in multiqubit systems

NASA Astrophysics Data System (ADS)

Luo, Yu; Tian, Tian; Shao, Lian-He; Li, Yongming

2016-06-01

In this paper, we study the monogamy inequality of Tsallis q -entropy entanglement. We first provide an analytic formula of Tsallis q -entropy entanglement in two-qubit systems for 5/-√{13 } 2 ≤q ≤5/+√{13 } 2 . The analytic formula of Tsallis q -entropy entanglement in 2 ⊗d system is also obtained and we show that Tsallis q -entropy entanglement satisfies a set of hierarchical monogamy equalities. Furthermore, we prove the squared Tsallis q -entropy entanglement follows a general inequality in the qubit systems. Based on the monogamy relations, a set of multipartite entanglement indicators is constructed, which can detect all genuine multiqubit entangled states even in the case of N -tangle vanishes. Moreover, we study some examples in multipartite higher-dimensional system for the monogamy inequalities.

Validity of the Stokes-Einstein relation in liquids: simple rules from the excess entropy.

PubMed

Pasturel, A; Jakse, N

2016-12-07

It is becoming common practice to consider that the Stokes-Einstein relation D/T~ η -1 usually works for liquids above their melting temperatures although there is also experimental evidence for its failure. Here we investigate numerically this commonly-invoked assumption for simple liquid metals as well as for their liquid alloys. Using ab initio molecular dynamics simulations we show how entropy scaling relationships developed by Rosenfeld can be used to predict the conditions for the validity of the Stokes-Einstein relation in the liquid phase. Specifically, we demonstrate the Stokes-Einstein relation may break down in the liquid phase of some liquid alloys mainly due to the presence of local structural ordering as evidenced in their partial two-body excess entropies. Our findings shed new light on the understanding of transport properties of liquid materials and will trigger more experimental and theoretical studies since excess entropy and its two-body approximation are readily obtainable from standard experiments and simulations.

Jets or vortices - what flows are generated by an inverse turbulent cascade?

NASA Astrophysics Data System (ADS)

Frishman, Anna; Laurie, Jason; Falkovich, Gregory

An inverse cascade-energy transfer to progressively larger scales - is a salient feature of two-dimensional turbulence. If the cascade reaches the system scale, it creates a coherent flow expected to have the largest available scale and conform with the symmetries of the domain. In a doubly periodic rectangle, the mean flow with zero total momentum was therefore believed to be unidirectional, with two jets along the short side; while for an aspect ratio close to unity, a vortex dipole was expected. Using direct numerical simulations, we show that in fact neither the box symmetry is respected nor the largest scale is realized: the flow is never purely unidirectional since the inverse cascade produces coherent vortices, whose number and relative motion are determined by the aspect ratio. This spontaneous symmetry breaking is closely related to the hierarchy of averaging times. Long-time averaging restores translational invariance due to vortex wandering along one direction, and gives jets whose profile, however, can be deduced neither from the largest-available-scale argument, nor from the often employed maximum-entropy principle or quasi-linear approximation.

Jets or vortices—What flows are generated by an inverse turbulent cascade?

NASA Astrophysics Data System (ADS)

Frishman, Anna; Laurie, Jason; Falkovich, Gregory

2017-03-01

An inverse cascade, energy transfer to progressively larger scales, is a salient feature of two-dimensional turbulence. If the cascade reaches the system scale, it creates a coherent flow expected to have the largest available scale and conform with the symmetries of the domain. In a doubly periodic rectangle, the mean flow with zero total momentum was therefore believed to be unidirectional, with two jets along the short side; while for an aspect ratio close to unity, a vortex dipole is expected. Using direct numerical simulations, we show that in fact neither is the box symmetry respected nor the largest scale realized: the flow is never purely unidirectional since the inverse cascade produces coherent vortices, whose number and relative motion are determined by the aspect ratio. This spontaneous symmetry breaking is closely related to the hierarchy of averaging times. Long-time averaging restores translational invariance due to vortex wandering along one direction, and gives jets whose profile, however, can neither be deduced from the largest-available-scale argument, nor from the often employed maximum-entropy principle or quasilinear approximation.

Rényi entropies and observables.

PubMed

Lesche, Bernhard

2004-01-01

Evidence is given that Rényi entropies of macroscopic thermodynamic systems defined on the bases of probabilities of microstates cannot be related to observables. The notion of observable is clarified.

Detecting Genetic Interactions for Quantitative Traits Using m-Spacing Entropy Measure

PubMed Central

Yee, Jaeyong; Kwon, Min-Seok; Park, Taesung; Park, Mira

2015-01-01

A number of statistical methods for detecting gene-gene interactions have been developed in genetic association studies with binary traits. However, many phenotype measures are intrinsically quantitative and categorizing continuous traits may not always be straightforward and meaningful. Association of gene-gene interactions with an observed distribution of such phenotypes needs to be investigated directly without categorization. Information gain based on entropy measure has previously been successful in identifying genetic associations with binary traits. We extend the usefulness of this information gain by proposing a nonparametric evaluation method of conditional entropy of a quantitative phenotype associated with a given genotype. Hence, the information gain can be obtained for any phenotype distribution. Because any functional form, such as Gaussian, is not assumed for the entire distribution of a trait or a given genotype, this method is expected to be robust enough to be applied to any phenotypic association data. Here, we show its use to successfully identify the main effect, as well as the genetic interactions, associated with a quantitative trait. PMID:26339620

Chain architecture and micellization: A mean-field coarse-grained model for poly(ethylene oxide) alkyl ether surfactants

DOE Office of Scientific and Technical Information (OSTI.GOV)

García Daza, Fabián A.; Mackie, Allan D., E-mail: allan.mackie@urv.cat; Colville, Alexander J.

2015-03-21

Microscopic modeling of surfactant systems is expected to be an important tool to describe, understand, and take full advantage of the micellization process for different molecular architectures. Here, we implement a single chain mean field theory to study the relevant equilibrium properties such as the critical micelle concentration (CMC) and aggregation number for three sets of surfactants with different geometries maintaining constant the number of hydrophobic and hydrophilic monomers. The results demonstrate the direct effect of the block organization for the surfactants under study by means of an analysis of the excess energy and entropy which can be accurately determinedmore » from the mean-field scheme. Our analysis reveals that the CMC values are sensitive to branching in the hydrophilic head part of the surfactant and can be observed in the entropy-enthalpy balance, while aggregation numbers are also affected by splitting the hydrophobic tail of the surfactant and are manifested by slight changes in the packing entropy.« less

Entanglement versus Stosszahlansatz: disappearance of the thermodynamic arrow in a high-correlation environment.

PubMed

Partovi, M Hossein

2008-02-01

The crucial role of ambient correlations in determining thermodynamic behavior is established. A class of entangled states of two macroscopic systems is constructed such that each component is in a state of thermal equilibrium at a given temperature, and when the two are allowed to interact heat can flow from the colder to the hotter system. A dilute gas model exhibiting this behavior is presented. This reversal of the thermodynamic arrow is a consequence of the entanglement between the two systems, a condition that is opposite to molecular chaos and shown to be unlikely in a low-entropy environment. By contrast, the second law is established by proving Clausius' inequality in a low-entropy environment. These general results strongly support the expectation, first expressed by Boltzmann and subsequently elaborated by others, that the second law is an emergent phenomenon which requires a low-entropy cosmological environment, one that can effectively function as an ideal information sink.

Chain architecture and micellization: A mean-field coarse-grained model for poly(ethylene oxide) alkyl ether surfactants

NASA Astrophysics Data System (ADS)

García Daza, Fabián A.; Colville, Alexander J.; Mackie, Allan D.

2015-03-01

Microscopic modeling of surfactant systems is expected to be an important tool to describe, understand, and take full advantage of the micellization process for different molecular architectures. Here, we implement a single chain mean field theory to study the relevant equilibrium properties such as the critical micelle concentration (CMC) and aggregation number for three sets of surfactants with different geometries maintaining constant the number of hydrophobic and hydrophilic monomers. The results demonstrate the direct effect of the block organization for the surfactants under study by means of an analysis of the excess energy and entropy which can be accurately determined from the mean-field scheme. Our analysis reveals that the CMC values are sensitive to branching in the hydrophilic head part of the surfactant and can be observed in the entropy-enthalpy balance, while aggregation numbers are also affected by splitting the hydrophobic tail of the surfactant and are manifested by slight changes in the packing entropy.

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy.

PubMed

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy

NASA Astrophysics Data System (ADS)

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

An Equation for Moist Entropy in a Precipitating and Icy Atmosphere

NASA Technical Reports Server (NTRS)

Tao, Wei-Kuo; Simpson, Joanne; Zeng, Xiping

2003-01-01

Moist entropy is nearly conserved in adiabatic motion. It is redistributed rather than created by moist convection. Thus moist entropy and its equation, as a healthy direction, can be used to construct analytical and numerical models for the interaction between tropical convective clouds and large-scale circulations. Hence, an accurate equation of moist entropy is needed for the analysis and modeling of atmospheric convective clouds. On the basis of the consistency between the energy and the entropy equations, a complete equation of moist entropy is derived from the energy equation. The equation expresses explicitly the internal and external sources of moist entropy, including those in relation to the microphysics of clouds and precipitation. In addition, an accurate formula for the surface flux of moist entropy from the underlying surface into the air above is derived. Because moist entropy deals "easily" with the transition among three water phases, it will be used as a prognostic variable in the next generation of cloud-resolving models (e. g. a global cloud-resolving model) for low computational noise. Its equation that is derived in this paper is accurate and complete, providing a theoretical basis for using moist entropy as a prognostic variable in the long-term modeling of clouds and large-scale circulations.

Connectivity in the human brain dissociates entropy and complexity of auditory inputs☆

PubMed Central

Nastase, Samuel A.; Iacovella, Vittorio; Davis, Ben; Hasson, Uri

2015-01-01

Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. PMID:25536493

Action and entanglement in gravity and field theory.

PubMed

Neiman, Yasha

2013-12-27

In nongravitational quantum field theory, the entanglement entropy across a surface depends on the short-distance regularization. Quantum gravity should not require such regularization, and it has been conjectured that the entanglement entropy there is always given by the black hole entropy formula evaluated on the entangling surface. We show that these statements have precise classical counterparts at the level of the action. Specifically, we point out that the action can have a nonadditive imaginary part. In gravity, the latter is fixed by the black hole entropy formula, while in nongravitating theories it is arbitrary. From these classical facts, the entanglement entropy conjecture follows by heuristically applying the relation between actions and wave functions.

Evolution, Entropy, & Biological Information

ERIC Educational Resources Information Center

Peterson, Jacob

2014-01-01

A logical question to be expected from students: "How could life develop, that is, change, evolve from simple, primitive organisms into the complex forms existing today, while at the same time there is a generally observed decline and disorganization--the second law of thermodynamics?" The explanations in biology textbooks relied upon by…

Term Dependence: A Basis for Luhn and Zipf Models.

ERIC Educational Resources Information Center

Losee, Robert M.

2001-01-01

Discusses relationships between the frequency-based characteristics of neighboring terms in natural language and the rank or frequency of the terms. Topics include information theory measures, including expected mutual information measure (EMIM); entropy and rank; Luhn's model of term aboutness; Zipf's law; and implications for indexing and…

Near-horizon conformal symmetry and black hole entropy.

PubMed

Carlip, S

2002-06-17

Near an event horizon, the action of general relativity acquires a new asymptotic conformal symmetry. For two-dimensional dilaton gravity, this symmetry results in a chiral Virasoro algebra, and Cardy's formula for the density of states reproduces the Bekenstein-Hawking entropy. This lends support to the notion that black hole entropy is controlled universally by conformal symmetry near the horizon.

Minimum entropy deconvolution and blind equalisation

NASA Technical Reports Server (NTRS)

Satorius, E. H.; Mulligan, J. J.

1992-01-01

Relationships between minimum entropy deconvolution, developed primarily for geophysics applications, and blind equalization are pointed out. It is seen that a large class of existing blind equalization algorithms are directly related to the scale-invariant cost functions used in minimum entropy deconvolution. Thus the extensive analyses of these cost functions can be directly applied to blind equalization, including the important asymptotic results of Donoho.

Generalized Entropic Uncertainty Relations with Tsallis' Entropy

NASA Technical Reports Server (NTRS)

Portesi, M.; Plastino, A.

1996-01-01

A generalization of the entropic formulation of the Uncertainty Principle of Quantum Mechanics is considered with the introduction of the q-entropies recently proposed by Tsallis. The concomitant generalized measure is illustrated for the case of phase and number operators in quantum optics. Interesting results are obtained when making use of q-entropies as the basis for constructing generalized entropic uncertainty measures.

Entanglement entropy in Fermi gases and Anderson's orthogonality catastrophe.

PubMed

Ossipov, A

2014-09-26

We study the ground-state entanglement entropy of a finite subsystem of size L of an infinite system of noninteracting fermions scattered by a potential of finite range a. We derive a general relation between the scattering matrix and the overlap matrix and use it to prove that for a one-dimensional symmetric potential the von Neumann entropy, the Rényi entropies, and the full counting statistics are robust against potential scattering, provided that L/a≫1. The results of numerical calculations support the validity of this conclusion for a generic potential.

Permutation entropy of fractional Brownian motion and fractional Gaussian noise

NASA Astrophysics Data System (ADS)

Zunino, L.; Pérez, D. G.; Martín, M. T.; Garavaglia, M.; Plastino, A.; Rosso, O. A.

2008-06-01

We have worked out theoretical curves for the permutation entropy of the fractional Brownian motion and fractional Gaussian noise by using the Bandt and Shiha [C. Bandt, F. Shiha, J. Time Ser. Anal. 28 (2007) 646] theoretical predictions for their corresponding relative frequencies. Comparisons with numerical simulations show an excellent agreement. Furthermore, the entropy-gap in the transition between these processes, observed previously via numerical results, has been here theoretically validated. Also, we have analyzed the behaviour of the permutation entropy of the fractional Gaussian noise for different time delays.

Shannon entropy and avoided crossings in closed and open quantum billiards

NASA Astrophysics Data System (ADS)

Park, Kyu-Won; Moon, Songky; Shin, Younghoon; Kim, Jinuk; Jeong, Kabgyun; An, Kyungwon

2018-06-01

The relation between Shannon entropy and avoided crossings is investigated in dielectric microcavities. The Shannon entropy of the probability density for eigenfunctions in an open elliptic billiard as well as a closed quadrupole billiard increases as the center of the avoided crossing is approached. These results are opposite to those of atomic physics for electrons. It is found that the collective Lamb shift of the open quantum system and the symmetry breaking in the closed chaotic quantum system have equivalent effects on the Shannon entropy.

A New Thermodynamic Parameter to Predict Formation of Solid Solution or Intermetallic Phases in High Entropy Alloys (Postprint)

DTIC Science & Technology

2015-11-02

George , Relative effects of enthalpy and entropy on the phase stability of equiatomic high-entropy alloys, Acta Mater. 61 (2013) 2628e2638. [4] B... Cantor , I.T.H. Chang, P. Knight, A.J.B. Vincent, Microstructural development in equiatomic multicomponent alloys, Mater. Sci. Eng. A 375e377 (2004...an Al0.5CoCrCuFeNi high entropy alloy, In- termetallics 31 (2012) 165e172. [24] Z. Wu, H. Bei, F. Otto, G.M. Pharr, E.P. George , Recovery

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhou Huanqiang; School of Physical Sciences, University of Queensland, Brisbane, Queensland 4072; Barthel, Thomas

We investigate boundary critical phenomena from a quantum-information perspective. Bipartite entanglement in the ground state of one-dimensional quantum systems is quantified using the Renyi entropy S{sub {alpha}}, which includes the von Neumann entropy ({alpha}{yields}1) and the single-copy entanglement ({alpha}{yields}{infinity}) as special cases. We identify the contribution of the boundaries to the Renyi entropy, and show that there is an entanglement loss along boundary renormalization group (RG) flows. This property, which is intimately related to the Affleck-Ludwig g theorem, is a consequence of majorization relations between the spectra of the reduced density matrix along the boundary RG flows. We also pointmore » out that the bulk contribution to the single-copy entanglement is half of that to the von Neumann entropy, whereas the boundary contribution is the same.« less

Research of MPPT for photovoltaic generation based on two-dimensional cloud model

NASA Astrophysics Data System (ADS)

Liu, Shuping; Fan, Wei

2013-03-01

The cloud model is a mathematical representation to fuzziness and randomness in linguistic concepts. It represents a qualitative concept with expected value Ex, entropy En and hyper entropy He, and integrates the fuzziness and randomness of a linguistic concept in a unified way. This model is a new method for transformation between qualitative and quantitative in the knowledge. This paper is introduced MPPT (maximum power point tracking, MPPT) controller based two- dimensional cloud model through analysis of auto-optimization MPPT control of photovoltaic power system and combining theory of cloud model. Simulation result shows that the cloud controller is simple and easy, directly perceived through the senses, and has strong robustness, better control performance.

Lattice vibrations boost demagnetization entropy in a shape-memory alloy

NASA Astrophysics Data System (ADS)

Stonaha, P. J.; Manley, M. E.; Bruno, N. M.; Karaman, I.; Arroyave, R.; Singh, N.; Abernathy, D. L.; Chi, S.

2015-10-01

Magnetocaloric (MC) materials present an avenue for chemical-free, solid-state refrigeration through cooling via adiabatic demagnetization. We have used inelastic neutron scattering to measure the lattice dynamics in the MC material N i45C o5M n36.6I n13.4 . Upon heating across the Curie temperature (TC) , the material exhibits an anomalous increase in phonon entropy of 0.22 ±0.04 kB/atom , which is ten times larger than expected from conventional thermal expansion. This transition is accompanied by an abrupt softening of the transverse optic phonon. We present first-principles calculations showing a strong coupling between lattice distortions and magnetic excitations.

Entropy and caloric curve for mononuclei considering both surface diffuseness and self-similar expansion degrees of freedom

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sobotka, L.G.; Department of Physics, Washington University, St. Louis, Missouri 63130; Charity, R.J.

2006-01-15

The caloric curve for mononuclear configurations is studied with a model that allows for both increased surface diffusness and self-similar expansion. The evolution of the effective mass with density and excitation is included in a schematic fashion. The entropies, extracted in a local-density approximation, confirm that nuclei posess a soft mode that is predominately a surface expansion. We also find that the mononuclear caloric curve (temperature versus excitation energy) exhibits a plateau. Thus a plateau should be the expectation with or without a multifragmentationlike phase transition. This conclusion is relevant only for reactions that populate the mononuclear region of phasemore » space.« less

A new one-dimensional radiative equilibrium model for investigating atmospheric radiation entropy flux.

PubMed

Wu, Wei; Liu, Yangang

2010-05-12

A new one-dimensional radiative equilibrium model is built to analytically evaluate the vertical profile of the Earth's atmospheric radiation entropy flux under the assumption that atmospheric longwave radiation emission behaves as a greybody and shortwave radiation as a diluted blackbody. Results show that both the atmospheric shortwave and net longwave radiation entropy fluxes increase with altitude, and the latter is about one order in magnitude greater than the former. The vertical profile of the atmospheric net radiation entropy flux follows approximately that of the atmospheric net longwave radiation entropy flux. Sensitivity study further reveals that a 'darker' atmosphere with a larger overall atmospheric longwave optical depth exhibits a smaller net radiation entropy flux at all altitudes, suggesting an intrinsic connection between the atmospheric net radiation entropy flux and the overall atmospheric longwave optical depth. These results indicate that the overall strength of the atmospheric irreversible processes at all altitudes as determined by the corresponding atmospheric net entropy flux is closely related to the amount of greenhouse gases in the atmosphere.

Investigation of FeNiCrWMn - a new high entropy alloy

NASA Astrophysics Data System (ADS)

Buluc, G.; Florea, I.; Bălţătescu, O.; Florea, R. M.; Carcea, I.

2015-11-01

The term of high entropy alloys started from the analysis of multicomponent alloys, which were produced at an experimental level since 1995 by developing a new concept related to the development of metallic materials. Recent developments in the field of high-entropy alloys have revealed that they have versatile properties like: ductility, toughness, hardness and corrosion resistance [1]. Up until now, it has been demonstrated that the explored this alloys are feasible to be synthesized, processed and analyzed contrary to the misunderstanding based on traditional experiences. Moreover, there are many opportunities in this field for academic studies and industrial applications [1, 2]. As the combinations of composition and process for producing high entropy alloys are numerous and each high entropy alloy has its own microstructure and properties to be identified and understood, the research work is truly limitless. The novelty of these alloys consists of chemical composition. These alloys have been named high entropy alloys due to the atomic scale mixing entropies higher than traditional alloys. In this paper, I will present the microscopy and the mechanical properties of high entropy alloy FeNiCrWMn.

Conformational Entropy of Intrinsically Disordered Proteins from Amino Acid Triads

PubMed Central

Baruah, Anupaul; Rani, Pooja; Biswas, Parbati

2015-01-01

This work quantitatively characterizes intrinsic disorder in proteins in terms of sequence composition and backbone conformational entropy. Analysis of the normalized relative composition of the amino acid triads highlights a distinct boundary between globular and disordered proteins. The conformational entropy is calculated from the dihedral angles of the middle amino acid in the amino acid triad for the conformational ensemble of the globular, partially and completely disordered proteins relative to the non-redundant database. Both Monte Carlo (MC) and Molecular Dynamics (MD) simulations are used to characterize the conformational ensemble of the representative proteins of each group. The results show that the globular proteins span approximately half of the allowed conformational states in the Ramachandran space, while the amino acid triads in disordered proteins sample the entire range of the allowed dihedral angle space following Flory’s isolated-pair hypothesis. Therefore, only the sequence information in terms of the relative amino acid triad composition may be sufficient to predict protein disorder and the backbone conformational entropy, even in the absence of well-defined structure. The predicted entropies are found to agree with those calculated using mutual information expansion and the histogram method. PMID:26138206

An uncertainty principle for unimodular quantum groups

DOE Office of Scientific and Technical Information (OSTI.GOV)

Crann, Jason; Université Lille 1 - Sciences et Technologies, UFR de Mathématiques, Laboratoire de Mathématiques Paul Painlevé - UMR CNRS 8524, 59655 Villeneuve d'Ascq Cédex; Kalantar, Mehrdad, E-mail: jason-crann@carleton.ca, E-mail: mkalanta@math.carleton.ca

2014-08-15

We present a generalization of Hirschman's entropic uncertainty principle for locally compact Abelian groups to unimodular locally compact quantum groups. As a corollary, we strengthen a well-known uncertainty principle for compact groups, and generalize the relation to compact quantum groups of Kac type. We also establish the complementarity of finite-dimensional quantum group algebras. In the non-unimodular setting, we obtain an uncertainty relation for arbitrary locally compact groups using the relative entropy with respect to the Haar weight as the measure of uncertainty. We also show that when restricted to q-traces of discrete quantum groups, the relative entropy with respect tomore » the Haar weight reduces to the canonical entropy of the random walk generated by the state.« less

Measuring the potential utility of seasonal climate predictions

NASA Astrophysics Data System (ADS)

Tippett, Michael K.; Kleeman, Richard; Tang, Youmin

2004-11-01

Variation of sea surface temperature (SST) on seasonal-to-interannual time-scales leads to changes in seasonal weather statistics and seasonal climate anomalies. Relative entropy, an information theory measure of utility, is used to quantify the impact of SST variations on seasonal precipitation compared to natural variability. An ensemble of general circulation model (GCM) simulations is used to estimate this quantity in three regions where tropical SST has a large impact on precipitation: South Florida, the Nordeste of Brazil and Kenya. We find the yearly variation of relative entropy is strongly correlated with shifts in ensemble mean precipitation and weakly correlated with ensemble variance. Relative entropy is also found to be related to measures of the ability of the GCM to reproduce observations.

Problem-Solving Phase Transitions During Team Collaboration.

PubMed

Wiltshire, Travis J; Butner, Jonathan E; Fiore, Stephen M

2018-01-01

Multiple theories of problem-solving hypothesize that there are distinct qualitative phases exhibited during effective problem-solving. However, limited research has attempted to identify when transitions between phases occur. We integrate theory on collaborative problem-solving (CPS) with dynamical systems theory suggesting that when a system is undergoing a phase transition it should exhibit a peak in entropy and that entropy levels should also relate to team performance. Communications from 40 teams that collaborated on a complex problem were coded for occurrence of problem-solving processes. We applied a sliding window entropy technique to each team's communications and specified criteria for (a) identifying data points that qualify as peaks and (b) determining which peaks were robust. We used multilevel modeling, and provide a qualitative example, to evaluate whether phases exhibit distinct distributions of communication processes. We also tested whether there was a relationship between entropy values at transition points and CPS performance. We found that a proportion of entropy peaks was robust and that the relative occurrence of communication codes varied significantly across phases. Peaks in entropy thus corresponded to qualitative shifts in teams' CPS communications, providing empirical evidence that teams exhibit phase transitions during CPS. Also, lower average levels of entropy at the phase transition points predicted better CPS performance. We specify future directions to improve understanding of phase transitions during CPS, and collaborative cognition, more broadly. Copyright © 2017 Cognitive Science Society, Inc.

Entropy, matter, and cosmology.

PubMed

Prigogine, I; Géhéniau, J

1986-09-01

The role of irreversible processes corresponding to creation of matter in general relativity is investigated. The use of Landau-Lifshitz pseudotensors together with conformal (Minkowski) coordinates suggests that this creation took place in the early universe at the stage of the variation of the conformal factor. The entropy production in this creation process is calculated. It is shown that these dissipative processes lead to the possibility of cosmological models that start from empty conditions and gradually build up matter and entropy. Gravitational entropy takes a simple meaning as associated to the entropy that is necessary to produce matter. This leads to an extension of the third law of thermodynamics, as now the zero point of entropy becomes the space-time structure out of which matter is generated. The theory can be put into a convenient form using a supplementary "C" field in Einstein's field equations. The role of the C field is to express the coupling between gravitation and matter leading to irreversible entropy production.

Entropy generation in biophysical systems

NASA Astrophysics Data System (ADS)

Lucia, U.; Maino, G.

2013-03-01

Recently, in theoretical biology and in biophysical engineering the entropy production has been verified to approach asymptotically its maximum rate, by using the probability of individual elementary modes distributed in accordance with the Boltzmann distribution. The basis of this approach is the hypothesis that the entropy production rate is maximum at the stationary state. In the present work, this hypothesis is explained and motivated, starting from the entropy generation analysis. This latter quantity is obtained from the entropy balance for open systems considering the lifetime of the natural real process. The Lagrangian formalism is introduced in order to develop an analytical approach to the thermodynamic analysis of the open irreversible systems. The stationary conditions of the open systems are thus obtained in relation to the entropy generation and the least action principle. Consequently, the considered hypothesis is analytically proved and it represents an original basic approach in theoretical and mathematical biology and also in biophysical engineering. It is worth remarking that the present results show that entropy generation not only increases but increases as fast as possible.

Entropic cohering power in quantum operations

NASA Astrophysics Data System (ADS)

Xi, Zhengjun; Hu, Ming-Liang; Li, Yongming; Fan, Heng

2018-02-01

Coherence is a basic feature of quantum systems and a common necessary condition for quantum correlations. It is also an important physical resource in quantum information processing. In this paper, using relative entropy, we consider a more general definition of the cohering power of quantum operations. First, we calculate the cohering power of unitary quantum operations and show that the amount of distributed coherence caused by non-unitary quantum operations cannot exceed the quantum-incoherent relative entropy between system of interest and its environment. We then find that the difference between the distributed coherence and the cohering power is larger than the quantum-incoherent relative entropy. As an application, we consider the distributed coherence caused by purification.

Machine learning with quantum relative entropy

NASA Astrophysics Data System (ADS)

Tsuda, Koji

2009-12-01

Density matrices are a central tool in quantum physics, but it is also used in machine learning. A positive definite matrix called kernel matrix is used to represent the similarities between examples. Positive definiteness assures that the examples are embedded in an Euclidean space. When a positive definite matrix is learned from data, one has to design an update rule that maintains the positive definiteness. Our update rule, called matrix exponentiated gradient update, is motivated by the quantum relative entropy. Notably, the relative entropy is an instance of Bregman divergences, which are asymmetric distance measures specifying theoretical properties of machine learning algorithms. Using the calculus commonly used in quantum physics, we prove an upperbound of the generalization error of online learning.

Perceptual suppression revealed by adaptive multi-scale entropy analysis of local field potential in monkey visual cortex.

PubMed

Hu, Meng; Liang, Hualou

2013-04-01

Generalized flash suppression (GFS), in which a salient visual stimulus can be rendered invisible despite continuous retinal input, provides a rare opportunity to directly study the neural mechanism of visual perception. Previous work based on linear methods, such as spectral analysis, on local field potential (LFP) during GFS has shown that the LFP power at distinctive frequency bands are differentially modulated by perceptual suppression. Yet, the linear method alone may be insufficient for the full assessment of neural dynamic due to the fundamentally nonlinear nature of neural signals. In this study, we set forth to analyze the LFP data collected from multiple visual areas in V1, V2 and V4 of macaque monkeys while performing the GFS task using a nonlinear method - adaptive multi-scale entropy (AME) - to reveal the neural dynamic of perceptual suppression. In addition, we propose a new cross-entropy measure at multiple scales, namely adaptive multi-scale cross-entropy (AMCE), to assess the nonlinear functional connectivity between two cortical areas. We show that: (1) multi-scale entropy exhibits percept-related changes in all three areas, with higher entropy observed during perceptual suppression; (2) the magnitude of the perception-related entropy changes increases systematically over successive hierarchical stages (i.e. from lower areas V1 to V2, up to higher area V4); and (3) cross-entropy between any two cortical areas reveals higher degree of asynchrony or dissimilarity during perceptual suppression, indicating a decreased functional connectivity between cortical areas. These results, taken together, suggest that perceptual suppression is related to a reduced functional connectivity and increased uncertainty of neural responses, and the modulation of perceptual suppression is more effective at higher visual cortical areas. AME is demonstrated to be a useful technique in revealing the underlying dynamic of nonlinear/nonstationary neural signal.

Another resolution of the configurational entropy paradox as applied to hard spheres

NASA Astrophysics Data System (ADS)

Baranau, Vasili; Tallarek, Ulrich

2017-12-01

Ozawa and Berthier [J. Chem. Phys. 146, 014502 (2017)] recently studied the configurational and vibrational entropies Sconf and Svib from the relation Stot = Sconf + Svib for polydisperse mixtures of spheres. They noticed that because the total entropy per particle Stot/N shall contain the mixing entropy per particle kBsmix and Svib/N shall not, the configurational entropy per particle Sconf/N shall diverge in the thermodynamic limit for continuous polydispersity due to the diverging smix. They also provided a resolution for this paradox and related problems—it relies on a careful redefining of Sconf and Svib. Here, we note that the relation Stot = Sconf + Svib is essentially a geometric relation in the phase space and shall hold without redefining Sconf and Svib. We also note that Stot/N diverges with N → ∞ with continuous polydispersity as well. The usual way to avoid this and other difficulties with Stot/N is to work with the excess entropy ΔStot (relative to the ideal gas of the same polydispersity). Speedy applied this approach to the relation above in his work [Mol. Phys. 95, 169 (1998)] and wrote this relation as ΔStot = Sconf + ΔSvib. This form has flaws as well because Svib/N does not contain the kBsmix term and the latter is introduced into ΔSvib/N instead. Here, we suggest that this relation shall actually be written as ΔStot = ΔcSconf + ΔvSvib, where Δ = Δc + Δv, while ΔcSconf = Sconf - kBNsmix and ΔvSvib=Svib-kBN [1 +ln (V/ΛdN ]+U/N kBT) with N, V, T, U, d, and Λ standing for the number of particles, volume, temperature, internal energy, dimensionality, and de Broglie wavelength, respectively. In this form, all the terms per particle are always finite for N → ∞ and continuous when introducing a small polydispersity to a monodisperse system. We also suggest that the Adam-Gibbs and related relations shall in fact contain ΔcSconf/N instead of Sconf/N.

Characterizing Protease Specificity: How Many Substrates Do We Need?

PubMed Central

Schauperl, Michael; Fuchs, Julian E.; Waldner, Birgit J.; Huber, Roland G.; Kramer, Christian; Liedl, Klaus R.

2015-01-01

Calculation of cleavage entropies allows to quantify, map and compare protease substrate specificity by an information entropy based approach. The metric intrinsically depends on the number of experimentally determined substrates (data points). Thus a statistical analysis of its numerical stability is crucial to estimate the systematic error made by estimating specificity based on a limited number of substrates. In this contribution, we show the mathematical basis for estimating the uncertainty in cleavage entropies. Sets of cleavage entropies are calculated using experimental cleavage data and modeled extreme cases. By analyzing the underlying mathematics and applying statistical tools, a linear dependence of the metric in respect to 1/n was found. This allows us to extrapolate the values to an infinite number of samples and to estimate the errors. Analyzing the errors, a minimum number of 30 substrates was found to be necessary to characterize substrate specificity, in terms of amino acid variability, for a protease (S4-S4’) with an uncertainty of 5 percent. Therefore, we encourage experimental researchers in the protease field to record specificity profiles of novel proteases aiming to identify at least 30 peptide substrates of maximum sequence diversity. We expect a full characterization of protease specificity helpful to rationalize biological functions of proteases and to assist rational drug design. PMID:26559682

Discrimination of coherent features in turbulent boundary layers by the entropy method

NASA Technical Reports Server (NTRS)

Corke, T. C.; Guezennec, Y. G.

1984-01-01

Entropy in information theory is defined as the expected or mean value of the measure of the amount of self-information contained in the ith point of a distribution series x sub i, based on its probability of occurrence p(x sub i). If p(x sub i) is the probability of the ith state of the system in probability space, then the entropy, E(X) = - sigma p(x sub i) logp (x sub i), is a measure of the disorder in the system. Based on this concept, a method was devised which sought to minimize the entropy in a time series in order to construct the signature of the most coherent motions. The constrained minimization was performed using a Lagrange multiplier approach which resulted in the solution of a simultaneous set of non-linear coupled equations to obtain the coherent time series. The application of the method to space-time data taken by a rake of sensors in the near-wall region of a turbulent boundary layer was presented. The results yielded coherent velocity motions made up of locally decelerated or accelerated fluid having a streamwise scale of approximately 100 nu/u(tau), which is in qualitative agreement with the results from other less objective discrimination methods.

Entropy, materials, and posterity

USGS Publications Warehouse

Cloud, P.

1977-01-01

Materials and energy are the interdependent feedstocks of economic systems, and thermodynamics is their moderator. It costs energy to transform the dispersed minerals of Earth's crust into ordered materials and structures. And it costs materials to collect and focus the energy to perform work - be it from solar, fossil fuel, nuclear, or other sources. The greater the dispersal of minerals sought, the more energy is required to collect them into ordered states. But available energy can be used once only. And the ordered materials of industrial economies become disordered with time. They may be partially reordered and recycled, but only at further costs in energy. Available energy everywhere degrades to bound states and order to disorder - for though entropy may be juggled it always increases. Yet industry is utterly dependent on low entropy states of matter and energy, while decreasing grades of ore require ever higher inputs of energy to convert them to metals, with ever increasing growth both of entropy and environmental hazard. Except as we may prize a thing for its intrinsic qualities - beauty, leisure, love, or gold - low-entropy is the only thing of real value. It is worth whatever the market will bear, and it becomes more valuable as entropy increases. It would be foolish of suppliers to sell it more cheaply or in larger amounts than their own enjoyment of life requires, whatever form it may take. For this reason, and because of physical constraints on the availability of all low-entropy states, the recent energy crises is only the first of a sequence of crises to be expected in energy and materials as long as current trends continue. The apportioning of low-entropy states in a modern industrial society is achieved more or less according to the theory of competitive markets. But the rational powers of this theory suffer as the world grows increasingly polarized into rich, over-industrialized nations with diminishing resource bases and poor, supplier nations with little industry. The theory also discounts posterity, the more so as population density and percapita rates of consumption continue to grow. A new social, economic, and ecologic norm that leads to population control, conservation, and an apportionment of low-entropy states across the generations is needed to assure to posterity the options that properly belong to it as an important but voiceless constituency of the collectivity we call mankind. ?? 1977 Ferdinand Enke Verlag Stuttgart.

Parametric scaling from species relative abundances to absolute abundances in the computation of biological diversity: a first proposal using Shannon's entropy.

PubMed

Ricotta, Carlo

2003-01-01

Traditional diversity measures such as the Shannon entropy are generally computed from the species' relative abundance vector of a given community to the exclusion of species' absolute abundances. In this paper, I first mention some examples where the total information content associated with a given community may be more adequate than Shannon's average information content for a better understanding of ecosystem functioning. Next, I propose a parametric measure of statistical information that contains both Shannon's entropy and total information content as special cases of this more general function.

Stochastic approach to equilibrium and nonequilibrium thermodynamics.

PubMed

Tomé, Tânia; de Oliveira, Mário J

2015-04-01

We develop the stochastic approach to thermodynamics based on stochastic dynamics, which can be discrete (master equation) and continuous (Fokker-Planck equation), and on two assumptions concerning entropy. The first is the definition of entropy itself and the second the definition of entropy production rate, which is non-negative and vanishes in thermodynamic equilibrium. Based on these assumptions, we study interacting systems with many degrees of freedom in equilibrium or out of thermodynamic equilibrium and how the macroscopic laws are derived from the stochastic dynamics. These studies include the quasiequilibrium processes; the convexity of the equilibrium surface; the monotonic time behavior of thermodynamic potentials, including entropy; the bilinear form of the entropy production rate; the Onsager coefficients and reciprocal relations; and the nonequilibrium steady states of chemical reactions.

Shuffled Cards, Messy Desks, and Disorderly Dorm Rooms - Examples of Entropy Increase? Nonsense!

NASA Astrophysics Data System (ADS)

Lambert, Frank L.

1999-10-01

The order of presentation in this article is unusual; its conclusion is first. This is done because the title entails text and lecture examples so familiar to all teachers that most may find a preliminary discussion redundant. Conclusion The dealer shuffling cards in Monte Carlo or Las Vegas, the professor who mixes the papers and books on a desk, the student who tosses clothing about his or her room, the fuel for the huge cranes and trucks that would be necessary to move the nonbonded stones of the Great Pyramid of Cheops all across Egypteach undergoes physical, thermodynamic entropy increase in these specific processes. The thermodynamic entropy change from human-defined order to disorder in the giant Egyptian stones themselves, in the clothing and books in a room or papers on a desk, and in the millions of cards in the world's casinos is precisely the same: Zero. K. G. Denbigh succinctly summarizes the case against identifying changes in position in one macro object or in a group with physical entropy change (1): If one wishes to substantiate a claim or a guess that some particular process involves a change of thermodynamic or statistical entropy, one should ask oneself whether there exists a reversible heat effect, or a change in the number of accessible energy eigenstates, pertaining to the process in question. If not, there has been no change of physical entropy (even though there may have been some change in our "information"). Thus, simply changing the location of everyday macro objects from an arrangement that we commonly judge as orderly (relatively singular) to one that appears disorderly (relatively probable) is a "zero change" in the thermodynamic entropy of the objects because the number of accessible energetic microstates in any of them has not been changed. Finally, although it may appear obvious, a collection of ordinary macro things does not constitute a thermodynamic system as does a group of microparticles. The crucial difference is that such things are not ceaselessly colliding and exchanging energy under the thermal dominance of their environment as are microparticles. A postulate can be derived from this fundamental criterion: The movement of macro objects from one location to another by an external agent involves no change in the objects' physical (thermodynamic) entropy. The agent of movement undergoes a thermodynamic entropy increase in the process. A needed corollary, considering the number of erroneous statements in print, is: There is no spontaneous tendency in groups of macro objects to become disorderly or randomly scattered. The tendency in nature toward increased entropy does not reside in the arrangement of any chemically unchanging objects but rather in the external agent moving them. It is the sole cause of their transport toward more probable locations. The Error There is no more widespread error in chemistry and physics texts than the identification of a thermodynamic entropy increase with a change in the pattern of a group of macro objects. The classic example is that of playing cards. Shuffling a new deck is widely said to result in an increase in entropy in the cards. This erroneous impression is often extended to all kinds of things when they are changed from humanly designated order to what is commonly considered disorder: a group of marbles to scattered marbles, racked billiard balls to a broken rack, neat groups of papers on a desk to the more usual disarray. In fact, there is no thermodynamic entropy change in the objects in the "after" state compared to the "before". Further, such alterations in arrangement have been used in at least one text to support a "law" that is stated, "things move spontaneously in the direction of maximum chaos or disorder".1 The foregoing examples and "law" seriously mislead the student by focusing on macro objects that are only a passive part of a system. They are deceptive in omitting the agent that actually is changed in entropy as it follows the second lawthat is, whatever energy source is involved in the process of moving the static macro objects to more probable random locations. Entropy is increased in the shuffler's and in the billiard cue holder's muscles, in the tornado's wind and the earthquake's stressnot in the objects shifted. Chemically unchanged macro things do not spontaneously, by some innate tendency, leap or even slowly lurch toward visible disorder. Energy concentrated in the ATP of a person's muscles or in wind or in earth-stress is ultimately responsible for moving objects and is partly degraded to diffuse thermal energy as a result. Discussion To discover the origin of this text and lecture error, a brief review of some aspects of physical entropy is useful. Of course, the original definition of Clausius, dS = Dq(rev)/T, applies to a system plus its surroundings, and the Gibbsian relation of pertains to a system at constant pressure and constant temperature. Only in the present discussion (where an unfortunate term, information "entropy", must be dealt with) would it be necessary to emphasize that temperature is integral to any physical thermodynamic entropy change described via Clausius or Gibbs. In our era we are surer even than they could be that temperature is indispensable in understanding thermodynamic entropy because it indicates the thermal environment of microparticles in a system. That environment sustains the intermolecular motions whereby molecules continuously interchange energy and are able to access the wide range of energetic microstates available to them. It is this ever-present thermal motion that makes spontaneous change possible, even at constant temperature and in the absence of chemical reaction, because it is the mechanism whereby molecules can occupy new energetic microstates if the boundaries of a system are altered. Prime examples of such spontaneous change are diffusion in fluids and the expansion of gases into vacua, both fundamentally due to the additional translational energetic microstates in the enlarged systems. (Of course, spontaneous endothermic processes ranging from phase changes to chemical reactions are also due to mobile energy-transferring microparticles that can access new rotational and vibrational as well as translational energetic microstatesin the thermal surroundings as well as in the chemical system.) Misinterpretation of the Boltzmann equation for entropy change, ln(number of energetic microstates after change/number of energetic microstates before change), is the source of much of the confusion regarding the behavior of macro objects. R, the gas constant, embeds temperature in Boltzmann's entropy as integrally as in the Clausius or Gibbs relation and, to repeat, the environment's temperature indicates the degree of energy dispersion that makes access to available energy microstates possible. The Boltzmann equation is revelatory in uniting the macrothermodynamics of classic Clausian entropy with what has been described above as the behavior of a system of microparticles occupying energetic microstates. In discussing how probability enters the Boltzmann equation (i.e., the number of possible energetic microstates and their occupancy by microparticles), texts and teachers often enumerate the many ways a few symbolic molecules can be distributed on lines representing energy levels, or in similar cells or boxes, or with combinations of playing cards. Of course these are good analogs for depicting an energetic microsystem. However, even if there are warnings by the instructor, the use of playing cards as a model is probably intellectually hazardous; these objects are so familiar that the student can too easily warp this macro analog of a microsystem into an example of actual entropic change in the cards. Another major source of confusion about entropy change as the result of simply rearranging macro objects comes from information theory "entropy".2 Claude E. Shannon's 1948 paper began the era of quantification of information and in it he adopted the word "entropy" to name the quantity that his equation defined (2). This occurred because a friend, the brilliant mathematician John von Neumann, told him "call it entropy no one knows what entropy really is, so in a debate you will always have the advantage" (3). Wryly funny for that moment, Shannon's unwise acquiescence has produced enormous scientific confusion due to the increasingly widespread usefulness of his equation and its fertile mathematical variations in many fields other than communications (4, 5). Certainly most non-experts hearing of the widely touted information "entropy" would assume its overlap with thermodynamic entropy. However, the great success of information "entropy" has been in areas totally divorced from experimental chemistry, whose objective macro results are dependent on the behavior of energetic microparticles. Nevertheless, many instructors in chemistry have the impression that information "entropy" is not only relevant to the calculations and conclusions of thermodynamic entropy but may change them. This is not true. There is no invariant function corresponding to energy embedded in each of the hundreds of equations of information "entropy" and thus no analog of temperature universally present in them. In contrast, inherent in all thermodynamic entropy, temperature is the objective indicator of a system's energetic state. Probability distributions in information "entropy" represent human selections; therefore information "entropy" is strongly subjective. Probability distributions in thermodynamic entropy are dependent on the microparticulate and physicochemical nature of the system; limited thereby, thermodynamic entropy is strongly objective. This is not to say that the extremely general mathematics of information theory cannot be modified ad hoc and further specifically constrained to yield results that are identical to Gibbs' or Boltzmann's relations (6). This may be important theoretically but it is totally immaterial here; such a modification simply supports conventional thermodynamic results without changing themno lesser nor any greater thermodynamic entropy. The point is that information "entropy" in all of its myriad nonphysicochemical forms as a measure of information or abstract communication has no relevance to the evaluation of thermodynamic entropy change in the movement of macro objects because such information "entropy" does not deal with microparticles whose perturbations are related to temperature.3 Even those who are very competent chemists and physicists have become confused when they have melded or mixed information "entropy" in their consideration of physical thermodynamic entropy. This is shown by the results in textbooks and by the lectures of professors found on the Internet.1 Overall then, how did such an error (concerning entropy changes in macro objects that are simply moved) become part of mainstream instruction, being repeated in print even by distinguished physicists and chemists? The modern term for distorting a photograph, morphing, is probably the best answer. Correct statements of statistical thermodynamics have been progressively altered so that their dependence on the energetics of atoms and molecules is obliterated for the nonprofessional reader and omitted by some author-scientists. The morphing process can be illustrated by the sequence of statements 1 to 4 below.

1. Isolated systems of atoms and molecules spontaneously tend to occupy all available energetic microstates thermally accessible to them and tend to change to any arrangement or macro state that provides more such microstates. Thus, spontaneous change is toward a condition of greater probability of energy dispersion. After a spontaneous change, the logarithm of the ratio of the number of available microstates to those in the prior state is related to the system's increase in entropy by a constant, R/N per mole. It is the presence of temperature in R that distinguishes physical entropy from all information "entropy".
2. Systems of atoms and molecules spontaneously tend to go from a less probable state in which they are relatively "orderly" (few microstates, low entropy) to one that is more probable in which they are "disorderly" (many microstates, high entropy).
3. Spontaneous (natural) processes go from order to disorder and entropy increases. Order is what we see as neat, patterned. Disorder is what we see as messy, random.
4. Things naturally become disorderly.

1. Singling out individual authors from many could appear invidious. Thus, references to quotations or errors are not listed.
2. It is important that information "entropy" always be in quotes whenever thermodynamic entropy is mentioned in the same article or book. Otherwise, the unfortunate confusion of the past half-century is amplified rather than attenuated.
3. It has been said that an information "entropy" equationcompared to those for thermodynamic entropymay look like a duck but, without any empowering thermal energy, it can't quack like a duck or walk like a duck.

1. Denbigh, K. G. Br. J. Philos. Sci. 1989, 40, 323-332.
2. Shannon, C. E. Bell System Tech. J. 1948, 27, 329-423, 623-656.
3. Tribus, M.; McIrvine, E. C. Sci. Am. 1971, 225, 180.
4. Including: Golembiewski, R. T. Handbook of Organizational Behavior; Dekker: New York, 1993.
5. Hillman, C. Entropy on the World Wide Web; http://www.math.washington.edu/~hillman/entropy.html. Extensive references to print and WWW sites, primarily information "entropy" but thermodynamic entropy in the physical sciences in http://www.math.washington.edu/~hillman/Entropy/phys.html (The "e" in entropy is case sensitive in these two URLs.). A European mirror site (via China) is at http://www.unibas.ch/mdpi/entropy (accessed June 1999).
6. Tribus, M. Am. Sci. 1966, 54, 201-210.

Coarse-graining errors and numerical optimization using a relative entropy framework

NASA Astrophysics Data System (ADS)

Chaimovich, Aviel; Shell, M. Scott

2011-03-01

The ability to generate accurate coarse-grained models from reference fully atomic (or otherwise "first-principles") ones has become an important component in modeling the behavior of complex molecular systems with large length and time scales. We recently proposed a novel coarse-graining approach based upon variational minimization of a configuration-space functional called the relative entropy, Srel, that measures the information lost upon coarse-graining. Here, we develop a broad theoretical framework for this methodology and numerical strategies for its use in practical coarse-graining settings. In particular, we show that the relative entropy offers tight control over the errors due to coarse-graining in arbitrary microscopic properties, and suggests a systematic approach to reducing them. We also describe fundamental connections between this optimization methodology and other coarse-graining strategies like inverse Monte Carlo, force matching, energy matching, and variational mean-field theory. We suggest several new numerical approaches to its minimization that provide new coarse-graining strategies. Finally, we demonstrate the application of these theoretical considerations and algorithms to a simple, instructive system and characterize convergence and errors within the relative entropy framework.

Studies on entanglement entropy for Hubbard model with hole-doping and external magnetic field [rapid communication

NASA Astrophysics Data System (ADS)

Yao, K. L.; Li, Y. C.; Sun, X. Z.; Liu, Q. M.; Qin, Y.; Fu, H. H.; Gao, G. Y.

2005-10-01

By using the density matrix renormalization group (DMRG) method for the one-dimensional (1D) Hubbard model, we have studied the von Neumann entropy of a quantum system, which describes the entanglement of the system block and the rest of the chain. It is found that there is a close relation between the entanglement entropy and properties of the system. The hole-doping can alter the charge charge and spin spin interactions, resulting in charge polarization along the chain. By comparing the results before and after the doping, we find that doping favors increase of the von Neumann entropy and thus also favors the exchange of information along the chain. Furthermore, we calculated the spin and entropy distribution in external magnetic filed. It is confirmed that both the charge charge and the spin spin interactions affect the exchange of information along the chain, making the entanglement entropy redistribute.

Entropy of finite random binary sequences with weak long-range correlations.

PubMed

Melnik, S S; Usatenko, O V

2014-11-01

We study the N-step binary stationary ergodic Markov chain and analyze its differential entropy. Supposing that the correlations are weak we express the conditional probability function of the chain through the pair correlation function and represent the entropy as a functional of the pair correlator. Since the model uses the two-point correlators instead of the block probability, it makes it possible to calculate the entropy of strings at much longer distances than using standard methods. A fluctuation contribution to the entropy due to finiteness of random chains is examined. This contribution can be of the same order as its regular part even at the relatively short lengths of subsequences. A self-similar structure of entropy with respect to the decimation transformations is revealed for some specific forms of the pair correlation function. Application of the theory to the DNA sequence of the R3 chromosome of Drosophila melanogaster is presented.

Entropy of finite random binary sequences with weak long-range correlations

NASA Astrophysics Data System (ADS)

Melnik, S. S.; Usatenko, O. V.

2014-11-01

We study the N -step binary stationary ergodic Markov chain and analyze its differential entropy. Supposing that the correlations are weak we express the conditional probability function of the chain through the pair correlation function and represent the entropy as a functional of the pair correlator. Since the model uses the two-point correlators instead of the block probability, it makes it possible to calculate the entropy of strings at much longer distances than using standard methods. A fluctuation contribution to the entropy due to finiteness of random chains is examined. This contribution can be of the same order as its regular part even at the relatively short lengths of subsequences. A self-similar structure of entropy with respect to the decimation transformations is revealed for some specific forms of the pair correlation function. Application of the theory to the DNA sequence of the R3 chromosome of Drosophila melanogaster is presented.

Scaling of the entropy budget with surface temperature in radiative-convective equilibrium

NASA Astrophysics Data System (ADS)

Singh, Martin S.; O'Gorman, Paul A.

2016-09-01

The entropy budget of the atmosphere is examined in simulations of radiative-convective equilibrium with a cloud-system resolving model over a wide range of surface temperatures from 281 to 311 K. Irreversible phase changes and the diffusion of water vapor account for more than half of the irreversible entropy production within the atmosphere, even in the coldest simulation. As the surface temperature is increased, the atmospheric radiative cooling rate increases, driving a greater entropy sink that must be matched by greater irreversible entropy production. The entropy production resulting from irreversible moist processes increases at a similar fractional rate as the entropy sink and at a lower rate than that implied by Clausius-Clapeyron scaling. This allows the entropy production from frictional drag on hydrometeors and on the atmospheric flow to also increase with warming, in contrast to recent results for simulations with global climate models in which the work output decreases with warming. A set of approximate scaling relations is introduced for the terms in the entropy budget as the surface temperature is varied, and many of the terms are found to scale with the mean surface precipitation rate. The entropy budget provides some insight into changes in frictional dissipation in response to warming or changes in model resolution, but it is argued that frictional dissipation is not closely linked to other measures of convective vigor.

Connectivity in the human brain dissociates entropy and complexity of auditory inputs.

PubMed

Nastase, Samuel A; Iacovella, Vittorio; Davis, Ben; Hasson, Uri

2015-03-01

Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. Copyright © 2014. Published by Elsevier Inc.

Quantum entropy and special relativity.

PubMed

Peres, Asher; Scudo, Petra F; Terno, Daniel R

2002-06-10

We consider a single free spin- 1 / 2 particle. The reduced density matrix for its spin is not covariant under Lorentz transformations. The spin entropy is not a relativistic scalar and has no invariant meaning.

Minimum relative entropy distributions with a large mean are Gaussian

NASA Astrophysics Data System (ADS)

Smerlak, Matteo

2016-12-01

Entropy optimization principles are versatile tools with wide-ranging applications from statistical physics to engineering to ecology. Here we consider the following constrained problem: Given a prior probability distribution q , find the posterior distribution p minimizing the relative entropy (also known as the Kullback-Leibler divergence) with respect to q under the constraint that mean (p ) is fixed and large. We show that solutions to this problem are approximately Gaussian. We discuss two applications of this result. In the context of dissipative dynamics, the equilibrium distribution of a Brownian particle confined in a strong external field is independent of the shape of the confining potential. We also derive an H -type theorem for evolutionary dynamics: The entropy of the (standardized) distribution of fitness of a population evolving under natural selection is eventually increasing in time.

Recoverability in quantum information theory

NASA Astrophysics Data System (ADS)

Wilde, Mark

The fact that the quantum relative entropy is non-increasing with respect to quantum physical evolutions lies at the core of many optimality theorems in quantum information theory and has applications in other areas of physics. In this work, we establish improvements of this entropy inequality in the form of physically meaningful remainder terms. One of the main results can be summarized informally as follows: if the decrease in quantum relative entropy between two quantum states after a quantum physical evolution is relatively small, then it is possible to perform a recovery operation, such that one can perfectly recover one state while approximately recovering the other. This can be interpreted as quantifying how well one can reverse a quantum physical evolution. Our proof method is elementary, relying on the method of complex interpolation, basic linear algebra, and the recently introduced Renyi generalization of a relative entropy difference. The theorem has a number of applications in quantum information theory, which have to do with providing physically meaningful improvements to many known entropy inequalities. This is based on arXiv:1505.04661, now accepted for publication in Proceedings of the Royal Society A. I acknowledge support from startup funds from the Department of Physics and Astronomy at LSU, the NSF under Award No. CCF-1350397, and the DARPA Quiness Program through US Army Research Office award W31P4Q-12-1-0019.

[Changes in the entropy of heart mass in dogs during inhalation of transuranic radionuclides].

PubMed

Kalmykova, Z I; Buldakov, L A; Tokarskaia, Z V

1991-01-01

Altogether 140 random-bred dogs of both sexes, aged 2 to 4 (body mass 14.5 +/- 0.1 kg) were examined. Age-related changes of heart mass entropy, resulting from disorder in the correlation of cardiac parts during aging, progress with age. During inhalation of acute, subacute and chronic effective amounts of nitrates of polymeric 239Pu and monomeric 241Am aerosol particles, measured in micron, dog heart mass entropy increases as compared to the age control, and during inhalation of transuranic radionuclides at small amounts, causing the animals' life prolongation, heart mass entropy decreases.

The pressure and entropy of a unitary Fermi gas with particle-hole fluctuation

NASA Astrophysics Data System (ADS)

Gong, Hao; Ruan, Xiao-Xia; Zong, Hong-Shi

2018-01-01

We calculate the pressure and entropy of a unitary Fermi gas based on universal relations combined with our previous prediction of energy which was calculated within the framework of the non-self-consistent T-matrix approximation with particle-hole fluctuation. The resulting entropy and pressure are compared with the experimental data and the theoretical results without induced interaction. For entropy, we find good agreement between our results with particle-hole fluctuation and the experimental measurements reported by ENS group and MIT experiment. For pressure, our results suffer from a systematic upshift compared to MIT data.

Linking melodic expectation to expressive performance timing and perceived musical tension.

PubMed

Gingras, Bruno; Pearce, Marcus T; Goodchild, Meghan; Dean, Roger T; Wiggins, Geraint; McAdams, Stephen

2016-04-01

This research explored the relations between the predictability of musical structure, expressive timing in performance, and listeners' perceived musical tension. Studies analyzing the influence of expressive timing on listeners' affective responses have been constrained by the fact that, in most pieces, the notated durations limit performers' interpretive freedom. To circumvent this issue, we focused on the unmeasured prelude, a semi-improvisatory genre without notated durations. In Experiment 1, 12 professional harpsichordists recorded an unmeasured prelude on a harpsichord equipped with a MIDI console. Melodic expectation was assessed using a probabilistic model (IDyOM [Information Dynamics of Music]) whose expectations have been previously shown to match closely those of human listeners. Performance timing information was extracted from the MIDI data using a score-performance matching algorithm. Time-series analyses showed that, in a piece with unspecified note durations, the predictability of melodic structure measurably influenced tempo fluctuations in performance. In Experiment 2, another 10 harpsichordists, 20 nonharpsichordist musicians, and 20 nonmusicians listened to the recordings from Experiment 1 and rated the perceived tension continuously. Granger causality analyses were conducted to investigate predictive relations among melodic expectation, expressive timing, and perceived tension. Although melodic expectation, as modeled by IDyOM, modestly predicted perceived tension for all participant groups, neither of its components, information content or entropy, was Granger causal. In contrast, expressive timing was a strong predictor and was Granger causal. However, because melodic expectation was also predictive of expressive timing, our results outline a complete chain of influence from predictability of melodic structure via expressive performance timing to perceived musical tension. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Maximum entropy and equations of state for random cellular structures

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rivier, N.

Random, space-filling cellular structures (biological tissues, metallurgical grain aggregates, foams, etc.) are investigated. Maximum entropy inference under a few constraints yields structural equations of state, relating the size of cells to their topological shape. These relations are known empirically as Lewis's law in Botany, or Desch's relation in Metallurgy. Here, the functional form of the constraints is now known as a priori, and one takes advantage of this arbitrariness to increase the entropy further. The resulting structural equations of state are independent of priors, they are measurable experimentally and constitute therefore a direct test for the applicability of MaxEnt inferencemore » (given that the structure is in statistical equilibrium, a fact which can be tested by another simple relation (Aboav's law)). 23 refs., 2 figs., 1 tab.« less

The Entropy of Non-Ergodic Complex Systems — a Derivation from First Principles

NASA Astrophysics Data System (ADS)

Thurner, Stefan; Hanel, Rudolf

In information theory the 4 Shannon-Khinchin1,2 (SK) axioms determine Boltzmann Gibbs entropy, S -∑i pilog pi, as the unique entropy. Physics is different from information in the sense that physical systems can be non-ergodic or non-Markovian. To characterize such strongly interacting, statistical systems - complex systems in particular - within a thermodynamical framework it might be necessary to introduce generalized entropies. A series of such entropies have been proposed in the past decades. Until now the understanding of their fundamental origin and their deeper relations to complex systems remains unclear. To clarify the situation we note that non-ergodicity explicitly violates the fourth SK axiom. We show that by relaxing this axiom the entropy generalizes to, S ∑i Γ(d + 1, 1 - c log pi), where Γ is the incomplete Gamma function, and c and d are scaling exponents. All recently proposed entropies compatible with the first 3 SK axioms appear to be special cases. We prove that each statistical system is uniquely characterized by the pair of the two scaling exponents (c, d), which defines equivalence classes for all systems. The corresponding distribution functions are special forms of Lambert-W exponentials containing, as special cases, Boltzmann, stretched exponential and Tsallis distributions (power-laws) - all widely abundant in nature. This derivation is the first ab initio justification for generalized entropies. We next show how the phasespace volume of a system is related to its generalized entropy, and provide a concise criterion when it is not of Boltzmann-Gibbs type but assumes a generalized form. We show that generalized entropies only become relevant when the dynamically (statistically) relevant fraction of degrees of freedom in a system vanishes in the thermodynamic limit. These are systems where the bulk of the degrees of freedom is frozen. Systems governed by generalized entropies are therefore systems whose phasespace volume effectively collapses to a lower-dimensional 'surface'. We explicitly illustrate the situation for accelerating random walks, and a spin system on a constant-conectancy network. We argue that generalized entropies should be relevant for self-organized critical systems such as sand piles, for spin systems which form meta-structures such as vortices, domains, instantons, etc., and for problems associated with anomalous diffusion.

Microscopic origin of entropy-driven polymorphism in hybrid organic-inorganic perovskite materials

NASA Astrophysics Data System (ADS)

Butler, Keith T.; Svane, Katrine; Kieslich, Gregor; Cheetham, Anthony K.; Walsh, Aron

2016-11-01

Entropy is a critical, but often overlooked, factor in determining the relative stabilities of crystal phases. The importance of entropy is most pronounced in softer materials, where small changes in free energy can drive phase transitions, which has recently been demonstrated in the case of organic-inorganic hybrid-formate perovskites. In this Rapid Communication we demonstrate the interplay between composition and crystal structure that is responsible for the particularly pronounced role of entropy in determining polymorphism in hybrid organic-inorganic materials. Using ab initio based lattice dynamics, we probe the origins and effects of vibrational entropy of four archetype perovskite (A B X3 ) structures. We consider an inorganic material (SrTiO3), an A -site hybrid-halide material (CH3NH3) PbI3 , a X -site hybrid material KSr (BH4)3 , and a mixed A - and X -site hybrid-formate material (N2H5) Zn (HCO2)3 , comparing the differences in entropy between two common polymorphs. The results demonstrate the importance of low-frequency intermolecular modes in determining the phase stability in these materials. The understanding gained allows us to propose a general principle for the relative stability of different polymorphs of hybrid materials as temperature is increased.

Optimality and inference in hydrology from entropy production considerations: synthetic hillslope numerical experiments

NASA Astrophysics Data System (ADS)

Kollet, S. J.

2015-05-01

In this study, entropy production optimization and inference principles are applied to a synthetic semi-arid hillslope in high-resolution, physics-based simulations. The results suggest that entropy or power is indeed maximized, because of the strong nonlinearity of variably saturated flow and competing processes related to soil moisture fluxes, the depletion of gradients, and the movement of a free water table. Thus, it appears that the maximum entropy production (MEP) principle may indeed be applicable to hydrologic systems. In the application to hydrologic system, the free water table constitutes an important degree of freedom in the optimization of entropy production and may also relate the theory to actual observations. In an ensuing analysis, an attempt is made to transfer the complex, "microscopic" hillslope model into a macroscopic model of reduced complexity using the MEP principle as an interference tool to obtain effective conductance coefficients and forces/gradients. The results demonstrate a new approach for the application of MEP to hydrologic systems and may form the basis for fruitful discussions and research in future.

Interictal cardiorespiratory variability in temporal lobe and absence epilepsy in childhood.

PubMed

Varon, Carolina; Montalto, Alessandro; Jansen, Katrien; Lagae, Lieven; Marinazzo, Daniele; Faes, Luca; Van Huffel, Sabine

2015-04-01

It is well known that epilepsy has a profound effect on the autonomic nervous system, especially on the autonomic control of heart rate and respiration. This effect has been widely studied during seizure activity, but less attention has been given to interictal (i.e. seizure-free) activity. The studies that have been done on this topic, showed that heart rate and respiration can be affected individually, even without the occurrence of seizures. In this work, the interactions between these two individual physiological variables are analysed during interictal activity in temporal lobe and absence epilepsy in childhood. These interactions are assessed by decomposing the predictive information about heart rate variability, into different components like the transfer entropy, cross-entropy, self- entropy and the conditional self entropy. Each one of these components quantifies different types of shared information. However, when using the cross-entropy and the conditional self entropy, it is possible to split the information carried by the heart rate, into two main components, one related to respiration and one related to different mechanisms, like sympathetic activation. This can be done after assuming a directional link going from respiration to heart rate. After analysing all the entropy components, it is shown that in subjects with absence epilepsy the information shared by respiration and heart rate is significantly lower than for normal subjects. And a more remarkable finding indicates that this type of epilepsy seems to have a long term effect on the cardiac and respiratory control mechanisms of the autonomic nervous system.

Entropic nonadditivity, H theorem, and nonlinear Klein-Kramers equations.

PubMed

Dos Santos, M A F; Lenzi, E K

2017-11-01

We use the H theorem to establish the entropy and the entropic additivity law for a system composed of subsystems, with the dynamics governed by the Klein-Kramers equations, by considering relations among the dynamics of these subsystems and their entropies. We start considering the subsystems governed by linear Klein-Kramers equations and verify that the Boltzmann-Gibbs entropy is appropriated to this dynamics, leading us to the standard entropic additivity, S_{BG}^{(1∪2)}=S_{BG}^{1}+S_{BG}^{2}, consistent with the fact that the distributions of the subsystem are independent. We then extend the dynamics of these subsystems to independent nonlinear Klein-Kramers equations. For this case, the results show that the H theorem is verified for a generalized entropy, which does not preserve the standard entropic additivity for independent distributions. In this scenario, consistent results are obtained when a suitable coupling among the nonlinear Klein-Kramers equations is considered, in which each subsystem modifies the other until an equilibrium state is reached. This dynamics, for the subsystems, results in the Tsallis entropy for the system and, consequently, verifies the relation S_{q}^{(1∪2)}=S_{q}^{1}+S_{q}^{2}+(1-q)S_{q}^{1}S_{q}^{2}/k, which is a nonadditive entropic relation.

Respiration and heart rate complexity: Effects of age and gender assessed by band-limited transfer entropy

PubMed Central

Nemati, Shamim; Edwards, Bradley A.; Lee, Joon; Pittman-Polletta, Benjamin; Butler, James P.; Malhotra, Atul

2013-01-01

Aging and disease are accompanied with a reduction of complex variability in the temporal patterns of heart rate. This reduction has been attributed to a break down of the underlying regulatory feedback mechanisms that maintain a homeodynamic state. Previous work has established the utility of entropy as an index of disorder, for quantification of changes in heart rate complexity. However, questions remain regarding the origin of heart rate complexity and the mechanisms involved in its reduction with aging and disease. In this work we use a newly developed technique based on the concept of band-limited transfer entropy to assess the aging-related changes in contribution of respiration and blood pressure to entropy of heart rate at different frequency bands. Noninvasive measurements of heart beat interval, respiration, and systolic blood pressure were recorded from 20 young (21–34 years) and 20 older (68–85 years) healthy adults. Band-limited transfer entropy analysis revealed a reduction in high-frequency contribution of respiration to heart rate complexity (p < 0.001) with normal aging, particularly in men. These results have the potential for dissecting the relative contributions of respiration and blood pressure-related reflexes to heart rate complexity and their degeneration with normal aging. PMID:23811194

Informational temperature concept and the nature of self-organization

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lin, Shu-Kun

1996-12-31

Self-organization phenomena are spontaneous processes. Their behavior should be governed by the second law of thermodynamics. The dissipative structure theory of the Prigogine school of thermodynamics claims that {open_quotes}order out of chaos{close_quotes} through {open_quotes}self-organization{close_quotes} and challenges the validity of the second law of thermodynamics. Unfortunately this theory is questionable. Therefore we have to reconsider the related fundamental theoretical problems. Informational entropy (S) and information (I) are related by S = S{sub max} - I, where S{sub max} is the maximum informational entropy. This conforms with the broadly accepted definition that entropy is the information loss. As informational entropy concept hasmore » been proved to be useful, it will be convenient to define an informational temperature, T{sub I}. This can be related to energy E and the informational entropy S. Information registration is a process of {Delta}I > 0, or {Delta}S < 0, and involves the energetically excited states ({Delta}E > 0). Therefore, T{sub I} is negative, and has the opposite sign of the conventional thermodynamic temperature, T. This concept is useful for clarifying the concepts of {open_quotes}order{close_quotes} and {open_quotes}disorder{close_quotes} of static structures and characterizing many typical information loss processes of self-organization.« less

Wavelet entropy of BOLD time series: An application to Rolandic epilepsy.

PubMed

Gupta, Lalit; Jansen, Jacobus F A; Hofman, Paul A M; Besseling, René M H; de Louw, Anton J A; Aldenkamp, Albert P; Backes, Walter H

2017-12-01

To assess the wavelet entropy for the characterization of intrinsic aberrant temporal irregularities in the time series of resting-state blood-oxygen-level-dependent (BOLD) signal fluctuations. Further, to evaluate the temporal irregularities (disorder/order) on a voxel-by-voxel basis in the brains of children with Rolandic epilepsy. The BOLD time series was decomposed using the discrete wavelet transform and the wavelet entropy was calculated. Using a model time series consisting of multiple harmonics and nonstationary components, the wavelet entropy was compared with Shannon and spectral (Fourier-based) entropy. As an application, the wavelet entropy in 22 children with Rolandic epilepsy was compared to 22 age-matched healthy controls. The images were obtained by performing resting-state functional magnetic resonance imaging (fMRI) using a 3T system, an 8-element receive-only head coil, and an echo planar imaging pulse sequence ( T2*-weighted). The wavelet entropy was also compared to spectral entropy, regional homogeneity, and Shannon entropy. Wavelet entropy was found to identify the nonstationary components of the model time series. In Rolandic epilepsy patients, a significantly elevated wavelet entropy was observed relative to controls for the whole cerebrum (P = 0.03). Spectral entropy (P = 0.41), regional homogeneity (P = 0.52), and Shannon entropy (P = 0.32) did not reveal significant differences. The wavelet entropy measure appeared more sensitive to detect abnormalities in cerebral fluctuations represented by nonstationary effects in the BOLD time series than more conventional measures. This effect was observed in the model time series as well as in Rolandic epilepsy. These observations suggest that the brains of children with Rolandic epilepsy exhibit stronger nonstationary temporal signal fluctuations than controls. 2 Technical Efficacy: Stage 3 J. Magn. Reson. Imaging 2017;46:1728-1737. © 2017 International Society for Magnetic Resonance in Medicine.

An estimator for the relative entropy rate of path measures for stochastic differential equations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Opper, Manfred, E-mail: manfred.opper@tu-berlin.de

2017-02-01

We address the problem of estimating the relative entropy rate (RER) for two stochastic processes described by stochastic differential equations. For the case where the drift of one process is known analytically, but one has only observations from the second process, we use a variational bound on the RER to construct an estimator.

Entanglement entropy of the Q≥4 quantum Potts chain.

PubMed

Lajkó, Péter; Iglói, Ferenc

2017-01-01

The entanglement entropy S is an indicator of quantum correlations in the ground state of a many-body quantum system. At a second-order quantum phase-transition point in one dimension S generally has a logarithmic singularity. Here we consider quantum spin chains with a first-order quantum phase transition, the prototype being the Q-state quantum Potts chain for Q>4 and calculate S across the transition point. According to numerical, density matrix renormalization group results at the first-order quantum phase transition point S shows a jump, which is expected to vanish for Q→4^{+}. This jump is calculated in leading order as ΔS=lnQ[1-4/Q-2/(QlnQ)+O(1/Q^{2})].

Reply to "Comment on 'Quantum Kaniadakis entropy under projective measurement' ".

PubMed

Ourabah, Kamel; Tribeche, Mouloud

2016-08-01

We rely on our proof of the nondecreasing character of quantum Kaniadakis entropy under projective measurement [Phys. Rev. E 92, 032114 (2015)PLEEE81539-375510.1103/PhysRevE.92.032114], and we put it into perspective with the results of Bosyk et al. [Quantum Inf Process 15, 3393 (2016)10.1007/s11128-016-1329-5]. Our method, adopted for the proof that Kaniadakis entropy does not decrease under a projective measurement, is based on Jensen's inequalities, while the method proposed by the authors of the Comment represents another alternative and clearly correct method to prove the same thing. Furthermore, we clarify that our interest in Kaniadakis entropy is due to the fact that this entropy has a transparent physical significance, emerging within the special relativity.

Applications of quantum entropy to statistics

NASA Astrophysics Data System (ADS)

Silver, R. N.; Martz, H. F.

This paper develops two generalizations of the maximum entropy (ME) principle. First, Shannon classical entropy is replaced by von Neumann quantum entropy to yield a broader class of information divergences (or penalty functions) for statistics applications. Negative relative quantum entropy enforces convexity, positivity, non-local extensivity and prior correlations such as smoothness. This enables the extension of ME methods from their traditional domain of ill-posed in-verse problems to new applications such as non-parametric density estimation. Second, given a choice of information divergence, a combination of ME and Bayes rule is used to assign both prior and posterior probabilities. Hyperparameters are interpreted as Lagrange multipliers enforcing constraints. Conservation principles are proposed to act statistical regularization and other hyperparameters, such as conservation of information and smoothness. ME provides an alternative to hierarchical Bayes methods.

Entropy density of an adiabatic relativistic Bose-Einstein condensate star

DOE Office of Scientific and Technical Information (OSTI.GOV)

Khaidir, Ahmad Firdaus; Kassim, Hasan Abu; Yusof, Norhasliza

Inspired by recent works, we investigate how the thermodynamics parameters (entropy, temperature, number density, energy density, etc) of Bose-Einstein Condensate star scale with the structure of the star. Below the critical temperature in which the condensation starts to occur, we study how the entropy behaves with varying temperature till it reaches its own stability against gravitational collapse and singularity. Compared to photon gases (pressure is described by radiation) where the chemical potential, μ is zero, entropy of photon gases obeys the Stefan-Boltzmann Law for a small values of T while forming a spiral structure for a large values of Tmore » due to general relativity. The entropy density of Bose-Einstein Condensate is obtained following the similar sequence but limited under critical temperature condition. We adopt the scalar field equation of state in Thomas-Fermi limit to study the characteristics of relativistic Bose-Einstein condensate under varying temperature and entropy. Finally, we obtain the entropy density proportional to (σT{sup 3}-3T) which obeys the Stefan-Boltzmann Law in ultra-relativistic condition.« less

All the entropies on the light-cone

NASA Astrophysics Data System (ADS)

Casini, Horacio; Testé, Eduardo; Torroba, Gonzalo

2018-05-01

We determine the explicit universal form of the entanglement and Renyi entropies, for regions with arbitrary boundary on a null plane or the light-cone. All the entropies are shown to saturate the strong subadditive inequality. This Renyi Markov property implies that the vacuum behaves like a product state. For the null plane, our analysis applies to general quantum field theories, and we show that the entropies do not depend on the region. For the light-cone, our approach is restricted to conformal field theories. In this case, the construction of the entropies is related to dilaton effective actions in two less dimensions. In particular, the universal logarithmic term in the entanglement entropy arises from a Wess-Zumino anomaly action. We also consider these properties in theories with holographic duals, for which we construct the minimal area surfaces for arbitrary shapes on the light-cone. We recover the Markov property and the universal form of the entropy, and argue that these properties continue to hold upon including stringy and quantum corrections. We end with some remarks on the recently proved entropic a-theorem in four spacetime dimensions.

Entanglement entropy in critical phenomena and analog models of quantum gravity

NASA Astrophysics Data System (ADS)

Fursaev, Dmitri V.

2006-06-01

A general geometrical structure of the entanglement entropy for spatial partition of a relativistic QFT system is established by using methods of the effective gravity action and the spectral geometry. A special attention is payed to the subleading terms in the entropy in different dimensions and to behavior in different states. It is conjectured, on the base of relation between the entropy and the action, that in a fundamental theory the ground state entanglement entropy per unit area equals 1/(4GN), where GN is the Newton constant in the low-energy gravity sector of the theory. The conjecture opens a new avenue in analogue gravity models. For instance, in higher-dimensional condensed matter systems, which near a critical point are described by relativistic QFT’s, the entanglement entropy density defines an effective gravitational coupling. By studying the properties of this constant one can get new insights in quantum gravity phenomena, such as the universality of the low-energy physics, the renormalization group behavior of GN, the statistical meaning of the Bekenstein-Hawking entropy.

Using Link Disconnection Entropy Disorder to Detect Fast Moving Nodes in MANETs.

PubMed

Alvarez, Carlos F; Palafox, Luis E; Aguilar, Leocundo; Sanchez, Mauricio A; Martinez, Luis G

2016-01-01

Mobile ad-hoc networks (MANETs) are dynamic by nature; this dynamism comes from node mobility, traffic congestion, and other transmission conditions. Metrics to evaluate the effects of those conditions shine a light on node's behavior in an ad-hoc network, helping to identify the node or nodes with better conditions of connection. In this paper, we propose a relative index to evaluate a single node reliability, based on the link disconnection entropy disorder using neighboring nodes as reference. Link disconnection entropy disorder is best used to identify fast moving nodes or nodes with unstable communications, this without the need of specialized sensors such as GPS. Several scenarios were studied to verify the index, measuring the effects of Speed and traffic density on the link disconnection entropy disorder. Packet delivery ratio is associated to the metric detecting a strong relationship, enabling the use of the link disconnection entropy disorder to evaluate the stability of a node to communicate with other nodes. To expand the utilization of the link entropy disorder, we identified nodes with higher speeds in network simulations just by using the link entropy disorder.

Cleavage Entropy as Quantitative Measure of Protease Specificity

PubMed Central

Fuchs, Julian E.; von Grafenstein, Susanne; Huber, Roland G.; Margreiter, Michael A.; Spitzer, Gudrun M.; Wallnoefer, Hannes G.; Liedl, Klaus R.

2013-01-01

A purely information theory-guided approach to quantitatively characterize protease specificity is established. We calculate an entropy value for each protease subpocket based on sequences of cleaved substrates extracted from the MEROPS database. We compare our results with known subpocket specificity profiles for individual proteases and protease groups (e.g. serine proteases, metallo proteases) and reflect them quantitatively. Summation of subpocket-wise cleavage entropy contributions yields a measure for overall protease substrate specificity. This total cleavage entropy allows ranking of different proteases with respect to their specificity, separating unspecific digestive enzymes showing high total cleavage entropy from specific proteases involved in signaling cascades. The development of a quantitative cleavage entropy score allows an unbiased comparison of subpocket-wise and overall protease specificity. Thus, it enables assessment of relative importance of physicochemical and structural descriptors in protease recognition. We present an exemplary application of cleavage entropy in tracing substrate specificity in protease evolution. This highlights the wide range of substrate promiscuity within homologue proteases and hence the heavy impact of a limited number of mutations on individual substrate specificity. PMID:23637583

Higher Curvature Gravity from Entanglement in Conformal Field Theories.

PubMed

Haehl, Felix M; Hijano, Eliot; Parrikar, Onkar; Rabideau, Charles

2018-05-18

By generalizing different recent works to the context of higher curvature gravity, we provide a unifying framework for three related results: (i) If an asymptotically anti-de Sitter (AdS) spacetime computes the entanglement entropies of ball-shaped regions in a conformal field theory using a generalized Ryu-Takayanagi formula up to second order in state deformations around the vacuum, then the spacetime satisfies the correct gravitational equations of motion up to second order around the AdS background. (ii) The holographic dual of entanglement entropy in higher curvature theories of gravity is given by the Wald entropy plus a particular correction term involving extrinsic curvatures. (iii) Conformal field theory relative entropy is dual to gravitational canonical energy (also in higher curvature theories of gravity). Especially for the second point, our novel derivation of this previously known statement does not involve the Euclidean replica trick.

Higher Curvature Gravity from Entanglement in Conformal Field Theories

NASA Astrophysics Data System (ADS)

Haehl, Felix M.; Hijano, Eliot; Parrikar, Onkar; Rabideau, Charles

2018-05-01

By generalizing different recent works to the context of higher curvature gravity, we provide a unifying framework for three related results: (i) If an asymptotically anti-de Sitter (AdS) spacetime computes the entanglement entropies of ball-shaped regions in a conformal field theory using a generalized Ryu-Takayanagi formula up to second order in state deformations around the vacuum, then the spacetime satisfies the correct gravitational equations of motion up to second order around the AdS background. (ii) The holographic dual of entanglement entropy in higher curvature theories of gravity is given by the Wald entropy plus a particular correction term involving extrinsic curvatures. (iii) Conformal field theory relative entropy is dual to gravitational canonical energy (also in higher curvature theories of gravity). Especially for the second point, our novel derivation of this previously known statement does not involve the Euclidean replica trick.

Hawking radiation and entropy of a black hole in Lovelock-Born-Infeld gravity from the quantum tunneling approach

NASA Astrophysics Data System (ADS)

Li, Gu-Qiang

2017-04-01

The tunneling radiation of particles from black holes in Lovelock-Born-Infeld (LBI) gravity is studied by using the Parikh-Wilczek (PW) method, and the emission rate of a particle is calculated. It is shown that the emission spectrum deviates from the purely thermal spectrum but is consistent with an underlying unitary theory. Compared to the conventional tunneling rate related to the increment of black hole entropy, the entropy of the black hole in LBI gravity is obtained. The entropy does not obey the area law unless all the Lovelock coefficients equal zero, but it satisfies the first law of thermodynamics and is in accordance with earlier results. It is distinctly shown that the PW tunneling framework is related to the thermodynamic laws of the black hole. Supported by Guangdong Natural Science Foundation (2016A030307051, 2015A030313789)

Brain entropy and human intelligence: A resting-state fMRI study

PubMed Central

Calderone, Daniel; Morales, Leah J.

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns. PMID:29432427

Brain entropy and human intelligence: A resting-state fMRI study.

PubMed

Saxe, Glenn N; Calderone, Daniel; Morales, Leah J

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns.

Entropy Production and Fluctuation Theorems for Active Matter

NASA Astrophysics Data System (ADS)

Mandal, Dibyendu; Klymko, Katherine; DeWeese, Michael R.

2017-12-01

Active biological systems reside far from equilibrium, dissipating heat even in their steady state, thus requiring an extension of conventional equilibrium thermodynamics and statistical mechanics. In this Letter, we have extended the emerging framework of stochastic thermodynamics to active matter. In particular, for the active Ornstein-Uhlenbeck model, we have provided consistent definitions of thermodynamic quantities such as work, energy, heat, entropy, and entropy production at the level of single, stochastic trajectories and derived related fluctuation relations. We have developed a generalization of the Clausius inequality, which is valid even in the presence of the non-Hamiltonian dynamics underlying active matter systems. We have illustrated our results with explicit numerical studies.

Topological nearly entropy

NASA Astrophysics Data System (ADS)

Gulamsarwar, Syazwani; Salleh, Zabidin

2017-08-01

The purpose of this paper is to generalize the notions of Adler's topological entropy along with their several fundamental properties. A function f : X → Y is said to be R-map if f-1 (V) is regular open in X for every regular open set V in Y. Thus, we initiated a notion of topological nearly entropy for topological R-dynamical systems which is based on nearly compact relative to the space by using R-map.

Local entropy difference upon a substrate binding of a psychrophilic α-amylase and a mesophilic homologue

NASA Astrophysics Data System (ADS)

Kosugi, Takahiro; Hayashi, Shigehiko

2011-01-01

Psychrophilic α-amylase from the antarctic bacterium pseudoalteromonashaloplanktis (AHA) and its mesophilic homologue, porcine pancreatic α-amylase (PPA) are theoretically investigated with molecular dynamics (MD) simulations. We carried out 240-ns MD simulations for four systems, AHA and PPA with/without the bound substrate, and examined protein conformational entropy changes upon the substrate binding. We developed an analysis that decomposes the entropy changes into contributions of individual amino acids, and successfully identified protein regions responsible for the entropy changes. The results provide a molecular insight into the structural flexibilities of those enzymes related to the temperature dependences of the enzymatic activity.

The Shannon entropy as a measure of diffusion in multidimensional dynamical systems

NASA Astrophysics Data System (ADS)

Giordano, C. M.; Cincotta, P. M.

2018-05-01

In the present work, we introduce two new estimators of chaotic diffusion based on the Shannon entropy. Using theoretical, heuristic and numerical arguments, we show that the entropy, S, provides a measure of the diffusion extent of a given small initial ensemble of orbits, while an indicator related with the time derivative of the entropy, S', estimates the diffusion rate. We show that in the limiting case of near ergodicity, after an appropriate normalization, S' coincides with the standard homogeneous diffusion coefficient. The very first application of this formulation to a 4D symplectic map and to the Arnold Hamiltonian reveals very successful and encouraging results.

Charged Rényi entropies in CFTs with Einstein-Gauss-Bonnet holographic duals

NASA Astrophysics Data System (ADS)

Pastras, Georgios; Manolopoulos, Dimitrios

2014-11-01

We calculate the Rényi entropy S q ( μ, λ), for spherical entangling surfaces in CFT's with Einstein-Gauss-Bonnet-Maxwell holographic duals. Rényi entropies must obey some interesting inequalities by definition. However, for Gauss-Bonnet couplings λ, larger than specific value, but still allowed by causality, we observe a violation of the inequality , which is related to the existence of negative entropy black holes, providing interesting restrictions in the bulk theory. Moreover, we find an interesting distinction of the behaviour of the analytic continuation of S q ( μ, λ) for imaginary chemical potential, between negative and non-negative λ.

Continuous time wavelet entropy of auditory evoked potentials.

PubMed

Cek, M Emre; Ozgoren, Murat; Savaci, F Acar

2010-01-01

In this paper, the continuous time wavelet entropy (CTWE) of auditory evoked potentials (AEP) has been characterized by evaluating the relative wavelet energies (RWE) in specified EEG frequency bands. Thus, the rapid variations of CTWE due to the auditory stimulation could be detected in post-stimulus time interval. This approach removes the probability of missing the information hidden in short time intervals. The discrete time and continuous time wavelet based wavelet entropy variations were compared on non-target and target AEP data. It was observed that CTWE can also be an alternative method to analyze entropy as a function of time. 2009 Elsevier Ltd. All rights reserved.

Formulating the shear stress distribution in circular open channels based on the Renyi entropy

NASA Astrophysics Data System (ADS)

Khozani, Zohreh Sheikh; Bonakdari, Hossein

2018-01-01

The principle of maximum entropy is employed to derive the shear stress distribution by maximizing the Renyi entropy subject to some constraints and by assuming that dimensionless shear stress is a random variable. A Renyi entropy-based equation can be used to model the shear stress distribution along the entire wetted perimeter of circular channels and circular channels with flat beds and deposited sediments. A wide range of experimental results for 12 hydraulic conditions with different Froude numbers (0.375 to 1.71) and flow depths (20.3 to 201.5 mm) were used to validate the derived shear stress distribution. For circular channels, model performance enhanced with increasing flow depth (mean relative error (RE) of 0.0414) and only deteriorated slightly at the greatest flow depth (RE of 0.0573). For circular channels with flat beds, the Renyi entropy model predicted the shear stress distribution well at lower sediment depth. The Renyi entropy model results were also compared with Shannon entropy model results. Both models performed well for circular channels, but for circular channels with flat beds the Renyi entropy model displayed superior performance in estimating the shear stress distribution. The Renyi entropy model was highly precise and predicted the shear stress distribution in a circular channel with RE of 0.0480 and in a circular channel with a flat bed with RE of 0.0488.

The Impact of Entropy on the Spatial Organization of Synaptonemal Complexes within the Cell Nucleus

PubMed Central

Fritsche, Miriam; Reinholdt, Laura G.; Lessard, Mark; Handel, Mary Ann; Bewersdorf, Jörg; Heermann, Dieter W.

2012-01-01

We employ 4Pi-microscopy to study SC organization in mouse spermatocyte nuclei allowing for the three-dimensional reconstruction of the SC's backbone arrangement. Additionally, we model the SCs in the cell nucleus by confined, self-avoiding polymers, whose chain ends are attached to the envelope of the confining cavity and diffuse along it. This work helps to elucidate the role of entropy in shaping pachytene SC organization. The framework provided by the complex interplay between SC polymer rigidity, tethering and confinement is able to qualitatively explain features of SC organization, such as mean squared end-to-end distances, mean squared center-of-mass distances, or SC density distributions. However, it fails in correctly assessing SC entanglement within the nucleus. In fact, our analysis of the 4Pi-microscopy images reveals a higher ordering of SCs within the nuclear volume than what is expected by our numerical model. This suggests that while effects of entropy impact SC organization, the dedicated action of proteins or actin cables is required to fine-tune the spatial ordering of SCs within the cell nucleus. PMID:22574147

UniEnt: uniform entropy model for the dynamics of a neuronal population

NASA Astrophysics Data System (ADS)

Hernandez Lahme, Damian; Nemenman, Ilya

Sensory information and motor responses are encoded in the brain in a collective spiking activity of a large number of neurons. Understanding the neural code requires inferring statistical properties of such collective dynamics from multicellular neurophysiological recordings. Questions of whether synchronous activity or silence of multiple neurons carries information about the stimuli or the motor responses are especially interesting. Unfortunately, detection of such high order statistical interactions from data is especially challenging due to the exponentially large dimensionality of the state space of neural collectives. Here we present UniEnt, a method for the inference of strengths of multivariate neural interaction patterns. The method is based on the Bayesian prior that makes no assumptions (uniform a priori expectations) about the value of the entropy of the observed multivariate neural activity, in contrast to popular approaches that maximize this entropy. We then study previously published multi-electrode recordings data from salamander retina, exposing the relevance of higher order neural interaction patterns for information encoding in this system. This work was supported in part by Grants JSMF/220020321 and NSF/IOS/1208126.

Unresolved Problems by Shock Capturing: Taming the Overheating Problem

NASA Technical Reports Server (NTRS)

Liou, Meng-Sing

2012-01-01

The overheating problem, first observed by von Neumann [1] and later studied extensively by Noh [2] using both Eulerian and Lagrangian formulations, remains to be one of the unsolved problems by shock capturing. It is historically well known to occur when a flow is under compression, such as when a shock wave hits and reflects from a wall or when two streams collides with each other. The overheating phenomenon is also found numerically in a smooth flow undergoing rarefaction created by two streams receding from each other. This is in contrary to one s intuition expecting a decrease in internal energy. The excessive amount in the temperature increase does not reduce by refining the mesh size or increasing the order of accuracy. This study finds that the overheating in the receding flow correlates with the entropy generation. By requiring entropy preservation, the overheating is eliminated and the solution is grid convergent. The shock-capturing scheme, as being practiced today, gives rise to the entropy generation, which in turn causes the overheating. This assertion stands up to the convergence test.

Heat capacty, relative enthalpy, and calorimetric entropy of silicate minerals: an empirical method of prediction.

USGS Publications Warehouse

Robinson, G.R.; Haas, J.L.

1983-01-01

Through the evaluation of experimental calorimetric data and estimates of the molar isobaric heat capacities, relative enthalpies and entropies of constituent oxides, a procedure for predicting the thermodynamic properties of silicates is developed. Estimates of the accuracy and precision of the technique and examples of its application are also presented. -J.A.Z.

Safety Assessment of Dangerous Goods Transport Enterprise Based on the Relative Entropy Aggregation in Group Decision Making Model

PubMed Central

Wu, Jun; Li, Chengbing; Huo, Yueying

2014-01-01

Safety of dangerous goods transport is directly related to the operation safety of dangerous goods transport enterprise. Aiming at the problem of the high accident rate and large harm in dangerous goods logistics transportation, this paper took the group decision making problem based on integration and coordination thought into a multiagent multiobjective group decision making problem; a secondary decision model was established and applied to the safety assessment of dangerous goods transport enterprise. First of all, we used dynamic multivalue background and entropy theory building the first level multiobjective decision model. Secondly, experts were to empower according to the principle of clustering analysis, and combining with the relative entropy theory to establish a secondary rally optimization model based on relative entropy in group decision making, and discuss the solution of the model. Then, after investigation and analysis, we establish the dangerous goods transport enterprise safety evaluation index system. Finally, case analysis to five dangerous goods transport enterprises in the Inner Mongolia Autonomous Region validates the feasibility and effectiveness of this model for dangerous goods transport enterprise recognition, which provides vital decision making basis for recognizing the dangerous goods transport enterprises. PMID:25477954

Safety assessment of dangerous goods transport enterprise based on the relative entropy aggregation in group decision making model.

PubMed

Wu, Jun; Li, Chengbing; Huo, Yueying

2014-01-01

Safety of dangerous goods transport is directly related to the operation safety of dangerous goods transport enterprise. Aiming at the problem of the high accident rate and large harm in dangerous goods logistics transportation, this paper took the group decision making problem based on integration and coordination thought into a multiagent multiobjective group decision making problem; a secondary decision model was established and applied to the safety assessment of dangerous goods transport enterprise. First of all, we used dynamic multivalue background and entropy theory building the first level multiobjective decision model. Secondly, experts were to empower according to the principle of clustering analysis, and combining with the relative entropy theory to establish a secondary rally optimization model based on relative entropy in group decision making, and discuss the solution of the model. Then, after investigation and analysis, we establish the dangerous goods transport enterprise safety evaluation index system. Finally, case analysis to five dangerous goods transport enterprises in the Inner Mongolia Autonomous Region validates the feasibility and effectiveness of this model for dangerous goods transport enterprise recognition, which provides vital decision making basis for recognizing the dangerous goods transport enterprises.

Coarse-graining errors and numerical optimization using a relative entropy framework.

PubMed

Chaimovich, Aviel; Shell, M Scott

2011-03-07

The ability to generate accurate coarse-grained models from reference fully atomic (or otherwise "first-principles") ones has become an important component in modeling the behavior of complex molecular systems with large length and time scales. We recently proposed a novel coarse-graining approach based upon variational minimization of a configuration-space functional called the relative entropy, S(rel), that measures the information lost upon coarse-graining. Here, we develop a broad theoretical framework for this methodology and numerical strategies for its use in practical coarse-graining settings. In particular, we show that the relative entropy offers tight control over the errors due to coarse-graining in arbitrary microscopic properties, and suggests a systematic approach to reducing them. We also describe fundamental connections between this optimization methodology and other coarse-graining strategies like inverse Monte Carlo, force matching, energy matching, and variational mean-field theory. We suggest several new numerical approaches to its minimization that provide new coarse-graining strategies. Finally, we demonstrate the application of these theoretical considerations and algorithms to a simple, instructive system and characterize convergence and errors within the relative entropy framework. © 2011 American Institute of Physics.

The Role of the Total Entropy Production in the Dynamics of Open Quantum Systems in Detection of Non-Markovianity

NASA Astrophysics Data System (ADS)

Salimi, S.; Haseli, S.; Khorashad, A. S.; Adabi, F.

2016-09-01

The interaction between system and environment is a fundamental concept in the theory of open quantum systems. As a result of the interaction, an amount of correlation (both classical and quantum) emerges between the system and the environment. In this work, we recall the quantity that will be very useful to describe the emergence of the correlation between the system and the environment, namely, the total entropy production. Appearance of total entropy production is due to the entanglement production between the system and the environment. In this work, we discuss about the role of the total entropy production for detecting the non-Markovianity. By utilizing the relation between the total entropy production and total correlation between subsystems, one can see a temporary decrease of total entropy production is a signature of non-Markovianity. We apply our criterion for the special case, where the composite system has initial correlation with environment.

Good Use of a `Bad' Metaphor. Entropy as Disorder

NASA Astrophysics Data System (ADS)

Haglund, Jesper

2017-05-01

Entropy is often introduced to students through the use of the disorder metaphor. However, many weaknesses and limitations of this metaphor have been identified, and it has therefore been argued that it is more harmful than useful in teaching. For instance, under the influence of the disorder metaphor, students tend to focus on spatial configuration with regard to entropy but disregard the role of energy, which may lead their intuition astray in problem solving. Albeit so, a review of research of students' ideas about entropy in relation to the disorder metaphor shows that students can use the metaphor in developing a more nuanced, complex view of the concept, by connecting entropy as disorder to other concepts such as microstates and spreading. The disorder metaphor—in combination with other explanatory approaches—can be used as a resource for learning, in giving students an early flavour of what entropy means, so long as we acknowledge its limitations; we can put this "bad" metaphor to good use in teaching.

Competition between conceptual relations affects compound recognition: the role of entropy.

PubMed

Schmidtke, Daniel; Kuperman, Victor; Gagné, Christina L; Spalding, Thomas L

2016-04-01

Previous research has suggested that the conceptual representation of a compound is based on a relational structure linking the compound's constituents. Existing accounts of the visual recognition of modifier-head or noun-noun compounds posit that the process involves the selection of a relational structure out of a set of competing relational structures associated with the same compound. In this article, we employ the information-theoretic metric of entropy to gauge relational competition and investigate its effect on the visual identification of established English compounds. The data from two lexical decision megastudies indicates that greater entropy (i.e., increased competition) in a set of conceptual relations associated with a compound is associated with longer lexical decision latencies. This finding indicates that there exists competition between potential meanings associated with the same complex word form. We provide empirical support for conceptual composition during compound word processing in a model that incorporates the effect of the integration of co-activated and competing relational information.

Multidimensional entropic uncertainty relation based on a commutator matrix in position and momentum spaces

NASA Astrophysics Data System (ADS)

Hertz, Anaelle; Vanbever, Luc; Cerf, Nicolas J.

2018-01-01

The uncertainty relation for continuous variables due to Byałinicki-Birula and Mycielski [I. Białynicki-Birula and J. Mycielski, Commun. Math. Phys. 44, 129 (1975), 10.1007/BF01608825] expresses the complementarity between two n -tuples of canonically conjugate variables (x1,x2,...,xn) and (p1,p2,...,pn) in terms of Shannon differential entropy. Here we consider the generalization to variables that are not canonically conjugate and derive an entropic uncertainty relation expressing the balance between any two n -variable Gaussian projective measurements. The bound on entropies is expressed in terms of the determinant of a matrix of commutators between the measured variables. This uncertainty relation also captures the complementarity between any two incompatible linear canonical transforms, the bound being written in terms of the corresponding symplectic matrices in phase space. Finally, we extend this uncertainty relation to Rényi entropies and also prove a covariance-based uncertainty relation which generalizes the Robertson relation.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bialynicki-Birula, Iwo

Quantum-mechanical uncertainty relations for position and momentum are expressed in the form of inequalities involving the Renyi entropies. The proof of these inequalities requires the use of the exact expression for the (p,q)-norm of the Fourier transformation derived by Babenko and Beckner. Analogous uncertainty relations are derived for angle and angular momentum and also for a pair of complementary observables in N-level systems. All these uncertainty relations become more attractive when expressed in terms of the symmetrized Renyi entropies.

Implications of climate change for bird conservation in the southwestern U.S

Treesearch

Megan M. Friggens; Deborah M. Finch

2015-01-01

Future expected changes in climate and human activity threaten many riparian habitats, particularly in the southwestern U.S. Using Maximum Entropy (MaxEnt3.3.3) modeling, we characterized habitat relationships and generated spatial predictions of habitat suitability for the Lucy’s warbler (Oreothlypis luciae), the Southwestern willow flycatcher (Empidonax...

Mixing times towards demographic equilibrium in insect populations with temperature variable age structures.

PubMed

Damos, Petros

2015-08-01

In this study, we use entropy related mixing rate modules to measure the effects of temperature on insect population stability and demographic breakdown. The uncertainty in the age of the mother of a randomly chosen newborn, and how it is moved after a finite act of time steps, is modeled using a stochastic transformation of the Leslie matrix. Age classes are represented as a cycle graph and its transitions towards the stable age distribution are brought forth as an exact Markov chain. The dynamics of divergence, from a non equilibrium state towards equilibrium, are evaluated using the Kolmogorov-Sinai entropy. Moreover, Kullback-Leibler distance is applied as information-theoretic measure to estimate exact mixing times of age transitions probabilities towards equilibrium. Using empirically data, we show that on the initial conditions and simulated projection's trough time, that population entropy can effectively be applied to detect demographic variability towards equilibrium under different temperature conditions. Changes in entropy are correlated with the fluctuations of the insect population decay rates (i.e. demographic stability towards equilibrium). Moreover, shorter mixing times are directly linked to lower entropy rates and vice versa. This may be linked to the properties of the insect model system, which in contrast to warm blooded animals has the ability to greatly change its metabolic and demographic rates. Moreover, population entropy and the related distance measures that are applied, provide a means to measure these rates. The current results and model projections provide clear biological evidence why dynamic population entropy may be useful to measure population stability. Copyright © 2015 Elsevier Inc. All rights reserved.

Beyond the classical theory of heat conduction: a perspective view of future from entropy

PubMed Central

Lai, Xiang; Zhu, Pingan

2016-01-01

Energy is conserved by the first law of thermodynamics; its quality degrades constantly due to entropy generation, by the second law of thermodynamics. It is thus important to examine the entropy generation regarding the way to reduce its magnitude and the limit of entropy generation as time tends to infinity regarding whether it is bounded or not. This work initiates such an analysis with one-dimensional heat conduction. The work not only offers some fundamental insights of universe and its future, but also builds up the relation between the second law of thermodynamics and mathematical inequalities via developing the latter of either new or classical nature. A concise review of entropy is also included for the interest of performing the analysis in this work and the similar analysis for other processes in the future. PMID:27843400

Relationship between dynamical entropy and energy dissipation far from thermodynamic equilibrium.

PubMed

Green, Jason R; Costa, Anthony B; Grzybowski, Bartosz A; Szleifer, Igal

2013-10-08

Connections between microscopic dynamical observables and macroscopic nonequilibrium (NE) properties have been pursued in statistical physics since Boltzmann, Gibbs, and Maxwell. The simulations we describe here establish a relationship between the Kolmogorov-Sinai entropy and the energy dissipated as heat from a NE system to its environment. First, we show that the Kolmogorov-Sinai or dynamical entropy can be separated into system and bath components and that the entropy of the system characterizes the dynamics of energy dissipation. Second, we find that the average change in the system dynamical entropy is linearly related to the average change in the energy dissipated to the bath. The constant energy and time scales of the bath fix the dynamical relationship between these two quantities. These results provide a link between microscopic dynamical variables and the macroscopic energetics of NE processes.

Relationship between dynamical entropy and energy dissipation far from thermodynamic equilibrium

PubMed Central

Green, Jason R.; Costa, Anthony B.; Grzybowski, Bartosz A.; Szleifer, Igal

2013-01-01

Connections between microscopic dynamical observables and macroscopic nonequilibrium (NE) properties have been pursued in statistical physics since Boltzmann, Gibbs, and Maxwell. The simulations we describe here establish a relationship between the Kolmogorov–Sinai entropy and the energy dissipated as heat from a NE system to its environment. First, we show that the Kolmogorov–Sinai or dynamical entropy can be separated into system and bath components and that the entropy of the system characterizes the dynamics of energy dissipation. Second, we find that the average change in the system dynamical entropy is linearly related to the average change in the energy dissipated to the bath. The constant energy and time scales of the bath fix the dynamical relationship between these two quantities. These results provide a link between microscopic dynamical variables and the macroscopic energetics of NE processes. PMID:24065832

Long memory and volatility clustering: Is the empirical evidence consistent across stock markets?

NASA Astrophysics Data System (ADS)

Bentes, Sónia R.; Menezes, Rui; Mendes, Diana A.

2008-06-01

Long memory and volatility clustering are two stylized facts frequently related to financial markets. Traditionally, these phenomena have been studied based on conditionally heteroscedastic models like ARCH, GARCH, IGARCH and FIGARCH, inter alia. One advantage of these models is their ability to capture nonlinear dynamics. Another interesting manner to study the volatility phenomenon is by using measures based on the concept of entropy. In this paper we investigate the long memory and volatility clustering for the SP 500, NASDAQ 100 and Stoxx 50 indexes in order to compare the US and European Markets. Additionally, we compare the results from conditionally heteroscedastic models with those from the entropy measures. In the latter, we examine Shannon entropy, Renyi entropy and Tsallis entropy. The results corroborate the previous evidence of nonlinear dynamics in the time series considered.

Entropy, pricing and macroeconomics of pumped-storage systems

NASA Astrophysics Data System (ADS)

Karakatsanis, Georgios; Mamassis, Nikos; Koutsoyiannis, Demetris; Efstratiadis, Andreas

2014-05-01

We propose a pricing scheme for the enhancement of macroeconomic performance of pumped-storage systems, based on the statistical properties of both geophysical and economic variables. The main argument consists in the need of a context of economic values concerning the hub energy resource; defined as the resource that comprises the reference energy currency for all involved renewable energy sources (RES) and discounts all related uncertainty. In the case of pumped-storage systems the hub resource is the reservoir's water, as a benchmark for all connected intermittent RES. The uncertainty of all involved natural and economic processes is statistically quantifiable by entropy. It is the relation between the entropies of all involved RES that shapes the macroeconomic state of the integrated pumped-storage system. Consequently, there must be consideration on the entropy of wind, solar and precipitation patterns, as well as on the entropy of economic processes -such as demand preferences on either current energy use or storage for future availability. For pumped-storage macroeconomics, a price on the reservoir's capacity scarcity should also be imposed in order to shape a pricing field with upper and lower limits for the long-term stability of the pricing range and positive net energy benefits, which is the primary issue of the generalized deployment of pumped-storage technology. Keywords: Entropy, uncertainty, pricing, hub energy resource, RES, energy storage, capacity scarcity, macroeconomics

Gender-specific heart rate dynamics in severe intrauterine growth-restricted fetuses.

PubMed

Gonçalves, Hernâni; Bernardes, João; Ayres-de-Campos, Diogo

2013-06-01

Management of intrauterine growth restriction (IUGR) remains a major issue in perinatology. The objective of this paper was the assessment of gender-specific fetal heart rate (FHR) dynamics as a diagnostic tool in severe IUGR. FHR was analyzed in the antepartum period in 15 severe IUGR fetuses and 18 controls, matched for gestational age, in relation to fetal gender. Linear and entropy methods, such as mean FHR (mFHR), low (LF), high (HF) and movement frequency (MF), approximate, sample and multiscale entropy. Sensitivities and specificities were estimated using Fisher linear discriminant analysis and the leave-one-out method. Overall, IUGR fetuses presented significantly lower mFHR and entropy compared with controls. However, gender-specific analysis showed that significantly lower mFHR was only evident in IUGR males and lower entropy in IUGR females. In addition, lower LF/(MF+HF) was patent in IUGR females compared with controls, but not in males. Rather high sensitivities and specificities were achieved in the detection of the FHR recordings related with IUGR male fetuses, when gender-specific analysis was performed at gestational ages less than 34 weeks. Severe IUGR fetuses present gender-specific linear and entropy FHR changes, compared with controls, characterized by a significantly lower entropy and sympathetic-vagal balance in females than in males. These findings need to be considered in order to achieve better diagnostic results. Copyright © 2013 Elsevier Ltd. All rights reserved.

Does a Single Eigenstate Encode the Full Hamiltonian?

NASA Astrophysics Data System (ADS)

Garrison, James R.; Grover, Tarun

2018-04-01

The eigenstate thermalization hypothesis (ETH) posits that the reduced density matrix for a subsystem corresponding to an excited eigenstate is "thermal." Here we expound on this hypothesis by asking: For which class of operators, local or nonlocal, is ETH satisfied? We show that this question is directly related to a seemingly unrelated question: Is the Hamiltonian of a system encoded within a single eigenstate? We formulate a strong form of ETH where, in the thermodynamic limit, the reduced density matrix of a subsystem corresponding to a pure, finite energy density eigenstate asymptotically becomes equal to the thermal reduced density matrix, as long as the subsystem size is much less than the total system size, irrespective of how large the subsystem is compared to any intrinsic length scale of the system. This allows one to access the properties of the underlying Hamiltonian at arbitrary energy densities (or temperatures) using just a single eigenstate. We provide support for our conjecture by performing an exact diagonalization study of a nonintegrable 1D quantum lattice model with only energy conservation. In addition, we examine the case in which the subsystem size is a finite fraction of the total system size, and we find that, even in this case, many operators continue to match their canonical expectation values, at least approximately. In particular, the von Neumann entanglement entropy equals the thermal entropy as long as the subsystem is less than half the total system. Our results are consistent with the possibility that a single eigenstate correctly predicts the expectation values of all operators with support on less than half the total system, as long as one uses a microcanonical ensemble with vanishing energy width for comparison. We also study, both analytically and numerically, a particle-number conserving model at infinite temperature that substantiates our conjectures.

Effect of curvature squared corrections to gravitational action on viscosity-to-entropy ratio of the dual gauge theory

NASA Astrophysics Data System (ADS)

Petrov, Pavel

In this thesis we study the properties of strongly-coupled large-N conformal field theories (CFT's) using AdS/CFT correspondence. Chapter 1 serves as an introduction. In Chapter 2 we study the shear viscosity of strongly-coupled large-N conformal field theories. We find that it is affected by R2 corrections to the AdS action and present an example of 4D theory in which the the conjectured universal lower bound on viscosity-to-entropy ratio η/s > 1/4π is violated by 1/N corrections. This fact proves that there is no universal lower bound of 1/4π on viscosity-to-entropy ratio and may be relevant for the studies of QCD quark-gluon plasma for which this ratio is experimentally found to be close to 1/4π. In Chapter 3 we study the formation of the electron star in 4D AdS space. We show that in a gravity theory with charged fermions a layer of charged fermion fluid may form at a finite distance from the charged black hole. We show that these “electron stars” are candidate gravity duals for strongly interacting fermion systems at finite density and finite temperature. Entropy density for such systems scales as s ˜ T2/z at low temperatures as expected from IR criticality of electron stars solutions.

Correction of Cardy–Verlinde formula for Fermions and Bosons with modified dispersion relation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sadatian, S. Davood, E-mail: sd-sadatian@um.ac.ir; Dareyni, H.

Cardy–Verlinde formula links the entropy of conformal symmetry field to the total energy and its Casimir energy in a D-dimensional space. To correct black hole thermodynamics, modified dispersion relation can be used which is proposed as a general feature of quantum gravity approaches. In this paper, the thermodynamics of Schwarzschild four-dimensional black hole is corrected using the modified dispersion relation for Fermions and Bosons. Finally, using modified thermodynamics of Schwarzschild four-dimensional black hole, generalization for Cardy–Verlinde formula is obtained. - Highlights: • The modified Cardy–Verlinde formula obtained using MDR for Fermions and Bosons. • The modified entropy of the blackmore » hole used to correct the Cardy–Verlinde formula. • The modified entropy of the CFT has been obtained.« less

Computational problems and signal processing in SETI

NASA Technical Reports Server (NTRS)

Deans, Stanley R.; Cullers, D. K.; Stauduhar, Richard

1991-01-01

The Search for Extraterrestrial Intelligence (SETI), currently being planned at NASA, will require that an enormous amount of data (on the order of 10 exp 11 distinct signal paths for a typical observation) be analyzed in real time by special-purpose hardware. Even though the SETI system design is not based on maximum entropy and Bayesian methods (partly due to the real-time processing constraint), it is expected that enough data will be saved to be able to apply these and other methods off line where computational complexity is not an overriding issue. Interesting computational problems that relate directly to the system design for processing such an enormous amount of data have emerged. Some of these problems are discussed, along with the current status on their solution.

Communication: The simplified generalized entropy theory of glass-formation in polymer melts.

PubMed

Freed, Karl F

2015-08-07

While a wide range of non-trivial predictions of the generalized entropy theory (GET) of glass-formation in polymer melts agree with a large number of observed universal and non-universal properties of these glass-formers and even for the dependence of these properties on monomer molecular structure, the huge mathematical complexity of the theory precludes its extension to describe, for instance, the perplexing, complex behavior observed for technologically important polymer films with thickness below ∼100 nm and for which a fundamental molecular theory is lacking for the structural relaxation. The present communication describes a hugely simplified version of the theory, called the simplified generalized entropy theory (SGET) that provides one component necessary for devising a theory for the structural relaxation of thin polymer films and thereby supplements the first required ingredient, the recently developed Flory-Huggins level theory for the thermodynamic properties of thin polymer films, before the concluding third step of combining all the components into the SGET for thin polymer films. Comparisons between the predictions of the SGET and the full GET for the four characteristic temperatures of glass-formation provide good agreement for a highly non-trivial model system of polymer melts with chains of the structure of poly(n-α olefins) systems where the GET has produced good agreement with experiment. The comparisons consider values of the relative backbone and side group stiffnesses such that the glass transition temperature decreases as the amount of excess free volume diminishes, contrary to general expectations but in accord with observations for poly(n-alkyl methacrylates). Moreover, the SGET is sufficiently concise to enable its discussion in a standard course on statistical mechanics or polymer physics.

Non-equilibrium thermodynamics, maximum entropy production and Earth-system evolution.

PubMed

Kleidon, Axel

2010-01-13

The present-day atmosphere is in a unique state far from thermodynamic equilibrium. This uniqueness is for instance reflected in the high concentration of molecular oxygen and the low relative humidity in the atmosphere. Given that the concentration of atmospheric oxygen has likely increased throughout Earth-system history, we can ask whether this trend can be generalized to a trend of Earth-system evolution that is directed away from thermodynamic equilibrium, why we would expect such a trend to take place and what it would imply for Earth-system evolution as a whole. The justification for such a trend could be found in the proposed general principle of maximum entropy production (MEP), which states that non-equilibrium thermodynamic systems maintain steady states at which entropy production is maximized. Here, I justify and demonstrate this application of MEP to the Earth at the planetary scale. I first describe the non-equilibrium thermodynamic nature of Earth-system processes and distinguish processes that drive the system's state away from equilibrium from those that are directed towards equilibrium. I formulate the interactions among these processes from a thermodynamic perspective and then connect them to a holistic view of the planetary thermodynamic state of the Earth system. In conclusion, non-equilibrium thermodynamics and MEP have the potential to provide a simple and holistic theory of Earth-system functioning. This theory can be used to derive overall evolutionary trends of the Earth's past, identify the role that life plays in driving thermodynamic states far from equilibrium, identify habitability in other planetary environments and evaluate human impacts on Earth-system functioning. This journal is © 2010 The Royal Society

Communication: The simplified generalized entropy theory of glass-formation in polymer melts

DOE Office of Scientific and Technical Information (OSTI.GOV)

Freed, Karl F.

2015-08-07

While a wide range of non-trivial predictions of the generalized entropy theory (GET) of glass-formation in polymer melts agree with a large number of observed universal and non-universal properties of these glass-formers and even for the dependence of these properties on monomer molecular structure, the huge mathematical complexity of the theory precludes its extension to describe, for instance, the perplexing, complex behavior observed for technologically important polymer films with thickness below ∼100 nm and for which a fundamental molecular theory is lacking for the structural relaxation. The present communication describes a hugely simplified version of the theory, called the simplifiedmore » generalized entropy theory (SGET) that provides one component necessary for devising a theory for the structural relaxation of thin polymer films and thereby supplements the first required ingredient, the recently developed Flory-Huggins level theory for the thermodynamic properties of thin polymer films, before the concluding third step of combining all the components into the SGET for thin polymer films. Comparisons between the predictions of the SGET and the full GET for the four characteristic temperatures of glass-formation provide good agreement for a highly non-trivial model system of polymer melts with chains of the structure of poly(n-α olefins) systems where the GET has produced good agreement with experiment. The comparisons consider values of the relative backbone and side group stiffnesses such that the glass transition temperature decreases as the amount of excess free volume diminishes, contrary to general expectations but in accord with observations for poly(n-alkyl methacrylates). Moreover, the SGET is sufficiently concise to enable its discussion in a standard course on statistical mechanics or polymer physics.« less

Entropy for Mechanically Vibrating Systems

NASA Astrophysics Data System (ADS)

Tufano, Dante

The research contained within this thesis deals with the subject of entropy as defined for and applied to mechanically vibrating systems. This work begins with an overview of entropy as it is understood in the fields of classical thermodynamics, information theory, statistical mechanics, and statistical vibroacoustics. Khinchin's definition of entropy, which is the primary definition used for the work contained in this thesis, is introduced in the context of vibroacoustic systems. The main goal of this research is to to establish a mathematical framework for the application of Khinchin's entropy in the field of statistical vibroacoustics by examining the entropy context of mechanically vibrating systems. The introduction of this thesis provides an overview of statistical energy analysis (SEA), a modeling approach to vibroacoustics that motivates this work on entropy. The objective of this thesis is given, and followed by a discussion of the intellectual merit of this work as well as a literature review of relevant material. Following the introduction, an entropy analysis of systems of coupled oscillators is performed utilizing Khinchin's definition of entropy. This analysis develops upon the mathematical theory relating to mixing entropy, which is generated by the coupling of vibroacoustic systems. The mixing entropy is shown to provide insight into the qualitative behavior of such systems. Additionally, it is shown that the entropy inequality property of Khinchin's entropy can be reduced to an equality using the mixing entropy concept. This equality can be interpreted as a facet of the second law of thermodynamics for vibroacoustic systems. Following this analysis, an investigation of continuous systems is performed using Khinchin's entropy. It is shown that entropy analyses using Khinchin's entropy are valid for continuous systems that can be decomposed into a finite number of modes. The results are shown to be analogous to those obtained for simple oscillators, which demonstrates the applicability of entropy-based approaches to real-world systems. Three systems are considered to demonstrate these findings: 1) a rod end-coupled to a simple oscillator, 2) two end-coupled rods, and 3) two end-coupled beams. The aforementioned work utilizes the weak coupling assumption to determine the entropy of composite systems. Following this discussion, a direct method of finding entropy is developed which does not rely on this limiting assumption. The resulting entropy provides a useful benchmark for evaluating the accuracy of the weak coupling approach, and is validated using systems of coupled oscillators. The later chapters of this work discuss Khinchin's entropy as applied to nonlinear and nonconservative systems, respectively. The discussion of entropy for nonlinear systems is motivated by the desire to expand the applicability of SEA techniques beyond the linear regime. The discussion of nonconservative systems is also crucial, since real-world systems interact with their environment, and it is necessary to confirm the validity of an entropy approach for systems that are relevant in the context of SEA. Having developed a mathematical framework for determining entropy under a number of previously unexplored cases, the relationship between thermodynamics and statistical vibroacoustics can be better understood. Specifically, vibroacoustic temperatures can be obtained for systems that are not necessarily linear or weakly coupled. In this way, entropy provides insight into how the power flow proportionality of statistical energy analysis (SEA) can be applied to a broader class of vibroacoustic systems. As such, entropy is a useful tool for both justifying and expanding the foundational results of SEA.

Entropy: A new measure of stock market volatility?

NASA Astrophysics Data System (ADS)

Bentes, Sonia R.; Menezes, Rui

2012-11-01

When uncertainty dominates understanding stock market volatility is vital. There are a number of reasons for that. On one hand, substantial changes in volatility of financial market returns are capable of having significant negative effects on risk averse investors. In addition, such changes can also impact on consumption patterns, corporate capital investment decisions and macroeconomic variables. Arguably, volatility is one of the most important concepts in the whole finance theory. In the traditional approach this phenomenon has been addressed based on the concept of standard-deviation (or variance) from which all the famous ARCH type models - Autoregressive Conditional Heteroskedasticity Models- depart. In this context, volatility is often used to describe dispersion from an expected value, price or model. The variability of traded prices from their sample mean is only an example. Although as a measure of uncertainty and risk standard-deviation is very popular since it is simple and easy to calculate it has long been recognized that it is not fully satisfactory. The main reason for that lies in the fact that it is severely affected by extreme values. This may suggest that this is not a closed issue. Bearing on the above we might conclude that many other questions might arise while addressing this subject. One of outstanding importance, from which more sophisticated analysis can be carried out, is how to evaluate volatility, after all? If the standard-deviation has some drawbacks shall we still rely on it? Shall we look for an alternative measure? In searching for this shall we consider the insight of other domains of knowledge? In this paper we specifically address if the concept of entropy, originally developed in physics by Clausius in the XIX century, which can constitute an effective alternative. Basically, what we try to understand is, which are the potentialities of entropy compared to the standard deviation. But why entropy? The answer lies on the fact that there is already some research on the domain of Econophysics, which points out that as a measure of disorder, distance from equilibrium or even ignorance, entropy might present some advantages. However another question arises: since there is several measures of entropy which one since there are several measures of entropy, which one shall be used? As a starting point we discuss the potentialities of Shannon entropy and Tsallis entropy. The main difference between them is that both Renyi and Tsallis are adequate for anomalous systems while Shannon has revealed optimal for equilibrium systems.

Measuring Ambiguity in HLA Typing Methods

PubMed Central

Madbouly, Abeer; Freeman, John; Maiers, Martin

2012-01-01

In hematopoietic stem cell transplantation, donor selection is based primarily on matching donor and patient HLA genes. These genes are highly polymorphic and their typing can result in exact allele assignment at each gene (the resolution at which patients and donors are matched), but it can also result in a set of ambiguous assignments, depending on the typing methodology used. To facilitate rapid identification of matched donors, registries employ statistical algorithms to infer HLA alleles from ambiguous genotypes. Linkage disequilibrium information encapsulated in haplotype frequencies is used to facilitate prediction of the most likely haplotype assignment. An HLA typing with less ambiguity produces fewer high-probability haplotypes and a more reliable prediction. We estimated ambiguity for several HLA typing methods across four continental populations using an information theory-based measure, Shannon's entropy. We used allele and haplotype frequencies to calculate entropy for different sets of 1,000 subjects with simulated HLA typing. Using allele frequencies we calculated an average entropy in Caucasians of 1.65 for serology, 1.06 for allele family level, 0.49 for a 2002-era SSO kit, and 0.076 for single-pass SBT. When using haplotype frequencies in entropy calculations, we found average entropies of 0.72 for serology, 0.73 for allele family level, 0.05 for SSO, and 0.002 for single-pass SBT. Application of haplotype frequencies further reduces HLA typing ambiguity. We also estimated expected confirmatory typing mismatch rates for simulated subjects. In a hypothetical registry with all donors typed using the same method, the entropy values based on haplotype frequencies correspond to confirmatory typing mismatch rates of 1.31% for SSO versus only 0.08% for SBT. Intermediate-resolution single-pass SBT contains the least ambiguity of the methods we evaluated and therefore the most certainty in allele prediction. The presented measure objectively evaluates HLA typing methods and can help define acceptable HLA typing for donor recruitment. PMID:22952712

Universal Entropy of Word Ordering Across Linguistic Families

PubMed Central

Montemurro, Marcelo A.; Zanette, Damián H.

2011-01-01

Background The language faculty is probably the most distinctive feature of our species, and endows us with a unique ability to exchange highly structured information. In written language, information is encoded by the concatenation of basic symbols under grammatical and semantic constraints. As is also the case in other natural information carriers, the resulting symbolic sequences show a delicate balance between order and disorder. That balance is determined by the interplay between the diversity of symbols and by their specific ordering in the sequences. Here we used entropy to quantify the contribution of different organizational levels to the overall statistical structure of language. Methodology/Principal Findings We computed a relative entropy measure to quantify the degree of ordering in word sequences from languages belonging to several linguistic families. While a direct estimation of the overall entropy of language yielded values that varied for the different families considered, the relative entropy quantifying word ordering presented an almost constant value for all those families. Conclusions/Significance Our results indicate that despite the differences in the structure and vocabulary of the languages analyzed, the impact of word ordering in the structure of language is a statistical linguistic universal. PMID:21603637

Entropy Inequalities for Stable Densities and Strengthened Central Limit Theorems

NASA Astrophysics Data System (ADS)

Toscani, Giuseppe

2016-10-01

We consider the central limit theorem for stable laws in the case of the standardized sum of independent and identically distributed random variables with regular probability density function. By showing decay of different entropy functionals along the sequence we prove convergence with explicit rate in various norms to a Lévy centered density of parameter λ >1 . This introduces a new information-theoretic approach to the central limit theorem for stable laws, in which the main argument is shown to be the relative fractional Fisher information, recently introduced in Toscani (Ricerche Mat 65(1):71-91, 2016). In particular, it is proven that, with respect to the relative fractional Fisher information, the Lévy density satisfies an analogous of the logarithmic Sobolev inequality, which allows to pass from the monotonicity and decay to zero of the relative fractional Fisher information in the standardized sum to the decay to zero in relative entropy with an explicit decay rate.

A practical comparison of algorithms for the measurement of multiscale entropy in neural time series data.

PubMed

Kuntzelman, Karl; Jack Rhodes, L; Harrington, Lillian N; Miskovic, Vladimir

2018-06-01

There is a broad family of statistical methods for capturing time series regularity, with increasingly widespread adoption by the neuroscientific community. A common feature of these methods is that they permit investigators to quantify the entropy of brain signals - an index of unpredictability/complexity. Despite the proliferation of algorithms for computing entropy from neural time series data there is scant evidence concerning their relative stability and efficiency. Here we evaluated several different algorithmic implementations (sample, fuzzy, dispersion and permutation) of multiscale entropy in terms of their stability across sessions, internal consistency and computational speed, accuracy and precision using a combination of electroencephalogram (EEG) and synthetic 1/ƒ noise signals. Overall, we report fair to excellent internal consistency and longitudinal stability over a one-week period for the majority of entropy estimates, with several caveats. Computational timing estimates suggest distinct advantages for dispersion and permutation entropy over other entropy estimates. Considered alongside the psychometric evidence, we suggest several ways in which researchers can maximize computational resources (without sacrificing reliability), especially when working with high-density M/EEG data or multivoxel BOLD time series signals. Copyright © 2018 Elsevier Inc. All rights reserved.

Using Link Disconnection Entropy Disorder to Detect Fast Moving Nodes in MANETs

PubMed Central

Palafox, Luis E.; Aguilar, Leocundo; Sanchez, Mauricio A.; Martinez, Luis G.

2016-01-01

Mobile ad-hoc networks (MANETs) are dynamic by nature; this dynamism comes from node mobility, traffic congestion, and other transmission conditions. Metrics to evaluate the effects of those conditions shine a light on node’s behavior in an ad-hoc network, helping to identify the node or nodes with better conditions of connection. In this paper, we propose a relative index to evaluate a single node reliability, based on the link disconnection entropy disorder using neighboring nodes as reference. Link disconnection entropy disorder is best used to identify fast moving nodes or nodes with unstable communications, this without the need of specialized sensors such as GPS. Several scenarios were studied to verify the index, measuring the effects of Speed and traffic density on the link disconnection entropy disorder. Packet delivery ratio is associated to the metric detecting a strong relationship, enabling the use of the link disconnection entropy disorder to evaluate the stability of a node to communicate with other nodes. To expand the utilization of the link entropy disorder, we identified nodes with higher speeds in network simulations just by using the link entropy disorder. PMID:27219671

n-Order and maximum fuzzy similarity entropy for discrimination of signals of different complexity: Application to fetal heart rate signals.

PubMed

Zaylaa, Amira; Oudjemia, Souad; Charara, Jamal; Girault, Jean-Marc

2015-09-01

This paper presents two new concepts for discrimination of signals of different complexity. The first focused initially on solving the problem of setting entropy descriptors by varying the pattern size instead of the tolerance. This led to the search for the optimal pattern size that maximized the similarity entropy. The second paradigm was based on the n-order similarity entropy that encompasses the 1-order similarity entropy. To improve the statistical stability, n-order fuzzy similarity entropy was proposed. Fractional Brownian motion was simulated to validate the different methods proposed, and fetal heart rate signals were used to discriminate normal from abnormal fetuses. In all cases, it was found that it was possible to discriminate time series of different complexity such as fractional Brownian motion and fetal heart rate signals. The best levels of performance in terms of sensitivity (90%) and specificity (90%) were obtained with the n-order fuzzy similarity entropy. However, it was shown that the optimal pattern size and the maximum similarity measurement were related to intrinsic features of the time series. Copyright © 2015 Elsevier Ltd. All rights reserved.

Entanglement entropy between real and virtual particles in ϕ4 quantum field theory

NASA Astrophysics Data System (ADS)

Ardenghi, Juan Sebastián

2015-04-01

The aim of this work is to compute the entanglement entropy of real and virtual particles by rewriting the generating functional of ϕ4 theory as a mean value between states and observables defined through the correlation functions. Then the von Neumann definition of entropy can be applied to these quantum states and in particular, for the partial traces taken over the internal or external degrees of freedom. This procedure can be done for each order in the perturbation expansion showing that the entanglement entropy for real and virtual particles behaves as ln (m0). In particular, entanglement entropy is computed at first order for the correlation function of two external points showing that mutual information is identical to the external entropy and that conditional entropies are negative for all the domain of m0. In turn, from the definition of the quantum states, it is possible to obtain general relations between total traces between different quantum states of a ϕr theory. Finally, discussion about the possibility of taking partial traces over external degrees of freedom is considered, which implies the introduction of some observables that measure space-time points where an interaction occurs.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jafferis, Daniel L.; Lewkowycz, Aitor; Maldacena, Juan

We consider the gravity dual of the modular Hamiltonian associated to a general subregion of a boundary theory. We use it to argue that the relative entropy of nearby states is given by the relative entropy in the bulk, to leading order in the bulk gravitational coupling. We also argue that the boundary modular flow is dual to the bulk modular flow in the entanglement wedge, with implications for entanglement wedge reconstruction.

An entropy maximization problem related to optical communication

NASA Technical Reports Server (NTRS)

Mceliece, R. J.; Rodemich, E. R.; Swanson, L.

1986-01-01

In relation to a problem in optical communication, the paper considers the general problem of maximizing the entropy of a stationary radom process that is subject to an average transition cost constraint. By using a recent result of Justesen and Hoholdt, an exact solution to the problem is presented and a class of finite state encoders that give a good approximation to the exact solution is suggested.

Hierarchical Polygamy Inequality for Entanglement of Tsallis q-Entropy

NASA Astrophysics Data System (ADS)

Luo, Yu; Li, Yong-Ming

2018-05-01

In this paper, we study the polygamy inequality of quantum entanglement in terms of Tsallis q-entropy. We first give a lower bound of Tsallis q-entropy entanglement of assistance (TOA) in the 2 ⊗ d systems. The relation-ships between Tsallis q-entropy entanglement (TEE) and TOA are also given. Furthermore, we prove TOA follows a hierarchical polygamy inequality in a 2 ⊗ 2 ⊗ 2 N‑2 systems. Supported by the National Natural Science Foundation of China under Grant No. 11671244, the Higher School Doctoral Subject Foun- dation of Ministry of Education of China under Grant No. 20130202110001, and Fundamental Research Funds for the Central Universities under Grants Nos. 2016TS060 and 2016CBY003

DEM interpolation weight calculation modulus based on maximum entropy

NASA Astrophysics Data System (ADS)

Chen, Tian-wei; Yang, Xia

2015-12-01

There is negative-weight in traditional interpolation of gridding DEM, in the article, the principle of Maximum Entropy is utilized to analyze the model system which depends on modulus of space weight. Negative-weight problem of the DEM interpolation is researched via building Maximum Entropy model, and adding nonnegative, first and second order's Moment constraints, the negative-weight problem is solved. The correctness and accuracy of the method was validated with genetic algorithm in matlab program. The method is compared with the method of Yang Chizhong interpolation and quadratic program. Comparison shows that the volume and scaling of Maximum Entropy's weight is fit to relations of space and the accuracy is superior to the latter two.

Biological evolution of replicator systems: towards a quantitative approach.

PubMed

Martin, Osmel; Horvath, J E

2013-04-01

The aim of this work is to study the features of a simple replicator chemical model of the relation between kinetic stability and entropy production under the action of external perturbations. We quantitatively explore the different paths leading to evolution in a toy model where two independent replicators compete for the same substrate. To do that, the same scenario described originally by Pross (J Phys Org Chem 17:312-316, 2004) is revised and new criteria to define the kinetic stability are proposed. Our results suggest that fast replicator populations are continually favored by the effects of strong stochastic environmental fluctuations capable to determine the global population, the former assumed to be the only acting evolution force. We demonstrate that the process is continually driven by strong perturbations only, and that population crashes may be useful proxies for these catastrophic environmental fluctuations. As expected, such behavior is particularly enhanced under very large scale perturbations, suggesting a likely dynamical footprint in the recovery patterns of new species after mass extinction events in the Earth's geological past. Furthermore, the hypothesis that natural selection always favors the faster processes may give theoretical support to different studies that claim the applicability of maximum principles like the Maximum Metabolic Flux (MMF) or Maximum Entropy Productions Principle (MEPP), seen as the main goal of biological evolution.

Biological Evolution of Replicator Systems: Towards a Quantitative Approach

NASA Astrophysics Data System (ADS)

Martin, Osmel; Horvath, J. E.

2013-04-01

The aim of this work is to study the features of a simple replicator chemical model of the relation between kinetic stability and entropy production under the action of external perturbations. We quantitatively explore the different paths leading to evolution in a toy model where two independent replicators compete for the same substrate. To do that, the same scenario described originally by Pross (J Phys Org Chem 17:312-316, 2004) is revised and new criteria to define the kinetic stability are proposed. Our results suggest that fast replicator populations are continually favored by the effects of strong stochastic environmental fluctuations capable to determine the global population, the former assumed to be the only acting evolution force. We demonstrate that the process is continually driven by strong perturbations only, and that population crashes may be useful proxies for these catastrophic environmental fluctuations. As expected, such behavior is particularly enhanced under very large scale perturbations, suggesting a likely dynamical footprint in the recovery patterns of new species after mass extinction events in the Earth's geological past. Furthermore, the hypothesis that natural selection always favors the faster processes may give theoretical support to different studies that claim the applicability of maximum principles like the Maximum Metabolic Flux (MMF) or Maximum Entropy Productions Principle (MEPP), seen as the main goal of biological evolution.

Corrosion-resistant high-entropy alloys: A review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Shi, Yunzhu; Yang, Bin; Liaw, Peter

Corrosion destroys more than three percent of the world’s gross domestic product. Therefore, the design of highly corrosion-resistant materials is urgently needed. By breaking the classical alloy-design philosophy, high-entropy alloys (HEAs) possess unique microstructures, which are solid solutions with random arrangements of multiple elements. The particular locally-disordered chemical environment is expected to lead to unique corrosion-resistant properties. In this review, the studies of the corrosion-resistant HEAs during the last decade are summarized. The corrosion-resistant properties of HEAs in various aqueous environments and the corrosion behavior of HEA coatings are presented. The effects of environments, alloying elements, and processing methods onmore » the corrosion resistance are analyzed in detail. Finally, the possible directions of future work regarding the corrosion behavior of HEAs are suggested.« less

Corrosion-resistant high-entropy alloys: A review

DOE PAGES

Shi, Yunzhu; Yang, Bin; Liaw, Peter

2017-02-05

Corrosion destroys more than three percent of the world’s gross domestic product. Therefore, the design of highly corrosion-resistant materials is urgently needed. By breaking the classical alloy-design philosophy, high-entropy alloys (HEAs) possess unique microstructures, which are solid solutions with random arrangements of multiple elements. The particular locally-disordered chemical environment is expected to lead to unique corrosion-resistant properties. In this review, the studies of the corrosion-resistant HEAs during the last decade are summarized. The corrosion-resistant properties of HEAs in various aqueous environments and the corrosion behavior of HEA coatings are presented. The effects of environments, alloying elements, and processing methods onmore » the corrosion resistance are analyzed in detail. Finally, the possible directions of future work regarding the corrosion behavior of HEAs are suggested.« less

Sign reversal of transformation entropy change in Co{sub 2}Cr(Ga,Si) shape memory alloys

DOE Office of Scientific and Technical Information (OSTI.GOV)

Xu, Xiao, E-mail: xu@material.tohoku.ac.jp; Omori, Toshihiro; Kainuma, Ryosuke

2015-11-02

In situ X-ray diffraction (XRD) measurements and compression tests were performed on Co{sub 2}Cr(Ga,Si) shape memory alloys. The reentrant martensitic transformation behavior was directly observed during the in situ XRD measurements. The high-temperature parent phase and low-temperature reentrant parent phase were found to have a continuous temperature dependence of lattice parameter, therefore suggesting that they are the same phase in nature. Moreover, compression tests were performed on a parent-phase single crystal sample; an evolution from normal to inverse temperature dependence of critical stress for martensitic transformation was directly observed. Based on the Clausius-Clapeyron analysis, a sign reversal of entropy changemore » can be expected on the same alloy.« less

Statistical Entropy of Vaidya-de Sitter Black Hole to All Orders in Planck Length

NASA Astrophysics Data System (ADS)

Sun, HangBin; He, Feng; Huang, Hai

2012-06-01

Considering corrections to all orders in Planck length on the quantum state density from generalized uncertainty principle, we calculate the statistical entropy of scalar field near event horizon and cosmological horizon of Vaidya-de Sitter black hole without any artificial cutoff. It is shown that the entropy is linear sum of event horizon area and cosmological horizon area and there are similar proportional parameters related to changing rate of the horizon position. This is different from the static and stationary cases.

Two aspects of black hole entropy in Lanczos-Lovelock models of gravity

NASA Astrophysics Data System (ADS)

Kolekar, Sanved; Kothawala, Dawood; Padmanabhan, T.

2012-03-01

We consider two specific approaches to evaluate the black hole entropy which are known to produce correct results in the case of Einstein’s theory and generalize them to Lanczos-Lovelock models. In the first approach (which could be called extrinsic), we use a procedure motivated by earlier work by Pretorius, Vollick, and Israel, and by Oppenheim, and evaluate the entropy of a configuration of densely packed gravitating shells on the verge of forming a black hole in Lanczos-Lovelock theories of gravity. We find that this matter entropy is not equal to (it is less than) Wald entropy, except in the case of Einstein theory, where they are equal. The matter entropy is proportional to the Wald entropy if we consider a specific mth-order Lanczos-Lovelock model, with the proportionality constant depending on the spacetime dimensions D and the order m of the Lanczos-Lovelock theory as (D-2m)/(D-2). Since the proportionality constant depends on m, the proportionality between matter entropy and Wald entropy breaks down when we consider a sum of Lanczos-Lovelock actions involving different m. In the second approach (which could be called intrinsic), we generalize a procedure, previously introduced by Padmanabhan in the context of general relativity, to study off-shell entropy of a class of metrics with horizon using a path integral method. We consider the Euclidean action of Lanczos-Lovelock models for a class of metrics off shell and interpret it as a partition function. We show that in the case of spherically symmetric metrics, one can interpret the Euclidean action as the free energy and read off both the entropy and energy of a black hole spacetime. Surprisingly enough, this leads to exactly the Wald entropy and the energy of the spacetime in Lanczos-Lovelock models obtained by other methods. We comment on possible implications of the result.

Entropy of Movement Outcome in Space-Time.

PubMed

Lai, Shih-Chiung; Hsieh, Tsung-Yu; Newell, Karl M

2015-07-01

Information entropy of the joint spatial and temporal (space-time) probability of discrete movement outcome was investigated in two experiments as a function of different movement strategies (space-time, space, and time instructional emphases), task goals (point-aiming and target-aiming) and movement speed-accuracy constraints. The variance of the movement spatial and temporal errors was reduced by instructional emphasis on the respective spatial or temporal dimension, but increased on the other dimension. The space-time entropy was lower in targetaiming task than the point aiming task but did not differ between instructional emphases. However, the joint probabilistic measure of spatial and temporal entropy showed that spatial error is traded for timing error in tasks with space-time criteria and that the pattern of movement error depends on the dimension of the measurement process. The unified entropy measure of movement outcome in space-time reveals a new relation for the speed-accuracy.

Landauer-Büttiker Approach to Strongly Coupled Quantum Thermodynamics: Inside-Outside Duality of Entropy Evolution

NASA Astrophysics Data System (ADS)

Bruch, Anton; Lewenkopf, Caio; von Oppen, Felix

2018-03-01

We develop a Landauer-Büttiker theory of entropy evolution in time-dependent, strongly coupled electron systems. The formalism naturally avoids the problem of the system-bath distinction by defining the entropy current in the attached leads. This current can then be used to infer changes of the entropy of the system which we refer to as the inside-outside duality. We carry out this program in an adiabatic expansion up to first order beyond the quasistatic limit. When combined with particle and energy currents, as well as the work required to change an external potential, our formalism provides a full thermodynamic description, applicable to arbitrary noninteracting electron systems in contact with reservoirs. This provides a clear understanding of the relation between heat and entropy currents generated by time-dependent potentials and their connection to the occurring dissipation.

Rényi squashed entanglement, discord, and relative entropy differences

NASA Astrophysics Data System (ADS)

Seshadreesan, Kaushik P.; Berta, Mario; Wilde, Mark M.

2015-10-01

The squashed entanglement quantifies the amount of entanglement in a bipartite quantum state, and it satisfies all of the axioms desired for an entanglement measure. The quantum discord is a measure of quantum correlations that are different from those due to entanglement. What these two measures have in common is that they are both based upon the conditional quantum mutual information. In Berta et al (2015 J. Math. Phys. 56 022205), we recently proposed Rényi generalizations of the conditional quantum mutual information of a tripartite state on ABC (with C being the conditioning system), which were shown to satisfy some properties that hold for the original quantity, such as non-negativity, duality, and monotonicity with respect to local operations on the system B (with it being left open to show that the Rényi quantity is monotone with respect to local operations on system A). Here we define a Rényi squashed entanglement and a Rényi quantum discord based on a Rényi conditional quantum mutual information and investigate these quantities in detail. Taking as a conjecture that the Rényi conditional quantum mutual information is monotone with respect to local operations on both systems A and B, we prove that the Rényi squashed entanglement and the Rényi quantum discord satisfy many of the properties of the respective original von Neumann entropy based quantities. In our prior work (Berta et al 2015 Phys. Rev. A 91 022333), we also detailed a procedure to obtain Rényi generalizations of any quantum information measure that is equal to a linear combination of von Neumann entropies with coefficients chosen from the set \\{-1,0,1\\}. Here, we extend this procedure to include differences of relative entropies. Using the extended procedure and a conjectured monotonicity of the Rényi generalizations in the Rényi parameter, we discuss potential remainder terms for well known inequalities such as monotonicity of the relative entropy, joint convexity of the relative entropy, and the Holevo bound.

Information and Entropy

NASA Astrophysics Data System (ADS)

Caticha, Ariel

2007-11-01

What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore it is the force that induces us to change our minds. This problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), which is designed for updating from arbitrary priors given information in the form of arbitrary constraints, includes as special cases both MaxEnt (which allows arbitrary constraints) and Bayes' rule (which allows arbitrary priors). Thus, ME unifies the two themes of these workshops—the Maximum Entropy and the Bayesian methods—into a single general inference scheme that allows us to handle problems that lie beyond the reach of either of the two methods separately. I conclude with a couple of simple illustrative examples.

Generalized relative entropies in the classical limit

NASA Astrophysics Data System (ADS)

Kowalski, A. M.; Martin, M. T.; Plastino, A.

2015-03-01

Our protagonists are (i) the Cressie-Read family of divergences (characterized by the parameter γ), (ii) Tsallis' generalized relative entropies (characterized by the q one), and, as a particular instance of both, (iii) the Kullback-Leibler (KL) relative entropy. In their normalized versions, we ascertain the equivalence between (i) and (ii). Additionally, we employ these three entropic quantifiers in order to provide a statistical investigation of the classical limit of a semiclassical model, whose properties are well known from a purely dynamic viewpoint. This places us in a good position to assess the appropriateness of our statistical quantifiers for describing involved systems. We compare the behaviour of (i), (ii), and (iii) as one proceeds towards the classical limit. We determine optimal ranges for γ and/or q. It is shown the Tsallis-quantifier is better than KL's for 1.5 < q < 2.5.

Low-temperature heat capacity of diopside glass (CaMgSi2O6): A calorimetric test of the configurational-entropy theory applied to the viscosity of liquid silicates

USGS Publications Warehouse

Richet, P.; Robie, R.A.; Hemingway, B.S.

1986-01-01

Heat-capacity measurements have been made between 8 and 370 K on an annealed and a rapidly quenched diopside glass. Between 15 and 200 K, Cp does not depend significantly on the thermal history of the glass. Below 15 K Cp is larger for the quenched than for the annealed specimen. The opposite is true above 200 K as a result of what is interpreted as a secondary relaxation around room temperature. The magnitude of these effects, however, is small enough that the relative entropies S(298)-S(0) of the glasses differ by only 0.5 J/mol K, i.e., a figure within the combined experimental uncertainties. The insensitivity of relative entropies to thermal history supports the assumption that the configurational heat capacity of the liquid may be taken as the heat capacity difference between the liquid and the glass (??Cp). Furthermore, this insensitivity allows calculation of the residual entropies at 0 K of diopside glasses as a function of the fictive temperature from the entropy of fusion of diopside and the heat capacities of the crystalline, glassy and liquid phases. For a glass with a fictive temperature of 1005 K, for example, this calorimetric residual entropy is 24.3 ?? 3 J/mol K, in agreement with the prediction made by RICHET (1984) from an analysis of the viscosity data with the configurational-entropy theory of relaxation processes of Adam and Gibbs (1965). In turn, all the viscosity measurements for liquid diopside, which span the range 0.5-4?? 1013 poise, can be quantitatively reproduced through this theory with the calorimetrically determined entropies and ??Cp data. Finally, the unclear significance of "activation energies" for structural interpretations of viscosity data is emphasized, and the importance of ??Cp and glass-transition temperature systematics for determining the composition and temperature dependences of the viscosity is pointed out. ?? 1986.

Multiscale sample entropy and cross-sample entropy based on symbolic representation and similarity of stock markets

NASA Astrophysics Data System (ADS)

Wu, Yue; Shang, Pengjian; Li, Yilong

2018-03-01

A modified multiscale sample entropy measure based on symbolic representation and similarity (MSEBSS) is proposed in this paper to research the complexity of stock markets. The modified algorithm reduces the probability of inducing undefined entropies and is confirmed to be robust to strong noise. Considering the validity and accuracy, MSEBSS is more reliable than Multiscale entropy (MSE) for time series mingled with much noise like financial time series. We apply MSEBSS to financial markets and results show American stock markets have the lowest complexity compared with European and Asian markets. There are exceptions to the regularity that stock markets show a decreasing complexity over the time scale, indicating a periodicity at certain scales. Based on MSEBSS, we introduce the modified multiscale cross-sample entropy measure based on symbolic representation and similarity (MCSEBSS) to consider the degree of the asynchrony between distinct time series. Stock markets from the same area have higher synchrony than those from different areas. And for stock markets having relative high synchrony, the entropy values will decrease with the increasing scale factor. While for stock markets having high asynchrony, the entropy values will not decrease with the increasing scale factor sometimes they tend to increase. So both MSEBSS and MCSEBSS are able to distinguish stock markets of different areas, and they are more helpful if used together for studying other features of financial time series.

Entropy-Aided Evaluation of Meteorological Droughts Over China

NASA Astrophysics Data System (ADS)

Sang, Yan-Fang; Singh, Vijay P.; Hu, Zengyun; Xie, Ping; Li, Xinxin

2018-01-01

Evaluation of drought and its spatial distribution is essential to develop mitigation measures. In this study, we employed the entropy index to investigate the spatiotemporal variability of meteorological droughts over China. Entropy values, with a reliable hydrological and geographical basis, are closely related to the months of precipitation deficit and its mean magnitude and can thus represent the physical formation of droughts. The value of entropy index can be roughly classified as <0.35, 0.36-0.90, and >0.90, reflecting high, middle, and low occurrence probabilities of droughts. The accumulated precipitation deficits, based on the standardized precipitation-evapotranspiration index at the 1, 3, 6, and 12 month scales, consistently increase with entropy decrease, no matter considering the moderately, severely, or extremely dry conditions. Therefore, Northwest China and North China, with smaller entropy values, have higher occurrence probability of droughts than South China, with a break at 38°N latitude. The aggravating droughts in North China and Southwest China over recent decades are represented by the increase in both the occurrence frequency and the magnitude. The entropy, determined by absolute magnitude of the difference between precipitation and potential evapotranspiration, as well as its scatter and skewness characteristics, is easily calculated and can be an effective index for evaluating drought and its spatial distribution. We therefore identified dominant thresholds for entropy values and statistical characteristics of precipitation deficit, which would help evaluate the occurrence probability of droughts worldwide.

Conformational Entropy from NMR Relaxation in Proteins: The SRLS Perspective.

PubMed

Tchaicheeyan, Oren; Meirovitch, Eva

2017-02-02

Conformational entropy changes associated with bond-vector motions in proteins contribute to the free energy of ligand-binding. To derive such contributions, we apply the slowly relaxing local structure (SRLS) approach to NMR relaxation from 15 N-H bonds or C-CDH 2 moieties of several proteins in free and ligand-bound form. The spatial restraints on probe motion, which determine the extent of local order, are expressed in SRLS by a well-defined potential, u(θ). The latter yields the orientational probability density, P eq  = exp(-u(θ)), and hence the related conformational entropy, Ŝ = -∫P eq (θ) ln[P eq (θ)] sin θ dθ (Ŝ is "entropy" in units of k B T, and θ represents the bond-vector orientation in the protein). SRLS is applied to 4-oxalocrotonate tautomerase (4-OT), the acyl-coenzyme A binding protein (ACBP), the C-terminal SH2 domain of phospholipase C γ 1 (PLC γ 1C SH2), the construct dihydrofolate reductase-E:folate (DHFR-E:folate), and their complexes with appropriate ligands, to determine ΔŜ. Eglin C and its V18A and V34A mutants are also studied. Finally, SRLS is applied to the structurally homologous proteins TNfn3 and FNfn10 to characterize within its scope the unusual "dynamics" of the TNfn3 core. Upon ligand-binding, the backbones of 4-OT, ACBP, and PLC γ 1C SH2 show limited, increased, and decreased order, respectively; the cores of DHFR-E:folate and PLC γ 1C SH2 become more ordered. The V18A (V34A) mutation increases (decreases) the order within the eglin C core. The core of TNfn3 is less ordered structurally and more mobile kinetically. Secondary structure versus loops, surface-binding versus core insertion, and ligand size emerged as being important in rationalizing ΔŜ. The consistent and general tool developed herein is expected to provide further insights in future work.

Investigating Diffusion and Entropy with Carbon Dioxide-Filled Balloons

ERIC Educational Resources Information Center

Jadrich, James; Bruxvoort, Crystal

2010-01-01

Fill an ordinary latex balloon with helium gas and you know what to expect. Over the next day or two the volume will decrease noticeably as helium escapes from the balloon. So what happens when a latex balloon is filled with carbon dioxide gas? Surprisingly, carbon dioxide balloons deflate at rates as much as an order of magnitude faster than…

Optimal control of orientation and entanglement for two dipole-dipole coupled quantum planar rotors.

PubMed

Yu, Hongling; Ho, Tak-San; Rabitz, Herschel

2018-05-09

Optimal control simulations are performed for orientation and entanglement of two dipole-dipole coupled identical quantum rotors. The rotors at various fixed separations lie on a model non-interacting plane with an applied control field. It is shown that optimal control of orientation or entanglement represents two contrasting control scenarios. In particular, the maximally oriented state (MOS) of the two rotors has a zero entanglement entropy and is readily attainable at all rotor separations. Whereas, the contrasting maximally entangled state (MES) has a zero orientation expectation value and is most conveniently attainable at small separations where the dipole-dipole coupling is strong. It is demonstrated that the peak orientation expectation value attained by the MOS at large separations exhibits a long time revival pattern due to the small energy splittings arising form the extremely weak dipole-dipole coupling between the degenerate product states of the two free rotors. Moreover, it is found that the peak entanglement entropy value attained by the MES remains largely unchanged as the two rotors are transported to large separations after turning off the control field. Finally, optimal control simulations of transition dynamics between the MOS and the MES reveal the intricate interplay between orientation and entanglement.

Entropy considerations applied to shock unsteadiness in hypersonic inlets

NASA Astrophysics Data System (ADS)

Bussey, Gillian Mary Harding

The stability of curved or rectangular shocks in hypersonic inlets in response to flow perturbations can be determined analytically from the principle of minimum entropy. Unsteady shock wave motion can have a significant effect on the flow in a hypersonic inlet or combustor. According to the principle of minimum entropy, a stable thermodynamic state is one with the lowest entropy gain. A model based on piston theory and its limits has been developed for applying the principle of minimum entropy to quasi-steady flow. Relations are derived for analyzing the time-averaged entropy gain flux across a shock for quasi-steady perturbations in atmospheric conditions and angle as a perturbation in entropy gain flux from the steady state. Initial results from sweeping a wedge at Mach 10 through several degrees in AEDC's Tunnel 9 indicates the bow shock becomes unsteady near the predicted normal Mach number. Several curved shocks of varying curvature are compared to a straight shock with the same mean normal Mach number, pressure ratio, or temperature ratio. The present work provides analysis and guidelines for designing an inlet robust to off- design flight or perturbations in flow conditions an inlet is likely to face. It also suggests that inlets with curved shocks are less robust to off-design flight than those with straight shocks such as rectangular inlets. Relations for evaluating entropy perturbations for highly unsteady flow across a shock and limits on their use were also developed. The normal Mach number at which a shock could be stable to high frequency upstream perturbations increases as the speed of the shock motion increases and slightly decreases as the perturbation size increases. The present work advances the principle of minimum entropy theory by providing additional validity for using the theory for time-varying flows and applying it to shocks, specifically those in inlets. While this analytic tool is applied in the present work for evaluating the stability of shocks in hypersonic inlets, it can be used for an arbitrary application with a shock.

Quantum coherence and correlations in quantum system

PubMed Central

Xi, Zhengjun; Li, Yongming; Fan, Heng

2015-01-01

Criteria of measure quantifying quantum coherence, a unique property of quantum system, are proposed recently. In this paper, we first give an uncertainty-like expression relating the coherence and the entropy of quantum system. This finding allows us to discuss the relations between the entanglement and the coherence. Further, we discuss in detail the relations among the coherence, the discord and the deficit in the bipartite quantum system. We show that, the one-way quantum deficit is equal to the sum between quantum discord and the relative entropy of coherence of measured subsystem. PMID:26094795

Large entropy derived from low-frequency vibrations and its implications for hydrogen storage

NASA Astrophysics Data System (ADS)

Wang, Xiaoxia; Chen, Hongshan

2018-02-01

Adsorption and desorption are driven by the energy and entropy competition, but the entropy effect is often ignored in hydrogen storage and the optimal adsorption strength for the ambient storage is controversial in the literature. This letter investigated the adsorption states of the H2 molecule on M-B12C6N6 (M = Li, Na, Mg, Ca, and Sc) and analyzed the correlation among the zero point energy (ZPE), the entropy change, and the adsorption energy and their effects on the delivery capacities. The ZPE has large correction to the adsorption energy due to the light mass of hydrogen. The computations show that the potential energies along the spherical surface centered at the alkali metals are very flat and it leads to large entropy (˜70 J/mol.K) of the adsorbed H2 molecules. The entropy change can compensate the enthalpy change effectively, and the ambient storage can be realized with relatively weak adsorption of ΔH = -12 kJ/mol. The results are encouraging and instructive for the design of hydrogen storage materials.

Spectral Entropy Based Neuronal Network Synchronization Analysis Based on Microelectrode Array Measurements

PubMed Central

Kapucu, Fikret E.; Välkki, Inkeri; Mikkonen, Jarno E.; Leone, Chiara; Lenk, Kerstin; Tanskanen, Jarno M. A.; Hyttinen, Jari A. K.

2016-01-01

Synchrony and asynchrony are essential aspects of the functioning of interconnected neuronal cells and networks. New information on neuronal synchronization can be expected to aid in understanding these systems. Synchronization provides insight in the functional connectivity and the spatial distribution of the information processing in the networks. Synchronization is generally studied with time domain analysis of neuronal events, or using direct frequency spectrum analysis, e.g., in specific frequency bands. However, these methods have their pitfalls. Thus, we have previously proposed a method to analyze temporal changes in the complexity of the frequency of signals originating from different network regions. The method is based on the correlation of time varying spectral entropies (SEs). SE assesses the regularity, or complexity, of a time series by quantifying the uniformity of the frequency spectrum distribution. It has been previously employed, e.g., in electroencephalogram analysis. Here, we revisit our correlated spectral entropy method (CorSE), providing evidence of its justification, usability, and benefits. Here, CorSE is assessed with simulations and in vitro microelectrode array (MEA) data. CorSE is first demonstrated with a specifically tailored toy simulation to illustrate how it can identify synchronized populations. To provide a form of validation, the method was tested with simulated data from integrate-and-fire model based computational neuronal networks. To demonstrate the analysis of real data, CorSE was applied on in vitro MEA data measured from rat cortical cell cultures, and the results were compared with three known event based synchronization measures. Finally, we show the usability by tracking the development of networks in dissociated mouse cortical cell cultures. The results show that temporal correlations in frequency spectrum distributions reflect the network relations of neuronal populations. In the simulated data, CorSE unraveled the synchronizations. With the real in vitro MEA data, CorSE produced biologically plausible results. Since CorSE analyses continuous data, it is not affected by possibly poor spike or other event detection quality. We conclude that CorSE can reveal neuronal network synchronization based on in vitro MEA field potential measurements. CorSE is expected to be equally applicable also in the analysis of corresponding in vivo and ex vivo data analysis. PMID:27803660

Image coding using entropy-constrained residual vector quantization

NASA Technical Reports Server (NTRS)

Kossentini, Faouzi; Smith, Mark J. T.; Barnes, Christopher F.

1993-01-01

The residual vector quantization (RVQ) structure is exploited to produce a variable length codeword RVQ. Necessary conditions for the optimality of this RVQ are presented, and a new entropy-constrained RVQ (ECRVQ) design algorithm is shown to be very effective in designing RVQ codebooks over a wide range of bit rates and vector sizes. The new EC-RVQ has several important advantages. It can outperform entropy-constrained VQ (ECVQ) in terms of peak signal-to-noise ratio (PSNR), memory, and computation requirements. It can also be used to design high rate codebooks and codebooks with relatively large vector sizes. Experimental results indicate that when the new EC-RVQ is applied to image coding, very high quality is achieved at relatively low bit rates.

Understanding the Thermodynamic Properties of the Elastocaloric Effect Through Experimentation and Modelling

NASA Astrophysics Data System (ADS)

Tušek, Jaka; Engelbrecht, Kurt; Mañosa, Lluis; Vives, Eduard; Pryds, Nini

2016-12-01

This paper presents direct and indirect methods for studying the elastocaloric effect (eCE) in shape memory materials and its comparison. The eCE can be characterized by the adiabatic temperature change or the isothermal entropy change (both as a function of applied stress/strain). To get these quantities, the evaluation of the eCE can be done using either direct methods, where one measures (adiabatic) temperature changes or indirect methods where one can measure the stress-strain-temperature characteristics of the materials and from these deduce the adiabatic temperature and isothermal entropy changes. The former can be done using the basic thermodynamic relations, i.e. Maxwell relation and Clausius-Clapeyron equation. This paper further presents basic thermodynamic properties of shape memory materials, such as the adiabatic temperature change, isothermal entropy change and total entropy-temperature diagrams (all as a function of temperature and applied stress/strain) of two groups of materials (Ni-Ti and Cu-Zn-Al alloys) obtained using indirect methods through phenomenological modelling and Maxwell relation. In the last part of the paper, the basic definition of the efficiency of the elastocaloric thermodynamic cycle (coefficient of performance) is defined and discussed.

Quantifying ‘Causality’ in Complex Systems: Understanding Transfer Entropy

PubMed Central

Abdul Razak, Fatimah; Jensen, Henrik Jeldtoft

2014-01-01

‘Causal’ direction is of great importance when dealing with complex systems. Often big volumes of data in the form of time series are available and it is important to develop methods that can inform about possible causal connections between the different observables. Here we investigate the ability of the Transfer Entropy measure to identify causal relations embedded in emergent coherent correlations. We do this by firstly applying Transfer Entropy to an amended Ising model. In addition we use a simple Random Transition model to test the reliability of Transfer Entropy as a measure of ‘causal’ direction in the presence of stochastic fluctuations. In particular we systematically study the effect of the finite size of data sets. PMID:24955766

Field-temperature phase diagram and entropy landscape of CeAuSb 2

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhao, Lishan; Yelland, Edward A.; Bruin, Jan A. N.

2016-05-12

Here, we report a field-temperature phase diagram and an entropy map for the heavy-fermion compound CeAuSb 2. CeAuSb 2 orders antiferromagnetically below T N = 6.6 K and has two metamagnetic transitions, at 2.8 and 5.6 T. The locations of the critical end points of the metamagnetic transitions, which may play a strong role in the putative quantum criticality of CeAuSb 2 and related compounds, are identified. The entropy map reveals an apparent entropy balance with Fermi-liquid behavior, implying that above the Neel transition the Ce moments are incorporated into the Fermi liquid. High-field data showing that the magnetic behaviormore » is remarkably anisotropic are also reported.« less

Analysis of the anomalous mean-field like properties of Gaussian core model in terms of entropy

NASA Astrophysics Data System (ADS)

Nandi, Manoj Kumar; Maitra Bhattacharyya, Sarika

2018-01-01

Studies of the Gaussian core model (GCM) have shown that it behaves like a mean-field model and the properties are quite different from standard glass former. In this work, we investigate the entropies, namely, the excess entropy (Sex) and the configurational entropy (Sc) and their different components to address these anomalies. Our study corroborates most of the earlier observations and also sheds new light on the high and low temperature dynamics. We find that unlike in standard glass former where high temperature dynamics is dominated by two-body correlation and low temperature by many-body correlations, in the GCM both high and low temperature dynamics are dominated by many-body correlations. We also find that the many-body entropy which is usually positive at low temperatures and is associated with activated dynamics is negative in the GCM suggesting suppression of activation. Interestingly despite the suppression of activation, the Adam-Gibbs (AG) relation that describes activated dynamics holds in the GCM, thus suggesting a non-activated contribution in AG relation. We also find an overlap between the AG relation and mode coupling power law regime leading to a power law behavior of Sc. From our analysis of this power law behavior, we predict that in the GCM the high temperature dynamics will disappear at dynamical transition temperature and below that there will be a transition to the activated regime. Our study further reveals that the activated regime in the GCM is quite narrow.

Sample entropy analysis of cervical neoplasia gene-expression signatures

PubMed Central

Botting, Shaleen K; Trzeciakowski, Jerome P; Benoit, Michelle F; Salama, Salama A; Diaz-Arrastia, Concepcion R

2009-01-01

Background We introduce Approximate Entropy as a mathematical method of analysis for microarray data. Approximate entropy is applied here as a method to classify the complex gene expression patterns resultant of a clinical sample set. Since Entropy is a measure of disorder in a system, we believe that by choosing genes which display minimum entropy in normal controls and maximum entropy in the cancerous sample set we will be able to distinguish those genes which display the greatest variability in the cancerous set. Here we describe a method of utilizing Approximate Sample Entropy (ApSE) analysis to identify genes of interest with the highest probability of producing an accurate, predictive, classification model from our data set. Results In the development of a diagnostic gene-expression profile for cervical intraepithelial neoplasia (CIN) and squamous cell carcinoma of the cervix, we identified 208 genes which are unchanging in all normal tissue samples, yet exhibit a random pattern indicative of the genetic instability and heterogeneity of malignant cells. This may be measured in terms of the ApSE when compared to normal tissue. We have validated 10 of these genes on 10 Normal and 20 cancer and CIN3 samples. We report that the predictive value of the sample entropy calculation for these 10 genes of interest is promising (75% sensitivity, 80% specificity for prediction of cervical cancer over CIN3). Conclusion The success of the Approximate Sample Entropy approach in discerning alterations in complexity from biological system with such relatively small sample set, and extracting biologically relevant genes of interest hold great promise. PMID:19232110

Characterizing time series via complexity-entropy curves

NASA Astrophysics Data System (ADS)

Ribeiro, Haroldo V.; Jauregui, Max; Zunino, Luciano; Lenzi, Ervin K.

2017-06-01

The search for patterns in time series is a very common task when dealing with complex systems. This is usually accomplished by employing a complexity measure such as entropies and fractal dimensions. However, such measures usually only capture a single aspect of the system dynamics. Here, we propose a family of complexity measures for time series based on a generalization of the complexity-entropy causality plane. By replacing the Shannon entropy by a monoparametric entropy (Tsallis q entropy) and after considering the proper generalization of the statistical complexity (q complexity), we build up a parametric curve (the q -complexity-entropy curve) that is used for characterizing and classifying time series. Based on simple exact results and numerical simulations of stochastic processes, we show that these curves can distinguish among different long-range, short-range, and oscillating correlated behaviors. Also, we verify that simulated chaotic and stochastic time series can be distinguished based on whether these curves are open or closed. We further test this technique in experimental scenarios related to chaotic laser intensity, stock price, sunspot, and geomagnetic dynamics, confirming its usefulness. Finally, we prove that these curves enhance the automatic classification of time series with long-range correlations and interbeat intervals of healthy subjects and patients with heart disease.

Optimization of a Circular Microchannel With Entropy Generation Minimization Method

NASA Astrophysics Data System (ADS)

Jafari, Arash; Ghazali, Normah Mohd

2010-06-01

New advances in micro and nano scales are being realized and the contributions of micro and nano heat dissipation devices are of high importance in this novel technology development. Past studies showed that microchannel design depends on its thermal resistance and pressure drop. However, entropy generation minimization (EGM) as a new optimization theory stated that the rate of entropy generation should be also optimized. Application of EGM in microchannel heat sink design is reviewed and discussed in this paper. Latest principles for deriving the entropy generation relations are discussed to present how this approach can be achieved. An optimization procedure using EGM method with the entropy generation rate is derived for a circular microchannel heat sink based upon thermal resistance and pressure drop. The equations are solved using MATLAB and the obtained results are compared to similar past studies. The effects of channel diameter, number of channels, heat flux, and pumping power on the entropy generation rate and Reynolds number are investigated. Analytical correlations are utilized for heat transfer and friction coefficients. A minimum entropy generation has been observed for N = 40 and channel diameter of 90μm. It is concluded that for N = 40 and channel hydraulic diameter of 90μm, the circular microchannel heat sink is on its optimum operating point based on second law of thermodynamics.

Entropy production and optimization of geothermal power plants

NASA Astrophysics Data System (ADS)

Michaelides, Efstathios E.

2012-09-01

Geothermal power plants are currently producing reliable and low-cost, base load electricity. Three basic types of geothermal power plants are currently in operation: single-flashing, dual-flashing, and binary power plants. Typically, the single-flashing and dual-flashing geothermal power plants utilize geothermal water (brine) at temperatures in the range of 550-430 K. Binary units utilize geothermal resources at lower temperatures, typically 450-380 K. The entropy production in the various components of the three types of geothermal power plants determines the efficiency of the plants. It is axiomatic that a lower entropy production would improve significantly the energy utilization factor of the corresponding power plant. For this reason, the entropy production in the major components of the three types of geothermal power plants has been calculated. It was observed that binary power plants generate the lowest amount of entropy and, thus, convert the highest rate of geothermal energy into mechanical energy. The single-flashing units generate the highest amount of entropy, primarily because they re-inject fluid at relatively high temperature. The calculations for entropy production provide information on the equipment where the highest irreversibilities occur, and may be used to optimize the design of geothermal processes in future geothermal power plants and thermal cycles used for the harnessing of geothermal energy.

Diffusivity anomaly in modified Stillinger-Weber liquids

NASA Astrophysics Data System (ADS)

Sengupta, Shiladitya; Vasisht, Vishwas V.; Sastry, Srikanth

2014-01-01

By modifying the tetrahedrality (the strength of the three body interactions) in the well-known Stillinger-Weber model for silicon, we study the diffusivity of a series of model liquids as a function of tetrahedrality and temperature at fixed pressure. Previous work has shown that at constant temperature, the diffusivity exhibits a maximum as a function of tetrahedrality, which we refer to as the diffusivity anomaly, in analogy with the well-known anomaly in water upon variation of pressure at constant temperature. We explore to what extent the structural and thermodynamic changes accompanying changes in the interaction potential can help rationalize the diffusivity anomaly, by employing the Rosenfeld relation between diffusivity and the excess entropy (over the ideal gas reference value), and the pair correlation entropy, which provides an approximation to the excess entropy in terms of the pair correlation function. We find that in the modified Stillinger-Weber liquids, the Rosenfeld relation works well above the melting temperatures but exhibits deviations below, with the deviations becoming smaller for smaller tetrahedrality. Further we find that both the excess entropy and the pair correlation entropy at constant temperature go through maxima as a function of the tetrahedrality, thus demonstrating the close relationship between structural, thermodynamic, and dynamical anomalies in the modified Stillinger-Weber liquids.

Quasiparticle entropy in superconductor/normal metal/superconductor proximity junctions in the diffusive limit

NASA Astrophysics Data System (ADS)

Virtanen, P.; Vischi, F.; Strambini, E.; Carrega, M.; Giazotto, F.

2017-12-01

We discuss the quasiparticle entropy and heat capacity of a dirty superconductor/normal metal/superconductor junction. In the case of short junctions, the inverse proximity effect extending in the superconducting banks plays a crucial role in determining the thermodynamic quantities. In this case, commonly used approximations can violate thermodynamic relations between supercurrent and quasiparticle entropy. We provide analytical and numerical results as a function of different geometrical parameters. Quantitative estimates for the heat capacity can be relevant for the design of caloritronic devices or radiation sensor applications.

Quantifying uncertainty due to fission-fusion dynamics as a component of social complexity.

PubMed

Ramos-Fernandez, Gabriel; King, Andrew J; Beehner, Jacinta C; Bergman, Thore J; Crofoot, Margaret C; Di Fiore, Anthony; Lehmann, Julia; Schaffner, Colleen M; Snyder-Mackler, Noah; Zuberbühler, Klaus; Aureli, Filippo; Boyer, Denis

2018-05-30

Groups of animals (including humans) may show flexible grouping patterns, in which temporary aggregations or subgroups come together and split, changing composition over short temporal scales, (i.e. fission and fusion). A high degree of fission-fusion dynamics may constrain the regulation of social relationships, introducing uncertainty in interactions between group members. Here we use Shannon's entropy to quantify the predictability of subgroup composition for three species known to differ in the way their subgroups come together and split over time: spider monkeys ( Ateles geoffroyi ), chimpanzees ( Pan troglodytes ) and geladas ( Theropithecus gelada ). We formulate a random expectation of entropy that considers subgroup size variation and sample size, against which the observed entropy in subgroup composition can be compared. Using the theory of set partitioning, we also develop a method to estimate the number of subgroups that the group is likely to be divided into, based on the composition and size of single focal subgroups. Our results indicate that Shannon's entropy and the estimated number of subgroups present at a given time provide quantitative metrics of uncertainty in the social environment (within which social relationships must be regulated) for groups with different degrees of fission-fusion dynamics. These metrics also represent an indirect quantification of the cognitive challenges posed by socially dynamic environments. Overall, our novel methodological approach provides new insight for understanding the evolution of social complexity and the mechanisms to cope with the uncertainty that results from fission-fusion dynamics. © 2017 The Author(s).

THE INTRAGROUP VERSUS THE INTRACLUSTER MEDIUM

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cavaliere, A.; Fusco-Femiano, R.; Lapi, A., E-mail: roberto.fuscofemiano@iaps.inaf.it

2016-06-20

Galaxy groups differ from clusters primarily by way of their lower masses, M ∼ 10{sup 14} M {sub ⊙} versus M ∼ 10{sup 15} M {sub ⊙}. We discuss how mass affects the thermal state of the intracluster or the intragroup medium, specifically as to their entropy levels and radial profiles. We show that entropy is produced in both cases by the continuing inflow of intergalactic gas across the system boundary into the gravitational potential well. The inflow is highly supersonic in clusters, but weakly so in groups. The former condition implies strong accretion shocks with substantial conversion of amore » large bulk kinetic into thermal energy, whereas the latter condition implies less effective conversion of lower energies. These features produce a conspicuous difference in entropy deposition at the current boundary. Thereafter, adiabatic compression of the hot gas into the potential well converts such time histories into radial profiles throughout a cluster or a group. In addition, in both cases, a location of the system at low z in the accelerating universe or in a poor environment will starve out the inflow and the entropy production and produce flattening or even bending down of the outer profile. We analyze, in detail, the sharp evidence provided by the two groups ESO 3060170 and RXJ1159+5531 that have been recently observed in X-rays out to their virial radii and find a close and detailed match with our expectations.« less

The Rényi entanglement entropy of a general quantum dimer model at the RK point: a highly efficient algorithm.

PubMed

Pei, Jiquan; Han, Steve; Liao, Haijun; Li, Tao

2014-01-22

A highly efficient and simple-to-implement Monte Carlo algorithm is proposed for the evaluation of the Rényi entanglement entropy (REE) of the quantum dimer model (QDM) at the Rokhsar-Kivelson (RK) point. It makes possible the evaluation of REE at the RK point to the thermodynamic limit for a general QDM. We apply the algorithm to a QDM defined on the triangular and the square lattice in two dimensions and the simple and the face centered cubic (fcc) lattice in three dimensions. We find the REE on all these lattices follows perfect linear scaling in the thermodynamic limit, apart from an even-odd oscillation in the case of the square lattice. We also evaluate the topological entanglement entropy (TEE) with both a subtraction and an extrapolation procedure. We find the QDMs on both the triangular and the fcc lattice exhibit robust Z2 topological order. The expected TEE of ln2 is clearly demonstrated in both cases. Our large scale simulation also proves the recently proposed extrapolation procedure in cylindrical geometry to be a highly reliable way to extract the TEE of a topologically ordered system.

Quantifying the entropic cost of cellular growth control

NASA Astrophysics Data System (ADS)

De Martino, Daniele; Capuani, Fabrizio; De Martino, Andrea

2017-07-01

Viewing the ways a living cell can organize its metabolism as the phase space of a physical system, regulation can be seen as the ability to reduce the entropy of that space by selecting specific cellular configurations that are, in some sense, optimal. Here we quantify the amount of regulation required to control a cell's growth rate by a maximum-entropy approach to the space of underlying metabolic phenotypes, where a configuration corresponds to a metabolic flux pattern as described by genome-scale models. We link the mean growth rate achieved by a population of cells to the minimal amount of metabolic regulation needed to achieve it through a phase diagram that highlights how growth suppression can be as costly (in regulatory terms) as growth enhancement. Moreover, we provide an interpretation of the inverse temperature β controlling maximum-entropy distributions based on the underlying growth dynamics. Specifically, we show that the asymptotic value of β for a cell population can be expected to depend on (i) the carrying capacity of the environment, (ii) the initial size of the colony, and (iii) the probability distribution from which the inoculum was sampled. Results obtained for E. coli and human cells are found to be remarkably consistent with empirical evidence.

Increased shell entropy as an explanation for observed decreased shell areal densities in OMEGA implosions

NASA Astrophysics Data System (ADS)

Hoffman, Nelson; Herrmann, Hans; Kim, Yongho

2014-10-01

A reduced ion-kinetic (RIK) model used in hydrodynamic simulations has had some success in explaining time- and space-averaged observables characterizing the fusion fuel in hot low-density ICF capsule implosions driven by 1-ns 60-beam laser pulses at OMEGA. But observables characterizing the capsule shell, e.g., the areal density of 12C in a plastic shell, have proved harder to explain. Recently we have found that assuming the shell has higher entropy than expected in a 1D laser-driven RIK simulation allows an explanation of the observed values of 12C areal density, and its dependence on initial shell thickness in a set of DT-filled plastic capsules. If, for example, a 15- μm CH shell implodes on an adiabat two to three times higher than predicted in a typical unmodified RIK simulation, the calculated burn-averaged shell areal density decreases from ~80 mg/cm2 in the unmodified simulation to the observed value of ~25 mg/cm2. We discuss possible mechanisms that could lead to increased entropy in such implosions. Research supported by U.S. Department of Energy under Contract DE-AC52-06NA25396.

Chemical equilibrium. [maximizing entropy of gas system to derive relations between thermodynamic variables

NASA Technical Reports Server (NTRS)

1976-01-01

The entropy of a gas system with the number of particles subject to external control is maximized to derive relations between the thermodynamic variables that obtain at equilibrium. These relations are described in terms of the chemical potential, defined as equivalent partial derivatives of entropy, energy, enthalpy, free energy, or free enthalpy. At equilibrium, the change in total chemical potential must vanish. This fact is used to derive the equilibrium constants for chemical reactions in terms of the partition functions of the species involved in the reaction. Thus the equilibrium constants can be determined accurately, just as other thermodynamic properties, from a knowledge of the energy levels and degeneracies for the gas species involved. These equilibrium constants permit one to calculate the equilibrium concentrations or partial pressures of chemically reacting species that occur in gas mixtures at any given condition of pressure and temperature or volume and temperature.

Maximum one-shot dissipated work from Rényi divergences

NASA Astrophysics Data System (ADS)

Yunger Halpern, Nicole; Garner, Andrew J. P.; Dahlsten, Oscar C. O.; Vedral, Vlatko

2018-05-01

Thermodynamics describes large-scale, slowly evolving systems. Two modern approaches generalize thermodynamics: fluctuation theorems, which concern finite-time nonequilibrium processes, and one-shot statistical mechanics, which concerns small scales and finite numbers of trials. Combining these approaches, we calculate a one-shot analog of the average dissipated work defined in fluctuation contexts: the cost of performing a protocol in finite time instead of quasistatically. The average dissipated work has been shown to be proportional to a relative entropy between phase-space densities, to a relative entropy between quantum states, and to a relative entropy between probability distributions over possible values of work. We derive one-shot analogs of all three equations, demonstrating that the order-infinity Rényi divergence is proportional to the maximum possible dissipated work in each case. These one-shot analogs of fluctuation-theorem results contribute to the unification of these two toolkits for small-scale, nonequilibrium statistical physics.

Maximum one-shot dissipated work from Rényi divergences.

PubMed

Yunger Halpern, Nicole; Garner, Andrew J P; Dahlsten, Oscar C O; Vedral, Vlatko

2018-05-01

Thermodynamics describes large-scale, slowly evolving systems. Two modern approaches generalize thermodynamics: fluctuation theorems, which concern finite-time nonequilibrium processes, and one-shot statistical mechanics, which concerns small scales and finite numbers of trials. Combining these approaches, we calculate a one-shot analog of the average dissipated work defined in fluctuation contexts: the cost of performing a protocol in finite time instead of quasistatically. The average dissipated work has been shown to be proportional to a relative entropy between phase-space densities, to a relative entropy between quantum states, and to a relative entropy between probability distributions over possible values of work. We derive one-shot analogs of all three equations, demonstrating that the order-infinity Rényi divergence is proportional to the maximum possible dissipated work in each case. These one-shot analogs of fluctuation-theorem results contribute to the unification of these two toolkits for small-scale, nonequilibrium statistical physics.

Predicting the Cosmological Constant from the CausalEntropic Principle

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bousso, Raphael; Harnik, Roni; Kribs, Graham D.

2007-02-20

We compute the expected value of the cosmological constant in our universe from the Causal Entropic Principle. Since observers must obey the laws of thermodynamics and causality, it asserts that physical parameters are most likely to be found in the range of values for which the total entropy production within a causally connected region is maximized. Despite the absence of more explicit anthropic criteria, the resulting probability distribution turns out to be in excellent agreement with observation. In particular, we find that dust heated by stars dominates the entropy production, demonstrating the remarkable power of this thermodynamic selection criterion. Themore » alternative approach--weighting by the number of ''observers per baryon''--is less well-defined, requires problematic assumptions about the nature of observers, and yet prefers values larger than present experimental bounds.« less

Entanglement spectrum of random-singlet quantum critical points

NASA Astrophysics Data System (ADS)

Fagotti, Maurizio; Calabrese, Pasquale; Moore, Joel E.

2011-01-01

The entanglement spectrum (i.e., the full distribution of Schmidt eigenvalues of the reduced density matrix) contains more information than the conventional entanglement entropy and has been studied recently in several many-particle systems. We compute the disorder-averaged entanglement spectrum in the form of the disorder-averaged moments TrρAα̲ of the reduced density matrix ρA for a contiguous block of many spins at the random-singlet quantum critical point in one dimension. The result compares well in the scaling limit with numerical studies on the random XX model and is also expected to describe the (interacting) random Heisenberg model. Our numerical studies on the XX case reveal that the dependence of the entanglement entropy and spectrum on the geometry of the Hilbert space partition is quite different than for conformally invariant critical points.

Colorectal Cancer and Colitis Diagnosis Using Fourier Transform Infrared Spectroscopy and an Improved K-Nearest-Neighbour Classifier.

PubMed

Li, Qingbo; Hao, Can; Kang, Xue; Zhang, Jialin; Sun, Xuejun; Wang, Wenbo; Zeng, Haishan

2017-11-27

Combining Fourier transform infrared spectroscopy (FTIR) with endoscopy, it is expected that noninvasive, rapid detection of colorectal cancer can be performed in vivo in the future. In this study, Fourier transform infrared spectra were collected from 88 endoscopic biopsy colorectal tissue samples (41 colitis and 47 cancers). A new method, viz., entropy weight local-hyperplane k-nearest-neighbor (EWHK), which is an improved version of K-local hyperplane distance nearest-neighbor (HKNN), is proposed for tissue classification. In order to avoid limiting high dimensions and small values of the nearest neighbor, the new EWHK method calculates feature weights based on information entropy. The average results of the random classification showed that the EWHK classifier for differentiating cancer from colitis samples produced a sensitivity of 81.38% and a specificity of 92.69%.

Maximum entropy perception-action space: a Bayesian model of eye movement selection

NASA Astrophysics Data System (ADS)

Colas, Francis; Bessière, Pierre; Girard, Benoît

2011-03-01

In this article, we investigate the issue of the selection of eye movements in a free-eye Multiple Object Tracking task. We propose a Bayesian model of retinotopic maps with a complex logarithmic mapping. This model is structured in two parts: a representation of the visual scene, and a decision model based on the representation. We compare different decision models based on different features of the representation and we show that taking into account uncertainty helps predict the eye movements of subjects recorded in a psychophysics experiment. Finally, based on experimental data, we postulate that the complex logarithmic mapping has a functional relevance, as the density of objects in this space in more uniform than expected. This may indicate that the representation space and control strategies are such that the object density is of maximum entropy.

Directionality theory and the evolution of body size.

PubMed

Demetrius, L

2000-12-07

Directionality theory, a dynamic theory of evolution that integrates population genetics with demography, is based on the concept of evolutionary entropy, a measure of the variability in the age of reproducing individuals in a population. The main tenets of the theory are three principles relating the response to the ecological constraints a population experiences, with trends in entropy as the population evolves under mutation and natural selection. (i) Stationary size or fluctuations around a stationary size (bounded growth): a unidirectional increase in entropy; (ii) prolonged episodes of exponential growth (unbounded growth), large population size: a unidirectional decrease in entropy; and (iii) prolonged episodes of exponential growth (unbounded growth), small population size: random, non-directional change in entropy. We invoke these principles, together with an allometric relationship between entropy, and the morphometric variable body size, to provide evolutionary explanations of three empirical patterns pertaining to trends in body size, namely (i) Cope's rule, the tendency towards size increase within phyletic lineages; (ii) the island rule, which pertains to changes in body size that occur as species migrate from mainland populations to colonize island habitats; and (iii) Bergmann's rule, the tendency towards size increase with increasing latitude. The observation that these ecotypic patterns can be explained in terms of the directionality principles for entropy underscores the significance of evolutionary entropy as a unifying concept in forging a link between micro-evolution, the dynamics of gene frequency change, and macro-evolution, dynamic changes in morphometric variables.

The relative entropy is fundamental to adaptive resolution simulations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kreis, Karsten; Graduate School Materials Science in Mainz, Staudingerweg 9, 55128 Mainz; Potestio, Raffaello, E-mail: potestio@mpip-mainz.mpg.de

Adaptive resolution techniques are powerful methods for the efficient simulation of soft matter systems in which they simultaneously employ atomistic and coarse-grained (CG) force fields. In such simulations, two regions with different resolutions are coupled with each other via a hybrid transition region, and particles change their description on the fly when crossing this boundary. Here we show that the relative entropy, which provides a fundamental basis for many approaches in systematic coarse-graining, is also an effective instrument for the understanding of adaptive resolution simulation methodologies. We demonstrate that the use of coarse-grained potentials which minimize the relative entropy withmore » respect to the atomistic system can help achieve a smoother transition between the different regions within the adaptive setup. Furthermore, we derive a quantitative relation between the width of the hybrid region and the seamlessness of the coupling. Our results do not only shed light on the what and how of adaptive resolution techniques but will also help setting up such simulations in an optimal manner.« less

The relative entropy is fundamental to adaptive resolution simulations

NASA Astrophysics Data System (ADS)

Kreis, Karsten; Potestio, Raffaello

2016-07-01

Adaptive resolution techniques are powerful methods for the efficient simulation of soft matter systems in which they simultaneously employ atomistic and coarse-grained (CG) force fields. In such simulations, two regions with different resolutions are coupled with each other via a hybrid transition region, and particles change their description on the fly when crossing this boundary. Here we show that the relative entropy, which provides a fundamental basis for many approaches in systematic coarse-graining, is also an effective instrument for the understanding of adaptive resolution simulation methodologies. We demonstrate that the use of coarse-grained potentials which minimize the relative entropy with respect to the atomistic system can help achieve a smoother transition between the different regions within the adaptive setup. Furthermore, we derive a quantitative relation between the width of the hybrid region and the seamlessness of the coupling. Our results do not only shed light on the what and how of adaptive resolution techniques but will also help setting up such simulations in an optimal manner.

Computing the Entropy of Kerr-Newman Black Hole Without Brick Walls Method

NASA Astrophysics Data System (ADS)

Zhang, Li-Chun; Wu, Yue-Qin; Li, Huai-Fan; Ren, Zhao

By using the entanglement entropy method, the statistical entropy of the Bose and Fermi fields in a thin film is calculated and the Bekenstein-Hawking entropy of Kerr-Newman black hole is obtained. Here, the Bose and Fermi fields are entangled with the quantum states in Kerr-Newman black hole and are outside of the horizon. The divergence of brick-wall model is avoided without any cutoff by the new equation of state density obtained with the generalized uncertainty principle. The calculation implies that the high density quantum states near the event horizon are strongly correlated with the quantum states in black hole. The black hole entropy is a quantum effect. It is an intrinsic characteristic of space-time. The ultraviolet cutoff in the brick-wall model is unreasonable. The generalized uncertainty principle should be considered in the high energy quantum field near the event horizon. From the calculation, the constant λ introduced in the generalized uncertainty principle is related to polar angle θ in an axisymmetric space-time.

Large magnetic entropy change and magnetoresistance in a Ni 41Co 9Mn 40Sn 10 magnetic shape memory alloy

DOE PAGES

Huang, L.; Cong, D. Y.; Ma, L.; ...

2015-07-02

A polycrystalline Ni 41Co 9Mn 40Sn 10 (at. %) magnetic shape memory alloy was prepared by arc melting and characterized mainly by magnetic measurements, in-situ high-energy X-ray diffraction (HEXRD), and mechanical testing. A large magnetoresistance of 53.8% (under 5 T) and a large magnetic entropy change of 31.9 J/(kg K) (under 5 T) were simultaneously achieved. Both of these values are among the highest values reported so far in Ni-Mn-Sn-based Heusler alloys. The large magnetic entropy change, closely related to the structural entropy change, is attributed to the large unit cell volume change across martensitic transformation as revealed by ourmore » in-situ HEXRD experiment. Furthermore, good compressive properties were also obtained. Lastly, the combination of large magnetoresistance, large magnetic entropy change, and good compressive properties, as well as low cost makes this alloy a promising candidate for multifunctional applications.« less

Entropy and convexity for nonlinear partial differential equations

PubMed Central

Ball, John M.; Chen, Gui-Qiang G.

2013-01-01

Partial differential equations are ubiquitous in almost all applications of mathematics, where they provide a natural mathematical description of many phenomena involving change in physical, chemical, biological and social processes. The concept of entropy originated in thermodynamics and statistical physics during the nineteenth century to describe the heat exchanges that occur in the thermal processes in a thermodynamic system, while the original notion of convexity is for sets and functions in mathematics. Since then, entropy and convexity have become two of the most important concepts in mathematics. In particular, nonlinear methods via entropy and convexity have been playing an increasingly important role in the analysis of nonlinear partial differential equations in recent decades. This opening article of the Theme Issue is intended to provide an introduction to entropy, convexity and related nonlinear methods for the analysis of nonlinear partial differential equations. We also provide a brief discussion about the content and contributions of the papers that make up this Theme Issue. PMID:24249768

Generalized Entanglement Entropies of Quantum Designs.

PubMed

Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun

2018-03-30

The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.

A modified belief entropy in Dempster-Shafer framework.

PubMed

Zhou, Deyun; Tang, Yongchuan; Jiang, Wen

2017-01-01

How to quantify the uncertain information in the framework of Dempster-Shafer evidence theory is still an open issue. Quite a few uncertainty measures have been proposed in Dempster-Shafer framework, however, the existing studies mainly focus on the mass function itself, the available information represented by the scale of the frame of discernment (FOD) in the body of evidence is ignored. Without taking full advantage of the information in the body of evidence, the existing methods are somehow not that efficient. In this paper, a modified belief entropy is proposed by considering the scale of FOD and the relative scale of a focal element with respect to FOD. Inspired by Deng entropy, the new belief entropy is consistent with Shannon entropy in the sense of probability consistency. What's more, with less information loss, the new measure can overcome the shortage of some other uncertainty measures. A few numerical examples and a case study are presented to show the efficiency and superiority of the proposed method.

A modified belief entropy in Dempster-Shafer framework

PubMed Central

Zhou, Deyun; Jiang, Wen

2017-01-01

How to quantify the uncertain information in the framework of Dempster-Shafer evidence theory is still an open issue. Quite a few uncertainty measures have been proposed in Dempster-Shafer framework, however, the existing studies mainly focus on the mass function itself, the available information represented by the scale of the frame of discernment (FOD) in the body of evidence is ignored. Without taking full advantage of the information in the body of evidence, the existing methods are somehow not that efficient. In this paper, a modified belief entropy is proposed by considering the scale of FOD and the relative scale of a focal element with respect to FOD. Inspired by Deng entropy, the new belief entropy is consistent with Shannon entropy in the sense of probability consistency. What’s more, with less information loss, the new measure can overcome the shortage of some other uncertainty measures. A few numerical examples and a case study are presented to show the efficiency and superiority of the proposed method. PMID:28481914

Generalized Entanglement Entropies of Quantum Designs

NASA Astrophysics Data System (ADS)

Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun

2018-03-01

The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.

A Discrete Constraint for Entropy Conservation and Sound Waves in Cloud-Resolving Modeling

NASA Technical Reports Server (NTRS)

Zeng, Xi-Ping; Tao, Wei-Kuo; Simpson, Joanne

2003-01-01

Ideal cloud-resolving models contain little-accumulative errors. When their domain is so large that synoptic large-scale circulations are accommodated, they can be used for the simulation of the interaction between convective clouds and the large-scale circulations. This paper sets up a framework for the models, using moist entropy as a prognostic variable and employing conservative numerical schemes. The models possess no accumulative errors of thermodynamic variables when they comply with a discrete constraint on entropy conservation and sound waves. Alternatively speaking, the discrete constraint is related to the correct representation of the large-scale convergence and advection of moist entropy. Since air density is involved in entropy conservation and sound waves, the challenge is how to compute sound waves efficiently under the constraint. To address the challenge, a compensation method is introduced on the basis of a reference isothermal atmosphere whose governing equations are solved analytically. Stability analysis and numerical experiments show that the method allows the models to integrate efficiently with a large time step.

Entropy and convexity for nonlinear partial differential equations.

PubMed

Ball, John M; Chen, Gui-Qiang G

2013-12-28

Partial differential equations are ubiquitous in almost all applications of mathematics, where they provide a natural mathematical description of many phenomena involving change in physical, chemical, biological and social processes. The concept of entropy originated in thermodynamics and statistical physics during the nineteenth century to describe the heat exchanges that occur in the thermal processes in a thermodynamic system, while the original notion of convexity is for sets and functions in mathematics. Since then, entropy and convexity have become two of the most important concepts in mathematics. In particular, nonlinear methods via entropy and convexity have been playing an increasingly important role in the analysis of nonlinear partial differential equations in recent decades. This opening article of the Theme Issue is intended to provide an introduction to entropy, convexity and related nonlinear methods for the analysis of nonlinear partial differential equations. We also provide a brief discussion about the content and contributions of the papers that make up this Theme Issue.

Protein flexibility and conformational entropy in ligand design targeting the carbohydrate recognition domain of galectin-3.

PubMed

Diehl, Carl; Engström, Olof; Delaine, Tamara; Håkansson, Maria; Genheden, Samuel; Modig, Kristofer; Leffler, Hakon; Ryde, Ulf; Nilsson, Ulf J; Akke, Mikael

2010-10-20

Rational drug design is predicated on knowledge of the three-dimensional structure of the protein-ligand complex and the thermodynamics of ligand binding. Despite the fundamental importance of both enthalpy and entropy in driving ligand binding, the role of conformational entropy is rarely addressed in drug design. In this work, we have probed the conformational entropy and its relative contribution to the free energy of ligand binding to the carbohydrate recognition domain of galectin-3. Using a combination of NMR spectroscopy, isothermal titration calorimetry, and X-ray crystallography, we characterized the binding of three ligands with dissociation constants ranging over 2 orders of magnitude. (15)N and (2)H spin relaxation measurements showed that the protein backbone and side chains respond to ligand binding by increased conformational fluctuations, on average, that differ among the three ligand-bound states. Variability in the response to ligand binding is prominent in the hydrophobic core, where a distal cluster of methyl groups becomes more rigid, whereas methyl groups closer to the binding site become more flexible. The results reveal an intricate interplay between structure and conformational fluctuations in the different complexes that fine-tunes the affinity. The estimated change in conformational entropy is comparable in magnitude to the binding enthalpy, demonstrating that it contributes favorably and significantly to ligand binding. We speculate that the relatively weak inherent protein-carbohydrate interactions and limited hydrophobic effect associated with oligosaccharide binding might have exerted evolutionary pressure on carbohydrate-binding proteins to increase the affinity by means of conformational entropy.

It is not the entropy you produce, rather, how you produce it

PubMed Central

Volk, Tyler; Pauluis, Olivier

2010-01-01

The principle of maximum entropy production (MEP) seeks to better understand a large variety of the Earth's environmental and ecological systems by postulating that processes far from thermodynamic equilibrium will ‘adapt to steady states at which they dissipate energy and produce entropy at the maximum possible rate’. Our aim in this ‘outside view’, invited by Axel Kleidon, is to focus on what we think is an outstanding challenge for MEP and for irreversible thermodynamics in general: making specific predictions about the relative contribution of individual processes to entropy production. Using studies that compared entropy production in the atmosphere of a dry versus humid Earth, we show that two systems might have the same entropy production rate but very different internal dynamics of dissipation. Using the results of several of the papers in this special issue and a thought experiment, we show that components of life-containing systems can evolve to either lower or raise the entropy production rate. Our analysis makes explicit fundamental questions for MEP that should be brought into focus: can MEP predict not just the overall state of entropy production of a system but also the details of the sub-systems of dissipaters within the system? Which fluxes of the system are those that are most likely to be maximized? How it is possible for MEP theory to be so domain-neutral that it can claim to apply equally to both purely physical–chemical systems and also systems governed by the ‘laws’ of biological evolution? We conclude that the principle of MEP needs to take on the issue of exactly how entropy is produced. PMID:20368249

Entropy in DNA Double-Strand Break, Detection and Signaling

NASA Astrophysics Data System (ADS)

Zhang, Yang; Schindler, Christina; Heermann, Dieter

2014-03-01

In biology, the term entropy is often understood as a measure of disorder - a restrictive interpretation that can even be misleading. Recently it has become clearer and clearer that entropy, contrary to conventional wisdom, can help to order and guide biological processes in living cells. DNA double-strand breaks (DSBs) are among the most dangerous lesions and efficient damage detection and repair is essential for organism viability. However, what remains unknown is the precise mechanism of targeting the site of damage within billions of intact nucleotides and a crowded nuclear environment, a process which is often referred to as recruitment or signaling. Here we show that the change in entropy associated with inflicting a DSB facilitates the recruitment of damage sensor proteins. By means of computational modeling we found that higher mobility and local chromatin structure accelerate protein association at DSB ends. We compared the effect of different chromatin architectures on protein dynamics and concentrations in the vicinity of DSBs, and related these results to experiments on repair in heterochromatin. Our results demonstrate how entropy contributes to a more efficient damage detection. We identify entropy as the physical basis for DNA double-strand break signaling.

Entropy vs. energy waveform processing: A comparison based on the heat equation

DOE PAGES

Hughes, Michael S.; McCarthy, John E.; Bruillard, Paul J.; ...

2015-05-25

Virtually all modern imaging devices collect electromagnetic or acoustic waves and use the energy carried by these waves to determine pixel values to create what is basically an “energy” picture. However, waves also carry “information”, as quantified by some form of entropy, and this may also be used to produce an “information” image. Numerous published studies have demonstrated the advantages of entropy, or “information imaging”, over conventional methods. The most sensitive information measure appears to be the joint entropy of the collected wave and a reference signal. The sensitivity of repeated experimental observations of a slowly-changing quantity may be definedmore » as the mean variation (i.e., observed change) divided by mean variance (i.e., noise). Wiener integration permits computation of the required mean values and variances as solutions to the heat equation, permitting estimation of their relative magnitudes. There always exists a reference, such that joint entropy has larger variation and smaller variance than the corresponding quantities for signal energy, matching observations of several studies. Moreover, a general prescription for finding an “optimal” reference for the joint entropy emerges, which also has been validated in several studies.« less

Pressure transfer function of a JT15D nozzle due to acoustic and convected entropy fluctuations

NASA Astrophysics Data System (ADS)

Miles, J. H.

An acoustic transmission matrix analysis of sound propagation in a variable area duct with and without flow is extended to include convected entropy fluctuations. The boundary conditions used in the analysis are a transfer function relating entropy and pressure at the nozzle inlet and the nozzle exit impedance. The nozzle pressure transfer function calculated is compared with JT15D turbofan engine nozzle data. The one dimensional theory for sound propagation in a variable area nozzle with flow but without convected entropy is good at the low engine speeds where the nozzle exit Mach number is low (M=0.2) and the duct exit impedance model is good. The effect of convected entropy appears to be so negligible that it is obscured by the inaccuracy of the nozzle exit impedance model, the lack of information on the magnitude of the convected entropy and its phase relationship with the pressure, and the scatter in the data. An improved duct exit impedance model is required at the higher engine speeds where the nozzle exit Mach number is high (M=0.56) and at low frequencies (below 120 Hz).

Dissipation and entropy production in open quantum systems

NASA Astrophysics Data System (ADS)

Majima, H.; Suzuki, A.

2010-11-01

A microscopic description of an open system is generally expressed by the Hamiltonian of the form: Htot = Hsys + Henviron + Hsys-environ. We developed a microscopic theory of entropy and derived a general formula, so-called "entropy-Hamiltonian relation" (EHR), that connects the entropy of the system to the interaction Hamiltonian represented by Hsys-environ for a nonequilibrium open quantum system. To derive the EHR formula, we mapped the open quantum system to the representation space of the Liouville-space formulation or thermo field dynamics (TFD), and thus worked on the representation space Script L := Script H otimes , where Script H denotes the ordinary Hilbert space while the tilde Hilbert space conjugates to Script H. We show that the natural transformation (mapping) of nonequilibrium open quantum systems is accomplished within the theoretical structure of TFD. By using the obtained EHR formula, we also derived the equation of motion for the distribution function of the system. We demonstrated that by knowing the microscopic description of the interaction, namely, the specific form of Hsys-environ on the representation space Script L, the EHR formulas enable us to evaluate the entropy of the system and to gain some information about entropy for nonequilibrium open quantum systems.

Entropy and Galilean Invariance of Lattice Boltzmann Theories

NASA Astrophysics Data System (ADS)

Chikatamarla, Shyam S.; Karlin, Iliya V.

2006-11-01

A theory of lattice Boltzmann (LB) models for hydrodynamic simulation is developed upon a novel relation between entropy construction and roots of Hermite polynomials. A systematic procedure is described for constructing numerically stable and complete Galilean invariant LB models. The stability of the new LB models is illustrated with a shock tube simulation.

Entropy bound of horizons for accelerating, rotating and charged Plebanski–Demianski black hole

DOE Office of Scientific and Technical Information (OSTI.GOV)

Debnath, Ujjal, E-mail: ujjaldebnath@yahoo.com

We first review the accelerating, rotating and charged Plebanski–Demianski (PD) black hole, which includes the Kerr–Newman rotating black hole and the Taub-NUT spacetime. The main feature of this black hole is that it has 4 horizons like event horizon, Cauchy horizon and two accelerating horizons. In the non-extremal case, the surface area, entropy, surface gravity, temperature, angular velocity, Komar energy and irreducible mass on the event horizon and Cauchy horizon are presented for PD black hole. The entropy product, temperature product, Komar energy product and irreducible mass product have been found for event horizon and Cauchy horizon. Also their sumsmore » are found for both horizons. All these relations are dependent on the mass of the PD black hole and other parameters. So all the products are not universal for PD black hole. The entropy and area bounds for two horizons have been investigated. Also we found the Christodoulou–Ruffini mass for extremal PD black hole. Finally, using first law of thermodynamics, we also found the Smarr relation for PD black hole.« less

Entropic bounds on currents in Langevin systems

NASA Astrophysics Data System (ADS)

Dechant, Andreas; Sasa, Shin-ichi

2018-06-01

We derive a bound on generalized currents for Langevin systems in terms of the total entropy production in the system and its environment. For overdamped dynamics, any generalized current is bounded by the total rate of entropy production. We show that this entropic bound on the magnitude of generalized currents imposes power-efficiency tradeoff relations for ratchets in contact with a heat bath: Maximum efficiency—Carnot efficiency for a Smoluchowski-Feynman ratchet and unity for a flashing or rocking ratchet—can only be reached at vanishing power output. For underdamped dynamics, while there may be reversible currents that are not bounded by the entropy production rate, we show that the output power and heat absorption rate are irreversible currents and thus obey the same bound. As a consequence, a power-efficiency tradeoff relation holds not only for underdamped ratchets but also for periodically driven heat engines. For weak driving, the bound results in additional constraints on the Onsager matrix beyond those imposed by the second law. Finally, we discuss the connection between heat and entropy in a nonthermal situation where the friction and noise intensity are state dependent.

Emergent Geometry from Entropy and Causality

NASA Astrophysics Data System (ADS)

Engelhardt, Netta

In this thesis, we investigate the connections between the geometry of spacetime and aspects of quantum field theory such as entanglement entropy and causality. This work is motivated by the idea that spacetime geometry is an emergent phenomenon in quantum gravity, and that the physics responsible for this emergence is fundamental to quantum field theory. Part I of this thesis is focused on the interplay between spacetime and entropy, with a special emphasis on entropy due to entanglement. In general spacetimes, there exist locally-defined surfaces sensitive to the geometry that may act as local black hole boundaries or cosmological horizons; these surfaces, known as holographic screens, are argued to have a connection with the second law of thermodynamics. Holographic screens obey an area law, suggestive of an association with entropy; they are also distinguished surfaces from the perspective of the covariant entropy bound, a bound on the total entropy of a slice of the spacetime. This construction is shown to be quite general, and is formulated in both classical and perturbatively quantum theories of gravity. The remainder of Part I uses the Anti-de Sitter/ Conformal Field Theory (AdS/CFT) correspondence to both expand and constrain the connection between entanglement entropy and geometry. The AdS/CFT correspondence posits an equivalence between string theory in the "bulk" with AdS boundary conditions and certain quantum field theories. In the limit where the string theory is simply classical General Relativity, the Ryu-Takayanagi and more generally, the Hubeny-Rangamani-Takayanagi (HRT) formulae provide a way of relating the geometry of surfaces to entanglement entropy. A first-order bulk quantum correction to HRT was derived by Faulkner, Lewkowycz and Maldacena. This formula is generalized to include perturbative quantum corrections in the bulk at any (finite) order. Hurdles to spacetime emergence from entanglement entropy as described by HRT and its quantum generalizations are discussed, both at the classical and perturbatively quantum limits. In particular, several No Go Theorems are proven, indicative of a conclusion that supplementary approaches or information may be necessary to recover the full spacetime geometry. Part II of this thesis involves the relation between geometry and causality, the property that information cannot travel faster than light. Requiring this of any quantum field theory results in constraints on string theory setups that are dual to quantum field theories via the AdS/CFT correspondence. At the level of perturbative quantum gravity, it is shown that causality in the field theory constraints the causal structure in the bulk. At the level of nonperturbative quantum string theory, we find that constraints on causal signals restrict the possible ways in which curvature singularities can be resolved in string theory. Finally, a new program of research is proposed for the construction of bulk geometry from the divergences of correlation functions in the dual field theory. This divergence structure is linked to the causal structure of the bulk and of the field theory.

Germinal center texture entropy as possible indicator of humoral immune response: immunophysiology viewpoint.

PubMed

Pantic, Igor; Pantic, Senka

2012-10-01

In this article, we present the results indicating that spleen germinal center (GC) texture entropy determined by gray-level co-occurrence matrix (GLCM) method is related to humoral immune response. Spleen tissue was obtained from eight outbred male short-haired guinea pigs previously immunized by sheep red blood cells (SRBC). A total of 312 images from 39 germinal centers (156 GC light zone images and 156 GC dark zone images) were acquired and analyzed by GLCM method. Angular second moment, contrast, correlation, entropy, and inverse difference moment were calculated for each image. Humoral immune response to SRBC was measured using T cell-dependent antibody response (TDAR) assay. Statistically highly significant negative correlation was detected between light zone entropy and the number of TDAR plaque-forming cells (r (s) = -0.86, p < 0.01). The entropy decreased as the plaque-forming cells increased and vice versa. A statistically significant negative correlation was also detected between dark zone entropy values and the number of plaque-forming cells (r (s) = -0.69, p < 0.05). Germinal center texture entropy may be a powerful indicator of humoral immune response. This study is one of the first to point out the potential scientific value of GLCM image texture analysis in lymphoid tissue cytoarchitecture evaluation. Lymphoid tissue texture analysis could become an important and affordable addition to the conventional immunophysiology techniques.

Gibbs paradox of entropy of mixing experimental facts. Its rejection, and the theoretical consequences

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lin, Shu-Kun

1996-12-31

Gibbs paradox statement of entropy of mixing has been regarded as the theoretical foundation of statistical mechanics, quantum theory and biophysics. However, all the relevant chemical experimental observations and logical analyses indicate that the Gibbs paradox statement is false. I prove that this statement is wrong: Gibbs paradox statement implies that entropy decreases with the increase in symmetry (as represented by a symmetry number {sigma}; see any statistical mechanics textbook). From group theory any system has at least a symmetry number {sigma}=1 which is the identity operation for a strictly asymmetric system. It follows that the entropy of a systemmore » is equal to, or less than, zero. However, from either von Neumann-Shannon entropy formula (S(w) =-{Sigma}{sup {omega}} in p{sub 1}) or the Boltzmann entropy formula (S = in w) and the original definition, entropy is non-negative. Therefore, this statement is false. It should not be a surprise that for the first time, many outstanding problems such as the validity of Pauling`s resonance theory, the explanation of second order phase transition phenomena, the biophysical problem of protein folding and the related hydrophobic effect, etc., can be solved. Empirical principles such as Pauli principle (and Hund`s rule) and HSAB principle, etc., can also be given a theoretical explanation.« less

Relations between work and entropy production for general information-driven, finite-state engines

NASA Astrophysics Data System (ADS)

Merhav, Neri

2017-02-01

We consider a system model of a general finite-state machine (ratchet) that simultaneously interacts with three kinds of reservoirs: a heat reservoir, a work reservoir, and an information reservoir, the latter being taken to be a running digital tape whose symbols interact sequentially with the machine. As has been shown in earlier work, this finite-state machine can act as a demon (with memory), which creates a net flow of energy from the heat reservoir into the work reservoir (thus extracting useful work) at the price of increasing the entropy of the information reservoir. Under very few assumptions, we propose a simple derivation of a family of inequalities that relate the work extraction with the entropy production. These inequalities can be seen as either upper bounds on the extractable work or as lower bounds on the entropy production, depending on the point of view. Many of these bounds are relatively easy to calculate and they are tight in the sense that equality can be approached arbitrarily closely. In their basic forms, these inequalities are applicable to any finite number of cycles (and not only asymptotically), and for a general input information sequence (possibly correlated), which is not necessarily assumed even stationary. Several known results are obtained as special cases.

The smooth entropy formalism for von Neumann algebras

NASA Astrophysics Data System (ADS)

Berta, Mario; Furrer, Fabian; Scholz, Volkher B.

2016-01-01

We discuss information-theoretic concepts on infinite-dimensional quantum systems. In particular, we lift the smooth entropy formalism as introduced by Renner and collaborators for finite-dimensional systems to von Neumann algebras. For the smooth conditional min- and max-entropy, we recover similar characterizing properties and information-theoretic operational interpretations as in the finite-dimensional case. We generalize the entropic uncertainty relation with quantum side information of Tomamichel and Renner and discuss applications to quantum cryptography. In particular, we prove the possibility to perform privacy amplification and classical data compression with quantum side information modeled by a von Neumann algebra.

Conformal Field Theory and black hole physics

NASA Astrophysics Data System (ADS)

Sidhu, Steve

2012-01-01

This thesis reviews the use of 2-dimensional conformal field theory applied to gravity, specifically calculating Bekenstein-Hawking entropy of black holes in (2+1) dimensions. A brief review of general relativity, Conformal Field Theory, energy extraction from black holes, and black hole thermodynamics will be given. The Cardy formula, which calculates the entropy of a black hole from the AdS/CFT duality, will be shown to calculate the correct Bekenstein-Hawking entropy of the static and rotating BTZ black holes. The first law of black hole thermodynamics of the static, rotating, and charged-rotating BTZ black holes will be verified.

Exact valence bond entanglement entropy and probability distribution in the XXX spin chain and the potts model.

PubMed

Jacobsen, J L; Saleur, H

2008-02-29

We determine exactly the probability distribution of the number N_(c) of valence bonds connecting a subsystem of length L>1 to the rest of the system in the ground state of the XXX antiferromagnetic spin chain. This provides, in particular, the asymptotic behavior of the valence-bond entanglement entropy S_(VB)=N_(c)ln2=4ln2/pi(2)lnL disproving a recent conjecture that this should be related with the von Neumann entropy, and thus equal to 1/3lnL. Our results generalize to the Q-state Potts model.

The smooth entropy formalism for von Neumann algebras

DOE Office of Scientific and Technical Information (OSTI.GOV)

Berta, Mario, E-mail: berta@caltech.edu; Furrer, Fabian, E-mail: furrer@eve.phys.s.u-tokyo.ac.jp; Scholz, Volkher B., E-mail: scholz@phys.ethz.ch

2016-01-15

We discuss information-theoretic concepts on infinite-dimensional quantum systems. In particular, we lift the smooth entropy formalism as introduced by Renner and collaborators for finite-dimensional systems to von Neumann algebras. For the smooth conditional min- and max-entropy, we recover similar characterizing properties and information-theoretic operational interpretations as in the finite-dimensional case. We generalize the entropic uncertainty relation with quantum side information of Tomamichel and Renner and discuss applications to quantum cryptography. In particular, we prove the possibility to perform privacy amplification and classical data compression with quantum side information modeled by a von Neumann algebra.

Minimum entropy density method for the time series analysis

NASA Astrophysics Data System (ADS)

Lee, Jeong Won; Park, Joongwoo Brian; Jo, Hang-Hyun; Yang, Jae-Suk; Moon, Hie-Tae

2009-01-01

The entropy density is an intuitive and powerful concept to study the complicated nonlinear processes derived from physical systems. We develop the minimum entropy density method (MEDM) to detect the structure scale of a given time series, which is defined as the scale in which the uncertainty is minimized, hence the pattern is revealed most. The MEDM is applied to the financial time series of Standard and Poor’s 500 index from February 1983 to April 2006. Then the temporal behavior of structure scale is obtained and analyzed in relation to the information delivery time and efficient market hypothesis.

Causal holographic information does not satisfy the linearized quantum focusing condition

NASA Astrophysics Data System (ADS)

Fu, Zicao; Marolf, Donald; Qi, Marvin

2018-04-01

The Hubeny-Rangamani causal holographic information (CHI) defined by a region R of a holographic quantum field theory (QFT) is a modern version of the idea that the area of event horizons might be related to an entropy. Here the event horizon lives in a dual gravitational bulk theory with Newton's constant G bulk, and the relation involves a factor of 4 G bulk. The fact that CHI is bounded below by the von Neumann entropy S suggests that CHI is coarse-grained. Its properties could thus differ markedly from those of S. In particular, recent results imply that when d ≤ 4 holographic QFTs are perturbatively coupled to d-dimensional gravity, the combined system satisfies the so-called quantum focusing condition (QFC) at leading order in the new gravitational coupling G d when the QFT entropy is taken to be that of von Neumann. However, by studying states dual to spherical bulk (anti-de Sitter) Schwarschild black holes in the conformal frame for which the boundary is a (2 + 1)-dimensional de Sitter space, we find the QFC defined by CHI is violated even when perturbing about a Killing horizon and using a single null congruence. Since it is known that a generalized second law (GSL) holds in this context, our work demonstrates that the QFC is not required in order for an entropy, or an entropy-like quantity, to satisfy such a GSL.

Like Beauty, Complexity is Hard to Define

NASA Astrophysics Data System (ADS)

Tsallis, Constantino

Like beauty, complexity is hard to define and rather easy to identify: nonlinear dynamics, strongly interconnected simple elements, some sort of divisoria aquorum between order and disorder. Before focusing on complexity, let us remember that the theoretical pillars of contemporary physics are mechanics (Newtonian, relativistic, quantum), Maxwell electromagnetism, and (Boltzmann-Gibbs, BG) statistical mechanics - obligatory basic disciplines in any advanced course in physics. The firstprinciple statistical-mechanical approach starts from (microscopic) electro-mechanics and theory of probabilities, and, through a variety of possible mesoscopic descriptions, arrives to (oscopic) thermodynamics. In the middle of this trip, we cross energy and entropy. Energy is related to the possible microscopic configurations of the system, whereas entropy is related to the corresponding probabilities. Therefore, in some sense, entropy represents a concept which, epistemologically speaking, is one step further with regard to energy. The fact that energy is not parameter-independent is very familiar: the kinetic energy of a truck is very different from that of a fly, and the relativistic energy of a fast electron is very different from its classical value, and so on. What about entropy? One hundred and forty years of tradition, and hundreds - we may even say thousands - of impressive theoretical successes of the parameter-free BG entropy have sedimented, in the mind of many scientists, the conviction that it is unique. However, it can be straightforwardly argued that, in general, this is not the case...

Uniqueness of thermodynamic projector and kinetic basis of molecular individualism

NASA Astrophysics Data System (ADS)

Gorban, Alexander N.; Karlin, Iliya V.

2004-05-01

Three results are presented: First, we solve the problem of persistence of dissipation for reduction of kinetic models. Kinetic equations with thermodynamic Lyapunov functions are studied. Uniqueness of the thermodynamic projector is proven: There exists only one projector which transforms any vector field equipped with the given Lyapunov function into a vector field with the same Lyapunov function for a given anzatz manifold which is not tangent to the Lyapunov function levels. Second, we use the thermodynamic projector for developing the short memory approximation and coarse-graining for general nonlinear dynamic systems. We prove that in this approximation the entropy production increases. ( The theorem about entropy overproduction.) In example, we apply the thermodynamic projector to derive the equations of reduced kinetics for the Fokker-Planck equation. A new class of closures is developed, the kinetic multipeak polyhedra. Distributions of this type are expected in kinetic models with multidimensional instability as universally as the Gaussian distribution appears for stable systems. The number of possible relatively stable states of a nonequilibrium system grows as 2 m, and the number of macroscopic parameters is in order mn, where n is the dimension of configuration space, and m is the number of independent unstable directions in this space. The elaborated class of closures and equations pretends to describe the effects of “molecular individualism”. This is the third result.

Information loss in effective field theory: Entanglement and thermal entropies

NASA Astrophysics Data System (ADS)

Boyanovsky, Daniel

2018-03-01

Integrating out high energy degrees of freedom to yield a low energy effective field theory leads to a loss of information with a concomitant increase in entropy. We obtain the effective field theory of a light scalar field interacting with heavy fields after tracing out the heavy degrees of freedom from the time evolved density matrix. The initial density matrix describes the light field in its ground state and the heavy fields in equilibrium at a common temperature T . For T =0 , we obtain the reduced density matrix in a perturbative expansion; it reveals an emergent mixed state as a consequence of the entanglement between light and heavy fields. We obtain the effective action that determines the time evolution of the reduced density matrix for the light field in a nonperturbative Dyson resummation of one-loop correlations of the heavy fields. The Von-Neumann entanglement entropy associated with the reduced density matrix is obtained for the nonresonant and resonant cases in the asymptotic long time limit. In the nonresonant case the reduced density matrix displays an incipient thermalization albeit with a wave-vector, time and coupling dependent effective temperature as a consequence of memory of initial conditions. The entanglement entropy is time independent and is the thermal entropy for this effective, nonequilibrium temperature. In the resonant case the light field fully thermalizes with the heavy fields, the reduced density matrix loses memory of the initial conditions and the entanglement entropy becomes the thermal entropy of the light field. We discuss the relation between the entanglement entropy ultraviolet divergences and renormalization.

Entropy of orthogonal polynomials with Freud weights and information entropies of the harmonic oscillator potential

NASA Astrophysics Data System (ADS)

Van Assche, W.; Yáñez, R. J.; Dehesa, J. S.

1995-08-01

The information entropy of the harmonic oscillator potential V(x)=1/2λx2 in both position and momentum spaces can be expressed in terms of the so-called ``entropy of Hermite polynomials,'' i.e., the quantity Sn(H):= -∫-∞+∞H2n(x)log H2n(x) e-x2dx. These polynomials are instances of the polynomials orthogonal with respect to the Freud weights w(x)=exp(-||x||m), m≳0. Here, a very precise and general result of the entropy of Freud polynomials recently established by Aptekarev et al. [J. Math. Phys. 35, 4423-4428 (1994)], specialized to the Hermite kernel (case m=2), leads to an important refined asymptotic expression for the information entropies of very excited states (i.e., for large n) in both position and momentum spaces, to be denoted by Sρ and Sγ, respectively. Briefly, it is shown that, for large values of n, Sρ+1/2logλ≂log(π√2n/e)+o(1) and Sγ-1/2log λ≂log(π√2n/e)+o(1), so that Sρ+Sγ≂log(2π2n/e2)+o(1) in agreement with the generalized indetermination relation of Byalinicki-Birula and Mycielski [Commun. Math. Phys. 44, 129-132 (1975)]. Finally, the rate of convergence of these two information entropies is numerically analyzed. In addition, using a Rakhmanov result, we describe a totally new proof of the leading term of the entropy of Freud polynomials which, naturally, is just a weak version of the aforementioned general result.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Burke, K.; Smith, J. C.; Grabowski, P. E.

Universal exact conditions guided the construction of most ground-state density functional approximations in use today. Here, we derive the relation between the entropy and Mermin free energy density functionals for thermal density functional theory. Both the entropy and sum of kinetic and electron-electron repulsion functionals are shown to be monotonically increasing with temperature, while the Mermin functional is concave downwards. Analogous relations are found for both exchange and correlation. The importance of these conditions is illustrated in two extremes: the Hubbard dimer and the uniform gas.

Relative entropy as a universal metric for multiscale errors

NASA Astrophysics Data System (ADS)

Chaimovich, Aviel; Shell, M. Scott

2010-06-01

We show that the relative entropy, Srel , suggests a fundamental indicator of the success of multiscale studies, in which coarse-grained (CG) models are linked to first-principles (FP) ones. We demonstrate that Srel inherently measures fluctuations in the differences between CG and FP potential energy landscapes, and develop a theory that tightly and generally links it to errors associated with coarse graining. We consider two simple case studies substantiating these results, and suggest that Srel has important ramifications for evaluating and designing coarse-grained models.

Relative entropy as a universal metric for multiscale errors.

PubMed

Chaimovich, Aviel; Shell, M Scott

2010-06-01

We show that the relative entropy, Srel, suggests a fundamental indicator of the success of multiscale studies, in which coarse-grained (CG) models are linked to first-principles (FP) ones. We demonstrate that Srel inherently measures fluctuations in the differences between CG and FP potential energy landscapes, and develop a theory that tightly and generally links it to errors associated with coarse graining. We consider two simple case studies substantiating these results, and suggest that Srel has important ramifications for evaluating and designing coarse-grained models.

Information thermodynamics of near-equilibrium computation

NASA Astrophysics Data System (ADS)

Prokopenko, Mikhail; Einav, Itai

2015-06-01

In studying fundamental physical limits and properties of computational processes, one is faced with the challenges of interpreting primitive information-processing functions through well-defined information-theoretic as well as thermodynamic quantities. In particular, transfer entropy, characterizing the function of computational transmission and its predictability, is known to peak near critical regimes. We focus on a thermodynamic interpretation of transfer entropy aiming to explain the underlying critical behavior by associating information flows intrinsic to computational transmission with particular physical fluxes. Specifically, in isothermal systems near thermodynamic equilibrium, the gradient of the average transfer entropy is shown to be dynamically related to Fisher information and the curvature of system's entropy. This relationship explicitly connects the predictability, sensitivity, and uncertainty of computational processes intrinsic to complex systems and allows us to consider thermodynamic interpretations of several important extreme cases and trade-offs.

Entropy and the Shelf Model: A Quantum Physical Approach to a Physical Property

ERIC Educational Resources Information Center

Jungermann, Arnd H.

2006-01-01

In contrast to most other thermodynamic data, entropy values are not given in relation to a certain--more or less arbitrarily defined--zero level. They are listed in standard thermodynamic tables as absolute values of specific substances. Therefore these values describe a physical property of the listed substances. One of the main tasks of…

Moments of the phase-space density, coincidence probabilities, and entropies of a multiparticle system

NASA Astrophysics Data System (ADS)

Bialas, A.

2006-04-01

A method to estimate moments of the phase-space density from event-by-event fluctuations is reviewed and its accuracy analyzed. Relation of these measurements to the determination of the entropy of the system is discussed. This is a summary of the results obtained recently together with W.Czyz and K.Zalewski.

Beating the Clauser-Horne-Shimony-Holt and the Svetlichny games with optimal states

NASA Astrophysics Data System (ADS)

Su, Hong-Yi; Ren, Changliang; Chen, Jing-Ling; Zhang, Fu-Lin; Wu, Chunfeng; Xu, Zhen-Peng; Gu, Mile; Vinjanampathy, Sai; Kwek, L. C.

2016-02-01

We study the relation between the maximal violation of Svetlichny's inequality and the mixedness of quantum states and obtain the optimal state (i.e., maximally nonlocal mixed states, or MNMS, for each value of linear entropy) to beat the Clauser-Horne-Shimony-Holt and the Svetlichny games. For the two-qubit and three-qubit MNMS, we showed that these states are also the most tolerant state against white noise, and thus serve as valuable quantum resources for such games. In particular, the quantum prediction of the MNMS decreases as the linear entropy increases, and then ceases to be nonlocal when the linear entropy reaches the critical points 2 /3 and 9 /14 for the two- and three-qubit cases, respectively. The MNMS are related to classical errors in experimental preparation of maximally entangled states.

Entropy uncertainty relations and stability of phase-temporal quantum cryptography with finite-length transmitted strings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Molotkov, S. N., E-mail: sergei.molotkov@gmail.com

2012-12-15

Any key-generation session contains a finite number of quantum-state messages, and it is there-fore important to understand the fundamental restrictions imposed on the minimal length of a string required to obtain a secret key with a specified length. The entropy uncertainty relations for smooth min and max entropies considerably simplify and shorten the proof of security. A proof of security of quantum key distribution with phase-temporal encryption is presented. This protocol provides the maximum critical error compared to other protocols up to which secure key distribution is guaranteed. In addition, unlike other basic protocols (of the BB84 type), which aremore » vulnerable with respect to an attack by 'blinding' of avalanche photodetectors, this protocol is stable with respect to such an attack and guarantees key security.« less

Quantum and Multidimensional Explanations in a Neurobiological Context of Mind.

PubMed

Korf, Jakob

2015-08-01

This article examines the possible relevance of physical-mathematical multidimensional or quantum concepts aiming at understanding the (human) mind in a neurobiological context. Some typical features of the quantum and multidimensional concepts are briefly introduced, including entanglement, superposition, holonomic, and quantum field theories. Next, we consider neurobiological principles, such as the brain and its emerging (physical) mind, evolutionary and ontological origins, entropy, syntropy/neg-entropy, causation, and brain energy metabolism. In many biological processes, including biochemical conversions, protein folding, and sensory perception, the ubiquitous involvement of quantum mechanisms is well recognized. Quantum and multidimensional approaches might be expected to help describe and model both brain and mental processes, but an understanding of their direct involvement in mental activity, that is, without mediation by molecular processes, remains elusive. More work has to be done to bridge the gap between current neurobiological and physical-mathematical concepts with their associated quantum-mind theories. © The Author(s) 2014.

A Bayesian Interpretation of First-Order Phase Transitions

NASA Astrophysics Data System (ADS)

Davis, Sergio; Peralta, Joaquín; Navarrete, Yasmín; González, Diego; Gutiérrez, Gonzalo

2016-03-01

In this work we review the formalism used in describing the thermodynamics of first-order phase transitions from the point of view of maximum entropy inference. We present the concepts of transition temperature, latent heat and entropy difference between phases as emergent from the more fundamental concept of internal energy, after a statistical inference analysis. We explicitly demonstrate this point of view by making inferences on a simple game, resulting in the same formalism as in thermodynamical phase transitions. We show that analogous quantities will inevitably arise in any problem of inferring the result of a yes/no question, given two different states of knowledge and information in the form of expectation values. This exposition may help to clarify the role of these thermodynamical quantities in the context of different first-order phase transitions such as the case of magnetic Hamiltonians (e.g. the Potts model).

Image reconstruction of IRAS survey scans

NASA Technical Reports Server (NTRS)

Bontekoe, Tj. Romke

1990-01-01

The IRAS survey data can be used successfully to produce images of extended objects. The major difficulties, viz. non-uniform sampling, different response functions for each detector, and varying signal-to-noise levels for each detector for each scan, were resolved. The results of three different image construction techniques are compared: co-addition, constrained least squares, and maximum entropy. The maximum entropy result is superior. An image of the galaxy M51 with an average spatial resolution of 45 arc seconds is presented, using 60 micron survey data. This exceeds the telescope diffraction limit of 1 minute of arc, at this wavelength. Data fusion is a proposed method for combining data from different instruments, with different spacial resolutions, at different wavelengths. Data estimates of the physical parameters, temperature, density and composition, can be made from the data without prior image (re-)construction. An increase in the accuracy of these parameters is expected as the result of this more systematic approach.

Research and implementation of group animation based on normal cloud model

NASA Astrophysics Data System (ADS)

Li, Min; Wei, Bin; Peng, Bao

2011-12-01

Group Animation is a difficult technology problem which always has not been solved in computer Animation technology, All current methods have their limitations. This paper put forward a method: the Motion Coordinate and Motion Speed of true fish group was collected as sample data, reverse cloud generator was designed and run, expectation, entropy and super entropy are gotten. Which are quantitative value of qualitative concept. These parameters are used as basis, forward cloud generator was designed and run, Motion Coordinate and Motion Speed of two-dimensional fish group animation are produced, And two spirit state variable about fish group : the feeling of hunger, the feeling of fear are designed. Experiment is used to simulated the motion state of fish Group Animation which is affected by internal cause and external cause above, The experiment shows that the Group Animation which is designed by this method has strong Realistic.

Prediction of Metabolite Concentrations, Rate Constants and Post-Translational Regulation Using Maximum Entropy-Based Simulations with Application to Central Metabolism of Neurospora crassa

DOE Office of Scientific and Technical Information (OSTI.GOV)

Cannon, William; Zucker, Jeremy; Baxter, Douglas

We report the application of a recently proposed approach for modeling biological systems using a maximum entropy production rate principle in lieu of having in vivo rate constants. The method is applied in four steps: (1) a new ODE-based optimization approach based on Marcelin’s 1910 mass action equation is used to obtain the maximum entropy distribution, (2) the predicted metabolite concentrations are compared to those generally expected from experiment using a loss function from which post-translational regulation of enzymes is inferred, (3) the system is re-optimized with the inferred regulation from which rate constants are determined from the metabolite concentrationsmore » and reaction fluxes, and finally (4) a full ODE-based, mass action simulation with rate parameters and allosteric regulation is obtained. From the last step, the power characteristics and resistance of each reaction can be determined. The method is applied to the central metabolism of Neurospora crassa and the flow of material through the three competing pathways of upper glycolysis, the non-oxidative pentose phosphate pathway, and the oxidative pentose phosphate pathway are evaluated as a function of the NADP/NADPH ratio. It is predicted that regulation of phosphofructokinase (PFK) and flow through the pentose phosphate pathway are essential for preventing an extreme level of fructose 1, 6-bisphophate accumulation. Such an extreme level of fructose 1,6-bisphophate would otherwise result in a glassy cytoplasm with limited diffusion, dramatically decreasing the entropy and energy production rate and, consequently, biological competitiveness.« less

Refined Composite Multiscale Dispersion Entropy and its Application to Biomedical Signals.

PubMed

Azami, Hamed; Rostaghi, Mostafa; Abasolo, Daniel; Escudero, Javier

2017-12-01

We propose a novel complexity measure to overcome the deficiencies of the widespread and powerful multiscale entropy (MSE), including, MSE values may be undefined for short signals, and MSE is slow for real-time applications. We introduce multiscale dispersion entropy (DisEn-MDE) as a very fast and powerful method to quantify the complexity of signals. MDE is based on our recently developed DisEn, which has a computation cost of O(N), compared with O(N 2 ) for sample entropy used in MSE. We also propose the refined composite MDE (RCMDE) to improve the stability of MDE. We evaluate MDE, RCMDE, and refined composite MSE (RCMSE) on synthetic signals and three biomedical datasets. The MDE, RCMDE, and RCMSE methods show similar results, although the MDE and RCMDE are faster, lead to more stable results, and discriminate different types of physiological signals better than MSE and RCMSE. For noisy short and long time series, MDE and RCMDE are noticeably more stable than MSE and RCMSE, respectively. For short signals, MDE and RCMDE, unlike MSE and RCMSE, do not lead to undefined values. The proposed MDE and RCMDE are significantly faster than MSE and RCMSE, especially for long signals, and lead to larger differences between physiological conditions known to alter the complexity of the physiological recordings. MDE and RCMDE are expected to be useful for the analysis of physiological signals thanks to their ability to distinguish different types of dynamics. The MATLAB codes used in this paper are freely available at http://dx.doi.org/10.7488/ds/1982.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bialynicki-Birula, Iwo

Quantum mechanical uncertainty relations for the position and the momentum and for the angle and the angular momentum are expressed in the form of inequalities involving the Renyi entropies. These uncertainty relations hold not only for pure but also for mixed states. Analogous uncertainty relations are valid also for a pair of complementary observables (the analogs of x and p) in N-level systems. All these uncertainty relations become more attractive when expressed in terms of the symmetrized Renyi entropies. The mathematical proofs of all the inequalities discussed in this paper can be found in Phys. Rev. A 74, No. 5more » (2006); arXiv:quant-ph/0608116.« less

Complexity of cardiovascular rhythms during head-up tilt test by entropy of patterns.

PubMed

Wejer, Dorota; Graff, Beata; Makowiec, Danuta; Budrejko, Szymon; Struzik, Zbigniew R

2017-05-01

The head-up tilt (HUT) test, which provokes transient dynamical alterations in the regulation of cardiovascular system, provides insights into complex organization of this system. Based on signals with heart period intervals (RR-intervals) and/or systolic blood pressure (SBP), differences in the cardiovascular regulation between vasovagal patients (VVS) and the healthy people group (CG) are investigated. Short-term relations among signal data represented symbolically by three-beat patterns allow to qualify and quantify the complexity of the cardiovascular regulation by Shannon entropy. Four types of patterns: permutation, ordinal, deterministic and dynamical, are used, and different resolutions of signal values in the the symbolization are applied in order to verify how entropy of patterns depends on a way in which values of signals are preprocessed. At rest, in the physiologically important signal resolution ranges, independently of the type of patterns used in estimates, the complexity of SBP signals in VVS is different from the complexity found in CG. Entropy of VVS is higher than CG what could be interpreted as substantial presence of noisy ingredients in SBP of VVS. After tilting this relation switches. Entropy of CG occurs significantly higher than VVS for SBP signals. In the case of RR-intervals and large resolutions, the complexity after the tilt becomes reduced when compared to the complexity of RR-intervals at rest for both groups. However, in the case of VVS patients this reduction is significantly stronger than in CG. Our observations about opposite switches in entropy between CG and VVS might support a hypothesis that baroreflex in VVS affects stronger the heart rate because of the inefficient regulation (possibly impaired local vascular tone alternations) of the blood pressure.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Maoyuan; Besford, Quinn Alexander; Mulvaney, Thomas

The entropy of hydrophobic solvation has been explained as the result of ordered solvation structures, of hydrogen bonds, of the small size of the water molecule, of dispersion forces, and of solvent density fluctuations. We report a new approach to the calculation of the entropy of hydrophobic solvation, along with tests of and comparisons to several other methods. The methods are assessed in the light of the available thermodynamic and spectroscopic information on the effects of temperature on hydrophobic solvation. Five model hydrophobes in SPC/E water give benchmark solvation entropies via Widom’s test-particle insertion method, and other methods and modelsmore » are tested against these particle-insertion results. Entropies associated with distributions of tetrahedral order, of electric field, and of solvent dipole orientations are examined. We find these contributions are small compared to the benchmark particle-insertion entropy. Competitive with or better than other theories in accuracy, but with no free parameters, is the new estimate of the entropy contributed by correlations between dipole moments. Dipole correlations account for most of the hydrophobic solvation entropy for all models studied and capture the distinctive temperature dependence seen in thermodynamic and spectroscopic experiments. Entropies based on pair and many-body correlations in number density approach the correct magnitudes but fail to describe temperature and size dependences, respectively. Hydrogen-bond definitions and free energies that best reproduce entropies from simulations are reported, but it is difficult to choose one hydrogen bond model that fits a variety of experiments. The use of information theory, scaled-particle theory, and related methods is discussed briefly. Our results provide a test of the Frank-Evans hypothesis that the negative solvation entropy is due to structured water near the solute, complement the spectroscopic detection of that solvation structure by identifying the structural feature responsible for the entropy change, and point to a possible explanation for the observed dependence on length scale. Our key results are that the hydrophobic effect, i.e. the signature, temperature-dependent, solvation entropy of nonpolar molecules in water, is largely due to a dispersion force arising from correlations between rotating permanent dipole moments, that the strength of this force depends on the Kirkwood g-factor, and that the strength of this force may be obtained exactly without simulation.« less

Perspective: Maximum caliber is a general variational principle for dynamical systems

NASA Astrophysics Data System (ADS)

Dixit, Purushottam D.; Wagoner, Jason; Weistuch, Corey; Pressé, Steve; Ghosh, Kingshuk; Dill, Ken A.

2018-01-01

We review here Maximum Caliber (Max Cal), a general variational principle for inferring distributions of paths in dynamical processes and networks. Max Cal is to dynamical trajectories what the principle of maximum entropy is to equilibrium states or stationary populations. In Max Cal, you maximize a path entropy over all possible pathways, subject to dynamical constraints, in order to predict relative path weights. Many well-known relationships of non-equilibrium statistical physics—such as the Green-Kubo fluctuation-dissipation relations, Onsager's reciprocal relations, and Prigogine's minimum entropy production—are limited to near-equilibrium processes. Max Cal is more general. While it can readily derive these results under those limits, Max Cal is also applicable far from equilibrium. We give examples of Max Cal as a method of inference about trajectory distributions from limited data, finding reaction coordinates in bio-molecular simulations, and modeling the complex dynamics of non-thermal systems such as gene regulatory networks or the collective firing of neurons. We also survey its basis in principle and some limitations.

Hamiltonian and Thermodynamic Modeling of Quantum Turbulence

NASA Astrophysics Data System (ADS)

Grmela, Miroslav

2010-10-01

The state variables in the novel model introduced in this paper are the fields playing this role in the classical Landau-Tisza model and additional fields of mass, entropy (or temperature), superfluid velocity, and gradient of the superfluid velocity, all depending on the position vector and another tree dimensional vector labeling the scale, describing the small-scale structure developed in 4He superfluid experiencing turbulent motion. The fluxes of mass, momentum, energy, and entropy in the position space as well as the fluxes of energy and entropy in scales, appear in the time evolution equations as explicit functions of the state variables and of their conjugates. The fundamental thermodynamic relation relating the fields to their conjugates is left in this paper undetermined. The GENERIC structure of the equations serves two purposes: (i) it guarantees that solutions to the governing equations, independently of the choice of the fundamental thermodynamic relation, agree with the observed compatibility with thermodynamics, and (ii) it is used as a guide in the construction of the novel model.

Perspective: Maximum caliber is a general variational principle for dynamical systems.

PubMed

Dixit, Purushottam D; Wagoner, Jason; Weistuch, Corey; Pressé, Steve; Ghosh, Kingshuk; Dill, Ken A

2018-01-07

We review here Maximum Caliber (Max Cal), a general variational principle for inferring distributions of paths in dynamical processes and networks. Max Cal is to dynamical trajectories what the principle of maximum entropy is to equilibrium states or stationary populations. In Max Cal, you maximize a path entropy over all possible pathways, subject to dynamical constraints, in order to predict relative path weights. Many well-known relationships of non-equilibrium statistical physics-such as the Green-Kubo fluctuation-dissipation relations, Onsager's reciprocal relations, and Prigogine's minimum entropy production-are limited to near-equilibrium processes. Max Cal is more general. While it can readily derive these results under those limits, Max Cal is also applicable far from equilibrium. We give examples of Max Cal as a method of inference about trajectory distributions from limited data, finding reaction coordinates in bio-molecular simulations, and modeling the complex dynamics of non-thermal systems such as gene regulatory networks or the collective firing of neurons. We also survey its basis in principle and some limitations.

Existence regimes for shocks in inhomogeneous magneto-plasmas having entropy

NASA Astrophysics Data System (ADS)

Iqbal, Javed; Yaqub Khan, M.

2018-04-01

The finding of connection of plasma density and temperature with entropy gives an incitement to study different plasma models with respect to entropy. Nonlinear dissipative one- and two-dimensional structures (shocks) are investigated in nonuniform magnetized plasma with respect to entropy. The dissipation comes in the medium through ion-neutral collisions. The linear dispersion relation is derived. The Korteweg-deVries-Burgers and Kadomtsev-Petviashvili-Burgers equations are derived for nonlinear drift waves in 1-D and 2-D by employing the drift approximation. It is found that vd/u ( vd is the diamagnetic drift velocity and u is the velocity of nonlinear structure) plays a significant role in the shock formation. It is also found that entropy has a significant effect on the strength of shocks. It is noticed that v d/u determines the rarefactive and compressive nature of the shocks. It is observed that upper and lower bounds exist for the shock velocity. It is also observed that the existing regimes for both one- and two-dimensional shocks for kappa distributed electrons are different from shocks with Cairns distributed electrons. Both rarefactive and compressive shocks are found for the 1-D drift waves with kappa distributed electrons. Interestingly, it is noticed that entropy enhances the strength of one- and two-dimensional shocks.

Rényi entropy, stationarity, and entanglement of the conformal scalar

NASA Astrophysics Data System (ADS)

Lee, Jeongseog; Lewkowycz, Aitor; Perlmutter, Eric; Safdi, Benjamin R.

2015-03-01

We extend previous work on the perturbative expansion of the Rényi entropy, S q , around q = 1 for a spherical entangling surface in a general CFT. Applied to conformal scalar fields in various spacetime dimensions, the results appear to conflict with the known conformal scalar Rényi entropies. On the other hand, the perturbative results agree with known Rényi entropies in a variety of other theories, including theories of free fermions and vector fields and theories with Einstein gravity duals. We propose a resolution stemming from a careful consideration of boundary conditions near the entangling surface. This is equivalent to a proper treatment of total-derivative terms in the definition of the modular Hamiltonian. As a corollary, we are able to resolve an outstanding puzzle in the literature regarding the Rényi entropy of super-Yang-Mills near q = 1. A related puzzle regards the question of stationarity of the renormalized entanglement entropy (REE) across a circle for a (2+1)-dimensional massive scalar field. We point out that the boundary contributions to the modular Hamiltonian shed light on the previously-observed non-stationarity. Moreover, IR divergences appear in perturbation theory about the massless fixed point that inhibit our ability to reliably calculate the REE at small non-zero mass.

Group prioritisation with unknown expert weights in incomplete linguistic context

NASA Astrophysics Data System (ADS)

Cheng, Dong; Cheng, Faxin; Zhou, Zhili; Wang, Juan

2017-09-01

In this paper, we study a group prioritisation problem in situations when the expert weights are completely unknown and their judgement preferences are linguistic and incomplete. Starting from the theory of relative entropy (RE) and multiplicative consistency, an optimisation model is provided for deriving an individual priority vector without estimating the missing value(s) of an incomplete linguistic preference relation. In order to address the unknown expert weights in the group aggregating process, we define two new kinds of expert weight indicators based on RE: proximity entropy weight and similarity entropy weight. Furthermore, a dynamic-adjusting algorithm (DAA) is proposed to obtain an objective expert weight vector and capture the dynamic properties involved in it. Unlike the extant literature of group prioritisation, the proposed RE approach does not require pre-allocation of expert weights and can solve incomplete preference relations. An interesting finding is that once all the experts express their preference relations, the final expert weight vector derived from the DAA is fixed irrespective of the initial settings of expert weights. Finally, an application example is conducted to validate the effectiveness and robustness of the RE approach.

Calculation of heat transfer on shuttle type configurations including the effects of variable entropy at boundary layer edge

NASA Technical Reports Server (NTRS)

Dejarnette, F. R.

1972-01-01

A relatively simple method is presented for including the effect of variable entropy at the boundary-layer edge in a heat transfer method developed previously. For each inviscid surface streamline an approximate shockwave shape is calculated using a modified form of Maslen's method for inviscid axisymmetric flows. The entropy for the streamline at the edge of the boundary layer is determined by equating the mass flux through the shock wave to that inside the boundary layer. Approximations used in this technique allow the heating rates along each inviscid surface streamline to be calculated independent of the other streamlines. The shock standoff distances computed by the present method are found to compare well with those computed by Maslen's asymmetric method. Heating rates are presented for blunted circular and elliptical cones and a typical space shuttle orbiter at angles of attack. Variable entropy effects are found to increase heating rates downstream of the nose significantly higher than those computed using normal-shock entropy, and turbulent heating rates increased more than laminar rates. Effects of Reynolds number and angles of attack are also shown.

A bound on holographic entanglement entropy from inverse mean curvature flow

NASA Astrophysics Data System (ADS)

Fischetti, Sebastian; Wiseman, Toby

2017-06-01

Entanglement entropies are notoriously difficult to compute. Large-N strongly-coupled holographic CFTs are an important exception, where the AdS/CFT dictionary gives the entanglement entropy of a CFT region in terms of the area of an extremal bulk surface anchored to the AdS boundary. Using this prescription, we show—for quite general states of (2  +  1)-dimensional such CFTs—that the renormalized entanglement entropy of any region of the CFT is bounded from above by a weighted local energy density. The key ingredient in this construction is the inverse mean curvature (IMC) flow, which we suitably generalize to flows of surfaces anchored to the AdS boundary. Our bound can then be thought of as a ‘subregion’ Penrose inequality in asymptotically locally AdS spacetimes, similar to the Penrose inequalities obtained from IMC flows in asymptotically flat spacetimes. Combining the result with positivity of relative entropy, we argue that our bound is valid perturbatively in 1/N, and conjecture that a restricted version of it holds in any CFT.

Species Entropies in the Kinetic Range of Collisionless Plasma Turbulence: Particle-in-cell Simulations

NASA Astrophysics Data System (ADS)

Gary, S. Peter; Zhao, Yinjian; Hughes, R. Scott; Wang, Joseph; Parashar, Tulasi N.

2018-06-01

Three-dimensional particle-in-cell simulations of the forward cascade of decaying turbulence in the relatively short-wavelength kinetic range have been carried out as initial-value problems on collisionless, homogeneous, magnetized electron-ion plasma models. The simulations have addressed both whistler turbulence at β i = β e = 0.25 and kinetic Alfvén turbulence at β i = β e = 0.50, computing the species energy dissipation rates as well as the increase of the Boltzmann entropies for both ions and electrons as functions of the initial dimensionless fluctuating magnetic field energy density ε o in the range 0 ≤ ε o ≤ 0.50. This study shows that electron and ion entropies display similar rates of increase and that all four entropy rates increase approximately as ε o , consistent with the assumption that the quasilinear premise is valid for the initial conditions assumed for these simulations. The simulations further predict that the time rates of ion entropy increase should be substantially greater for kinetic Alfvén turbulence than for whistler turbulence.

How hidden are hidden processes? A primer on crypticity and entropy convergence

NASA Astrophysics Data System (ADS)

Mahoney, John R.; Ellison, Christopher J.; James, Ryan G.; Crutchfield, James P.

2011-09-01

We investigate a stationary process's crypticity—a measure of the difference between its hidden state information and its observed information—using the causal states of computational mechanics. Here, we motivate crypticity and cryptic order as physically meaningful quantities that monitor how hidden a hidden process is. This is done by recasting previous results on the convergence of block entropy and block-state entropy in a geometric setting, one that is more intuitive and that leads to a number of new results. For example, we connect crypticity to how an observer synchronizes to a process. We show that the block-causal-state entropy is a convex function of block length. We give a complete analysis of spin chains. We present a classification scheme that surveys stationary processes in terms of their possible cryptic and Markov orders. We illustrate related entropy convergence behaviors using a new form of foliated information diagram. Finally, along the way, we provide a variety of interpretations of crypticity and cryptic order to establish their naturalness and pervasiveness. This is also a first step in developing applications in spatially extended and network dynamical systems.

Structural transformations of heat treated Co-less high entropy alloys

NASA Astrophysics Data System (ADS)

Mitrica, D.; Tudor, A.; Rinaldi, A.; Soare, V.; Predescu, C.; Berbecaru, A.; Stoiciu, F.; Badilita, V.

2018-03-01

Co is considered to be one of the main ingredients in superalloys. Co is considered a critical element and its substitution is difficult due to its unique ability to form high temperature stable structures with high mechanical and corrosion/oxidation resistance. High entropy alloys (HEA) represent a relatively new concept in material design. HEA are characterised by a high number of alloying elements, in unusually high proportion. Due to their specific particularities, high entropy alloys tend to form predominant solid solution structures that develop potentially high chemical, physical and mechanical properties. Present paper is studying Co-less high entropy alloys with high potential in severe environment applications. The high entropy alloys based on Al-Cr-Fe-Mn-Ni system were prepared by induction melting and casting under protective atmosphere. The as-cast specimens were heat treated at various temperatures to determine the structure and property behaviour. Samples taken before and after heat treatment were investigated for chemical, physical, structural and mechanical characteristics. Sigma phase composition and heat treatment parameters had major influence over the resulted alloy structure and properties.

Force-Time Entropy of Isometric Impulse.

PubMed

Hsieh, Tsung-Yu; Newell, Karl M

2016-01-01

The relation between force and temporal variability in discrete impulse production has been viewed as independent (R. A. Schmidt, H. Zelaznik, B. Hawkins, J. S. Frank, & J. T. Quinn, 1979 ) or dependent on the rate of force (L. G. Carlton & K. M. Newell, 1993 ). Two experiments in an isometric single finger force task investigated the joint force-time entropy with (a) fixed time to peak force and different percentages of force level and (b) fixed percentage of force level and different times to peak force. The results showed that the peak force variability increased either with the increment of force level or through a shorter time to peak force that also reduced timing error variability. The peak force entropy and entropy of time to peak force increased on the respective dimension as the parameter conditions approached either maximum force or a minimum rate of force production. The findings show that force error and timing error are dependent but complementary when considered in the same framework with the joint force-time entropy at a minimum in the middle parameter range of discrete impulse.

Entropy of space-time outcome in a movement speed-accuracy task.

PubMed

Hsieh, Tsung-Yu; Pacheco, Matheus Maia; Newell, Karl M

2015-12-01

The experiment reported was set-up to investigate the space-time entropy of movement outcome as a function of a range of spatial (10, 20 and 30 cm) and temporal (250-2500 ms) criteria in a discrete aiming task. The variability and information entropy of the movement spatial and temporal errors considered separately increased and decreased on the respective dimension as a function of an increment of movement velocity. However, the joint space-time entropy was lowest when the relative contribution of spatial and temporal task criteria was comparable (i.e., mid-range of space-time constraints), and it increased with a greater trade-off between spatial or temporal task demands, revealing a U-shaped function across space-time task criteria. The traditional speed-accuracy functions of spatial error and temporal error considered independently mapped to this joint space-time U-shaped entropy function. The trade-off in movement tasks with joint space-time criteria is between spatial error and timing error, rather than movement speed and accuracy. Copyright © 2015 Elsevier B.V. All rights reserved.

Nonlinear evolution and final fate of (charged) superradiant instability

NASA Astrophysics Data System (ADS)

Green, Stephen; Bosch, Pablo; Lehner, Luis

2016-03-01

We describe the full nonlinear development of the superradiant instability for a charged massless scalar field, coupled to general relativity and electromagnetism, in the vicinity of a Reissner-Nordstrom-AdS black hole. The presence of the negative cosmological constant provides a natural context for considering perfectly reflecting boundary conditions and studying the dynamics as the scalar field interacts repeateadly with the black hole. At early times, small superradiant perturbations grow as expected from linearized studies. Backreaction then causes the black hole to lose charge and mass until the perturbation becomes nonsuperradiant, with the final state described by a stable hairy black hole. For large gauge coupling, the instability extracts a large amount of charge per unit mass, resulting in greater entropy increase. We discuss the implications of the observed behavior for the general problem of superradiance in black hole spacetimes.

Implications, Consequences and Interpretations of Generalized Entropy in the Cosmological Setups

NASA Astrophysics Data System (ADS)

Moradpour, H.

2016-09-01

Recently, it was argued (Tsallis and Cirto, Eur. Phys. J. C 73, 2487 2013) that the total entropy of a gravitational system should be related to the volume of system instead of the system surface. Here, we show that this new proposal cannot satisfy the unified first law of thermodynamics and the Friedmans equation simultaneously, unless the effects of dark energy candidate on the horizon entropy are considered. In fact, our study shows that some types of dark energy candidate may admit this proposal. Some general properties of required dark energy are also addressed. Moreover, our investigation shows that this new proposal for entropy, while combined with the second law of thermodynamics (as the backbone of Verlinde's proposal), helps us in provideing a thermodynamic interpretation for the difference between the surface and bulk degrees of freedom which, according to Padmanabhan's proposal, leads to the emergence of spacetime and thus the universe expansion. In fact, our investigation shows that the entropy changes of system may be equal to the difference between the surface and bulk degrees of freedom falling from surface into the system volume. Briefly, our results signal us that this new proposal for entropy may be in agreement with the thermodynamics laws, the Friedmann equation, Padmanabhan's holographic proposal for the emergence of spacetime and therefore the universe expansion. In fact, this new definition of entropy may be used to make a bridge between Verlinde's and Padmanabhan's proposals.

Conserved charges of minimal massive gravity coupled to scalar field

NASA Astrophysics Data System (ADS)

Setare, M. R.; Adami, H.

2018-02-01

Recently, the theory of topologically massive gravity non-minimally coupled to a scalar field has been proposed, which comes from the Lorentz-Chern-Simons theory (JHEP 06, 113, 2015), a torsion-free theory. We extend this theory by adding an extra term which makes the torsion to be non-zero. We show that the BTZ spacetime is a particular solution to this theory in the case where the scalar field is constant. The quasi-local conserved charge is defined by the concept of the generalized off-shell ADT current. Also a general formula is found for the entropy of the stationary black hole solution in context of the considered theory. The obtained formulas are applied to the BTZ black hole solution in order to obtain the energy, the angular momentum and the entropy of this solution. The central extension term, the central charges and the eigenvalues of the Virasoro algebra generators for the BTZ black hole solution are thus obtained. The energy and the angular momentum of the BTZ black hole using the eigenvalues of the Virasoro algebra generators are calculated. Also, using the Cardy formula, the entropy of the BTZ black hole is found. It is found that the results obtained in two different ways exactly match, just as expected.

Blind source computer device identification from recorded VoIP calls for forensic investigation.

PubMed

Jahanirad, Mehdi; Anuar, Nor Badrul; Wahab, Ainuddin Wahid Abdul

2017-03-01

The VoIP services provide fertile ground for criminal activity, thus identifying the transmitting computer devices from recorded VoIP call may help the forensic investigator to reveal useful information. It also proves the authenticity of the call recording submitted to the court as evidence. This paper extended the previous study on the use of recorded VoIP call for blind source computer device identification. Although initial results were promising but theoretical reasoning for this is yet to be found. The study suggested computing entropy of mel-frequency cepstrum coefficients (entropy-MFCC) from near-silent segments as an intrinsic feature set that captures the device response function due to the tolerances in the electronic components of individual computer devices. By applying the supervised learning techniques of naïve Bayesian, linear logistic regression, neural networks and support vector machines to the entropy-MFCC features, state-of-the-art identification accuracy of near 99.9% has been achieved on different sets of computer devices for both call recording and microphone recording scenarios. Furthermore, unsupervised learning techniques, including simple k-means, expectation-maximization and density-based spatial clustering of applications with noise (DBSCAN) provided promising results for call recording dataset by assigning the majority of instances to their correct clusters. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.

Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables

NASA Astrophysics Data System (ADS)

Barnett, Lionel; Barrett, Adam B.; Seth, Anil K.

2009-12-01

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.

H-theorem in quantum physics.

PubMed

Lesovik, G B; Lebedev, A V; Sadovskyy, I A; Suslov, M V; Vinokur, V M

2016-09-12

Remarkable progress of quantum information theory (QIT) allowed to formulate mathematical theorems for conditions that data-transmitting or data-processing occurs with a non-negative entropy gain. However, relation of these results formulated in terms of entropy gain in quantum channels to temporal evolution of real physical systems is not thoroughly understood. Here we build on the mathematical formalism provided by QIT to formulate the quantum H-theorem in terms of physical observables. We discuss the manifestation of the second law of thermodynamics in quantum physics and uncover special situations where the second law can be violated. We further demonstrate that the typical evolution of energy-isolated quantum systems occurs with non-diminishing entropy.

Spectral density of mixtures of random density matrices for qubits

NASA Astrophysics Data System (ADS)

Zhang, Lin; Wang, Jiamei; Chen, Zhihua

2018-06-01

We derive the spectral density of the equiprobable mixture of two random density matrices of a two-level quantum system. We also work out the spectral density of mixture under the so-called quantum addition rule. We use the spectral densities to calculate the average entropy of mixtures of random density matrices, and show that the average entropy of the arithmetic-mean-state of n qubit density matrices randomly chosen from the Hilbert-Schmidt ensemble is never decreasing with the number n. We also get the exact value of the average squared fidelity. Some conjectures and open problems related to von Neumann entropy are also proposed.

Mass dependence of the activation enthalpy and entropy of unentangled linear alkane chains

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jeong, Cheol; Douglas, Jack F.

2015-10-14

The mass scaling of the self-diffusion coefficient D of polymers in the liquid state, D ∼ M{sup β}, is one of the most basic characteristics of these complex fluids. Although traditional theories such as the Rouse and reptation models of unentangled and entangled polymer melts, respectively, predict that β is constant, this exponent for alkanes has been estimated experimentally to vary from −1.8 to −2.7 upon cooling. Significantly, β changes with temperature T under conditions where the chains are not entangled and at temperatures far above the glass transition temperature T{sub g} where dynamic heterogeneity does not complicate the descriptionmore » of the liquid dynamics. Based on atomistic molecular dynamics simulations on unentangled linear alkanes in the melt, we find that the variation of β with T can be directly attributed to the dependence of the enthalpy ΔH{sub a} and entropy ΔS{sub a} of activation on the number of alkane backbone carbon atoms, n. In addition, we find a sharp change in the melt dynamics near a “critical” chain length, n ≈ 17. A close examination of this phenomenon indicates that a “buckling transition” from rod-like to coiled chain configurations occurs at this characteristic chain length and distinct entropy-enthalpy compensation relations, ΔS{sub a} ∝ ΔH{sub a}, hold on either side of this polymer conformational transition. We conclude that the activation free energy parameters exert a significant influence on the dynamics of polymer melts that is not anticipated by either the Rouse and reptation models. In addition to changes of ΔH{sub a} and ΔS{sub a} with M, we expect changes in these free energy parameters to be crucial for understanding the dynamics of polymer blends, nanocomposites, and confined polymers because of changes of the fluid free energy by interfacial interactions and geometrical confinement.« less

Generalized Information Theory Meets Human Cognition: Introducing a Unified Framework to Model Uncertainty and Information Search.

PubMed

Crupi, Vincenzo; Nelson, Jonathan D; Meder, Björn; Cevolani, Gustavo; Tentori, Katya

2018-06-17

Searching for information is critical in many situations. In medicine, for instance, careful choice of a diagnostic test can help narrow down the range of plausible diseases that the patient might have. In a probabilistic framework, test selection is often modeled by assuming that people's goal is to reduce uncertainty about possible states of the world. In cognitive science, psychology, and medical decision making, Shannon entropy is the most prominent and most widely used model to formalize probabilistic uncertainty and the reduction thereof. However, a variety of alternative entropy metrics (Hartley, Quadratic, Tsallis, Rényi, and more) are popular in the social and the natural sciences, computer science, and philosophy of science. Particular entropy measures have been predominant in particular research areas, and it is often an open issue whether these divergences emerge from different theoretical and practical goals or are merely due to historical accident. Cutting across disciplinary boundaries, we show that several entropy and entropy reduction measures arise as special cases in a unified formalism, the Sharma-Mittal framework. Using mathematical results, computer simulations, and analyses of published behavioral data, we discuss four key questions: How do various entropy models relate to each other? What insights can be obtained by considering diverse entropy models within a unified framework? What is the psychological plausibility of different entropy models? What new questions and insights for research on human information acquisition follow? Our work provides several new pathways for theoretical and empirical research, reconciling apparently conflicting approaches and empirical findings within a comprehensive and unified information-theoretic formalism. Copyright © 2018 Cognitive Science Society, Inc.

Classifying the Quantum Phases of Matter

DTIC Science & Technology

2015-01-01

Kim related entanglement entropy to topological storage of quantum information [8]. Michalakis et al. showed that a particle-like excitation spectrum...Perturbative analysis of topological entanglement entropy from conditional independence, Phys. Rev. B 86, 254116 (2012), arXiv:1210.2360. [3] I. Kim...symmetries or long-range entanglement ), (2) elucidating the properties of three-dimensional quantum codes (in particular those which admit no string-like

STATIC QUARK ANTI-QUARK FREE AND INTERNAL ENERGY IN 2-FLAVOR QCD AND BOUND STATES IN THE QGP.

DOE Office of Scientific and Technical Information (OSTI.GOV)

ZANTOW, F.; KACZMAREK, O.

2005-07-25

We present results on heavy quark free energies in 2-flavour QCD. The temperature dependence of the interaction between static quark anti-quark pairs will be analyzed in terms of temperature dependent screening radii, which give a first estimate on the medium modification of (heavy quark) bound states in the quark gluon plasma. Comparing those radii to the (zero temperature) mean squared charge radii of chasmonium states indicates that the J/{Psi} may survive the phase transition as a bound state, while {chi}{sub c} and {Psi}{prime} are expected to show significant thermal modifications at temperatures close to the transition. Furthermore we will analyzemore » the relation between heavy quark free energies, entropy contributions and internal energy and discuss their relation to potential models used to analyze the melting of heavy quark bound states above the deconfinement temperature. Results of different groups and various potential models for bound states in the deconfined phase of QCD are compared.« less

Dynamical maps, quantum detailed balance, and the Petz recovery map

NASA Astrophysics Data System (ADS)

Alhambra, Álvaro M.; Woods, Mischa P.

2017-08-01

Markovian master equations (formally known as quantum dynamical semigroups) can be used to describe the evolution of a quantum state ρ when in contact with a memoryless thermal bath. This approach has had much success in describing the dynamics of real-life open quantum systems in the laboratory. Such dynamics increase the entropy of the state ρ and the bath until both systems reach thermal equilibrium, at which point entropy production stops. Our main result is to show that the entropy production at time t is bounded by the relative entropy between the original state and the state at time 2 t . The bound puts strong constraints on how quickly a state can thermalize, and we prove that the factor of 2 is tight. The proof makes use of a key physically relevant property of these dynamical semigroups, detailed balance, showing that this property is intimately connected with the field of recovery maps from quantum information theory. We envisage that the connections made here between the two fields will have further applications. We also use this connection to show that a similar relation can be derived when the fixed point is not thermal.

A new complexity measure for time series analysis and classification

NASA Astrophysics Data System (ADS)

Nagaraj, Nithin; Balasubramanian, Karthi; Dey, Sutirth

2013-07-01

Complexity measures are used in a number of applications including extraction of information from data such as ecological time series, detection of non-random structure in biomedical signals, testing of random number generators, language recognition and authorship attribution etc. Different complexity measures proposed in the literature like Shannon entropy, Relative entropy, Lempel-Ziv, Kolmogrov and Algorithmic complexity are mostly ineffective in analyzing short sequences that are further corrupted with noise. To address this problem, we propose a new complexity measure ETC and define it as the "Effort To Compress" the input sequence by a lossless compression algorithm. Here, we employ the lossless compression algorithm known as Non-Sequential Recursive Pair Substitution (NSRPS) and define ETC as the number of iterations needed for NSRPS to transform the input sequence to a constant sequence. We demonstrate the utility of ETC in two applications. ETC is shown to have better correlation with Lyapunov exponent than Shannon entropy even with relatively short and noisy time series. The measure also has a greater rate of success in automatic identification and classification of short noisy sequences, compared to entropy and a popular measure based on Lempel-Ziv compression (implemented by Gzip).

Correlation between magnetocaloric and electrical properties based on phenomenological models in La0.47Pr0.2Pb0.33MnO3 perovskite

NASA Astrophysics Data System (ADS)

Mechi, Nesrine; Alzahrani, Bandar; Hcini, Sobhi; Bouazizi, Mohamed Lamjed; Dhahri, Abdessalem

2018-06-01

We have investigated the correlation between magnetocaloric and electrical properties of La0.47Pr0.2Pb0.33MnO3 perovskite prepared using the sol-gel method. Rietveld analysis of X-ray diffraction (XRD) pattern shows pure crystalline phase with rhombohedral ? structure. Magnetic entropy change, relative cooling power (RCP) and specific heat were predicted from M(T, μ0H) data at different magnetic fields with the help of the phenomenological model. The magnetic entropy change reaches a maximum value ? of about 3.96 J kg-1 K-1 for μ0H = 5 T corresponding to RCP of 183 J kg-1. These values are relatively higher, making our sample a promising candidate for the magnetic refrigeration. Electrical-resistivity measurements were well fitted with the phenomenological percolation model, which is based on the phase segregation of ferromagnetic-metallic clusters and paramagnetic-semiconductor regions. The temperature and magnetic field dependences of resistivity data, ρ(T, μ0H), allowed us to determine the magnetic entropy change ?. Results show that the as-obtained magnetic entropy change values are similar to those determined from the phenomenological model.

Sample entropy and regularity dimension in complexity analysis of cortical surface structure in early Alzheimer's disease and aging.

PubMed

Chen, Ying; Pham, Tuan D

2013-05-15

We apply for the first time the sample entropy (SampEn) and regularity dimension model for measuring signal complexity to quantify the structural complexity of the brain on MRI. The concept of the regularity dimension is based on the theory of chaos for studying nonlinear dynamical systems, where power laws and entropy measure are adopted to develop the regularity dimension for modeling a mathematical relationship between the frequencies with which information about signal regularity changes in various scales. The sample entropy and regularity dimension of MRI-based brain structural complexity are computed for early Alzheimer's disease (AD) elder adults and age and gender-matched non-demented controls, as well as for a wide range of ages from young people to elder adults. A significantly higher global cortical structure complexity is detected in AD individuals (p<0.001). The increase of SampEn and the regularity dimension are also found to be accompanied with aging which might indicate an age-related exacerbation of cortical structural irregularity. The provided model can be potentially used as an imaging bio-marker for early prediction of AD and age-related cognitive decline. Copyright © 2013 Elsevier B.V. All rights reserved.

Using the concept of Shannon's Entropy to evaluate impacts of climate extremes on interannual variability in ecosystem CO2 fluxes

NASA Astrophysics Data System (ADS)

Ma, S.; Baldocchi, D. D.

2016-12-01

Although interannual variability in ecosystem CO2 fluxes have been observed in the field and described with empirical or process-based models, we still lack tools for evaluating and comparing impacts of climate extremes or unusual biogeophysical events on the variability. We examined a 15-year-long dataset of net ecosystem exchange of CO2 (NEE) measured at a woody savanna and a grassland site in California from 2000 to 2015. We proposed a conceptual framework to quantify season contributions by computing relatively contributions of each season to annual anomalies of gross ecosystem productivity (GPP) and ecosystem respiration (Reco). According to the framework, we calculated the Shannon's Entropy for each year. The values of Shannon Entropy were higher in the year that variations in GPP and Reco were beyond predictions of empirical models established for the study site. We specifically examined the outliers compared to model predictions and concluded that the outliers were related to occurrences of unexpected biogeophysical events in those years. This study offers a new application of Shannon's Entropy in understanding complicated biophysical and ecological processes involved in ecosystem carbon cycling.

Thermal coefficients of the methyl groups within ubiquitin

PubMed Central

Sabo, T Michael; Bakhtiari, Davood; Walter, Korvin F A; McFeeters, Robert L; Giller, Karin; Becker, Stefan; Griesinger, Christian; Lee, Donghan

2012-01-01

Physiological processes such as protein folding and molecular recognition are intricately linked to their dynamic signature, which is reflected in their thermal coefficient. In addition, the local conformational entropy is directly related to the degrees of freedom, which each residue possesses within its conformational space. Therefore, the temperature dependence of the local conformational entropy may provide insight into understanding how local dynamics may affect the stability of proteins. Here, we analyze the temperature dependence of internal methyl group dynamics derived from the cross-correlated relaxation between dipolar couplings of two CH bonds within ubiquitin. Spanning a temperature range from 275 to 308 K, internal methyl group dynamics tend to increase with increasing temperature, which translates to a general increase in local conformational entropy. With this data measured over multiple temperatures, the thermal coefficient of the methyl group order parameter, the characteristic thermal coefficient, and the local heat capacity were obtained. By analyzing the distribution of methyl group thermal coefficients within ubiquitin, we found that the N-terminal region has relatively high thermostability. These results indicate that methyl groups contribute quite appreciably to the total heat capacity of ubiquitin through the regulation of local conformational entropy. PMID:22334336

A full-Bayesian approach to parameter inference from tracer travel time moments and investigation of scale effects at the Cape Cod experimental site

USGS Publications Warehouse

Woodbury, Allan D.; Rubin, Yoram

2000-01-01

A method for inverting the travel time moments of solutes in heterogeneous aquifers is presented and is based on peak concentration arrival times as measured at various samplers in an aquifer. The approach combines a Lagrangian [Rubin and Dagan, 1992] solute transport framework with full‐Bayesian hydrogeological parameter inference. In the full‐Bayesian approach the noise values in the observed data are treated as hyperparameters, and their effects are removed by marginalization. The prior probability density functions (pdfs) for the model parameters (horizontal integral scale, velocity, and log K variance) and noise values are represented by prior pdfs developed from minimum relative entropy considerations. Analysis of the Cape Cod (Massachusetts) field experiment is presented. Inverse results for the hydraulic parameters indicate an expected value for the velocity, variance of log hydraulic conductivity, and horizontal integral scale of 0.42 m/d, 0.26, and 3.0 m, respectively. While these results are consistent with various direct‐field determinations, the importance of the findings is in the reduction of confidence range about the various expected values. On selected control planes we compare observed travel time frequency histograms with the theoretical pdf, conditioned on the observed travel time moments. We observe a positive skew in the travel time pdf which tends to decrease as the travel time distance grows. We also test the hypothesis that there is no scale dependence of the integral scale λ with the scale of the experiment at Cape Cod. We adopt two strategies. The first strategy is to use subsets of the full data set and then to see if the resulting parameter fits are different as we use different data from control planes at expanding distances from the source. The second approach is from the viewpoint of entropy concentration. No increase in integral scale with distance is inferred from either approach over the range of the Cape Cod tracer experiment.

Entanglement entropy of 2D conformal quantum critical points: hearing the shape of a quantum drum.

PubMed

Fradkin, Eduardo; Moore, Joel E

2006-08-04

The entanglement entropy of a pure quantum state of a bipartite system A union or logical sumB is defined as the von Neumann entropy of the reduced density matrix obtained by tracing over one of the two parts. In one dimension, the entanglement of critical ground states diverges logarithmically in the subsystem size, with a universal coefficient that for conformally invariant critical points is related to the central charge of the conformal field theory. We find that the entanglement entropy of a standard class of z=2 conformal quantum critical points in two spatial dimensions, in addition to a nonuniversal "area law" contribution linear in the size of the AB boundary, generically has a universal logarithmically divergent correction, which is completely determined by the geometry of the partition and by the central charge of the field theory that describes the critical wave function.

Entanglement entropy of critical spin liquids.

PubMed

Zhang, Yi; Grover, Tarun; Vishwanath, Ashvin

2011-08-05

Quantum spin liquids are phases of matter whose internal structure is not captured by a local order parameter. Particularly intriguing are critical spin liquids, where strongly interacting excitations control low energy properties. Here we calculate their bipartite entanglement entropy that characterizes their quantum structure. In particular we calculate the Renyi entropy S(2) on model wave functions obtained by Gutzwiller projection of a Fermi sea. Although the wave functions are not sign positive, S(2) can be calculated on relatively large systems (>324 spins) using the variational Monte Carlo technique. On the triangular lattice we find that entanglement entropy of the projected Fermi sea state violates the boundary law, with S(2) enhanced by a logarithmic factor. This is an unusual result for a bosonic wave function reflecting the presence of emergent fermions. These techniques can be extended to study a wide class of other phases.

Tsirelson's bound from a generalized data processing inequality

NASA Astrophysics Data System (ADS)

Dahlsten, Oscar C. O.; Lercher, Daniel; Renner, Renato

2012-06-01

The strength of quantum correlations is bounded from above by Tsirelson's bound. We establish a connection between this bound and the fact that correlations between two systems cannot increase under local operations, a property known as the data processing inequality (DPI). More specifically, we consider arbitrary convex probabilistic theories. These can be equipped with an entropy measure that naturally generalizes the von Neumann entropy, as shown recently in Short and Wehner (2010 New J. Phys. 12 033023) and Barnum et al (2010 New J. Phys. 12 033024). We prove that if the DPI holds with respect to this generalized entropy measure then the underlying theory necessarily respects Tsirelson's bound. We, moreover, generalize this statement to any entropy measure satisfying certain minimal requirements. A consequence of our result is that not all the entropic relations used for deriving Tsirelson's bound via information causality in Pawlowski et al (2009 Nature 461 1101-4) are necessary.

Entropy: Thermodynamic definition and quantum expression

NASA Astrophysics Data System (ADS)

Gyftopoulos, Elias P.; Çubukçu, Erol

1997-04-01

Numerous expressions exist in the scientific literature purporting to represent entropy. Are they all acceptable? To answer this question, we review the thermodynamic definition of entropy, and establish eight criteria that must be satisfied by it. The definition and criteria are obtained by using solely the general, nonstatistical statements of the first and second laws presented in Thermodynamics: Foundations and Applications [Elias P. Gyftopoulos and Gian Paolo Beretta (Macmillan, New York, 1991)]. We apply the eight criteria to each of the entropy expressions proposed in the literature and find that only the relation S=-kTrρln ρ satisfies all the criteria, provided that the density operator ρ corresponds to a homogeneous ensemble of identical systems, identically prepared. Homogeneous ensemble means that every member of the ensemble is described by the same density operator ρ as any other member, that is, the ensemble is not a statistical mixture of projectors (wave functions).

Discrete gravity on random tensor network and holographic Rényi entropy

NASA Astrophysics Data System (ADS)

Han, Muxin; Huang, Shilin

2017-11-01

In this paper we apply the discrete gravity and Regge calculus to tensor networks and Anti-de Sitter/conformal field theory (AdS/CFT) correspondence. We construct the boundary many-body quantum state |Ψ〉 using random tensor networks as the holographic mapping, applied to the Wheeler-deWitt wave function of bulk Euclidean discrete gravity in 3 dimensions. The entanglement Rényi entropy of |Ψ〉 is shown to holographically relate to the on-shell action of Einstein gravity on a branch cover bulk manifold. The resulting Rényi entropy S n of |Ψ〉 approximates with high precision the Rényi entropy of ground state in 2-dimensional conformal field theory (CFT). In particular it reproduces the correct n dependence. Our results develop the framework of realizing the AdS3/CFT2 correspondence on random tensor networks, and provide a new proposal to approximate the CFT ground state.

Symmetry for the duration of entropy-consuming intervals.

PubMed

García-García, Reinaldo; Domínguez, Daniel

2014-05-01

We introduce the violation fraction υ as the cumulative fraction of time that a mesoscopic system spends consuming entropy at a single trajectory in phase space. We show that the fluctuations of this quantity are described in terms of a symmetry relation reminiscent of fluctuation theorems, which involve a function Φ, which can be interpreted as an entropy associated with the fluctuations of the violation fraction. The function Φ, when evaluated for arbitrary stochastic realizations of the violation fraction, is odd upon the symmetry transformations that are relevant for the associated stochastic entropy production. This fact leads to a detailed fluctuation theorem for the probability density function of Φ. We study the steady-state limit of this symmetry in the paradigmatic case of a colloidal particle dragged by optical tweezers through an aqueous solution. Finally, we briefly discuss possible applications of our results for the estimation of free-energy differences from single-molecule experiments.

Brane - Anti-Brane Democracy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rajaraman, Arvind

2003-06-02

We suggest a duality invariant formula for the entropy and temperature of nonextreme black holes in supersymmetric string theory. The entropy is given in terms of the duality invariant parameter of the deviation from extremality and 56 SU(8) covariant central charges. It interpolates between the entropies of Schwarzschild solution and extremal solutions with various amount of unbroken supersymmetries and therefore serves for classification of black holes in supersymmetric string theories. We introduce the second auxiliary 56 via E(7) symmetric constraint. The symmetric and antisymmetric combinations of these two multiplets are related via moduli to the corresponding two fundamental representations ofmore » E(7): brane and anti-brane ''numbers.'' Using the CPT as well as C symmetry of the entropy formula and duality one can explain the mysterious simplicity of the non-extreme black hole area formula in terms of branes and anti-branes.« less

Holographic definition of points and distances

NASA Astrophysics Data System (ADS)

Czech, Bartłomiej; Lamprou, Lampros

2014-11-01

We discuss the way in which field theory quantities assemble the spatial geometry of three-dimensional anti-de Sitter space (AdS3). The field theory ingredients are the entanglement entropies of boundary intervals. A point in AdS3 corresponds to a collection of boundary intervals which is selected by a variational principle we discuss. Coordinates in AdS3 are integration constants of the resulting equation of motion. We propose a distance function for this collection of points, which obeys the triangle inequality as a consequence of the strong subadditivity of entropy. Our construction correctly reproduces the static slice of AdS3 and the Ryu-Takayanagi relation between geodesics and entanglement entropies. We discuss how these results extend to quotients of AdS3 —the conical defect and the BTZ geometries. In these cases, the set of entanglement entropies must be supplemented by other field theory quantities, which can carry the information about lengths of nonminimal geodesics.

Entropy production of doubly stochastic quantum channels

DOE Office of Scientific and Technical Information (OSTI.GOV)

Müller-Hermes, Alexander, E-mail: muellerh@posteo.net; Department of Mathematical Sciences, University of Copenhagen, 2100 Copenhagen; Stilck França, Daniel, E-mail: dsfranca@mytum.de

2016-02-15

We study the entropy increase of quantum systems evolving under primitive, doubly stochastic Markovian noise and thus converging to the maximally mixed state. This entropy increase can be quantified by a logarithmic-Sobolev constant of the Liouvillian generating the noise. We prove a universal lower bound on this constant that stays invariant under taking tensor-powers. Our methods involve a new comparison method to relate logarithmic-Sobolev constants of different Liouvillians and a technique to compute logarithmic-Sobolev inequalities of Liouvillians with eigenvectors forming a projective representation of a finite abelian group. Our bounds improve upon similar results established before and as an applicationmore » we prove an upper bound on continuous-time quantum capacities. In the last part of this work we study entropy production estimates of discrete-time doubly stochastic quantum channels by extending the framework of discrete-time logarithmic-Sobolev inequalities to the quantum case.« less

Transfer Entropy and Transient Limits of Computation

PubMed Central

Prokopenko, Mikhail; Lizier, Joseph T.

2014-01-01

Transfer entropy is a recently introduced information-theoretic measure quantifying directed statistical coherence between spatiotemporal processes, and is widely used in diverse fields ranging from finance to neuroscience. However, its relationships to fundamental limits of computation, such as Landauer's limit, remain unknown. Here we show that in order to increase transfer entropy (predictability) by one bit, heat flow must match or exceed Landauer's limit. Importantly, we generalise Landauer's limit to bi-directional information dynamics for non-equilibrium processes, revealing that the limit applies to prediction, in addition to retrodiction (information erasure). Furthermore, the results are related to negentropy, and to Bremermann's limit and the Bekenstein bound, producing, perhaps surprisingly, lower bounds on the computational deceleration and information loss incurred during an increase in predictability about the process. The identified relationships set new computational limits in terms of fundamental physical quantities, and establish transfer entropy as a central measure connecting information theory, thermodynamics and theory of computation. PMID:24953547

Linear entropy and collapse–revival phenomenon for a general formalism N-type four-level atom interacting with a single-mode field

NASA Astrophysics Data System (ADS)

Eied, A. A.

2018-05-01

In this paper, the linear entropy and collapse-revival phenomenon through the relation (< {\\hat{a}}+{\\hat{a}} > -{\\bar{n}}) in a system of N-configuration four-level atom interacting with a single-mode field with additional forms of nonlinearities of both the field and the intensity-dependent atom-field coupling functional are investigated. A factorization of the initial density operator is assumed, considering the field to be initially in a squeezed coherent states and the atom initially in its most upper excited state. The dynamical behavior of the linear entropy and the time evolution of (< {\\hat{a}}+ {\\hat{a}} > -{\\bar{n}}) are analyzed. In particular, the effects of the mean photon number, detuning, Kerr-like medium and the intensity-dependent coupling functional on the entropy and the evolution of (< {\\hat{a}}+ {\\hat{a}} > -{\\bar{n}}) are examined.

Entropy generation minimization for the sloshing phenomenon in half-full elliptical storage tanks

NASA Astrophysics Data System (ADS)

Saghi, Hassan

2018-02-01

In this paper, the entropy generation in the sloshing phenomenon was obtained in elliptical storage tanks and the optimum geometry of tank was suggested. To do this, a numerical model was developed to simulate the sloshing phenomenon by using coupled Reynolds-Averaged Navier-Stokes (RANS) solver and the Volume-of-Fluid (VOF) method. The RANS equations were discretized and solved using the staggered grid finite difference and SMAC methods, and the available data were used for the model validation. Some parameters consisting of maximum free surface displacement (MFSD), maximum horizontal force exerted on the tank perimeter (MHF), tank perimeter (TP), and total entropy generation (Sgen) were introduced as design criteria for elliptical storage tanks. The entropy generation distribution provides designers with useful information about the causes of the energy loss. In this step, horizontal periodic sway motions as X =amsin(ωt) were applied to elliptical storage tanks with different aspect ratios namely ratios of large diameter to small diameter of elliptical storage tank (AR). Then, the effect of am and ω was studied on the results. The results show that the relation between MFSD and MHF is almost linear relative to the sway motion amplitude. Moreover, the results show that an increase in the AR causes a decrease in the MFSD and MHF. The results, also, show that the relation between MFSD and MHF is nonlinear relative to the sway motion angular frequency. Furthermore, the results show that an increase in the AR causes that the relation between MFSD and MHF becomes linear relative to the sway motion angular frequency. In addition, MFSD and MHF were minimized in a sway motion with a 7 rad/s angular frequency. Finally, the results show that the elliptical storage tank with AR =1.2-1.4 is the optimum section.

Distribution entropy analysis of epileptic EEG signals.

PubMed

Li, Peng; Yan, Chang; Karmakar, Chandan; Liu, Changchun

2015-01-01

It is an open-ended challenge to accurately detect the epileptic seizures through electroencephalogram (EEG) signals. Recently published studies have made elaborate attempts to distinguish between the normal and epileptic EEG signals by advanced nonlinear entropy methods, such as the approximate entropy, sample entropy, fuzzy entropy, and permutation entropy, etc. Most recently, a novel distribution entropy (DistEn) has been reported to have superior performance compared with the conventional entropy methods for especially short length data. We thus aimed, in the present study, to show the potential of DistEn in the analysis of epileptic EEG signals. The publicly-accessible Bonn database which consisted of normal, interictal, and ictal EEG signals was used in this study. Three different measurement protocols were set for better understanding the performance of DistEn, which are: i) calculate the DistEn of a specific EEG signal using the full recording; ii) calculate the DistEn by averaging the results for all its possible non-overlapped 5 second segments; and iii) calculate it by averaging the DistEn values for all the possible non-overlapped segments of 1 second length, respectively. Results for all three protocols indicated a statistically significantly increased DistEn for the ictal class compared with both the normal and interictal classes. Besides, the results obtained under the third protocol, which only used very short segments (1 s) of EEG recordings showed a significantly (p <; 0.05) increased DistEn for the interictal class in compassion with the normal class, whereas both analyses using relatively long EEG signals failed in tracking this difference between them, which may be due to a nonstationarity effect on entropy algorithm. The capability of discriminating between the normal and interictal EEG signals is of great clinical relevance since it may provide helpful tools for the detection of a seizure onset. Therefore, our study suggests that the DistEn analysis of EEG signals is very promising for clinical and even portable EEG monitoring.

Thermodynamics and evolution.

PubMed

Demetrius, L

2000-09-07

The science of thermodynamics is concerned with understanding the properties of inanimate matter in so far as they are determined by changes in temperature. The Second Law asserts that in irreversible processes there is a uni-directional increase in thermodynamic entropy, a measure of the degree of uncertainty in the thermal energy state of a randomly chosen particle in the aggregate. The science of evolution is concerned with understanding the properties of populations of living matter in so far as they are regulated by changes in generation time. Directionality theory, a mathematical model of the evolutionary process, establishes that in populations subject to bounded growth constraints, there is a uni-directional increase in evolutionary entropy, a measure of the degree of uncertainty in the age of the immediate ancestor of a randomly chosen newborn. This article reviews the mathematical basis of directionality theory and analyses the relation between directionality theory and statistical thermodynamics. We exploit an analytic relation between temperature, and generation time, to show that the directionality principle for evolutionary entropy is a non-equilibrium extension of the principle of a uni-directional increase of thermodynamic entropy. The analytic relation between these directionality principles is consistent with the hypothesis of the equivalence of fundamental laws as one moves up the hierarchy, from a molecular ensemble where the thermodynamic laws apply, to a population of replicating entities (molecules, cells, higher organisms), where evolutionary principles prevail. Copyright 2000 Academic Press.

Energy, entropy and mass scaling relations for elliptical galaxies. Towards a physical understanding of their photometric properties

NASA Astrophysics Data System (ADS)

Márquez, I.; Lima Neto, G. B.; Capelato, H.; Durret, F.; Lanzoni, B.; Gerbal, D.

2001-12-01

In the present paper, we show that elliptical galaxies (Es) obey a scaling relation between potential energy and mass. Since they are relaxed systems in a post violent-relaxation stage, they are quasi-equilibrium gravitational systems and therefore they also have a quasi-constant specific entropy. Assuming that light traces mass, these two laws imply that in the space defined by the three Sérsic law parameters (intensity Sigma0 , scale a and shape nu ), elliptical galaxies are distributed on two intersecting 2-manifolds: the Entropic Surface and the Energy-Mass Surface. Using a sample of 132 galaxies belonging to three nearby clusters, we have verified that ellipticals indeed follow these laws. This also implies that they are distributed along the intersection line (the Energy-Entropy line), thus they constitute a one-parameter family. These two physical laws (separately or combined), allow to find the theoretical origin of several observed photometrical relations, such as the correlation between absolute magnitude and effective surface brightness, and the fact that ellipticals are located on a surface in the [log Reff, -2.5 log Sigma0, log nu ] space. The fact that elliptical galaxies are a one-parameter family has important implications for cosmology and galaxy formation and evolution models. Moreover, the Energy-Entropy line could be used as a distance indicator.

Quantum Markov chains, sufficiency of quantum channels, and Rényi information measures

NASA Astrophysics Data System (ADS)

Datta, Nilanjana; Wilde, Mark M.

2015-12-01

A short quantum Markov chain is a tripartite state {ρ }{ABC} such that system A can be recovered perfectly by acting on system C of the reduced state {ρ }{BC}. Such states have conditional mutual information I(A;B| C) equal to zero and are the only states with this property. A quantum channel {N} is sufficient for two states ρ and σ if there exists a recovery channel using which one can perfectly recover ρ from {N}(ρ ) and σ from {N}(σ ). The relative entropy difference D(ρ \\parallel σ )-D({N}(ρ )\\parallel {N}(σ )) is equal to zero if and only if {N} is sufficient for ρ and σ. In this paper, we show that these properties extend to Rényi generalizations of these information measures which were proposed in (Berta et al 2015 J. Math. Phys. 56 022205; Seshadreesan et al 2015 J. Phys. A: Math. Theor. 48 395303), thus providing an alternate characterization of short quantum Markov chains and sufficient quantum channels. These results give further support to these quantities as being legitimate Rényi generalizations of the conditional mutual information and the relative entropy difference. Along the way, we solve some open questions of Ruskai and Zhang, regarding the trace of particular matrices that arise in the study of monotonicity of relative entropy under quantum operations and strong subadditivity of the von Neumann entropy.

Negative Entropy of Life

NASA Astrophysics Data System (ADS)

Goradia, Shantilal

2015-10-01

We modify Newtonian gravity to probabilistic quantum mechanical gravity to derive strong coupling. If this approach is valid, we should be able to extend it to the physical body (life) as follows. Using Boltzmann equation, we get the entropy of the universe (137) as if its reciprocal, the fine structure constant (ALPHA), is the hidden candidate representing the negative entropy of the universe which is indicative of the binary information as its basis (http://www.arXiv.org/pdf/physics0210040v5). Since ALPHA relates to cosmology, it must relate to molecular biology too, with the binary system as the fundamental source of information for the nucleotides of the DNA as implicit in the book by the author: ``Quantum Consciousness - The Road to Reality.'' We debate claims of anthropic principle based on the negligible variation of ALPHA and throw light on thermodynamics. We question constancy of G in multiple ways.

Mass-independent area (or entropy) and thermodynamic volume products in conformal gravity

NASA Astrophysics Data System (ADS)

Pradhan, Parthapratim

2017-06-01

In this work, we investigate the thermodynamic properties of conformal gravity in four dimensions. We compute the area (or entropy) functional relation for this black hole (BH). We consider both de Sitter (dS) and anti-de Sitter (AdS) cases. We derive the Cosmic-Censorship-Inequality which is an important relation in general relativity that relates the total mass of a spacetime to the area of all the BH horizons. Local thermodynamic stability is studied by computing the specific heat. The second-order phase transition occurs at a certain condition. Various types of second-order phase structure have been given for various values of a and the cosmological constant Λ in the Appendix. When a = 0, one obtains the result of Schwarzschild-dS and Schwarzschild-AdS cases. In the limit aM ≪ 1, one obtains the result of Grumiller spacetime, where a is nontrivial Rindler parameter or Rindler acceleration and M is the mass parameter. The thermodynamic volume functional relation is derived in the extended phase space, where the cosmological constant is treated as a thermodynamic pressure and its conjugate variable as a thermodynamic volume. The mass-independent area (or entropy) functional relation and thermodynamic volume functional relation that we have derived could turn out to be a universal quantity.

Algorithms for a very high speed universal noiseless coding module

NASA Technical Reports Server (NTRS)

Rice, Robert F.; Yeh, Pen-Shu

1991-01-01

The algorithmic definitions and performance characterizations are presented for a high performance adaptive coding module. Operation of at least one of these (single chip) implementations is expected to exceed 500 Mbits/s under laboratory conditions. Operation of a companion decoding module should operate at up to half the coder's rate. The module incorporates a powerful noiseless coder for Standard Form Data Sources (i.e., sources whose symbols can be represented by uncorrelated non-negative integers where the smaller integers are more likely than the larger ones). Performance close to data entropies can be expected over a Dynamic Range of from 1.5 to 12 to 14 bits/sample (depending on the implementation).

Extended statistical entropy analysis as a quantitative management tool for water resource systems

NASA Astrophysics Data System (ADS)

Sobantka, Alicja; Rechberger, Helmut

2010-05-01

The use of entropy in hydrology and water resources has been applied to various applications. As water resource systems are inherently spatial and complex, a stochastic description of these systems is needed, and entropy theory enables development of such a description by providing determination of the least-biased probability distributions with limited knowledge and data. Entropy can also serve as a basis for risk and reliability analysis. The relative entropy has been variously interpreted as a measure freedom of choice, uncertainty and disorder, information content, missing information or information gain or loss. In the analysis of empirical data, entropy is another measure of dispersion, an alternative to the variance. Also, as an evaluation tool, the statistical entropy analysis (SEA) has been developed by previous workers to quantify the power of a process to concentrate chemical elements. Within this research programme the SEA is aimed to be extended for application to chemical compounds and tested for its deficits and potentials in systems where water resources play an important role. The extended SEA (eSEA) will be developed first for the nitrogen balance in waste water treatment plants (WWTP). Later applications on the emission of substances to water bodies such as groundwater (e.g. leachate from landfills) will also be possible. By applying eSEA to the nitrogen balance in a WWTP, all possible nitrogen compounds, which may occur during the water treatment process, are taken into account and are quantified in their impact towards the environment and human health. It has been shown that entropy reducing processes are part of modern waste management. Generally, materials management should be performed in a way that significant entropy rise is avoided. The entropy metric might also be used to perform benchmarking on WWTPs. The result out of this management tool would be the determination of the efficiency of WWTPs. By improving and optimizing the efficiency of WWTPs with respect to the state-of-the-art of technology, waste water treatment could become more resources preserving.

Derivation of the spin-glass order parameter from stochastic thermodynamics

NASA Astrophysics Data System (ADS)

Crisanti, A.; Picco, M.; Ritort, F.

2018-05-01

A fluctuation relation is derived to extract the order parameter function q (x ) in weakly ergodic systems. The relation is based on measuring and classifying entropy production fluctuations according to the value of the overlap q between configurations. For a fixed value of q , entropy production fluctuations are Gaussian distributed allowing us to derive the quasi-FDT so characteristic of aging systems. The theory is validated by extracting the q (x ) in various types of glassy models. It might be generally applicable to other nonequilibrium systems and experimental small systems.

Relative entropy and optimization-driven coarse-graining methods in VOTCA

DOE PAGES

Mashayak, S. Y.; Jochum, Mara N.; Koschke, Konstantin; ...

2015-07-20

We discuss recent advances of the VOTCA package for systematic coarse-graining. Two methods have been implemented, namely the downhill simplex optimization and the relative entropy minimization. We illustrate the new methods by coarse-graining SPC/E bulk water and more complex water-methanol mixture systems. The CG potentials obtained from both methods are then evaluated by comparing the pair distributions from the coarse-grained to the reference atomistic simulations.We have also added a parallel analysis framework to improve the computational efficiency of the coarse-graining process.

Exact conditions on the temperature dependence of density functionals

DOE PAGES

Burke, K.; Smith, J. C.; Grabowski, P. E.; ...

2016-05-15

Universal exact conditions guided the construction of most ground-state density functional approximations in use today. Here, we derive the relation between the entropy and Mermin free energy density functionals for thermal density functional theory. Both the entropy and sum of kinetic and electron-electron repulsion functionals are shown to be monotonically increasing with temperature, while the Mermin functional is concave downwards. Analogous relations are found for both exchange and correlation. The importance of these conditions is illustrated in two extremes: the Hubbard dimer and the uniform gas.

On the role of dealing with quantum coherence in amplitude amplification

NASA Astrophysics Data System (ADS)

Rastegin, Alexey E.

2018-07-01

Amplitude amplification is one of primary tools in building algorithms for quantum computers. This technique generalizes key ideas of the Grover search algorithm. Potentially useful modifications are connected with changing phases in the rotation operations and replacing the intermediate Hadamard transform with arbitrary unitary one. In addition, arbitrary initial distribution of the amplitudes may be prepared. We examine trade-off relations between measures of quantum coherence and the success probability in amplitude amplification processes. As measures of coherence, the geometric coherence and the relative entropy of coherence are considered. In terms of the relative entropy of coherence, complementarity relations with the success probability seem to be the most expository. The general relations presented are illustrated within several model scenarios of amplitude amplification processes.

Investigations of student understanding of entropy and of mixed second-order partial derivatives in upper-level thermodynamics

NASA Astrophysics Data System (ADS)

Bucy, Brandon R.

While much of physics education research (PER) has traditionally been conducted in introductory undergraduate courses, researchers have begun to study student understanding of physics concepts at the upper-level. In this dissertation, we describe investigations conducted in advanced undergraduate thermodynamics courses. We present and discuss results pertaining to student understanding of two topics: entropy and the role of mixed second-order partial derivatives in thermodynamics. Our investigations into student understanding of entropy consisted of an analysis of written student responses to researcher-designed diagnostic questions. Data gathered in clinical interviews is employed to illustrate and extend results gathered from written responses. The question sets provided students with several ideal gas processes, and asked students to determine and compare the entropy changes of these processes. We administered the question sets to students from six distinct populations, including students enrolled in classical thermodynamics, statistical mechanics, thermal physics, physical chemistry, and chemical engineering courses, as well as a sample of physics graduate students. Data was gathered both before and after instruction in several samples. Several noteworthy features of student reasoning are identified and discussed. These features include student ideas about entropy prior to instruction, as well as specific difficulties and other aspects of student reasoning evident after instruction. As an example, students from various populations tended to emphasize either the thermodynamic or the statistical definition of entropy. Both approaches present students with a unique set of benefits as well as challenges. We additionally studied student understanding of partial derivatives in a thermodynamics context. We identified specific difficulties related to the mixed second partial derivatives of a thermodynamic state function, based on an analysis of student responses to homework and exam problems. Students tended to set these partial derivatives identically equal to zero. Students also displayed difficulties in relating the physical description of a material property to a corresponding mathematical statement involving partial derivatives. We describe the development of a guided-inquiry tutorial activity designed to address these specific difficulties. This tutorial focused on the graphical interpretation of partial derivatives. Preliminary results suggest that the tutorial was effective in addressing several student difficulties related to partial derivatives.

Efficient Bayesian experimental design for contaminant source identification

NASA Astrophysics Data System (ADS)

Zhang, J.; Zeng, L.

2013-12-01

In this study, an efficient full Bayesian approach is developed for the optimal sampling well location design and source parameter identification of groundwater contaminants. An information measure, i.e., the relative entropy, is employed to quantify the information gain from indirect concentration measurements in identifying unknown source parameters such as the release time, strength and location. In this approach, the sampling location that gives the maximum relative entropy is selected as the optimal one. Once the sampling location is determined, a Bayesian approach based on Markov Chain Monte Carlo (MCMC) is used to estimate unknown source parameters. In both the design and estimation, the contaminant transport equation is required to be solved many times to evaluate the likelihood. To reduce the computational burden, an interpolation method based on the adaptive sparse grid is utilized to construct a surrogate for the contaminant transport. The approximated likelihood can be evaluated directly from the surrogate, which greatly accelerates the design and estimation process. The accuracy and efficiency of our approach are demonstrated through numerical case studies. Compared with the traditional optimal design, which is based on the Gaussian linear assumption, the method developed in this study can cope with arbitrary nonlinearity. It can be used to assist in groundwater monitor network design and identification of unknown contaminant sources. Contours of the expected information gain. The optimal observing location corresponds to the maximum value. Posterior marginal probability densities of unknown parameters, the thick solid black lines are for the designed location. For comparison, other 7 lines are for randomly chosen locations. The true values are denoted by vertical lines. It is obvious that the unknown parameters are estimated better with the desinged location.

Coordinated within-trial dynamics of low-frequency neural rhythms controls evidence accumulation.

PubMed

Werkle-Bergner, Markus; Grandy, Thomas H; Chicherio, Christian; Schmiedek, Florian; Lövdén, Martin; Lindenberger, Ulman

2014-06-18

Higher cognitive functions, such as human perceptual decision making, require information processing and transmission across wide-spread cortical networks. Temporally synchronized neural firing patterns are advantageous for efficiently representing and transmitting information within and between assemblies. Computational, empirical, and conceptual considerations all lead to the expectation that the informational redundancy of neural firing rates is positively related to their synchronization. Recent theorizing and initial evidence also suggest that the coding of stimulus characteristics and their integration with behavioral goal states require neural interactions across a hierarchy of timescales. However, most studies thus have focused on neural activity in a single frequency range or on a restricted set of brain regions. Here we provide evidence for cooperative spatiotemporal dynamics of slow and fast EEG signals during perceptual decision making at the single-trial level. Participants performed three masked two-choice decision tasks, one each with numerical, verbal, or figural content. Decrements in posterior α power (8-14 Hz) were paralleled by increments in high-frequency (>30 Hz) signal entropy in trials demanding active sensory processing. Simultaneously, frontocentral θ power (4-7 Hz) increased, indicating evidence integration. The coordinated α/θ dynamics were tightly linked to decision speed and remarkably similar across tasks, suggesting a domain-general mechanism. In sum, we demonstrate an inverse association between decision-related changes in widespread low-frequency power and local high-frequency entropy. The cooperation among mechanisms captured by these changes enhances the informational density of neural response patterns and qualifies as a neural coding system in the service of perceptual decision making. Copyright © 2014 the authors 0270-6474/14/348519-10$15.00/0.

Thermodynamics of extremal rotating thin shells in an extremal BTZ spacetime and the extremal black hole entropy

NASA Astrophysics Data System (ADS)

Lemos, José P. S.; Minamitsuji, Masato; Zaslavskii, Oleg B.

2017-02-01

In a (2 +1 )-dimensional spacetime with a negative cosmological constant, the thermodynamics and the entropy of an extremal rotating thin shell, i.e., an extremal rotating ring, are investigated. The outer and inner regions with respect to the shell are taken to be the Bañados-Teitelbom-Zanelli (BTZ) spacetime and the vacuum ground state anti-de Sitter spacetime, respectively. By applying the first law of thermodynamics to the extremal thin shell, one shows that the entropy of the shell is an arbitrary well-behaved function of the gravitational area A+ alone, S =S (A+). When the thin shell approaches its own gravitational radius r+ and turns into an extremal rotating BTZ black hole, it is found that the entropy of the spacetime remains such a function of A+, both when the local temperature of the shell at the gravitational radius is zero and nonzero. It is thus vindicated by this analysis that extremal black holes, here extremal BTZ black holes, have different properties from the corresponding nonextremal black holes, which have a definite entropy, the Bekenstein-Hawking entropy S (A+)=A/+4G , where G is the gravitational constant. It is argued that for extremal black holes, in particular for extremal BTZ black holes, one should set 0 ≤S (A+)≤A/+4G;i.e., the extremal black hole entropy has values in between zero and the maximum Bekenstein-Hawking entropy A/+4 G . Thus, rather than having just two entropies for extremal black holes, as previous results have debated, namely, 0 and A/+4 G , it is shown here that extremal black holes, in particular extremal BTZ black holes, may have a continuous range of entropies, limited by precisely those two entropies. Surely, the entropy that a particular extremal black hole picks must depend on past processes, notably on how it was formed. A remarkable relation between the third law of thermodynamics and the impossibility for a massive body to reach the velocity of light is also found. In addition, in the procedure, it becomes clear that there are two distinct angular velocities for the shell, the mechanical and thermodynamic angular velocities. We comment on the relationship between these two velocities. In passing, we clarify, for a static spacetime with a thermal shell, the meaning of the Tolman temperature formula at a generic radius and at the shell.

Conditional Entropy and Location Error in Indoor Localization Using Probabilistic Wi-Fi Fingerprinting.

PubMed

Berkvens, Rafael; Peremans, Herbert; Weyn, Maarten

2016-10-02

Localization systems are increasingly valuable, but their location estimates are only useful when the uncertainty of the estimate is known. This uncertainty is currently calculated as the location error given a ground truth, which is then used as a static measure in sometimes very different environments. In contrast, we propose the use of the conditional entropy of a posterior probability distribution as a complementary measure of uncertainty. This measure has the advantage of being dynamic, i.e., it can be calculated during localization based on individual sensor measurements, does not require a ground truth, and can be applied to discrete localization algorithms. Furthermore, for every consistent location estimation algorithm, both the location error and the conditional entropy measures must be related, i.e., a low entropy should always correspond with a small location error, while a high entropy can correspond with either a small or large location error. We validate this relationship experimentally by calculating both measures of uncertainty in three publicly available datasets using probabilistic Wi-Fi fingerprinting with eight different implementations of the sensor model. We show that the discrepancy between these measures, i.e., many location estimates having a high location error while simultaneously having a low conditional entropy, is largest for the least realistic implementations of the probabilistic sensor model. Based on the results presented in this paper, we conclude that conditional entropy, being dynamic, complementary to location error, and applicable to both continuous and discrete localization, provides an important extra means of characterizing a localization method.

Conditional Entropy and Location Error in Indoor Localization Using Probabilistic Wi-Fi Fingerprinting

PubMed Central

Berkvens, Rafael; Peremans, Herbert; Weyn, Maarten

2016-01-01

Localization systems are increasingly valuable, but their location estimates are only useful when the uncertainty of the estimate is known. This uncertainty is currently calculated as the location error given a ground truth, which is then used as a static measure in sometimes very different environments. In contrast, we propose the use of the conditional entropy of a posterior probability distribution as a complementary measure of uncertainty. This measure has the advantage of being dynamic, i.e., it can be calculated during localization based on individual sensor measurements, does not require a ground truth, and can be applied to discrete localization algorithms. Furthermore, for every consistent location estimation algorithm, both the location error and the conditional entropy measures must be related, i.e., a low entropy should always correspond with a small location error, while a high entropy can correspond with either a small or large location error. We validate this relationship experimentally by calculating both measures of uncertainty in three publicly available datasets using probabilistic Wi-Fi fingerprinting with eight different implementations of the sensor model. We show that the discrepancy between these measures, i.e., many location estimates having a high location error while simultaneously having a low conditional entropy, is largest for the least realistic implementations of the probabilistic sensor model. Based on the results presented in this paper, we conclude that conditional entropy, being dynamic, complementary to location error, and applicable to both continuous and discrete localization, provides an important extra means of characterizing a localization method. PMID:27706099

Deep inelastic scattering as a probe of entanglement

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kharzeev, Dmitri E.; Levin, Eugene M.

Using nonlinear evolution equations of QCD, we compute the von Neumann entropy of the system of partons resolved by deep inelastic scattering at a given Bjorken x and momentum transfer q 2 = - Q 2 . We interpret the result as the entropy of entanglement between the spatial region probed by deep inelastic scattering and the rest of the proton. At small x the relation between the entanglement entropy S ( x ) and the parton distribution x G ( x ) becomes very simple: S ( x ) = ln [ x G ( x ) ] .more » In this small x , large rapidity Y regime, all partonic microstates have equal probabilities—the proton is composed by an exponentially large number exp ( Δ Y ) of microstates that occur with equal and exponentially small probabilities exp ( - Δ Y ) , where Δ is defined by x G ( x ) ~ 1 / x Δ . For this equipartitioned state, the entanglement entropy is maximal—so at small x , deep inelastic scattering probes a maximally entangled state. Here, we propose the entanglement entropy as an observable that can be studied in deep inelastic scattering. This will then require event-by-event measurements of hadronic final states, and would allow to study the transformation of entanglement entropy into the Boltzmann one. We estimate that the proton is represented by the maximally entangled state at x ≤ 10 -3 ; this kinematic region will be amenable to studies at the Electron Ion Collider.« less

Navigation and Self-Semantic Location of Drones in Indoor Environments by Combining the Visual Bug Algorithm and Entropy-Based Vision.

PubMed

Maravall, Darío; de Lope, Javier; Fuentes, Juan P

2017-01-01

We introduce a hybrid algorithm for the self-semantic location and autonomous navigation of robots using entropy-based vision and visual topological maps. In visual topological maps the visual landmarks are considered as leave points for guiding the robot to reach a target point (robot homing) in indoor environments. These visual landmarks are defined from images of relevant objects or characteristic scenes in the environment. The entropy of an image is directly related to the presence of a unique object or the presence of several different objects inside it: the lower the entropy the higher the probability of containing a single object inside it and, conversely, the higher the entropy the higher the probability of containing several objects inside it. Consequently, we propose the use of the entropy of images captured by the robot not only for the landmark searching and detection but also for obstacle avoidance. If the detected object corresponds to a landmark, the robot uses the suggestions stored in the visual topological map to reach the next landmark or to finish the mission. Otherwise, the robot considers the object as an obstacle and starts a collision avoidance maneuver. In order to validate the proposal we have defined an experimental framework in which the visual bug algorithm is used by an Unmanned Aerial Vehicle (UAV) in typical indoor navigation tasks.