Coarse-graining errors and numerical optimization using a relative entropy framework.

PubMed

Chaimovich, Aviel; Shell, M Scott

2011-03-07

The ability to generate accurate coarse-grained models from reference fully atomic (or otherwise "first-principles") ones has become an important component in modeling the behavior of complex molecular systems with large length and time scales. We recently proposed a novel coarse-graining approach based upon variational minimization of a configuration-space functional called the relative entropy, S(rel), that measures the information lost upon coarse-graining. Here, we develop a broad theoretical framework for this methodology and numerical strategies for its use in practical coarse-graining settings. In particular, we show that the relative entropy offers tight control over the errors due to coarse-graining in arbitrary microscopic properties, and suggests a systematic approach to reducing them. We also describe fundamental connections between this optimization methodology and other coarse-graining strategies like inverse Monte Carlo, force matching, energy matching, and variational mean-field theory. We suggest several new numerical approaches to its minimization that provide new coarse-graining strategies. Finally, we demonstrate the application of these theoretical considerations and algorithms to a simple, instructive system and characterize convergence and errors within the relative entropy framework. © 2011 American Institute of Physics.

On S-mixing entropy of quantum channels

NASA Astrophysics Data System (ADS)

Mukhamedov, Farrukh; Watanabe, Noboru

2018-06-01

In this paper, an S-mixing entropy of quantum channels is introduced as a generalization of Ohya's S-mixing entropy. We investigate several properties of the introduced entropy. Moreover, certain relations between the S-mixing entropy and the existing map and output entropies of quantum channels are investigated as well. These relations allowed us to find certain connections between separable states and the introduced entropy. Hence, there is a sufficient condition to detect entangled states. Moreover, several properties of the introduced entropy are investigated. Besides, entropies of qubit and phase-damping channels are calculated.

Chemical equilibrium. [maximizing entropy of gas system to derive relations between thermodynamic variables

NASA Technical Reports Server (NTRS)

1976-01-01

The entropy of a gas system with the number of particles subject to external control is maximized to derive relations between the thermodynamic variables that obtain at equilibrium. These relations are described in terms of the chemical potential, defined as equivalent partial derivatives of entropy, energy, enthalpy, free energy, or free enthalpy. At equilibrium, the change in total chemical potential must vanish. This fact is used to derive the equilibrium constants for chemical reactions in terms of the partition functions of the species involved in the reaction. Thus the equilibrium constants can be determined accurately, just as other thermodynamic properties, from a knowledge of the energy levels and degeneracies for the gas species involved. These equilibrium constants permit one to calculate the equilibrium concentrations or partial pressures of chemically reacting species that occur in gas mixtures at any given condition of pressure and temperature or volume and temperature.

Effect of chunk strength on the performance of children with developmental dyslexia on artificial grammar learning task may be related to complexity.

PubMed

Schiff, Rachel; Katan, Pesia; Sasson, Ayelet; Kahta, Shani

2017-07-01

There's a long held view that chunks play a crucial role in artificial grammar learning performance. We compared chunk strength influences on performance, in high and low topological entropy (a measure of complexity) grammar systems, with dyslexic children, age-matched and reading-level-matched control participants. Findings show that age-matched control participants' performance reflected equivalent influence of chunk strength in the two topological entropy conditions, as typically found in artificial grammar learning experiments. By contrast, dyslexic children and reading-level-matched controls' performance reflected knowledge of chunk strength only under the low topological entropy condition. In the low topological entropy grammar system, they appeared completely unable to utilize chunk strength to make appropriate test item selections. In line with previous research, this study suggests that for typically developing children, it is the chunks that are attended during artificial grammar learning and create a foundation on which implicit associative learning mechanisms operate, and these chunks are unitized to different strengths. However, for children with dyslexia, it is complexity that may influence the subsequent memorability of chunks, independently of their strength.

On variational expressions for quantum relative entropies

NASA Astrophysics Data System (ADS)

Berta, Mario; Fawzi, Omar; Tomamichel, Marco

2017-12-01

Distance measures between quantum states like the trace distance and the fidelity can naturally be defined by optimizing a classical distance measure over all measurement statistics that can be obtained from the respective quantum states. In contrast, Petz showed that the measured relative entropy, defined as a maximization of the Kullback-Leibler divergence over projective measurement statistics, is strictly smaller than Umegaki's quantum relative entropy whenever the states do not commute. We extend this result in two ways. First, we show that Petz' conclusion remains true if we allow general positive operator-valued measures. Second, we extend the result to Rényi relative entropies and show that for non-commuting states the sandwiched Rényi relative entropy is strictly larger than the measured Rényi relative entropy for α \\in (1/2, \\infty ) and strictly smaller for α \\in [0,1/2). The latter statement provides counterexamples for the data processing inequality of the sandwiched Rényi relative entropy for α < 1/2. Our main tool is a new variational expression for the measured Rényi relative entropy, which we further exploit to show that certain lower bounds on quantum conditional mutual information are superadditive.

Multiscale entropy analysis of heart rate variability in heart failure, hypertensive, and sinoaortic-denervated rats: classical and refined approaches.

PubMed

Silva, Luiz Eduardo Virgilio; Lataro, Renata Maria; Castania, Jaci Airton; da Silva, Carlos Alberto Aguiar; Valencia, Jose Fernando; Murta, Luiz Otavio; Salgado, Helio Cesar; Fazan, Rubens; Porta, Alberto

2016-07-01

The analysis of heart rate variability (HRV) by nonlinear methods has been gaining increasing interest due to their ability to quantify the complexity of cardiovascular regulation. In this study, multiscale entropy (MSE) and refined MSE (RMSE) were applied to track the complexity of HRV as a function of time scale in three pathological conscious animal models: rats with heart failure (HF), spontaneously hypertensive rats (SHR), and rats with sinoaortic denervation (SAD). Results showed that HF did not change HRV complexity, although there was a tendency to decrease the entropy in HF animals. On the other hand, SHR group was characterized by reduced complexity at long time scales, whereas SAD animals exhibited a smaller short- and long-term irregularity. We propose that short time scales (1 to 4), accounting for fast oscillations, are more related to vagal and respiratory control, whereas long time scales (5 to 20), accounting for slow oscillations, are more related to sympathetic control. The increased sympathetic modulation is probably the main reason for the lower entropy observed at high scales for both SHR and SAD groups, acting as a negative factor for the cardiovascular complexity. This study highlights the contribution of the multiscale complexity analysis of HRV for understanding the physiological mechanisms involved in cardiovascular regulation. Copyright © 2016 the American Physiological Society.

Relative entropy equals bulk relative entropy

DOE PAGES

Jafferis, Daniel L.; Lewkowycz, Aitor; Maldacena, Juan; ...

2016-06-01

We consider the gravity dual of the modular Hamiltonian associated to a general subregion of a boundary theory. We use it to argue that the relative entropy of nearby states is given by the relative entropy in the bulk, to leading order in the bulk gravitational coupling. We also argue that the boundary modular flow is dual to the bulk modular flow in the entanglement wedge, with implications for entanglement wedge reconstruction.

Entanglement entropy of critical spin liquids.

PubMed

Zhang, Yi; Grover, Tarun; Vishwanath, Ashvin

2011-08-05

Quantum spin liquids are phases of matter whose internal structure is not captured by a local order parameter. Particularly intriguing are critical spin liquids, where strongly interacting excitations control low energy properties. Here we calculate their bipartite entanglement entropy that characterizes their quantum structure. In particular we calculate the Renyi entropy S(2) on model wave functions obtained by Gutzwiller projection of a Fermi sea. Although the wave functions are not sign positive, S(2) can be calculated on relatively large systems (>324 spins) using the variational Monte Carlo technique. On the triangular lattice we find that entanglement entropy of the projected Fermi sea state violates the boundary law, with S(2) enhanced by a logarithmic factor. This is an unusual result for a bosonic wave function reflecting the presence of emergent fermions. These techniques can be extended to study a wide class of other phases.

Relative entropy of steering: on its definition and properties

NASA Astrophysics Data System (ADS)

Kaur, Eneet; Wilde, Mark M.

2017-11-01

In Gallego and Aolita (2015 Phys. Rev. X 5 041008), the authors proposed a definition for the relative entropy of steering and showed that the resulting quantity is a convex steering monotone. Here we advocate for a different definition for relative entropy of steering, based on well grounded concerns coming from quantum Shannon theory. We prove that this modified relative entropy of steering is a convex steering monotone. Furthermore, we establish that it is uniformly continuous and faithful, in both cases giving quantitative bounds that should be useful in applications. We also consider a restricted relative entropy of steering which is relevant for the case in which the free operations in the resource theory of steering have a more restricted form (the restricted operations could be more relevant in practical scenarios). The restricted relative entropy of steering is convex, monotone with respect to these restricted operations, uniformly continuous, and faithful.

Entanglement distribution in multi-particle systems in terms of unified entropy.

PubMed

Luo, Yu; Zhang, Fu-Gang; Li, Yongming

2017-04-25

We investigate the entanglement distribution in multi-particle systems in terms of unified (q, s)-entropy. We find that for any tripartite mixed state, the unified (q, s)-entropy entanglement of assistance follows a polygamy relation. This polygamy relation also holds in multi-particle systems. Furthermore, a generalized monogamy relation is provided for unified (q, s)-entropy entanglement in the multi-qubit system.

Efficient optimization of the quantum relative entropy

NASA Astrophysics Data System (ADS)

Fawzi, Hamza; Fawzi, Omar

2018-04-01

Many quantum information measures can be written as an optimization of the quantum relative entropy between sets of states. For example, the relative entropy of entanglement of a state is the minimum relative entropy to the set of separable states. The various capacities of quantum channels can also be written in this way. We propose a unified framework to numerically compute these quantities using off-the-shelf semidefinite programming solvers, exploiting the approximation method proposed in Fawzi, Saunderson and Parrilo (2017 arXiv: 1705.00812). As a notable application, this method allows us to provide numerical counterexamples for a proposed lower bound on the quantum conditional mutual information in terms of the relative entropy of recovery.

Sample entropy analysis of cervical neoplasia gene-expression signatures

PubMed Central

Botting, Shaleen K; Trzeciakowski, Jerome P; Benoit, Michelle F; Salama, Salama A; Diaz-Arrastia, Concepcion R

2009-01-01

Background We introduce Approximate Entropy as a mathematical method of analysis for microarray data. Approximate entropy is applied here as a method to classify the complex gene expression patterns resultant of a clinical sample set. Since Entropy is a measure of disorder in a system, we believe that by choosing genes which display minimum entropy in normal controls and maximum entropy in the cancerous sample set we will be able to distinguish those genes which display the greatest variability in the cancerous set. Here we describe a method of utilizing Approximate Sample Entropy (ApSE) analysis to identify genes of interest with the highest probability of producing an accurate, predictive, classification model from our data set. Results In the development of a diagnostic gene-expression profile for cervical intraepithelial neoplasia (CIN) and squamous cell carcinoma of the cervix, we identified 208 genes which are unchanging in all normal tissue samples, yet exhibit a random pattern indicative of the genetic instability and heterogeneity of malignant cells. This may be measured in terms of the ApSE when compared to normal tissue. We have validated 10 of these genes on 10 Normal and 20 cancer and CIN3 samples. We report that the predictive value of the sample entropy calculation for these 10 genes of interest is promising (75% sensitivity, 80% specificity for prediction of cervical cancer over CIN3). Conclusion The success of the Approximate Sample Entropy approach in discerning alterations in complexity from biological system with such relatively small sample set, and extracting biologically relevant genes of interest hold great promise. PMID:19232110

Low Streamflow Forcasting using Minimum Relative Entropy

NASA Astrophysics Data System (ADS)

Cui, H.; Singh, V. P.

2013-12-01

Minimum relative entropy spectral analysis is derived in this study, and applied to forecast streamflow time series. Proposed method extends the autocorrelation in the manner that the relative entropy of underlying process is minimized so that time series data can be forecasted. Different prior estimation, such as uniform, exponential and Gaussian assumption, is taken to estimate the spectral density depending on the autocorrelation structure. Seasonal and nonseasonal low streamflow series obtained from Colorado River (Texas) under draught condition is successfully forecasted using proposed method. Minimum relative entropy determines spectral of low streamflow series with higher resolution than conventional method. Forecasted streamflow is compared to the prediction using Burg's maximum entropy spectral analysis (MESA) and Configurational entropy. The advantage and disadvantage of each method in forecasting low streamflow is discussed.

Classicality condition on a system observable in a quantum measurement and a relative-entropy conservation law

NASA Astrophysics Data System (ADS)

Kuramochi, Yui; Ueda, Masahito

2015-03-01

We consider the information flow on a system observable X corresponding to a positive-operator-valued measure under a quantum measurement process Y described by a completely positive instrument from the viewpoint of the relative entropy. We establish a sufficient condition for the relative-entropy conservation law which states that the average decrease in the relative entropy of the system observable X equals the relative entropy of the measurement outcome of Y , i.e., the information gain due to measurement. This sufficient condition is interpreted as an assumption of classicality in the sense that there exists a sufficient statistic in a joint successive measurement of Y followed by X such that the probability distribution of the statistic coincides with that of a single measurement of X for the premeasurement state. We show that in the case when X is a discrete projection-valued measure and Y is discrete, the classicality condition is equivalent to the relative-entropy conservation for arbitrary states. The general theory on the relative-entropy conservation is applied to typical quantum measurement models, namely, quantum nondemolition measurement, destructive sharp measurements on two-level systems, a photon counting, a quantum counting, homodyne and heterodyne measurements. These examples except for the nondemolition and photon-counting measurements do not satisfy the known Shannon-entropy conservation law proposed by Ban [M. Ban, J. Phys. A: Math. Gen. 32, 1643 (1999), 10.1088/0305-4470/32/9/012], implying that our approach based on the relative entropy is applicable to a wider class of quantum measurements.

On the effects of signal processing on sample entropy for postural control.

PubMed

Lubetzky, Anat V; Harel, Daphna; Lubetzky, Eyal

2018-01-01

Sample entropy, a measure of time series regularity, has become increasingly popular in postural control research. We are developing a virtual reality assessment of sensory integration for postural control in people with vestibular dysfunction and wished to apply sample entropy as an outcome measure. However, despite the common use of sample entropy to quantify postural sway, we found lack of consistency in the literature regarding center-of-pressure signal manipulations prior to the computation of sample entropy. We therefore wished to investigate the effect of parameters choice and signal processing on participants' sample entropy outcome. For that purpose, we compared center-of-pressure sample entropy data between patients with vestibular dysfunction and age-matched controls. Within our assessment, participants observed virtual reality scenes, while standing on floor or a compliant surface. We then analyzed the effect of: modification of the radius of similarity (r) and the embedding dimension (m); down-sampling or filtering and differencing or detrending. When analyzing the raw center-of-pressure data, we found a significant main effect of surface in medio-lateral and anterior-posterior directions across r's and m's. We also found a significant interaction group × surface in the medio-lateral direction when r was 0.05 or 0.1 with a monotonic increase in p value with increasing r in both m's. These effects were maintained with down-sampling by 2, 3, and 4 and with detrending but not with filtering and differencing. Based on these findings, we suggest that for sample entropy to be compared across postural control studies, there needs to be increased consistency, particularly of signal handling prior to the calculation of sample entropy. Procedures such as filtering, differencing or detrending affect sample entropy values and could artificially alter the time series pattern. Therefore, if such procedures are performed they should be well justified.

Flood control project selection using an interval type-2 entropy weight with interval type-2 fuzzy TOPSIS

NASA Astrophysics Data System (ADS)

Zamri, Nurnadiah; Abdullah, Lazim

2014-06-01

Flood control project is a complex issue which takes economic, social, environment and technical attributes into account. Selection of the best flood control project requires the consideration of conflicting quantitative and qualitative evaluation criteria. When decision-makers' judgment are under uncertainty, it is relatively difficult for them to provide exact numerical values. The interval type-2 fuzzy set (IT2FS) is a strong tool which can deal with the uncertainty case of subjective, incomplete, and vague information. Besides, it helps to solve for some situations where the information about criteria weights for alternatives is completely unknown. Therefore, this paper is adopted the information interval type-2 entropy concept into the weighting process of interval type-2 fuzzy TOPSIS. This entropy weight is believed can effectively balance the influence of uncertainty factors in evaluating attribute. Then, a modified ranking value is proposed in line with the interval type-2 entropy weight. Quantitative and qualitative factors that normally linked with flood control project are considered for ranking. Data in form of interval type-2 linguistic variables were collected from three authorised personnel of three Malaysian Government agencies. Study is considered for the whole of Malaysia. From the analysis, it shows that diversion scheme yielded the highest closeness coefficient at 0.4807. A ranking can be drawn using the magnitude of closeness coefficient. It was indicated that the diversion scheme recorded the first rank among five causes.

How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems.

PubMed

Hanel, Rudolf; Thurner, Stefan; Gell-Mann, Murray

2014-05-13

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and Markovian systems in statistical mechanics, information theory, and statistics. For several decades there has been an ongoing controversy over whether the notion of the maximum entropy principle can be extended in a meaningful way to nonextensive, nonergodic, and complex statistical systems and processes. In this paper we start by reviewing how Boltzmann-Gibbs-Shannon entropy is related to multiplicities of independent random processes. We then show how the relaxation of independence naturally leads to the most general entropies that are compatible with the first three Shannon-Khinchin axioms, the (c,d)-entropies. We demonstrate that the MEP is a perfectly consistent concept for nonergodic and complex statistical systems if their relative entropy can be factored into a generalized multiplicity and a constraint term. The problem of finding such a factorization reduces to finding an appropriate representation of relative entropy in a linear basis. In a particular example we show that path-dependent random processes with memory naturally require specific generalized entropies. The example is to our knowledge the first exact derivation of a generalized entropy from the microscopic properties of a path-dependent random process.

Gradient Dynamics and Entropy Production Maximization

NASA Astrophysics Data System (ADS)

Janečka, Adam; Pavelka, Michal

2018-01-01

We compare two methods for modeling dissipative processes, namely gradient dynamics and entropy production maximization. Both methods require similar physical inputs-how energy (or entropy) is stored and how it is dissipated. Gradient dynamics describes irreversible evolution by means of dissipation potential and entropy, it automatically satisfies Onsager reciprocal relations as well as their nonlinear generalization (Maxwell-Onsager relations), and it has statistical interpretation. Entropy production maximization is based on knowledge of free energy (or another thermodynamic potential) and entropy production. It also leads to the linear Onsager reciprocal relations and it has proven successful in thermodynamics of complex materials. Both methods are thermodynamically sound as they ensure approach to equilibrium, and we compare them and discuss their advantages and shortcomings. In particular, conditions under which the two approaches coincide and are capable of providing the same constitutive relations are identified. Besides, a commonly used but not often mentioned step in the entropy production maximization is pinpointed and the condition of incompressibility is incorporated into gradient dynamics.

Role of information theoretic uncertainty relations in quantum theory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jizba, Petr, E-mail: p.jizba@fjfi.cvut.cz; ITP, Freie Universität Berlin, Arnimallee 14, D-14195 Berlin; Dunningham, Jacob A., E-mail: J.Dunningham@sussex.ac.uk

2015-04-15

Uncertainty relations based on information theory for both discrete and continuous distribution functions are briefly reviewed. We extend these results to account for (differential) Rényi entropy and its related entropy power. This allows us to find a new class of information-theoretic uncertainty relations (ITURs). The potency of such uncertainty relations in quantum mechanics is illustrated with a simple two-energy-level model where they outperform both the usual Robertson–Schrödinger uncertainty relation and Shannon entropy based uncertainty relation. In the continuous case the ensuing entropy power uncertainty relations are discussed in the context of heavy tailed wave functions and Schrödinger cat states. Again,more » improvement over both the Robertson–Schrödinger uncertainty principle and Shannon ITUR is demonstrated in these cases. Further salient issues such as the proof of a generalized entropy power inequality and a geometric picture of information-theoretic uncertainty relations are also discussed.« less

Sample entropy and regularity dimension in complexity analysis of cortical surface structure in early Alzheimer's disease and aging.

PubMed

Chen, Ying; Pham, Tuan D

2013-05-15

We apply for the first time the sample entropy (SampEn) and regularity dimension model for measuring signal complexity to quantify the structural complexity of the brain on MRI. The concept of the regularity dimension is based on the theory of chaos for studying nonlinear dynamical systems, where power laws and entropy measure are adopted to develop the regularity dimension for modeling a mathematical relationship between the frequencies with which information about signal regularity changes in various scales. The sample entropy and regularity dimension of MRI-based brain structural complexity are computed for early Alzheimer's disease (AD) elder adults and age and gender-matched non-demented controls, as well as for a wide range of ages from young people to elder adults. A significantly higher global cortical structure complexity is detected in AD individuals (p<0.001). The increase of SampEn and the regularity dimension are also found to be accompanied with aging which might indicate an age-related exacerbation of cortical structural irregularity. The provided model can be potentially used as an imaging bio-marker for early prediction of AD and age-related cognitive decline. Copyright © 2013 Elsevier B.V. All rights reserved.

Uncertainty relations with quantum memory for the Wehrl entropy

NASA Astrophysics Data System (ADS)

De Palma, Giacomo

2018-03-01

We prove two new fundamental uncertainty relations with quantum memory for the Wehrl entropy. The first relation applies to the bipartite memory scenario. It determines the minimum conditional Wehrl entropy among all the quantum states with a given conditional von Neumann entropy and proves that this minimum is asymptotically achieved by a suitable sequence of quantum Gaussian states. The second relation applies to the tripartite memory scenario. It determines the minimum of the sum of the Wehrl entropy of a quantum state conditioned on the first memory quantum system with the Wehrl entropy of the same state conditioned on the second memory quantum system and proves that also this minimum is asymptotically achieved by a suitable sequence of quantum Gaussian states. The Wehrl entropy of a quantum state is the Shannon differential entropy of the outcome of a heterodyne measurement performed on the state. The heterodyne measurement is one of the main measurements in quantum optics and lies at the basis of one of the most promising protocols for quantum key distribution. These fundamental entropic uncertainty relations will be a valuable tool in quantum information and will, for example, find application in security proofs of quantum key distribution protocols in the asymptotic regime and in entanglement witnessing in quantum optics.

Quantifying selection and diversity in viruses by entropy methods, with application to the haemagglutinin of H3N2 influenza

PubMed Central

Pan, Keyao; Deem, Michael W.

2011-01-01

Many viruses evolve rapidly. For example, haemagglutinin (HA) of the H3N2 influenza A virus evolves to escape antibody binding. This evolution of the H3N2 virus means that people who have previously been exposed to an influenza strain may be infected by a newly emerged virus. In this paper, we use Shannon entropy and relative entropy to measure the diversity and selection pressure by an antibody in each amino acid site of H3 HA between the 1992–1993 season and the 2009–2010 season. Shannon entropy and relative entropy are two independent state variables that we use to characterize H3N2 evolution. The entropy method estimates future H3N2 evolution and migration using currently available H3 HA sequences. First, we show that the rate of evolution increases with the virus diversity in the current season. The Shannon entropy of the sequence in the current season predicts relative entropy between sequences in the current season and those in the next season. Second, a global migration pattern of H3N2 is assembled by comparing the relative entropy flows of sequences sampled in China, Japan, the USA and Europe. We verify this entropy method by describing two aspects of historical H3N2 evolution. First, we identify 54 amino acid sites in HA that have evolved in the past to evade the immune system. Second, the entropy method shows that epitopes A and B on the top of HA evolve most vigorously to escape antibody binding. Our work provides a novel entropy-based method to predict and quantify future H3N2 evolution and to describe the evolutionary history of H3N2. PMID:21543352

Wavelet entropy characterization of elevated intracranial pressure.

PubMed

Xu, Peng; Scalzo, Fabien; Bergsneider, Marvin; Vespa, Paul; Chad, Miller; Hu, Xiao

2008-01-01

Intracranial Hypertension (ICH) often occurs for those patients with traumatic brain injury (TBI), stroke, tumor, etc. Pathology of ICH is still controversial. In this work, we used wavelet entropy and relative wavelet entropy to study the difference existed between normal and hypertension states of ICP for the first time. The wavelet entropy revealed the similar findings as the approximation entropy that entropy during ICH state is smaller than that in normal state. Moreover, with wavelet entropy, we can see that ICH state has the more focused energy in the low wavelet frequency band (0-3.1 Hz) than the normal state. The relative wavelet entropy shows that the energy distribution in the wavelet bands between these two states is actually different. Based on these results, we suggest that ICH may be formed by the re-allocation of oscillation energy within brain.

Maps on positive operators preserving Rényi type relative entropies and maximal f-divergences

NASA Astrophysics Data System (ADS)

Gaál, Marcell; Nagy, Gergő

2018-02-01

In this paper, we deal with two quantum relative entropy preserver problems on the cones of positive (either positive definite or positive semidefinite) operators. The first one is related to a quantum Rényi relative entropy like quantity which plays an important role in classical-quantum channel decoding. The second one is connected to the so-called maximal f-divergences introduced by D. Petz and M. B. Ruskai who considered this quantity as a generalization of the usual Belavkin-Staszewski relative entropy. We emphasize in advance that all the results are obtained for finite-dimensional Hilbert spaces.

Bayesian or Laplacien inference, entropy and information theory and information geometry in data and signal processing

NASA Astrophysics Data System (ADS)

Mohammad-Djafari, Ali

2015-01-01

The main object of this tutorial article is first to review the main inference tools using Bayesian approach, Entropy, Information theory and their corresponding geometries. This review is focused mainly on the ways these tools have been used in data, signal and image processing. After a short introduction of the different quantities related to the Bayes rule, the entropy and the Maximum Entropy Principle (MEP), relative entropy and the Kullback-Leibler divergence, Fisher information, we will study their use in different fields of data and signal processing such as: entropy in source separation, Fisher information in model order selection, different Maximum Entropy based methods in time series spectral estimation and finally, general linear inverse problems.

Use of information entropy measures of sitting postural sway to quantify developmental delay in infants

PubMed Central

Deffeyes, Joan E; Harbourne, Regina T; DeJong, Stacey L; Kyvelidou, Anastasia; Stuberg, Wayne A; Stergiou, Nicholas

2009-01-01

Background By quantifying the information entropy of postural sway data, the complexity of the postural movement of different populations can be assessed, giving insight into pathologic motor control functioning. Methods In this study, developmental delay of motor control function in infants was assessed by analysis of sitting postural sway data acquired from force plate center of pressure measurements. Two types of entropy measures were used: symbolic entropy, including a new asymmetric symbolic entropy measure, and approximate entropy, a more widely used entropy measure. For each method of analysis, parameters were adjusted to optimize the separation of the results from the infants with delayed development from infants with typical development. Results The method that gave the widest separation between the populations was the asymmetric symbolic entropy method, which we developed by modification of the symbolic entropy algorithm. The approximate entropy algorithm also performed well, using parameters optimized for the infant sitting data. The infants with delayed development were found to have less complex patterns of postural sway in the medial-lateral direction, and were found to have different left-right symmetry in their postural sway, as compared to typically developing infants. Conclusion The results of this study indicate that optimization of the entropy algorithm for infant sitting postural sway data can greatly improve the ability to separate the infants with developmental delay from typically developing infants. PMID:19671183

Thermodynamics and computation during collective motion near criticality

NASA Astrophysics Data System (ADS)

Crosato, Emanuele; Spinney, Richard E.; Nigmatullin, Ramil; Lizier, Joseph T.; Prokopenko, Mikhail

2018-01-01

We study self-organization of collective motion as a thermodynamic phenomenon in the context of the first law of thermodynamics. It is expected that the coherent ordered motion typically self-organises in the presence of changes in the (generalized) internal energy and of (generalized) work done on, or extracted from, the system. We aim to explicitly quantify changes in these two quantities in a system of simulated self-propelled particles and contrast them with changes in the system's configuration entropy. In doing so, we adapt a thermodynamic formulation of the curvatures of the internal energy and the work, with respect to two parameters that control the particles' alignment. This allows us to systematically investigate the behavior of the system by varying the two control parameters to drive the system across a kinetic phase transition. Our results identify critical regimes and show that during the phase transition, where the configuration entropy of the system decreases, the rates of change of the work and of the internal energy also decrease, while their curvatures diverge. Importantly, the reduction of entropy achieved through expenditure of work is shown to peak at criticality. We relate this both to a thermodynamic efficiency and the significance of the increased order with respect to a computational path. Additionally, this study provides an information-geometric interpretation of the curvature of the internal energy as the difference between two curvatures: the curvature of the free entropy, captured by the Fisher information, and the curvature of the configuration entropy.

Optimal quantum networks and one-shot entropies

NASA Astrophysics Data System (ADS)

Chiribella, Giulio; Ebler, Daniel

2016-09-01

We develop a semidefinite programming method for the optimization of quantum networks, including both causal networks and networks with indefinite causal structure. Our method applies to a broad class of performance measures, defined operationally in terms of interative tests set up by a verifier. We show that the optimal performance is equal to a max relative entropy, which quantifies the informativeness of the test. Building on this result, we extend the notion of conditional min-entropy from quantum states to quantum causal networks. The optimization method is illustrated in a number of applications, including the inversion, charge conjugation, and controlization of an unknown unitary dynamics. In the non-causal setting, we show a proof-of-principle application to the maximization of the winning probability in a non-causal quantum game.

Neuronal Entropy-Rate Feature of Entopeduncular Nucleus in Rat Model of Parkinson's Disease.

PubMed

Darbin, Olivier; Jin, Xingxing; Von Wrangel, Christof; Schwabe, Kerstin; Nambu, Atsushi; Naritoku, Dean K; Krauss, Joachim K; Alam, Mesbah

2016-03-01

The function of the nigro-striatal pathway on neuronal entropy in the basal ganglia (BG) output nucleus, i.e. the entopeduncular nucleus (EPN) was investigated in the unilaterally 6-hyroxydopamine (6-OHDA)-lesioned rat model of Parkinson's disease (PD). In both control subjects and subjects with 6-OHDA lesion of dopamine (DA) the nigro-striatal pathway, a histological hallmark for parkinsonism, neuronal entropy in EPN was maximal in neurons with firing rates ranging between 15 and 25 Hz. In 6-OHDA lesioned rats, neuronal entropy in the EPN was specifically higher in neurons with firing rates above 25 Hz. Our data establishes that the nigro-striatal pathway controls neuronal entropy in motor circuitry and that the parkinsonian condition is associated with abnormal relationship between firing rate and neuronal entropy in BG output nuclei. The neuronal firing rates and entropy relationship provide putative relevant electrophysiological information to investigate the sensory-motor processing in normal condition and conditions such as movement disorders.

RELATIONSHIP BETWEEN ENTROPY OF SPIKE TIMING AND FIRING RATE IN ENTOPEDUNCULAR NUCLEUS NEURONS IN ANESTHETIZED RATS: FUNCTION OF THE NIGRO-STRIATAL PATHWAY

PubMed Central

Darbin, Olivier; Jin, Xingxing; von Wrangel, Christof; Schwabe, Kerstin; Nambu, Atsushi; Naritoku, Dean K; Krauss, Joachim K.; Alam, Mesbah

2016-01-01

The function of the nigro-striatal pathway on neuronal entropy in the basal ganglia (BG) output nucleus (entopeduncular nucleus, EPN) was investigated in the unilaterally 6-hyroxydopamine (6-OHDA)-lesioned rat model of Parkinson’s disease (PD). In both control subjects and subjects with 6-OHDA lesion of the nigro-striatal pathway, a histological hallmark for parkinsonism, neuronal entropy in EPN was maximal in neurons with firing rates ranging between 15Hz and 25 Hz. In 6-OHDA lesioned rats, neuronal entropy in the EPN was specifically higher in neurons with firing rates above 25Hz. Our data establishes that nigro-striatal pathway controls neuronal entropy in motor circuitry and that the parkinsonian condition is associated with abnormal relationship between firing rate and neuronal entropy in BG output nuclei. The neuronal firing rates and entropy relationship provide putative relevant electrophysiological information to investigate the sensory-motor processing in normal condition and conditions with movement disorders. PMID:26711712

Modified Dispersion Relations: from Black-Hole Entropy to the Cosmological Constant

NASA Astrophysics Data System (ADS)

Garattini, Remo

2012-07-01

Quantum Field Theory is plagued by divergences in the attempt to calculate physical quantities. Standard techniques of regularization and renormalization are used to keep under control such a problem. In this paper we would like to use a different scheme based on Modified Dispersion Relations (MDR) to remove infinities appearing in one loop approximation in contrast to what happens in conventional approaches. In particular, we apply the MDR regularization to the computation of the entropy of a Schwarzschild black hole from one side and the Zero Point Energy (ZPE) of the graviton from the other side. The graviton ZPE is connected to the cosmological constant by means of of the Wheeler-DeWitt equation.

Probabilistic modelling of flood events using the entropy copula

NASA Astrophysics Data System (ADS)

Li, Fan; Zheng, Qian

2016-11-01

The estimation of flood frequency is vital for the flood control strategies and hydraulic structure design. Generating synthetic flood events according to statistical properties of observations is one of plausible methods to analyze the flood frequency. Due to the statistical dependence among the flood event variables (i.e. the flood peak, volume and duration), a multidimensional joint probability estimation is required. Recently, the copula method is widely used for multivariable dependent structure construction, however, the copula family should be chosen before application and the choice process is sometimes rather subjective. The entropy copula, a new copula family, employed in this research proposed a way to avoid the relatively subjective process by combining the theories of copula and entropy. The analysis shows the effectiveness of the entropy copula for probabilistic modelling the flood events of two hydrological gauges, and a comparison of accuracy with the popular copulas was made. The Gibbs sampling technique was applied for trivariate flood events simulation in order to mitigate the calculation difficulties of extending to three dimension directly. The simulation results indicate that the entropy copula is a simple and effective copula family for trivariate flood simulation.

Thyrotropin secretion in mild and severe primary hypothyroidism is distinguished by amplified burst mass and Basal secretion with increased spikiness and approximate entropy.

PubMed

Roelfsema, Ferdinand; Pereira, Alberto M; Adriaanse, Ria; Endert, Erik; Fliers, Eric; Romijn, Johannes A; Veldhuis, Johannes D

2010-02-01

Twenty-four-hour TSH secretion profiles in primary hypothyroidism have been analyzed with methods no longer in use. The insights afforded by earlier methods are limited. We studied TSH secretion in patients with primary hypothyroidism (eight patients with severe and eight patients with mild hypothyroidism) with up-to-date analytical tools and compared the results with outcomes in 38 healthy controls. Patients and controls underwent a 24-h study with 10-min blood sampling. TSH data were analyzed with a newly developed automated deconvolution program, approximate entropy, spikiness assessment, and cosinor regression. Both basal and pulsatile TSH secretion rates were increased in hypothyroid patients, the latter by increased burst mass with unchanged frequency. Secretory regularity (approximate entropy) was diminished, and spikiness was increased only in patients with severe hypothyroidism. A diurnal TSH rhythm was present in all but two patients, although with an earlier acrophase in severe hypothyroidism. The estimated slow component of the TSH half-life was shortened in all patients. Increased TSH concentrations in hypothyroidism are mediated by amplification of basal secretion and burst size. Secretory abnormalities quantitated by approximate entropy and spikiness were only present in patients with severe disease and thus are possibly related to the increased thyrotrope cell mass.

Min-entropy uncertainty relation for finite-size cryptography

NASA Astrophysics Data System (ADS)

Ng, Nelly Huei Ying; Berta, Mario; Wehner, Stephanie

2012-10-01

Apart from their foundational significance, entropic uncertainty relations play a central role in proving the security of quantum cryptographic protocols. Of particular interest are therefore relations in terms of the smooth min-entropy for Bennett-Brassard 1984 (BB84) and six-state encodings. The smooth min-entropy Hminɛ(X/B) quantifies the negative logarithm of the probability for an attacker B to guess X, except with a small failure probability ɛ. Previously, strong uncertainty relations were obtained which are valid in the limit of large block lengths. Here, we prove an alternative uncertainty relation in terms of the smooth min-entropy that is only marginally less strong but has the crucial property that it can be applied to rather small block lengths. This paves the way for a practical implementation of many cryptographic protocols. As part of our proof we show tight uncertainty relations for a family of Rényi entropies that may be of independent interest.

Approximate entropy analysis of event-related potentials in patients with early vascular dementia.

PubMed

Xu, Jin; Sheng, Hengsong; Lou, Wutao; Zhao, Songzhen

2012-06-01

This study investigated differences in event-related potential (ERP) parameters among early vascular dementia (VD) patients, healthy elder controls (ECs), and young controls (YCs). A visual "oddball" color identification task was performed while individuals' electroencephalograms (EEGs) were recorded. Approximate entropy (ApEn), a nonlinear measure, along with P300 latencies and amplitudes were used to analyze ERP data and compare these three groups. The patients with VD showed more complex ERP waveforms and higher ApEn values than did ECs while performing the visual task. It was further found that patients with VD showed reduced P300 amplitudes and increased latencies. The results indicate that patients with VD have fewer attention resources to devote to processing stimuli, lower speed of stimulus classification, and lower synchrony in their cortical activity during the response period. We suggest that ApEn, as a measure of ERP complexity, is a promising marker for early diagnosis of VD.

Some New Properties of Quantum Correlations

NASA Astrophysics Data System (ADS)

Liu, Feng; Li, Fei; Wei, Yunxia

2017-02-01

Quantum coherence measures the correlation between different measurement results in a single-system, while entanglement and quantum discord measure the correlation among different subsystems in a multipartite system. In this paper, we focus on the relative entropy form of them, and obtain three new properties of them as follows: 1) General forms of maximally coherent states for the relative entropy coherence, 2) Linear monogamy of the relative entropy entanglement, and 3) Subadditivity of quantum discord. Here, the linear monogamy is defined as there is a small constant as the upper bound on the sum of the relative entropy entanglement in subsystems.

High-Speed Magnetohydrodynamic Flow Control Analyses With 3-D Simulations

DTIC Science & Technology

2008-01-01

color. 14. ABSTRACT Magnetohydrodynamic studies of high-speed flow control are described with emphasis on understanding fluid response to specific...interactions play a crucial role by distorting the velocity field. The interaction with an external circuit through electrodes is relatively efficient when... Entropy layer . . . . . . . . . . . . . 20 6 Energy management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 7 Conclusion

On the relation between correlation dimension, approximate entropy and sample entropy parameters, and a fast algorithm for their calculation

NASA Astrophysics Data System (ADS)

Zurek, Sebastian; Guzik, Przemyslaw; Pawlak, Sebastian; Kosmider, Marcin; Piskorski, Jaroslaw

2012-12-01

We explore the relation between correlation dimension, approximate entropy and sample entropy parameters, which are commonly used in nonlinear systems analysis. Using theoretical considerations we identify the points which are shared by all these complexity algorithms and show explicitly that the above parameters are intimately connected and mutually interdependent. A new geometrical interpretation of sample entropy and correlation dimension is provided and the consequences for the interpretation of sample entropy, its relative consistency and some of the algorithms for parameter selection for this quantity are discussed. To get an exact algorithmic relation between the three parameters we construct a very fast algorithm for simultaneous calculations of the above, which uses the full time series as the source of templates, rather than the usual 10%. This algorithm can be used in medical applications of complexity theory, as it can calculate all three parameters for a realistic recording of 104 points within minutes with the use of an average notebook computer.

EEG entropy measures indicate decrease of cortical information processing in Disorders of Consciousness.

PubMed

Thul, Alexander; Lechinger, Julia; Donis, Johann; Michitsch, Gabriele; Pichler, Gerald; Kochs, Eberhard F; Jordan, Denis; Ilg, Rüdiger; Schabus, Manuel

2016-02-01

Clinical assessments that rely on behavioral responses to differentiate Disorders of Consciousness are at times inapt because of some patients' motor disabilities. To objectify patients' conditions of reduced consciousness the present study evaluated the use of electroencephalography to measure residual brain activity. We analyzed entropy values of 18 scalp EEG channels of 15 severely brain-damaged patients with clinically diagnosed Minimally-Conscious-State (MCS) or Unresponsive-Wakefulness-Syndrome (UWS) and compared the results to a sample of 24 control subjects. Permutation entropy (PeEn) and symbolic transfer entropy (STEn), reflecting information processes in the EEG, were calculated for all subjects. Participants were tested on a modified active own-name paradigm to identify correlates of active instruction following. PeEn showed reduced local information content in the EEG in patients, that was most pronounced in UWS. STEn analysis revealed altered directed information flow in the EEG of patients, indicating impaired feed-backward connectivity. Responses to auditory stimulation yielded differences in entropy measures, indicating reduced information processing in MCS and UWS. Local EEG information content and information flow are affected in Disorders of Consciousness. This suggests local cortical information capacity and feedback information transfer as neural correlates of consciousness. The utilized EEG entropy analyses were able to relate to patient groups with different Disorders of Consciousness. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Stokes-Einstein relation and excess entropy in Al-rich Al-Cu melts

NASA Astrophysics Data System (ADS)

Pasturel, A.; Jakse, N.

2016-07-01

We investigate the conditions for the validity of the Stokes-Einstein relation that connects diffusivity to viscosity in melts using entropy-scaling relationships developed by Rosenfeld. Employing ab initio molecular dynamics simulations to determine transport and structural properties of liquid Al1-xCux alloys (with composition x ≤ 0.4), we first show that reduced self-diffusion coefficients and viscosities, according to Rosenfeld's formulation, scale with the two-body approximation of the excess entropy except the reduced viscosity for x = 0.4. Then, we use our findings to evidence that the Stokes-Einstein relation using effective atomic radii is not valid in these alloys while its validity can be related to the temperature dependence of the partial pair-excess entropies of both components. Finally, we derive a relation between the ratio of the self-diffusivities of the components and the ratio of their pair excess entropies.

On the entropy variation in the scenario of entropic gravity

NASA Astrophysics Data System (ADS)

Xiao, Yong; Bai, Shi-Yang

2018-05-01

In the scenario of entropic gravity, entropy varies as a function of the location of the matter, while the tendency to increase entropy appears as gravity. We concentrate on studying the entropy variation of a typical gravitational system with different relative positions between the mass and the gravitational source. The result is that the entropy of the system doesn't increase when the mass is displaced closer to the gravitational source. In this way it disproves the proposal of entropic gravity from thermodynamic entropy. It doesn't exclude the possibility that gravity originates from non-thermodynamic entropy like entanglement entropy.

Characterization of time series via Rényi complexity-entropy curves

NASA Astrophysics Data System (ADS)

Jauregui, M.; Zunino, L.; Lenzi, E. K.; Mendes, R. S.; Ribeiro, H. V.

2018-05-01

One of the most useful tools for distinguishing between chaotic and stochastic time series is the so-called complexity-entropy causality plane. This diagram involves two complexity measures: the Shannon entropy and the statistical complexity. Recently, this idea has been generalized by considering the Tsallis monoparametric generalization of the Shannon entropy, yielding complexity-entropy curves. These curves have proven to enhance the discrimination among different time series related to stochastic and chaotic processes of numerical and experimental nature. Here we further explore these complexity-entropy curves in the context of the Rényi entropy, which is another monoparametric generalization of the Shannon entropy. By combining the Rényi entropy with the proper generalization of the statistical complexity, we associate a parametric curve (the Rényi complexity-entropy curve) with a given time series. We explore this approach in a series of numerical and experimental applications, demonstrating the usefulness of this new technique for time series analysis. We show that the Rényi complexity-entropy curves enable the differentiation among time series of chaotic, stochastic, and periodic nature. In particular, time series of stochastic nature are associated with curves displaying positive curvature in a neighborhood of their initial points, whereas curves related to chaotic phenomena have a negative curvature; finally, periodic time series are represented by vertical straight lines.

Cosmological Entropy Bounds

NASA Astrophysics Data System (ADS)

Brustein, R.

I review some basic facts about entropy bounds in general and about cosmological entropy bounds. Then I review the causal entropy bound, the conditions for its validity and its application to the study of cosmological singularities. This article is based on joint work with Gabriele Veneziano and subsequent related research.

[Wavelet packet extraction and entropy analysis of telemetry EEG from the prelimbic cortex of medial prefrontal cortex in morphine-induced CPP rats].

PubMed

Bai, Yu; Bai, Jia-Ming; Li, Jing; Li, Min; Yu, Ran; Pan, Qun-Wan

2014-12-25

The purpose of the present study is to analyze the relationship between the telemetry electroencephalogram (EEG) changes of the prelimbic (PL) cortex and the drug-seeking behavior of morphine-induced conditioned place preference (CPP) rats by using the wavelet packet extraction and entropy measurement. The recording electrode was stereotactically implanted into the PL cortex of rats. The animals were then divided randomly into operation-only control and morphine-induced CPP groups, respectively. A CPP video system in combination with an EEG wireless telemetry device was used for recording EEG of PL cortex when the rats shuttled between black-white or white-black chambers. The telemetry recorded EEGs were analyzed by wavelet packet extraction, Welch power spectrum estimate, normalized amplitude and Shannon entropy algorithm. The results showed that, compared with operation-only control group, the left PL cortex's EEG of morphine-induced CPP group during black-white chamber shuttling exhibited the following changes: (1) the amplitude of average EEG for each frequency bands extracted by wavelet packet was reduced; (2) the Welch power intensity was increased significantly in 10-50 Hz EEG band (P < 0.01 or P < 0.05); (3) Shannon entropy was increased in β, γ₁, and γ₂waves of the EEG (P < 0.01 or P < 0.05); and (4) the average information entropy was reduced (P < 0.01). The results suggest that above mentioned EEG changes in morphine-induced CPP group rat may be related to animals' drug-seeking motivation and behavior launching.

Classification enhancement for post-stroke dementia using fuzzy neighborhood preserving analysis with QR-decomposition.

PubMed

Al-Qazzaz, Noor Kamal; Ali, Sawal; Ahmad, Siti Anom; Escudero, Javier

2017-07-01

The aim of the present study was to discriminate the electroencephalogram (EEG) of 5 patients with vascular dementia (VaD), 15 patients with stroke-related mild cognitive impairment (MCI), and 15 control normal subjects during a working memory (WM) task. We used independent component analysis (ICA) and wavelet transform (WT) as a hybrid preprocessing approach for EEG artifact removal. Three different features were extracted from the cleaned EEG signals: spectral entropy (SpecEn), permutation entropy (PerEn) and Tsallis entropy (TsEn). Two classification schemes were applied - support vector machine (SVM) and k-nearest neighbors (kNN) - with fuzzy neighborhood preserving analysis with QR-decomposition (FNPAQR) as a dimensionality reduction technique. The FNPAQR dimensionality reduction technique increased the SVM classification accuracy from 82.22% to 90.37% and from 82.6% to 86.67% for kNN. These results suggest that FNPAQR consistently improves the discrimination of VaD, MCI patients and control normal subjects and it could be a useful feature selection to help the identification of patients with VaD and MCI.

Noise and complexity in human postural control: interpreting the different estimations of entropy.

PubMed

Rhea, Christopher K; Silver, Tobin A; Hong, S Lee; Ryu, Joong Hyun; Studenka, Breanna E; Hughes, Charmayne M L; Haddad, Jeffrey M

2011-03-17

Over the last two decades, various measures of entropy have been used to examine the complexity of human postural control. In general, entropy measures provide information regarding the health, stability and adaptability of the postural system that is not captured when using more traditional analytical techniques. The purpose of this study was to examine how noise, sampling frequency and time series length influence various measures of entropy when applied to human center of pressure (CoP) data, as well as in synthetic signals with known properties. Such a comparison is necessary to interpret data between and within studies that use different entropy measures, equipment, sampling frequencies or data collection durations. The complexity of synthetic signals with known properties and standing CoP data was calculated using Approximate Entropy (ApEn), Sample Entropy (SampEn) and Recurrence Quantification Analysis Entropy (RQAEn). All signals were examined at varying sampling frequencies and with varying amounts of added noise. Additionally, an increment time series of the original CoP data was examined to remove long-range correlations. Of the three measures examined, ApEn was the least robust to sampling frequency and noise manipulations. Additionally, increased noise led to an increase in SampEn, but a decrease in RQAEn. Thus, noise can yield inconsistent results between the various entropy measures. Finally, the differences between the entropy measures were minimized in the increment CoP data, suggesting that long-range correlations should be removed from CoP data prior to calculating entropy. The various algorithms typically used to quantify the complexity (entropy) of CoP may yield very different results, particularly when sampling frequency and noise are different. The results of this study are discussed within the context of the neural noise and loss of complexity hypotheses.

Ergodicity, Maximum Entropy Production, and Steepest Entropy Ascent in the Proofs of Onsager's Reciprocal Relations

NASA Astrophysics Data System (ADS)

Benfenati, Francesco; Beretta, Gian Paolo

2018-04-01

We show that to prove the Onsager relations using the microscopic time reversibility one necessarily has to make an ergodic hypothesis, or a hypothesis closely linked to that. This is true in all the proofs of the Onsager relations in the literature: from the original proof by Onsager, to more advanced proofs in the context of linear response theory and the theory of Markov processes, to the proof in the context of the kinetic theory of gases. The only three proofs that do not require any kind of ergodic hypothesis are based on additional hypotheses on the macroscopic evolution: Ziegler's maximum entropy production principle (MEPP), the principle of time reversal invariance of the entropy production, or the steepest entropy ascent principle (SEAP).

Entanglement entropy flow and the Ward identity.

PubMed

Rosenhaus, Vladimir; Smolkin, Michael

2014-12-31

We derive differential equations for the flow of entanglement entropy as a function of the metric and the couplings of the theory. The variation of the universal part of entanglement entropy under a local Weyl transformation is related to the variation under a local change in the couplings. We show that this relation is, in fact, equivalent to the trace Ward identity. As a concrete application of our formalism, we express the entanglement entropy for massive free fields as a two-point function of the energy-momentum tensor.

An alternative expression to the Sackur-Tetrode entropy formula for an ideal gas

NASA Astrophysics Data System (ADS)

Nagata, Shoichi

2018-03-01

An expression for the entropy of a monoatomic classical ideal gas is known as the Sackur-Tetrode equation. This pioneering investigation about 100 years ago incorporates quantum considerations. The purpose of this paper is to provide an alternative expression for the entropy in terms of the Heisenberg uncertainty relation. The analysis is made on the basis of fluctuation theory, for a canonical system in thermal equilibrium at temperature T. This new formula indicates manifestly that the entropy of macroscopic world is recognized as a measure of uncertainty in microscopic quantum world. The entropy in the Sackur-Tetrode equation can be re-interpreted from a different perspective viewpoint. The emphasis is on the connection between the entropy and the uncertainty relation in quantum consideration.

Entanglement Entropy of Black Holes.

PubMed

Solodukhin, Sergey N

2011-01-01

The entanglement entropy is a fundamental quantity, which characterizes the correlations between sub-systems in a larger quantum-mechanical system. For two sub-systems separated by a surface the entanglement entropy is proportional to the area of the surface and depends on the UV cutoff, which regulates the short-distance correlations. The geometrical nature of entanglement-entropy calculation is particularly intriguing when applied to black holes when the entangling surface is the black-hole horizon. I review a variety of aspects of this calculation: the useful mathematical tools such as the geometry of spaces with conical singularities and the heat kernel method, the UV divergences in the entropy and their renormalization, the logarithmic terms in the entanglement entropy in four and six dimensions and their relation to the conformal anomalies. The focus in the review is on the systematic use of the conical singularity method. The relations to other known approaches such as 't Hooft's brick-wall model and the Euclidean path integral in the optical metric are discussed in detail. The puzzling behavior of the entanglement entropy due to fields, which non-minimally couple to gravity, is emphasized. The holographic description of the entanglement entropy of the blackhole horizon is illustrated on the two- and four-dimensional examples. Finally, I examine the possibility to interpret the Bekenstein-Hawking entropy entirely as the entanglement entropy.

Entanglement Entropy of Black Holes

NASA Astrophysics Data System (ADS)

Solodukhin, Sergey N.

2011-10-01

The entanglement entropy is a fundamental quantity, which characterizes the correlations between sub-systems in a larger quantum-mechanical system. For two sub-systems separated by a surface the entanglement entropy is proportional to the area of the surface and depends on the UV cutoff, which regulates the short-distance correlations. The geometrical nature of entanglement-entropy calculation is particularly intriguing when applied to black holes when the entangling surface is the black-hole horizon. I review a variety of aspects of this calculation: the useful mathematical tools such as the geometry of spaces with conical singularities and the heat kernel method, the UV divergences in the entropy and their renormalization, the logarithmic terms in the entanglement entropy in four and six dimensions and their relation to the conformal anomalies. The focus in the review is on the systematic use of the conical singularity method. The relations to other known approaches such as 't Hooft's brick-wall model and the Euclidean path integral in the optical metric are discussed in detail. The puzzling behavior of the entanglement entropy due to fields, which non-minimally couple to gravity, is emphasized. The holographic description of the entanglement entropy of the blackhole horizon is illustrated on the two- and four-dimensional examples. Finally, I examine the possibility to interpret the Bekenstein-Hawking entropy entirely as the entanglement entropy.

Numerical estimation of the relative entropy of entanglement

NASA Astrophysics Data System (ADS)

Zinchenko, Yuriy; Friedland, Shmuel; Gour, Gilad

2010-11-01

We propose a practical algorithm for the calculation of the relative entropy of entanglement (REE), defined as the minimum relative entropy between a state and the set of states with positive partial transpose. Our algorithm is based on a practical semidefinite cutting plane approach. In low dimensions the implementation of the algorithm in matlab provides an estimation for the REE with an absolute error smaller than 10-3.

Bi-spectral index, entropy and predicted plasma propofol concentrations with target controlled infusions in Indian patients.

PubMed

Puri, Goverdhan D; Mathew, Preethy J; Sethu Madhavan, J; Hegde, Harihar V; Fiehn, Andreas

2011-10-01

Many processed electroencephalographic signals are used now to help the anaesthesiologist titrate the depth of sedation. We investigated the relationship between target plasma propofol concentration and objective end-points of sedation- Bispectral Index (BIS), State Entropy (SE) and Response Entropy (RE)-at clinical end-points as assessed by Modified Observer Assessment of Alertness/sedation Scale (MOAAS) in Indian patients. Eighteen ASA 1 and 2 Indian adult patients scheduled to undergo elective surgery were included. The target control infusion (TCI) of propofol was administered using 'Diprifusor'. The level of sedation was assessed using MOAAS by the anaesthesiologist. BIS, SE, RE were recorded throughout. TCI was started at 0.5 μg/ml and increased by 0.5 μg/ml every 6 min till MOAAS scores reached 0 or there was sustained BIS value less than 30. The EC(50) and EC(95) of predicted plasma propofol concentration for loss of consciousness (assessed by loss of response to verbal command), were 2.3 and 2.8 μg/ml respectively and for loss of response to painful stimuli (trapezius squeeze) were 4.0 and 5.0 μg/ml respectively. The BIS and entropy values (EC(50) and EC(95)) for loss of consciousness and response to painful stimuli in Indian patients were estimated. The preliminary relation of target plasma propofol concentration with BIS was found to be BIS = 100.5-16.4 × (Target concentration). The target plasma propofol concentrations required to produce unconsciousness and loss of response to painful stimuli in Indian patients have been estimated. Also, the relations between target plasma concentration and objective measures of different levels of anaesthesia have been established.

An Error-Entropy Minimization Algorithm for Tracking Control of Nonlinear Stochastic Systems with Non-Gaussian Variables

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Yunlong; Wang, Aiping; Guo, Lei

This paper presents an error-entropy minimization tracking control algorithm for a class of dynamic stochastic system. The system is represented by a set of time-varying discrete nonlinear equations with non-Gaussian stochastic input, where the statistical properties of stochastic input are unknown. By using Parzen windowing with Gaussian kernel to estimate the probability densities of errors, recursive algorithms are then proposed to design the controller such that the tracking error can be minimized. The performance of the error-entropy minimization criterion is compared with the mean-square-error minimization in the simulation results.

Resting State Brain Entropy Alterations in Relapsing Remitting Multiple Sclerosis.

PubMed

Zhou, Fuqing; Zhuang, Ying; Gong, Honghan; Zhan, Jie; Grossman, Murray; Wang, Ze

2016-01-01

Brain entropy (BEN) mapping provides a novel approach to characterize brain temporal dynamics, a key feature of human brain. Using resting state functional magnetic resonance imaging (rsfMRI), reliable and spatially distributed BEN patterns have been identified in normal brain, suggesting a potential use in clinical populations since temporal brain dynamics and entropy may be altered in disease conditions. The purpose of this study was to characterize BEN in multiple sclerosis (MS), a neurodegenerative disease that affects millions of people. Since currently there is no cure for MS, developing treatment or medication that can slow down its progression represents a high research priority, for which validating a brain marker sensitive to disease and the related functional impairments is essential. Because MS can start long time before any measurable symptoms and structural deficits, assessing the dynamic brain activity and correspondingly BEN may provide a critical way to study MS and its progression. Because BEN is new to MS, we aimed to assess BEN alterations in the relapsing-remitting MS (RRMS) patients using a patient versus control design, to examine the correlation of BEN to clinical measurements, and to check the correlation of BEN to structural brain measures which have been more often used in MS studies. As compared to controls, RRMS patients showed increased BEN in motor areas, executive control area, spatial coordinating area, and memory system. Increased BEN was related to greater disease severity as measured by the expanded disability status scale (EDSS) and greater tissue damage as indicated by the mean diffusivity. Patients also showed decreased BEN in other places, which was associated with less disability or fatigue, indicating a disease-related BEN re-distribution. Our results suggest BEN as a novel and useful tool for characterizing RRMS.

Campbell's Rule for Estimating Entropy Changes

ERIC Educational Resources Information Center

Jensen, William B.

2004-01-01

Campbell's rule for estimating entropy changes is discussed in relation to an earlier article by Norman Craig, where it was proposed that the approximate value of the entropy of reaction was related to net moles of gas consumed or generated. It was seen that the average for Campbell's data set was lower than that for Craig's data set and…

Psychological Entropy: A Framework for Understanding Uncertainty-Related Anxiety

ERIC Educational Resources Information Center

Hirsh, Jacob B.; Mar, Raymond A.; Peterson, Jordan B.

2012-01-01

Entropy, a concept derived from thermodynamics and information theory, describes the amount of uncertainty and disorder within a system. Self-organizing systems engage in a continual dialogue with the environment and must adapt themselves to changing circumstances to keep internal entropy at a manageable level. We propose the entropy model of…

Determining Dynamical Path Distributions usingMaximum Relative Entropy

DTIC Science & Technology

2015-05-31

entropy to a one-dimensional continuum labeled by a parameter η. The resulting η-entropies are equivalent to those proposed by Renyi [12] or by Tsallis [13...1995). [12] A. Renyi , “On measures of entropy and information,”Proc. 4th Berkeley Simposium on Mathematical Statistics and Probability, Vol 1, p. 547-461

Cascade control of superheated steam temperature with neuro-PID controller.

PubMed

Zhang, Jianhua; Zhang, Fenfang; Ren, Mifeng; Hou, Guolian; Fang, Fang

2012-11-01

In this paper, an improved cascade control methodology for superheated processes is developed, in which the primary PID controller is implemented by neural networks trained by minimizing error entropy criterion. The entropy of the tracking error can be estimated recursively by utilizing receding horizon window technique. The measurable disturbances in superheated processes are input to the neuro-PID controller besides the sequences of tracking error in outer loop control system, hence, feedback control is combined with feedforward control in the proposed neuro-PID controller. The convergent condition of the neural networks is analyzed. The implementation procedures of the proposed cascade control approach are summarized. Compared with the neuro-PID controller using minimizing squared error criterion, the proposed neuro-PID controller using minimizing error entropy criterion may decrease fluctuations of the superheated steam temperature. A simulation example shows the advantages of the proposed method. Copyright © 2012 ISA. Published by Elsevier Ltd. All rights reserved.

Holographic charged Rényi entropies

NASA Astrophysics Data System (ADS)

Belin, Alexandre; Hung, Ling-Yan; Maloney, Alexander; Matsuura, Shunji; Myers, Robert C.; Sierens, Todd

2013-12-01

We construct a new class of entanglement measures by extending the usual definition of Rényi entropy to include a chemical potential. These charged Rényi entropies measure the degree of entanglement in different charge sectors of the theory and are given by Euclidean path integrals with the insertion of a Wilson line encircling the entangling surface. We compute these entropies for a spherical entangling surface in CFT's with holographic duals, where they are related to entropies of charged black holes with hyperbolic horizons. We also compute charged Rényi entropies in free field theories.

Thermodynamics of cosolvent action: phenacetin, salicylic acid and probenecid.

PubMed

Peña, M A; Escalera, B; Reíllo, A; Sánchez, A B; Bustamante, P

2009-03-01

The solubility of phenacetin, salicylic acid, and probenecid in ethanol-water and ethanol-ethyl acetate mixtures at several temperatures (15-40 degrees C) was measured. The solubility profiles are related to medium polarity changes. The apparent thermodynamic magnitudes and enthalpy-entropy relationships are related to the cosolvent action. Salicylic acid and probenecid show a single peak against the solubility parameter delta(1) of both solvent mixtures, at 40% (delta(1) = 21.70 MPa(1/2)) and 30% (delta(1) = 20.91 MPa(1/2)) ethanol in ethyl acetate, respectively. Phenacetin displays two peaks at 60% ethanol in ethyl acetate (23.30 MPa(1/2)) and 90% ethanol in water (delta(1) = 28.64 MPa(1/2)). The apparent enthalpies of solution display a maximum at 30% (phenacetin and salicylic acid) and 40% (probenecid) ethanol in water, respectively. Two different mechanisms, entropy at low ethanol ratios, and enthalpy at high ethanol ratios control the solubility enhancement in the aqueous mixture. In the nonaqueous mixture (ethanol-ethyl acetate) enthalpy is the driving force throughout the whole solvent composition for salicylic acid and phenacetin. For probenecid, the dominant mechanism shifts from entropy to enthalpy as the ethanol in ethyl acetate concentration increases. The enthalpy-entropy compensation plots corroborate the different mechanisms involved in the solubility enhancement by cosolvents. (c) 2008 Wiley-Liss, Inc. and the American Pharmacists Association

Quantum Rényi relative entropies affirm universality of thermodynamics.

PubMed

Misra, Avijit; Singh, Uttam; Bera, Manabendra Nath; Rajagopal, A K

2015-10-01

We formulate a complete theory of quantum thermodynamics in the Rényi entropic formalism exploiting the Rényi relative entropies, starting from the maximum entropy principle. In establishing the first and second laws of quantum thermodynamics, we have correctly identified accessible work and heat exchange in both equilibrium and nonequilibrium cases. The free energy (internal energy minus temperature times entropy) remains unaltered, when all the entities entering this relation are suitably defined. Exploiting Rényi relative entropies we have shown that this "form invariance" holds even beyond equilibrium and has profound operational significance in isothermal process. These results reduce to the Gibbs-von Neumann results when the Rényi entropic parameter α approaches 1. Moreover, it is shown that the universality of the Carnot statement of the second law is the consequence of the form invariance of the free energy, which is in turn the consequence of maximum entropy principle. Further, the Clausius inequality, which is the precursor to the Carnot statement, is also shown to hold based on the data processing inequalities for the traditional and sandwiched Rényi relative entropies. Thus, we find that the thermodynamics of nonequilibrium state and its deviation from equilibrium together determine the thermodynamic laws. This is another important manifestation of the concepts of information theory in thermodynamics when they are extended to the quantum realm. Our work is a substantial step towards formulating a complete theory of quantum thermodynamics and corresponding resource theory.

The specific entropy of elliptical galaxies: an explanation for profile-shape distance indicators?

NASA Astrophysics Data System (ADS)

Lima Neto, G. B.; Gerbal, D.; Márquez, I.

1999-10-01

Dynamical systems in equilibrium have a stationary entropy; we suggest that elliptical galaxies, as stellar systems in a stage of quasi-equilibrium, may have in principle a unique specific entropy. This uniqueness, a priori unknown, should be reflected in correlations between the fundamental parameters describing the mass (light) distribution in galaxies. Following recent photometrical work on elliptical galaxies by Caon et al., Graham & Colless and Prugniel & Simien, we use the Sérsic law to describe the light profile and an analytical approximation to its three-dimensional deprojection. The specific entropy is then calculated, supposing that the galaxy behaves as a spherical, isotropic, one-component system in hydrostatic equilibrium, obeying the ideal-gas equations of state. We predict a relation between the three parameters of the Sérsic law linked to the specific entropy, defining a surface in the parameter space, an `Entropic Plane', by analogy with the well-known Fundamental Plane. We have analysed elliptical galaxies in two rich clusters of galaxies (Coma and ABCG 85) and a group of galaxies (associated with NGC 4839, near Coma). We show that, for a given cluster, the galaxies follow closely a relation predicted by the constant specific entropy hypothesis with a typical dispersion (one standard deviation) of 9.5per cent around the mean value of the specific entropy. Moreover, assuming that the specific entropy is also the same for galaxies of different clusters, we are able to derive relative distances between Coma, ABGC 85, and the group of NGC 4839. If the errors are due only to the determination of the specific entropy (about 10per cent), then the error in the relative distance determination should be less than 20per cent for rich clusters. We suggest that the unique specific entropy may provide a physical explanation for the distance indicators based on the Sérsic profile put forward by Young & Currie and recently discussed by Binggeli & Jerjen.

Stokes–Einstein relation and excess entropy in Al-rich Al-Cu melts

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pasturel, A.; Jakse, N.

We investigate the conditions for the validity of the Stokes-Einstein relation that connects diffusivity to viscosity in melts using entropy-scaling relationships developed by Rosenfeld. Employing ab initio molecular dynamics simulations to determine transport and structural properties of liquid Al{sub 1−x}Cu{sub x} alloys (with composition x ≤ 0.4), we first show that reduced self-diffusion coefficients and viscosities, according to Rosenfeld's formulation, scale with the two-body approximation of the excess entropy except the reduced viscosity for x = 0.4. Then, we use our findings to evidence that the Stokes-Einstein relation using effective atomic radii is not valid in these alloys while its validity can be relatedmore » to the temperature dependence of the partial pair-excess entropies of both components. Finally, we derive a relation between the ratio of the self-diffusivities of the components and the ratio of their pair excess entropies.« less

How to Calculate Renyi Entropy from Heart Rate Variability, and Why it Matters for Detecting Cardiac Autonomic Neuropathy.

PubMed

Cornforth, David J; Tarvainen, Mika P; Jelinek, Herbert F

2014-01-01

Cardiac autonomic neuropathy (CAN) is a disease that involves nerve damage leading to an abnormal control of heart rate. An open question is to what extent this condition is detectable from heart rate variability (HRV), which provides information only on successive intervals between heart beats, yet is non-invasive and easy to obtain from a three-lead ECG recording. A variety of measures may be extracted from HRV, including time domain, frequency domain, and more complex non-linear measures. Among the latter, Renyi entropy has been proposed as a suitable measure that can be used to discriminate CAN from controls. However, all entropy methods require estimation of probabilities, and there are a number of ways in which this estimation can be made. In this work, we calculate Renyi entropy using several variations of the histogram method and a density method based on sequences of RR intervals. In all, we calculate Renyi entropy using nine methods and compare their effectiveness in separating the different classes of participants. We found that the histogram method using single RR intervals yields an entropy measure that is either incapable of discriminating CAN from controls, or that it provides little information that could not be gained from the SD of the RR intervals. In contrast, probabilities calculated using a density method based on sequences of RR intervals yield an entropy measure that provides good separation between groups of participants and provides information not available from the SD. The main contribution of this work is that different approaches to calculating probability may affect the success of detecting disease. Our results bring new clarity to the methods used to calculate the Renyi entropy in general, and in particular, to the successful detection of CAN.

How to Calculate Renyi Entropy from Heart Rate Variability, and Why it Matters for Detecting Cardiac Autonomic Neuropathy

PubMed Central

Cornforth, David J.;  Tarvainen, Mika P.; Jelinek, Herbert F.

2014-01-01

Cardiac autonomic neuropathy (CAN) is a disease that involves nerve damage leading to an abnormal control of heart rate. An open question is to what extent this condition is detectable from heart rate variability (HRV), which provides information only on successive intervals between heart beats, yet is non-invasive and easy to obtain from a three-lead ECG recording. A variety of measures may be extracted from HRV, including time domain, frequency domain, and more complex non-linear measures. Among the latter, Renyi entropy has been proposed as a suitable measure that can be used to discriminate CAN from controls. However, all entropy methods require estimation of probabilities, and there are a number of ways in which this estimation can be made. In this work, we calculate Renyi entropy using several variations of the histogram method and a density method based on sequences of RR intervals. In all, we calculate Renyi entropy using nine methods and compare their effectiveness in separating the different classes of participants. We found that the histogram method using single RR intervals yields an entropy measure that is either incapable of discriminating CAN from controls, or that it provides little information that could not be gained from the SD of the RR intervals. In contrast, probabilities calculated using a density method based on sequences of RR intervals yield an entropy measure that provides good separation between groups of participants and provides information not available from the SD. The main contribution of this work is that different approaches to calculating probability may affect the success of detecting disease. Our results bring new clarity to the methods used to calculate the Renyi entropy in general, and in particular, to the successful detection of CAN. PMID:25250311

Noise and Complexity in Human Postural Control: Interpreting the Different Estimations of Entropy

PubMed Central

Rhea, Christopher K.; Silver, Tobin A.; Hong, S. Lee; Ryu, Joong Hyun; Studenka, Breanna E.; Hughes, Charmayne M. L.; Haddad, Jeffrey M.

2011-01-01

Background Over the last two decades, various measures of entropy have been used to examine the complexity of human postural control. In general, entropy measures provide information regarding the health, stability and adaptability of the postural system that is not captured when using more traditional analytical techniques. The purpose of this study was to examine how noise, sampling frequency and time series length influence various measures of entropy when applied to human center of pressure (CoP) data, as well as in synthetic signals with known properties. Such a comparison is necessary to interpret data between and within studies that use different entropy measures, equipment, sampling frequencies or data collection durations. Methods and Findings The complexity of synthetic signals with known properties and standing CoP data was calculated using Approximate Entropy (ApEn), Sample Entropy (SampEn) and Recurrence Quantification Analysis Entropy (RQAEn). All signals were examined at varying sampling frequencies and with varying amounts of added noise. Additionally, an increment time series of the original CoP data was examined to remove long-range correlations. Of the three measures examined, ApEn was the least robust to sampling frequency and noise manipulations. Additionally, increased noise led to an increase in SampEn, but a decrease in RQAEn. Thus, noise can yield inconsistent results between the various entropy measures. Finally, the differences between the entropy measures were minimized in the increment CoP data, suggesting that long-range correlations should be removed from CoP data prior to calculating entropy. Conclusions The various algorithms typically used to quantify the complexity (entropy) of CoP may yield very different results, particularly when sampling frequency and noise are different. The results of this study are discussed within the context of the neural noise and loss of complexity hypotheses. PMID:21437281

Free Energy, Enthalpy and Entropy from Implicit Solvent End-Point Simulations.

PubMed

Fogolari, Federico; Corazza, Alessandra; Esposito, Gennaro

2018-01-01

Free energy is the key quantity to describe the thermodynamics of biological systems. In this perspective we consider the calculation of free energy, enthalpy and entropy from end-point molecular dynamics simulations. Since the enthalpy may be calculated as the ensemble average over equilibrated simulation snapshots the difficulties related to free energy calculation are ultimately related to the calculation of the entropy of the system and in particular of the solvent entropy. In the last two decades implicit solvent models have been used to circumvent the problem and to take into account solvent entropy implicitly in the solvation terms. More recently outstanding advancement in both implicit solvent models and in entropy calculations are making the goal of free energy estimation from end-point simulations more feasible than ever before. We review briefly the basic theory and discuss the advancements in light of practical applications.

Relating quantum coherence and correlations with entropy-based measures.

PubMed

Wang, Xiao-Li; Yue, Qiu-Ling; Yu, Chao-Hua; Gao, Fei; Qin, Su-Juan

2017-09-21

Quantum coherence and quantum correlations are important quantum resources for quantum computation and quantum information. In this paper, using entropy-based measures, we investigate the relationships between quantum correlated coherence, which is the coherence between subsystems, and two main kinds of quantum correlations as defined by quantum discord as well as quantum entanglement. In particular, we show that quantum discord and quantum entanglement can be well characterized by quantum correlated coherence. Moreover, we prove that the entanglement measure formulated by quantum correlated coherence is lower and upper bounded by the relative entropy of entanglement and the entanglement of formation, respectively, and equal to the relative entropy of entanglement for all the maximally correlated states.

Biseparability of noisy pseudopure, W and GHZ states using conditional quantum relative Tsallis entropy

NASA Astrophysics Data System (ADS)

Nayak, Anantha S.; Sudha; Usha Devi, A. R.; Rajagopal, A. K.

2017-02-01

We employ the conditional version of sandwiched Tsallis relative entropy to determine 1:N-1 separability range in the noisy one-parameter families of pseudopure and Werner-like N-qubit W, GHZ states. The range of the noisy parameter, for which the conditional sandwiched Tsallis relative entropy is positive, reveals perfect agreement with the necessary and sufficient criteria for separability in the 1:N-1 partition of these one parameter noisy states.

Von Neumann entropy in a Rashba-Dresselhaus nanodot; dynamical electronic spin-orbit entanglement

NASA Astrophysics Data System (ADS)

Safaiee, Rosa; Golshan, Mohammad Mehdi

2017-06-01

The main purpose of the present article is to report the characteristics of von Neumann entropy, thereby, the electronic hybrid entanglement, in the heterojunction of two semiconductors, with due attention to the Rashba and Dresselhaus spin-orbit interactions. To this end, we cast the von Neumann entropy in terms of spin polarization and compute its time evolution; with a vast span of applications. It is assumed that gate potentials are applied to the heterojunction, providing a two dimensional parabolic confining potential (forming an isotropic nanodot at the junction), as well as means of controlling the spin-orbit couplings. The spin degeneracy is also removed, even at electronic zero momentum, by the presence of an external magnetic field which, in turn, leads to the appearance of Landau states. We then proceed by computing the time evolution of the corresponding von Neumann entropy from a separable (spin-polarized) initial state. The von Neumann entropy, as we show, indicates that electronic hybrid entanglement does occur between spin and two-dimensional Landau levels. Our results also show that von Neumann entropy, as well as the degree of spin-orbit entanglement, periodically collapses and revives. The characteristics of such behavior; period, amplitude, etc., are shown to be determined from the controllable external agents. Moreover, it is demonstrated that the phenomenon of collapse-revivals' in the behavior of von Neumann entropy, equivalently, electronic hybrid entanglement, is accompanied by plateaus (of great importance in quantum computation schemes) whose durations are, again, controlled by the external elements. Along these lines, we also make a comparison between effects of the two spin-orbit couplings on the entanglement (von Neumann entropy) characteristics. The finer details of the electronic hybrid entanglement, which may be easily verified through spin polarization measurements, are also accreted and discussed. The novel results of the present article, with potent applications in the field of quantum information processing, provide a deeper understanding of the electronic von Neumann entropy and hybrid entanglement that occurs in two-dimensional nanodots.

On entropic uncertainty relations in the presence of a minimal length

NASA Astrophysics Data System (ADS)

Rastegin, Alexey E.

2017-07-01

Entropic uncertainty relations for the position and momentum within the generalized uncertainty principle are examined. Studies of this principle are motivated by the existence of a minimal observable length. Then the position and momentum operators satisfy the modified commutation relation, for which more than one algebraic representation is known. One of them is described by auxiliary momentum so that the momentum and coordinate wave functions are connected by the Fourier transform. However, the probability density functions of the physically true and auxiliary momenta are different. As the corresponding entropies differ, known entropic uncertainty relations are changed. Using differential Shannon entropies, we give a state-dependent formulation with correction term. State-independent uncertainty relations are obtained in terms of the Rényi entropies and the Tsallis entropies with binning. Such relations allow one to take into account a finiteness of measurement resolution.

Observation of Dipolar Spin-Exchange Interactions with Polar Molecules in a Lattice

DTIC Science & Technology

2013-01-01

extend beyond nearest neighbours. This allows coherent spin dynamics to persist even for gases with relatively high entropy and low lattice filling...dynamics to persist even for gases with relatively high entropy and low lat- tice filling. While measured effects of dipolar interactions in ultracold...limits superexchange to nearest-neighbor interactions and requires extremely low temperature and entropy . In contrast, long-range dipolar

Algorithm based on the short-term Rényi entropy and IF estimation for noisy EEG signals analysis.

PubMed

Lerga, Jonatan; Saulig, Nicoletta; Mozetič, Vladimir

2017-01-01

Stochastic electroencephalogram (EEG) signals are known to be nonstationary and often multicomponential. Detecting and extracting their components may help clinicians to localize brain neurological dysfunctionalities for patients with motor control disorders due to the fact that movement-related cortical activities are reflected in spectral EEG changes. A new algorithm for EEG signal components detection from its time-frequency distribution (TFD) has been proposed in this paper. The algorithm utilizes the modification of the Rényi entropy-based technique for number of components estimation, called short-term Rényi entropy (STRE), and upgraded by an iterative algorithm which was shown to enhance existing approaches. Combined with instantaneous frequency (IF) estimation, the proposed method was applied to EEG signal analysis both in noise-free and noisy environments for limb movements EEG signals, and was shown to be an efficient technique providing spectral description of brain activities at each electrode location up to moderate additive noise levels. Furthermore, the obtained information concerning the number of EEG signal components and their IFs show potentials to enhance diagnostics and treatment of neurological disorders for patients with motor control illnesses. Copyright © 2016 Elsevier Ltd. All rights reserved.

Causality, transfer entropy, and allosteric communication landscapes in proteins with harmonic interactions.

PubMed

Hacisuleyman, Aysima; Erman, Burak

2017-06-01

A fast and approximate method of generating allosteric communication landscapes in proteins is presented by using Schreiber's entropy transfer concept in combination with the Gaussian Network Model of proteins. Predictions of the model and the allosteric communication landscapes generated show that information transfer in proteins does not necessarily take place along a single path, but an ensemble of pathways is possible. The model emphasizes that knowledge of entropy only is not sufficient for determining allosteric communication and additional information based on time delayed correlations should be introduced, which leads to the presence of causality in proteins. The model provides a simple tool for mapping entropy sink-source relations into pairs of residues. By this approach, residues that should be manipulated to control protein activity may be determined. This should be of great importance for allosteric drug design and for understanding the effects of mutations on function. The model is applied to determine allosteric communication in three proteins, Ubiquitin, Pyruvate Kinase, and the PDZ domain. Predictions are in agreement with molecular dynamics simulations and experimental evidence. Proteins 2017; 85:1056-1064. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Clausius entropy for arbitrary bifurcate null surfaces

NASA Astrophysics Data System (ADS)

Baccetti, Valentina; Visser, Matt

2014-02-01

Jacobson’s thermodynamic derivation of the Einstein equations was originally applied only to local Rindler horizons. But at least some parts of that construction can usefully be extended to give meaningful results for arbitrary bifurcate null surfaces. As presaged in Jacobson’s original article, this more general construction sharply brings into focus the questions: is entropy objectively ‘real’? Or is entropy in some sense subjective and observer-dependent? These innocent questions open a Pandora’s box of often inconclusive debate. A consensus opinion, though certainly not universally held, seems to be that Clausius entropy (thermodynamic entropy, defined via a Clausius relation {\\rm{d}}S = \\unicode{x111} Q/T) should be objectively real, but that the ontological status of statistical entropy (Shannon or von Neumann entropy) is much more ambiguous, and much more likely to be observer-dependent. This question is particularly pressing when it comes to understanding Bekenstein entropy (black hole entropy). To perhaps further add to the confusion, we shall argue that even the Clausius entropy can often be observer-dependent. In the current article we shall conclusively demonstrate that one can meaningfully assign a notion of Clausius entropy to arbitrary bifurcate null surfaces—effectively defining a ‘virtual Clausius entropy’ for arbitrary ‘virtual (local) causal horizons’. As an application, we see that we can implement a version of the generalized second law (GSL) for this virtual Clausius entropy. This version of GSL can be related to certain (nonstandard) integral variants of the null energy condition. Because the concepts involved are rather subtle, we take some effort in being careful and explicit in developing our framework. In future work we will apply this construction to generalize Jacobson’s derivation of the Einstein equations.

Gacs quantum algorithmic entropy in infinite dimensional Hilbert spaces

DOE Office of Scientific and Technical Information (OSTI.GOV)

Benatti, Fabio, E-mail: benatti@ts.infn.it; Oskouei, Samad Khabbazi, E-mail: kh.oskuei@ut.ac.ir; Deh Abad, Ahmad Shafiei, E-mail: shafiei@khayam.ut.ac.ir

We extend the notion of Gacs quantum algorithmic entropy, originally formulated for finitely many qubits, to infinite dimensional quantum spin chains and investigate the relation of this extension with two quantum dynamical entropies that have been proposed in recent years.

Integrating the Ergonomics Techniques with Multi Criteria Decision Making as a New Approach for Risk Management: An Assessment of Repetitive Tasks -Entropy Case Study.

PubMed

Khandan, Mohammad; Nili, Majid; Koohpaei, Alireza; Mosaferchi, Saeedeh

2016-01-01

Nowadays, the health work decision makers need to analyze a huge amount of data and consider many conflicting evaluation criteria and sub-criteria. Therefore, an ergonomic evaluation in the work environment in order to the control occupational disorders is considered as the Multi Criteria Decision Making (MCDM) problem. In this study, the ergonomic risks factors, which may influence health, were evaluated in a manufacturing company in 2014. Then entropy method was applied to prioritize the different risk factors. This study was done with a descriptive-analytical approach and 13 tasks were included from total number of employees who were working in the seven halls of an ark opal manufacturing (240). Required information was gathered by the demographic questionnaire and Assessment of Repetitive Tasks (ART) method for repetitive task assessment. In addition, entropy was used to prioritize the risk factors based on the ergonomic control needs. The total exposure score based on the ART method calculated was equal to 30.07 ±12.43. Data analysis illustrated that 179 cases (74.6% of tasks) were in the high level of risk area and 13.8% were in the medium level of risk. ART- entropy results revealed that based on the weighted factors, higher value belongs to grip factor and the lowest value was related to neck and hand posture and duration. Based on the limited financial resources, it seems that MCDM in many challenging situations such as control procedures and priority approaches could be used successfully. Other MCDM methods for evaluating and prioritizing the ergonomic problems are recommended.

The entropy reduction engine: Integrating planning, scheduling, and control

NASA Technical Reports Server (NTRS)

Drummond, Mark; Bresina, John L.; Kedar, Smadar T.

1991-01-01

The Entropy Reduction Engine, an architecture for the integration of planning, scheduling, and control, is described. The architecture is motivated, presented, and analyzed in terms of its different components; namely, problem reduction, temporal projection, and situated control rule execution. Experience with this architecture has motivated the recent integration of learning. The learning methods are described along with their impact on architecture performance.

Modeling the Overalternating Bias with an Asymmetric Entropy Measure

PubMed Central

Gronchi, Giorgio; Raglianti, Marco; Noventa, Stefano; Lazzeri, Alessandro; Guazzini, Andrea

2016-01-01

Psychological research has found that human perception of randomness is biased. In particular, people consistently show the overalternating bias: they rate binary sequences of symbols (such as Heads and Tails in coin flipping) with an excess of alternation as more random than prescribed by the normative criteria of Shannon's entropy. Within data mining for medical applications, Marcellin proposed an asymmetric measure of entropy that can be ideal to account for such bias and to quantify subjective randomness. We fitted Marcellin's entropy and Renyi's entropy (a generalized form of uncertainty measure comprising many different kinds of entropies) to experimental data found in the literature with the Differential Evolution algorithm. We observed a better fit for Marcellin's entropy compared to Renyi's entropy. The fitted asymmetric entropy measure also showed good predictive properties when applied to different datasets of randomness-related tasks. We concluded that Marcellin's entropy can be a parsimonious and effective measure of subjective randomness that can be useful in psychological research about randomness perception. PMID:27458418

Entropy for the Complexity of Physiological Signal Dynamics.

PubMed

Zhang, Xiaohua Douglas

2017-01-01

Recently, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of biological dynamics. Portable noninvasive medical devices are crucial to capture individual characteristics of biological dynamics. The wearable noninvasive medical devices and the analysis/management of related digital medical data will revolutionize the management and treatment of diseases, subsequently resulting in the establishment of a new healthcare system. One of the key features that can be extracted from the data obtained by wearable noninvasive medical device is the complexity of physiological signals, which can be represented by entropy of biological dynamics contained in the physiological signals measured by these continuous monitoring medical devices. Thus, in this chapter I present the major concepts of entropy that are commonly used to measure the complexity of biological dynamics. The concepts include Shannon entropy, Kolmogorov entropy, Renyi entropy, approximate entropy, sample entropy, and multiscale entropy. I also demonstrate an example of using entropy for the complexity of glucose dynamics.

Statistics of Infima and Stopping Times of Entropy Production and Applications to Active Molecular Processes

NASA Astrophysics Data System (ADS)

Neri, Izaak; Roldán, Édgar; Jülicher, Frank

2017-01-01

We study the statistics of infima, stopping times, and passage probabilities of entropy production in nonequilibrium steady states, and we show that they are universal. We consider two examples of stopping times: first-passage times of entropy production and waiting times of stochastic processes, which are the times when a system reaches a given state for the first time. Our main results are as follows: (i) The distribution of the global infimum of entropy production is exponential with mean equal to minus Boltzmann's constant; (ii) we find exact expressions for the passage probabilities of entropy production; (iii) we derive a fluctuation theorem for stopping-time distributions of entropy production. These results have interesting implications for stochastic processes that can be discussed in simple colloidal systems and in active molecular processes. In particular, we show that the timing and statistics of discrete chemical transitions of molecular processes, such as the steps of molecular motors, are governed by the statistics of entropy production. We also show that the extreme-value statistics of active molecular processes are governed by entropy production; for example, we derive a relation between the maximal excursion of a molecular motor against the direction of an external force and the infimum of the corresponding entropy-production fluctuations. Using this relation, we make predictions for the distribution of the maximum backtrack depth of RNA polymerases, which follow from our universal results for entropy-production infima.

Entropy Transfer between Residue Pairs and Allostery in Proteins: Quantifying Allosteric Communication in Ubiquitin.

PubMed

Hacisuleyman, Aysima; Erman, Burak

2017-01-01

It has recently been proposed by Gunasakaran et al. that allostery may be an intrinsic property of all proteins. Here, we develop a computational method that can determine and quantify allosteric activity in any given protein. Based on Schreiber's transfer entropy formulation, our approach leads to an information transfer landscape for the protein that shows the presence of entropy sinks and sources and explains how pairs of residues communicate with each other using entropy transfer. The model can identify the residues that drive the fluctuations of others. We apply the model to Ubiquitin, whose allosteric activity has not been emphasized until recently, and show that there are indeed systematic pathways of entropy and information transfer between residues that correlate well with the activities of the protein. We use 600 nanosecond molecular dynamics trajectories for Ubiquitin and its complex with human polymerase iota and evaluate entropy transfer between all pairs of residues of Ubiquitin and quantify the binding susceptibility changes upon complex formation. We explain the complex formation propensities of Ubiquitin in terms of entropy transfer. Important residues taking part in allosteric communication in Ubiquitin predicted by our approach are in agreement with results of NMR relaxation dispersion experiments. Finally, we show that time delayed correlation of fluctuations of two interacting residues possesses an intrinsic causality that tells which residue controls the interaction and which one is controlled. Our work shows that time delayed correlations, entropy transfer and causality are the required new concepts for explaining allosteric communication in proteins.

Modelling the spreading rate of controlled communicable epidemics through an entropy-based thermodynamic model

NASA Astrophysics Data System (ADS)

Wang, WenBin; Wu, ZiNiu; Wang, ChunFeng; Hu, RuiFeng

2013-11-01

A model based on a thermodynamic approach is proposed for predicting the dynamics of communicable epidemics assumed to be governed by controlling efforts of multiple scales so that an entropy is associated with the system. All the epidemic details are factored into a single and time-dependent coefficient, the functional form of this coefficient is found through four constraints, including notably the existence of an inflexion point and a maximum. The model is solved to give a log-normal distribution for the spread rate, for which a Shannon entropy can be defined. The only parameter, that characterizes the width of the distribution function, is uniquely determined through maximizing the rate of entropy production. This entropy-based thermodynamic (EBT) model predicts the number of hospitalized cases with a reasonable accuracy for SARS in the year 2003. This EBT model can be of use for potential epidemics such as avian influenza and H7N9 in China.

Quantitative EEG analysis of the maturational changes associated with childhood absence epilepsy

NASA Astrophysics Data System (ADS)

Rosso, O. A.; Hyslop, W.; Gerlach, R.; Smith, R. L. L.; Rostas, J. A. P.; Hunter, M.

2005-10-01

This study aimed to examine the background electroencephalography (EEG) in children with childhood absence epilepsy, a condition whose presentation has strong developmental links. EEG hallmarks of absence seizure activity are widely accepted and there is recognition that the bulk of inter-ictal EEG in this group is normal to the naked eye. This multidisciplinary study aimed to use the normalized total wavelet entropy (NTWS) (Signal Processing 83 (2003) 1275) to examine the background EEG of those patients demonstrating absence seizure activity, and compare it with children without absence epilepsy. This calculation can be used to define the degree of order in a system, with higher levels of entropy indicating a more disordered (chaotic) system. Results were subjected to further statistical analyses of significance. Entropy values were calculated for patients versus controls. For all channels combined, patients with absence epilepsy showed (statistically significant) lower entropy values than controls. The size of the difference in entropy values was not uniform, with certain EEG electrodes consistently showing greater differences than others.

Gender differences in offaxis neuromuscular control during stepping under a slippery condition.

PubMed

Lee, Song Joo; Ren, Yupeng; Geiger, François; Zhang, Li-Qun

2013-11-01

Females are at greater risks of musculoskeletal injuries than are males, which may be related to decreased neuromuscular control in axial and/or frontal planes, offaxis neuromuscular control. The objective of this study was to investigate gender differences in offaxis neuromuscular control during stepping under a slippery condition. Forty-three healthy subjects (21 males and 22 females) performed different stepping tasks under a slippery condition, namely, free pivoting task (FPT) to control axial plane pivoting, free sliding task (FST) to control frontal plane sliding, and free pivoting and sliding task (FPST) to control axial pivoting, and frontal sliding on a custom-made offaxis elliptical trainer. Compared to males, females showed significantly higher pivoting instability, higher max internal and external pivoting angles, higher mean max medial and lateral sliding distance, and higher entropy of time to peak EMG in the medial and lateral gastrocnemius muscles during the FPST and higher entropy of time to peak EMG in the lateral gastrocnemius muscle during the FPT and FST. The findings may help us understand potential injury risk factors associated with gender differences, and provide a basis for developing targeted neuromuscular training to improve offaxis neuromuscular control, and reduce musculoskeletal injuries associated with excessive offaxis loadings.

Entanglement from dissipation and holographic interpretation

NASA Astrophysics Data System (ADS)

Cantcheff, M. Botta; Gadelha, Alexandre L.; Marchioro, Dáfni F. Z.; Nedel, Daniel Luiz

2018-02-01

In this work we study a dissipative field theory where the dissipation process is manifestly related to dynamical entanglement and put it in the holographic context. Such endeavour is realized by further development of a canonical approach to study quantum dissipation, which consists of doubling the degrees of freedom of the original system by defining an auxiliary one. A time dependent entanglement entropy for the vacumm state is calculated and a geometrical interpretation of the auxiliary system and the entropy is given in the context of the AdS/CFT correspondence using the Ryu-Takayanagi formula. We show that the dissipative dynamics is controlled by the entanglement entropy and there are two distinct stages: in the early times the holographic interpretation requires some deviation from classical General Relativity; in the later times the quantum system is described as a wormhole, a solution of the Einstein's equations near to a maximally extended black hole with two asymptotically AdS boundaries. We focus our holographic analysis in this regime, and suggest a mechanism similar to teleportation protocol to exchange (quantum) information between the two CFTs on the boundaries (see Maldacena et al. in Fortschr Phys 65(5):1700034, arXiv:1704.05333 [hep-th], 2017).

Propensity approach to nonequilibrium thermodynamics of a chemical reaction network: Controlling single E-coli β-galactosidase enzyme catalysis through the elementary reaction stepsa)

NASA Astrophysics Data System (ADS)

Das, Biswajit; Banerjee, Kinshuk; Gangopadhyay, Gautam

2013-12-01

In this work, we develop an approach to nonequilibrium thermodynamics of an open chemical reaction network in terms of the elementary reaction propensities. The method is akin to the microscopic formulation of the dissipation function in terms of the Kullback-Leibler distance of phase space trajectories in Hamiltonian system. The formalism is applied to a single oligomeric enzyme kinetics at chemiostatic condition that leads the reaction system to a nonequilibrium steady state, characterized by a positive total entropy production rate. Analytical expressions are derived, relating the individual reaction contributions towards the total entropy production rate with experimentally measurable reaction velocity. Taking a real case of Escherichia coli β-galactosidase enzyme obeying Michaelis-Menten kinetics, we thoroughly analyze the temporal as well as the steady state behavior of various thermodynamic quantities for each elementary reaction. This gives a useful insight in the relative magnitudes of various energy terms and the dissipated heat to sustain a steady state of the reaction system operating far-from-equilibrium. It is also observed that, the reaction is entropy-driven at low substrate concentration and becomes energy-driven as the substrate concentration rises.

A trade-off between local and distributed information processing associated with remote episodic versus semantic memory.

PubMed

Heisz, Jennifer J; Vakorin, Vasily; Ross, Bernhard; Levine, Brian; McIntosh, Anthony R

2014-01-01

Episodic memory and semantic memory produce very different subjective experiences yet rely on overlapping networks of brain regions for processing. Traditional approaches for characterizing functional brain networks emphasize static states of function and thus are blind to the dynamic information processing within and across brain regions. This study used information theoretic measures of entropy to quantify changes in the complexity of the brain's response as measured by magnetoencephalography while participants listened to audio recordings describing past personal episodic and general semantic events. Personal episodic recordings evoked richer subjective mnemonic experiences and more complex brain responses than general semantic recordings. Critically, we observed a trade-off between the relative contribution of local versus distributed entropy, such that personal episodic recordings produced relatively more local entropy whereas general semantic recordings produced relatively more distributed entropy. Changes in the relative contributions of local and distributed entropy to the total complexity of the system provides a potential mechanism that allows the same network of brain regions to represent cognitive information as either specific episodes or more general semantic knowledge.

Entropic inequalities for a class of quantum secret-sharing states

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sarvepalli, Pradeep

It is well known that von Neumann entropy is nonmonotonic, unlike Shannon entropy (which is monotonically nondecreasing). Consequently, it is difficult to relate the entropies of the subsystems of a given quantum state. In this paper, we show that if we consider quantum secret-sharing states arising from a class of monotone span programs, then we can partially recover the monotonicity of entropy for the so-called unauthorized sets. Furthermore, we can show for these quantum states that the entropy of the authorized sets is monotonically nonincreasing.

Entropy in the interior of a higher-dimensional black hole

NASA Astrophysics Data System (ADS)

Yang, Jian-Zhi; Liu, Wen-Biao

2018-07-01

Recently Christodoulou and Rovelli brought out a sensible description for the black hole volume as the largest volume. Later the entropy related to this volume in a 4-dimensional Schwarzschild black hole was investigated, which showed that such entropy is proportional to the surface area of the black hole. We will probe into these issues in the context of higher-dimensional case. It is found that the proportion between this entropy and the Bekenstein-Hawking entropy will go down through dramatic change along with the increase of spacetime dimension.

Dissecting Protein Configurational Entropy into Conformational and Vibrational Contributions.

PubMed

Chong, Song-Ho; Ham, Sihyun

2015-10-01

Quantifying how the rugged nature of the underlying free-energy landscape determines the entropic cost a protein must incur upon folding and ligand binding is a challenging problem. Here, we present a novel computational approach that dissects the protein configurational entropy on the basis of the classification of protein dynamics on the landscape into two separate components: short-term vibrational dynamics related to individual free-energy wells and long-term conformational dynamics associated with transitions between wells. We apply this method to separate the configurational entropy of the protein villin headpiece subdomain into its conformational and vibrational components. We find that the change in configurational entropy upon folding is dominated by the conformational entropy despite the fact that the magnitude of the vibrational entropy is the significantly larger component in each of the folded and unfolded states, which is in accord with the previous empirical estimations. The straightforward applicability of our method to unfolded proteins promises a wide range of applications, including those related to intrinsically disordered proteins.

Spatiotemporal Dependency of Age-Related Changes in Brain Signal Variability

PubMed Central

McIntosh, A. R.; Vakorin, V.; Kovacevic, N.; Wang, H.; Diaconescu, A.; Protzner, A. B.

2014-01-01

Recent theoretical and empirical work has focused on the variability of network dynamics in maturation. Such variability seems to reflect the spontaneous formation and dissolution of different functional networks. We sought to extend these observations into healthy aging. Two different data sets, one EEG (total n = 48, ages 18–72) and one magnetoencephalography (n = 31, ages 20–75) were analyzed for such spatiotemporal dependency using multiscale entropy (MSE) from regional brain sources. In both data sets, the changes in MSE were timescale dependent, with higher entropy at fine scales and lower at more coarse scales with greater age. The signals were parsed further into local entropy, related to information processed within a regional source, and distributed entropy (information shared between two sources, i.e., functional connectivity). Local entropy increased for most regions, whereas the dominant change in distributed entropy was age-related reductions across hemispheres. These data further the understanding of changes in brain signal variability across the lifespan, suggesting an inverted U-shaped curve, but with an important qualifier. Unlike earlier in maturation, where the changes are more widespread, changes in adulthood show strong spatiotemporal dependence. PMID:23395850

Entropy bound of local quantum field theory with generalized uncertainty principle

NASA Astrophysics Data System (ADS)

Kim, Yong-Wan; Lee, Hyung Won; Myung, Yun Soo

2009-03-01

We study the entropy bound for local quantum field theory (LQFT) with generalized uncertainty principle. The generalized uncertainty principle provides naturally a UV cutoff to the LQFT as gravity effects. Imposing the non-gravitational collapse condition as the UV-IR relation, we find that the maximal entropy of a bosonic field is limited by the entropy bound A 3 / 4 rather than A with A the boundary area.

Entropy of nonrotating isolated horizons in Lovelock theory from loop quantum gravity

NASA Astrophysics Data System (ADS)

Wang, Jing-Bo; Huang, Chao-Guang; Li, Lin

2016-08-01

In this paper, the BF theory method is applied to the nonrotating isolated horizons in Lovelock theory. The final entropy matches the Wald entropy formula for this theory. We also confirm the conclusion obtained by Bodendorfer et al. that the entropy is related to the flux operator rather than the area operator in general diffeomorphic-invariant theory. Supported by National Natural Science Foundation of China (11275207)

Relative entropy of entanglement and restricted measurements.

PubMed

Piani, M

2009-10-16

We introduce variants of relative entropy of entanglement based on the optimal distinguishability from unentangled states by means of restricted measurements. In this way we are able to prove that the standard regularized entropy of entanglement is strictly positive for all multipartite entangled states. This implies that the asymptotic creation of a multipartite entangled state by means of local operations and classical communication always requires the consumption of a nonlocal resource at a strictly positive rate.

[Evaluation of a simplified index (spectral entropy) about sleep state of electrocardiogram recorded by a simplified polygraph, MemCalc-Makin2].

PubMed

Ohisa, Noriko; Ogawa, Hiromasa; Murayama, Nobuki; Yoshida, Katsumi

2010-02-01

Polysomnography (PSG) is the gold standard for the diagnosis of sleep apnea hypopnea syndrome (SAHS), but it takes time to analyze the PSG and PSG cannot be performed repeatedly because of efforts and costs. Therefore, simplified sleep respiratory disorder indices in which are reflected the PSG results are needed. The Memcalc method, which is a combination of the maximum entropy method for spectral analysis and the non-linear least squares method for fitting analysis (Makin2, Suwa Trust, Tokyo, Japan) has recently been developed. Spectral entropy which is derived by the Memcalc method might be useful to expressing the trend of time-series behavior. Spectral entropy of ECG which is calculated with the Memcalc method was evaluated by comparing to the PSG results. Obstructive SAS patients (n = 79) and control volanteer (n = 7) ECG was recorded using MemCalc-Makin2 (GMS) with PSG recording using Alice IV (Respironics) from 20:00 to 6:00. Spectral entropy of ECG, which was calculated every 2 seconds using the Memcalc method, was compared to sleep stages which were analyzed manually from PSG recordings. Spectral entropy value (-0.473 vs. -0.418, p < 0.05) were significantly increased in the OSAHS compared to the control. For the entropy cutoff level of -0.423, sensitivity and specificity for OSAHS were 86.1% and 71.4%, respectively, resulting in a receiver operating characteristic with an area under the curve of 0.837. The absolute value of entropy had inverse correlation with stage 3. Spectral entropy, which was calculated with Memcalc method, might be a possible index evaluating the quality of sleep.

Entropy-based complexity of the cardiovascular control in Parkinson disease: comparison between binning and k-nearest-neighbor approaches.

PubMed

Porta, Alberto; Bari, Vlasta; Bassani, Tito; Marchi, Andrea; Tassin, Stefano; Canesi, Margherita; Barbic, Franca; Furlan, Raffaello

2013-01-01

Entropy-based approaches are frequently used to quantify complexity of short-term cardiovascular control from spontaneous beat-to-beat variability of heart period (HP) and systolic arterial pressure (SAP). Among these tools the ones optimizing a critical parameter such as the pattern length are receiving more and more attention. This study compares two entropy-based techniques for the quantification of complexity making use of completely different strategies to optimize the pattern length. Comparison was carried out over HP and SAP variability series recorded from 12 Parkinson's disease (PD) patients without orthostatic hypotension or symptoms of orthostatic intolerance and 12 age-matched healthy control (HC) subjects. Regardless of the method, complexity of cardiovascular control increased in PD group, thus suggesting the early impairment of cardiovascular function.

Stochastic modeling and control system designs of the NASA/MSFC Ground Facility for large space structures: The maximum entropy/optimal projection approach

NASA Technical Reports Server (NTRS)

Hsia, Wei-Shen

1986-01-01

In the Control Systems Division of the Systems Dynamics Laboratory of the NASA/MSFC, a Ground Facility (GF), in which the dynamics and control system concepts being considered for Large Space Structures (LSS) applications can be verified, was designed and built. One of the important aspects of the GF is to design an analytical model which will be as close to experimental data as possible so that a feasible control law can be generated. Using Hyland's Maximum Entropy/Optimal Projection Approach, a procedure was developed in which the maximum entropy principle is used for stochastic modeling and the optimal projection technique is used for a reduced-order dynamic compensator design for a high-order plant.

Entropic Inference

NASA Astrophysics Data System (ADS)

Caticha, Ariel

2011-03-01

In this tutorial we review the essential arguments behing entropic inference. We focus on the epistemological notion of information and its relation to the Bayesian beliefs of rational agents. The problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), includes as special cases both MaxEnt and Bayes' rule, and therefore unifies the two themes of these workshops—the Maximum Entropy and the Bayesian methods—into a single general inference scheme.

Group entropies, correlation laws, and zeta functions.

PubMed

Tempesta, Piergiulio

2011-08-01

The notion of group entropy is proposed. It enables the unification and generaliztion of many different definitions of entropy known in the literature, such as those of Boltzmann-Gibbs, Tsallis, Abe, and Kaniadakis. Other entropic functionals are introduced, related to nontrivial correlation laws characterizing universality classes of systems out of equilibrium when the dynamics is weakly chaotic. The associated thermostatistics are discussed. The mathematical structure underlying our construction is that of formal group theory, which provides the general structure of the correlations among particles and dictates the associated entropic functionals. As an example of application, the role of group entropies in information theory is illustrated and generalizations of the Kullback-Leibler divergence are proposed. A new connection between statistical mechanics and zeta functions is established. In particular, Tsallis entropy is related to the classical Riemann zeta function.

Intra- and inter-individual variation of BIS-index and Entropy during controlled sedation with midazolam/remifentanil and dexmedetomidine/remifentanil in healthy volunteers: an interventional study.

PubMed

Haenggi, Matthias; Ypparila-Wolters, Heidi; Hauser, Kathrin; Caviezel, Claudio; Takala, Jukka; Korhonen, Ilkka; Jakob, Stephan M

2009-01-01

We studied intra-individual and inter-individual variability of two online sedation monitors, BIS and Entropy, in volunteers under sedation. Ten healthy volunteers were sedated in a stepwise manner with doses of either midazolam and remifentanil or dexmedetomidine and remifentanil. One week later the procedure was repeated with the remaining drug combination. The doses were adjusted to achieve three different sedation levels (Ramsay Scores 2, 3 and 4) and controlled by a computer-driven drug-delivery system to maintain stable plasma concentrations of the drugs. At each level of sedation, BIS and Entropy (response entropy and state entropy) values were recorded for 20 minutes. Baseline recordings were obtained before the sedative medications were administered. Both inter-individual and intra-individual variability increased as the sedation level deepened. Entropy values showed greater variability than BIS(R) values, and the variability was greater during dexmedetomidine/remifentanil sedation than during midazolam/remifentanil sedation. The large intra-individual and inter-individual variability of BIS and Entropy values in sedated volunteers makes the determination of sedation levels by processed electroencephalogram (EEG) variables impossible. Reports in the literature which draw conclusions based on processed EEG variables obtained from sedated intensive care unit (ICU) patients may be inaccurate due to this variability. clinicaltrials.gov Nr. NCT00641563.

Nonparametric entropy estimation using kernel densities.

PubMed

Lake, Douglas E

2009-01-01

The entropy of experimental data from the biological and medical sciences provides additional information over summary statistics. Calculating entropy involves estimates of probability density functions, which can be effectively accomplished using kernel density methods. Kernel density estimation has been widely studied and a univariate implementation is readily available in MATLAB. The traditional definition of Shannon entropy is part of a larger family of statistics, called Renyi entropy, which are useful in applications that require a measure of the Gaussianity of data. Of particular note is the quadratic entropy which is related to the Friedman-Tukey (FT) index, a widely used measure in the statistical community. One application where quadratic entropy is very useful is the detection of abnormal cardiac rhythms, such as atrial fibrillation (AF). Asymptotic and exact small-sample results for optimal bandwidth and kernel selection to estimate the FT index are presented and lead to improved methods for entropy estimation.

Analysis of the Influence of Complexity and Entropy of Odorant on Fractal Dynamics and Entropy of EEG Signal.

PubMed

Namazi, Hamidreza; Akrami, Amin; Nazeri, Sina; Kulish, Vladimir V

2016-01-01

An important challenge in brain research is to make out the relation between the features of olfactory stimuli and the electroencephalogram (EEG) signal. Yet, no one has discovered any relation between the structures of olfactory stimuli and the EEG signal. This study investigates the relation between the structures of EEG signal and the olfactory stimulus (odorant). We show that the complexity of the EEG signal is coupled with the molecular complexity of the odorant, where more structurally complex odorant causes less fractal EEG signal. Also, odorant having higher entropy causes the EEG signal to have lower approximate entropy. The method discussed here can be applied and investigated in case of patients with brain diseases as the rehabilitation purpose.

Analysis of the Influence of Complexity and Entropy of Odorant on Fractal Dynamics and Entropy of EEG Signal

PubMed Central

Akrami, Amin; Nazeri, Sina

2016-01-01

An important challenge in brain research is to make out the relation between the features of olfactory stimuli and the electroencephalogram (EEG) signal. Yet, no one has discovered any relation between the structures of olfactory stimuli and the EEG signal. This study investigates the relation between the structures of EEG signal and the olfactory stimulus (odorant). We show that the complexity of the EEG signal is coupled with the molecular complexity of the odorant, where more structurally complex odorant causes less fractal EEG signal. Also, odorant having higher entropy causes the EEG signal to have lower approximate entropy. The method discussed here can be applied and investigated in case of patients with brain diseases as the rehabilitation purpose. PMID:27699169

Entropy change of biological dynamics in COPD.

PubMed

Jin, Yu; Chen, Chang; Cao, Zhixin; Sun, Baoqing; Lo, Iek Long; Liu, Tzu-Ming; Zheng, Jun; Sun, Shixue; Shi, Yan; Zhang, Xiaohua Douglas

2017-01-01

In this century, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of large amount of data in human physiological signals. Entropy is a key metric for quantifying the irregularity contained in physiological signals. In this review, we focus on how entropy changes in various physiological signals in COPD. Our review concludes that the entropy change relies on the types of physiological signals under investigation. For major physiological signals related to respiratory diseases, such as airflow, heart rate variability, and gait variability, the entropy of a patient with COPD is lower than that of a healthy person. However, in case of hormone secretion and respiratory sound, the entropy of a patient is higher than that of a healthy person. For mechanomyogram signal, the entropy increases with the increased severity of COPD. This result should give valuable guidance for the use of entropy for physiological signals measured by wearable medical device as well as for further research on entropy in COPD.

Visualizing Entropy

NASA Astrophysics Data System (ADS)

Lechner, Joseph H.

1999-10-01

This report describes two classroom activities that help students visualize the abstract concept of entropy and apply the second law of thermodynamics to real situations. (i) A sealed "rainbow tube" contains six smaller vessels, each filled with a different brightly colored solution (low entropy). When the tube is inverted, the solutions mix together and react to form an amorphous precipitate (high entropy). The change from low entropy to high entropy is irreversible as long as the tube remains sealed. (ii) When U.S. currency is withdrawn from circulation, intact bills (low entropy) are shredded into small fragments (high entropy). Shredding is quick and easy; the reverse process is clearly nonspontaneous. It is theoretically possible, but it is time-consuming and energy-intensive, to reassemble one bill from a pile that contains fragments of hundreds of bills. We calculate the probability P of drawing pieces of only one specific bill from a mixture containing one pound of bills, each shredded into n fragments. This result can be related to Boltzmann's entropy formula S?=klnW.

Towards a unifying approach to diversity measures: bridging the gap between the Shannon entropy and Rao's quadratic index.

PubMed

Ricotta, Carlo; Szeidl, Laszlo

2006-11-01

The diversity of a species assemblage has been studied extensively for many decades in relation to its possible connection with ecosystem functioning and organization. In this view most diversity measures, such as Shannon's entropy, rely upon information theory as a basis for the quantification of diversity. Also, traditional diversity measures are computed using species relative abundances and cannot account for the ecological differences between species. Rao first proposed a diversity index, termed quadratic diversity (Q) that incorporates both species relative abundances and pairwise distances between species. Quadratic diversity is traditionally defined as the expected distance between two randomly selected individuals. In this paper, we show that quadratic diversity can be interpreted as the expected conflict among the species of a given assemblage. From this unusual interpretation, it naturally follows that Rao's Q can be related to the Shannon entropy through a generalized version of the Tsallis parametric entropy.

Lower and upper bounds for entanglement of Rényi-α entropy.

PubMed

Song, Wei; Chen, Lin; Cao, Zhuo-Liang

2016-12-23

Entanglement Rényi-α entropy is an entanglement measure. It reduces to the standard entanglement of formation when α tends to 1. We derive analytical lower and upper bounds for the entanglement Rényi-α entropy of arbitrary dimensional bipartite quantum systems. We also demonstrate the application our bound for some concrete examples. Moreover, we establish the relation between entanglement Rényi-α entropy and some other entanglement measures.

The Conditional Entropy Power Inequality for Bosonic Quantum Systems

NASA Astrophysics Data System (ADS)

De Palma, Giacomo; Trevisan, Dario

2018-06-01

We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under the heat semigroup evolution. The beam-splitter and the squeezing are the central elements of quantum optics, and can model the attenuation, the amplification and the noise of electromagnetic signals. This conditional Entropy Power Inequality will have a strong impact in quantum information and quantum cryptography. Among its many possible applications there is the proof of a new uncertainty relation for the conditional Wehrl entropy.

The Conditional Entropy Power Inequality for Bosonic Quantum Systems

NASA Astrophysics Data System (ADS)

De Palma, Giacomo; Trevisan, Dario

2018-01-01

We prove the conditional Entropy Power Inequality for Gaussian quantum systems. This fundamental inequality determines the minimum quantum conditional von Neumann entropy of the output of the beam-splitter or of the squeezing among all the input states where the two inputs are conditionally independent given the memory and have given quantum conditional entropies. We also prove that, for any couple of values of the quantum conditional entropies of the two inputs, the minimum of the quantum conditional entropy of the output given by the conditional Entropy Power Inequality is asymptotically achieved by a suitable sequence of quantum Gaussian input states. Our proof of the conditional Entropy Power Inequality is based on a new Stam inequality for the quantum conditional Fisher information and on the determination of the universal asymptotic behaviour of the quantum conditional entropy under the heat semigroup evolution. The beam-splitter and the squeezing are the central elements of quantum optics, and can model the attenuation, the amplification and the noise of electromagnetic signals. This conditional Entropy Power Inequality will have a strong impact in quantum information and quantum cryptography. Among its many possible applications there is the proof of a new uncertainty relation for the conditional Wehrl entropy.

Excess Entropy Production in Quantum System: Quantum Master Equation Approach

NASA Astrophysics Data System (ADS)

Nakajima, Satoshi; Tokura, Yasuhiro

2017-12-01

For open systems described by the quantum master equation (QME), we investigate the excess entropy production under quasistatic operations between nonequilibrium steady states. The average entropy production is composed of the time integral of the instantaneous steady entropy production rate and the excess entropy production. We propose to define average entropy production rate using the average energy and particle currents, which are calculated by using the full counting statistics with QME. The excess entropy production is given by a line integral in the control parameter space and its integrand is called the Berry-Sinitsyn-Nemenman (BSN) vector. In the weakly nonequilibrium regime, we show that BSN vector is described by ln \\breve{ρ }_0 and ρ _0 where ρ _0 is the instantaneous steady state of the QME and \\breve{ρ }_0 is that of the QME which is given by reversing the sign of the Lamb shift term. If the system Hamiltonian is non-degenerate or the Lamb shift term is negligible, the excess entropy production approximately reduces to the difference between the von Neumann entropies of the system. Additionally, we point out that the expression of the entropy production obtained in the classical Markov jump process is different from our result and show that these are approximately equivalent only in the weakly nonequilibrium regime.

Entropy Transfer between Residue Pairs and Allostery in Proteins: Quantifying Allosteric Communication in Ubiquitin

PubMed Central

2017-01-01

It has recently been proposed by Gunasakaran et al. that allostery may be an intrinsic property of all proteins. Here, we develop a computational method that can determine and quantify allosteric activity in any given protein. Based on Schreiber's transfer entropy formulation, our approach leads to an information transfer landscape for the protein that shows the presence of entropy sinks and sources and explains how pairs of residues communicate with each other using entropy transfer. The model can identify the residues that drive the fluctuations of others. We apply the model to Ubiquitin, whose allosteric activity has not been emphasized until recently, and show that there are indeed systematic pathways of entropy and information transfer between residues that correlate well with the activities of the protein. We use 600 nanosecond molecular dynamics trajectories for Ubiquitin and its complex with human polymerase iota and evaluate entropy transfer between all pairs of residues of Ubiquitin and quantify the binding susceptibility changes upon complex formation. We explain the complex formation propensities of Ubiquitin in terms of entropy transfer. Important residues taking part in allosteric communication in Ubiquitin predicted by our approach are in agreement with results of NMR relaxation dispersion experiments. Finally, we show that time delayed correlation of fluctuations of two interacting residues possesses an intrinsic causality that tells which residue controls the interaction and which one is controlled. Our work shows that time delayed correlations, entropy transfer and causality are the required new concepts for explaining allosteric communication in proteins. PMID:28095404

Differences between state entropy and bispectral index during analysis of identical electroencephalogram signals: a comparison with two randomised anaesthetic techniques.

PubMed

Pilge, Stefanie; Kreuzer, Matthias; Karatchiviev, Veliko; Kochs, Eberhard F; Malcharek, Michael; Schneider, Gerhard

2015-05-01

It is claimed that bispectral index (BIS) and state entropy reflect an identical clinical spectrum, the hypnotic component of anaesthesia. So far, it is not known to what extent different devices display similar index values while processing identical electroencephalogram (EEG) signals. To compare BIS and state entropy during analysis of identical EEG data. Inspection of raw EEG input to detect potential causes of erroneous index calculation. Offline re-analysis of EEG data from a randomised, single-centre controlled trial using the Entropy Module and an Aspect A-2000 monitor. Klinikum rechts der Isar, Technische Universität München, Munich. Forty adult patients undergoing elective surgery under general anaesthesia. Blocked randomisation of 20 patients per anaesthetic group (sevoflurane/remifentanil or propofol/remifentanil). Isolated forearm technique for differentiation between consciousness and unconsciousness. Prediction probability (PK) of state entropy to discriminate consciousness from unconsciousness. Correlation and agreement between state entropy and BIS from deep to light hypnosis. Analysis of raw EEG compared with index values that are in conflict with clinical examination, with frequency measures (frequency bands/Spectral Edge Frequency 95) and visual inspection for physiological EEG patterns (e.g. beta or delta arousal), pathophysiological features such as high-frequency signals (electromyogram/high-frequency EEG or eye fluttering/saccades), different types of electro-oculogram or epileptiform EEG and technical artefacts. PK of state entropy was 0.80 and of BIS 0.84; correlation coefficient of state entropy with BIS 0.78. Nine percent BIS and 14% state entropy values disagreed with clinical examination. Highest incidence of disagreement occurred after state transitions, in particular for state entropy after loss of consciousness during sevoflurane anaesthesia. EEG sequences which led to false 'conscious' index values often showed high-frequency signals and eye blinks. High-frequency EEG/electromyogram signals were pooled because a separation into EEG and fast electro-oculogram, for example eye fluttering or saccades, on the basis of a single EEG channel may not be very reliable. These signals led to higher Spectral Edge Frequency 95 and ratio of relative beta and gamma band power than EEG signals, indicating adequate unconscious classification. The frequency of other artefacts that were assignable, for example technical artefacts, movement artefacts, was negligible and they were excluded from analysis. High-frequency signals and eye blinks may account for index values that falsely indicate consciousness. Compared with BIS, state entropy showed more false classifications of the clinical state at transition between consciousness and unconsciousness.

Defining chaos.

PubMed

Hunt, Brian R; Ott, Edward

2015-09-01

In this paper, we propose, discuss, and illustrate a computationally feasible definition of chaos which can be applied very generally to situations that are commonly encountered, including attractors, repellers, and non-periodically forced systems. This definition is based on an entropy-like quantity, which we call "expansion entropy," and we define chaos as occurring when this quantity is positive. We relate and compare expansion entropy to the well-known concept of topological entropy to which it is equivalent under appropriate conditions. We also present example illustrations, discuss computational implementations, and point out issues arising from attempts at giving definitions of chaos that are not entropy-based.

Improved Forecasting Methods for Naval Manpower Studies

DTIC Science & Technology

2015-03-25

Using monthly data is likely to improve the overall fit of the models and the accuracy of the BP test . A measure of unemployment to control for...measure of the relative goodness of fit of a statistical model. It is grounded in the concept of information entropy, in effect, offering a relative...the Kullback – Leibler divergence, DKL(f,g1); similarly, the information lost from using g2 to

Entropy-aware projected Landweber reconstruction for quantized block compressive sensing of aerial imagery

NASA Astrophysics Data System (ADS)

Liu, Hao; Li, Kangda; Wang, Bing; Tang, Hainie; Gong, Xiaohui

2017-01-01

A quantized block compressive sensing (QBCS) framework, which incorporates the universal measurement, quantization/inverse quantization, entropy coder/decoder, and iterative projected Landweber reconstruction, is summarized. Under the QBCS framework, this paper presents an improved reconstruction algorithm for aerial imagery, QBCS, with entropy-aware projected Landweber (QBCS-EPL), which leverages the full-image sparse transform without Wiener filter and an entropy-aware thresholding model for wavelet-domain image denoising. Through analyzing the functional relation between the soft-thresholding factors and entropy-based bitrates for different quantization methods, the proposed model can effectively remove wavelet-domain noise of bivariate shrinkage and achieve better image reconstruction quality. For the overall performance of QBCS reconstruction, experimental results demonstrate that the proposed QBCS-EPL algorithm significantly outperforms several existing algorithms. With the experiment-driven methodology, the QBCS-EPL algorithm can obtain better reconstruction quality at a relatively moderate computational cost, which makes it more desirable for aerial imagery applications.

Lossless quantum data compression with exponential penalization: an operational interpretation of the quantum Rényi entropy.

PubMed

Bellomo, Guido; Bosyk, Gustavo M; Holik, Federico; Zozor, Steeve

2017-11-07

Based on the problem of quantum data compression in a lossless way, we present here an operational interpretation for the family of quantum Rényi entropies. In order to do this, we appeal to a very general quantum encoding scheme that satisfies a quantum version of the Kraft-McMillan inequality. Then, in the standard situation, where one is intended to minimize the usual average length of the quantum codewords, we recover the known results, namely that the von Neumann entropy of the source bounds the average length of the optimal codes. Otherwise, we show that by invoking an exponential average length, related to an exponential penalization over large codewords, the quantum Rényi entropies arise as the natural quantities relating the optimal encoding schemes with the source description, playing an analogous role to that of von Neumann entropy.

Entropy-variation with resistance in a quantized RLC circuit derived by the generalized Hellmann-Feynman theorem

NASA Astrophysics Data System (ADS)

Fan, Hong-Yi; Xu, Xue-Xiang; Hu, Li-Yun

2010-06-01

By virtue of the generalized Hellmann-Feynman theorem for the ensemble average, we obtain the internal energy and average energy consumed by the resistance R in a quantized resistance-inductance-capacitance (RLC) electric circuit. We also calculate the entropy-variation with R. The relation between entropy and R is also derived. By the use of figures we indeed see that the entropy increases with the increment of R.

Entropic criterion for model selection

NASA Astrophysics Data System (ADS)

Tseng, Chih-Yuan

2006-10-01

Model or variable selection is usually achieved through ranking models according to the increasing order of preference. One of methods is applying Kullback-Leibler distance or relative entropy as a selection criterion. Yet that will raise two questions, why use this criterion and are there any other criteria. Besides, conventional approaches require a reference prior, which is usually difficult to get. Following the logic of inductive inference proposed by Caticha [Relative entropy and inductive inference, in: G. Erickson, Y. Zhai (Eds.), Bayesian Inference and Maximum Entropy Methods in Science and Engineering, AIP Conference Proceedings, vol. 707, 2004 (available from arXiv.org/abs/physics/0311093)], we show relative entropy to be a unique criterion, which requires no prior information and can be applied to different fields. We examine this criterion by considering a physical problem, simple fluids, and results are promising.

Assessing the strength of cardiac and sympathetic baroreflex controls via transfer entropy during orthostatic challenge

NASA Astrophysics Data System (ADS)

Porta, Alberto; Marchi, Andrea; Bari, Vlasta; De Maria, Beatrice; Esler, Murray; Lambert, Elisabeth; Baumert, Mathias

2017-05-01

The study assesses the strength of the causal relation along baroreflex (BR) in humans during an incremental postural challenge soliciting the BR. Both cardiac BR (cBR) and sympathetic BR (sBR) were characterized via BR sequence approaches from spontaneous fluctuations of heart period (HP), systolic arterial pressure (SAP), diastolic arterial pressure (DAP) and muscle sympathetic nerve activity (MSNA). A model-based transfer entropy method was applied to quantify the strength of the coupling from SAP to HP and from DAP to MSNA. The confounding influences of respiration were accounted for. Twelve young healthy subjects (20-36 years, nine females) were sequentially tilted at 0°, 20°, 30° and 40°. We found that (i) the strength of the causal relation along the cBR increases with tilt table inclination, while that along the sBR is unrelated to it; (ii) the strength of the causal coupling is unrelated to the gain of the relation; (iii) transfer entropy indexes are significantly and positively associated with simplified causality indexes derived from BR sequence analysis. The study proves that causality indexes are complementary to traditional characterization of the BR and suggests that simple markers derived from BR sequence analysis might be fruitfully exploited to estimate causality along the BR. This article is part of the themed issue `Mathematical methods in medicine: neuroscience, cardiology and pathology'.

Dispersion entropy for the analysis of resting-state MEG regularity in Alzheimer's disease.

PubMed

Azami, Hamed; Rostaghi, Mostafa; Fernandez, Alberto; Escudero, Javier

2016-08-01

Alzheimer's disease (AD) is a progressive degenerative brain disorder affecting memory, thinking, behaviour and emotion. It is the most common form of dementia and a big social problem in western societies. The analysis of brain activity may help to diagnose this disease. Changes in entropy methods have been reported useful in research studies to characterize AD. We have recently proposed dispersion entropy (DisEn) as a very fast and powerful tool to quantify the irregularity of time series. The aim of this paper is to evaluate the ability of DisEn, in comparison with fuzzy entropy (FuzEn), sample entropy (SampEn), and permutation entropy (PerEn), to discriminate 36 AD patients from 26 elderly control subjects using resting-state magnetoencephalogram (MEG) signals. The results obtained by DisEn, FuzEn, and SampEn, unlike PerEn, show that the AD patients' signals are more regular than controls' time series. The p-values obtained by DisEn, FuzEn, SampEn, and PerEn based methods demonstrate the superiority of DisEn over PerEn, SampEn, and PerEn. Moreover, the computation time for the newly proposed DisEn-based method is noticeably less than for the FuzEn, SampEn, and PerEn based approaches.

Entropy production and nonlinear Fokker-Planck equations.

PubMed

Casas, G A; Nobre, F D; Curado, E M F

2012-12-01

The entropy time rate of systems described by nonlinear Fokker-Planck equations--which are directly related to generalized entropic forms--is analyzed. Both entropy production, associated with irreversible processes, and entropy flux from the system to its surroundings are studied. Some examples of known generalized entropic forms are considered, and particularly, the flux and production of the Boltzmann-Gibbs entropy, obtained from the linear Fokker-Planck equation, are recovered as particular cases. Since nonlinear Fokker-Planck equations are appropriate for the dynamical behavior of several physical phenomena in nature, like many within the realm of complex systems, the present analysis should be applicable to irreversible processes in a large class of nonlinear systems, such as those described by Tsallis and Kaniadakis entropies.

Convexity of the entanglement entropy of SU(2N)-symmetric fermions with attractive interactions.

PubMed

Drut, Joaquín E; Porter, William J

2015-02-06

The positivity of the probability measure of attractively interacting systems of 2N-component fermions enables the derivation of an exact convexity property for the ground-state energy of such systems. Using analogous arguments, applied to path-integral expressions for the entanglement entropy derived recently, we prove nonperturbative analytic relations for the Rényi entropies of those systems. These relations are valid for all subsystem sizes, particle numbers, and dimensions, and in arbitrary external trapping potentials.

Statistical mechanical theory for steady state systems. II. Reciprocal relations and the second entropy.

PubMed

Attard, Phil

2005-04-15

The concept of second entropy is introduced for the dynamic transitions between macrostates. It is used to develop a theory for fluctuations in velocity, and is exemplified by deriving Onsager reciprocal relations for Brownian motion. The cases of free, driven, and pinned Brownian particles are treated in turn, and Stokes' law is derived. The second entropy analysis is applied to the general case of thermodynamic fluctuations, and the Onsager reciprocal relations for these are derived using the method. The Green-Kubo formulas for the transport coefficients emerge from the analysis, as do Langevin dynamics.

Rényi entropy, abundance distribution, and the equivalence of ensembles.

PubMed

Mora, Thierry; Walczak, Aleksandra M

2016-05-01

Distributions of abundances or frequencies play an important role in many fields of science, from biology to sociology, as does the Rényi entropy, which measures the diversity of a statistical ensemble. We derive a mathematical relation between the abundance distribution and the Rényi entropy, by analogy with the equivalence of ensembles in thermodynamics. The abundance distribution is mapped onto the density of states, and the Rényi entropy to the free energy. The two quantities are related in the thermodynamic limit by a Legendre transform, by virtue of the equivalence between the micro-canonical and canonical ensembles. In this limit, we show how the Rényi entropy can be constructed geometrically from rank-frequency plots. This mapping predicts that non-concave regions of the rank-frequency curve should result in kinks in the Rényi entropy as a function of its order. We illustrate our results on simple examples, and emphasize the limitations of the equivalence of ensembles when a thermodynamic limit is not well defined. Our results help choose reliable diversity measures based on the experimental accuracy of the abundance distributions in particular frequency ranges.

Entropy emission properties of near-extremal Reissner-Nordström black holes

NASA Astrophysics Data System (ADS)

Hod, Shahar

2016-05-01

Bekenstein and Mayo have revealed an interesting property of evaporating (3 +1 )-dimensional Schwarzschild black holes: their entropy emission rates S˙Sch are related to their energy emission rates P by the simple relation S˙Sch=CSch×(P /ℏ)1/2, where CSch is a numerically computed dimensionless coefficient. Remembering that (1 +1 )-dimensional perfect black-body emitters are characterized by the same functional relation, S˙1 +1=C1 +1×(P /ℏ)1/2 [with C1 +1=(π /3 )1/2], Bekenstein and Mayo have concluded that, in their entropy emission properties, (3 +1 )-dimensional Schwarzschild black holes behave effectively as (1 +1 )-dimensional entropy emitters. Later studies have shown that this intriguing property is actually a generic feature of all radiating (D +1 )-dimensional Schwarzschild black holes. One naturally wonders whether all black holes behave as simple (1 +1 )-dimensional entropy emitters? In order to address this interesting question, we shall study in this paper the entropy emission properties of Reissner-Nordström black holes. We shall show, in particular, that the physical properties which characterize the neutral sector of the Hawking emission spectra of these black holes can be studied analytically in the near-extremal TBH→0 regime (here TBH is the Bekenstein-Hawking temperature of the black hole). We find that the Hawking radiation spectra of massless neutral scalar fields and coupled electromagnetic-gravitational fields are characterized by the nontrivial entropy-energy relations S˙RNScalar=-CRNScalar×(A P3/ℏ3)1/4ln (A P /ℏ) and S˙RN Elec -Grav=-CRNElec -Grav×(A4P9/ℏ9)1 /10ln (A P /ℏ) in the near-extremal TBH→0 limit (here {CRNScalar,CRNElec -Grav} are analytically calculated dimensionless coefficients and A is the surface area of the Reissner-Nordström black hole). Our analytical results therefore indicate that not all black holes behave as simple (1 +1 )-dimensional entropy emitters.

Entropy change of biological dynamics in COPD

PubMed Central

Cao, Zhixin; Sun, Baoqing; Lo, Iek Long; Liu, Tzu-Ming; Zheng, Jun; Sun, Shixue; Shi, Yan; Zhang, Xiaohua Douglas

2017-01-01

In this century, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of large amount of data in human physiological signals. Entropy is a key metric for quantifying the irregularity contained in physiological signals. In this review, we focus on how entropy changes in various physiological signals in COPD. Our review concludes that the entropy change relies on the types of physiological signals under investigation. For major physiological signals related to respiratory diseases, such as airflow, heart rate variability, and gait variability, the entropy of a patient with COPD is lower than that of a healthy person. However, in case of hormone secretion and respiratory sound, the entropy of a patient is higher than that of a healthy person. For mechanomyogram signal, the entropy increases with the increased severity of COPD. This result should give valuable guidance for the use of entropy for physiological signals measured by wearable medical device as well as for further research on entropy in COPD. PMID:29066881

Informational basis of sensory adaptation: entropy and single-spike efficiency in rat barrel cortex.

PubMed

Adibi, Mehdi; Clifford, Colin W G; Arabzadeh, Ehsan

2013-09-11

We showed recently that exposure to whisker vibrations enhances coding efficiency in rat barrel cortex despite increasing correlations in variability (Adibi et al., 2013). Here, to understand how adaptation achieves this improvement in sensory representation, we decomposed the stimulus information carried in neuronal population activity into its fundamental components in the framework of information theory. In the context of sensory coding, these components are the entropy of the responses across the entire stimulus set (response entropy) and the entropy of the responses conditional on the stimulus (conditional response entropy). We found that adaptation decreased response entropy and conditional response entropy at both the level of single neurons and the pooled activity of neuronal populations. However, the net effect of adaptation was to increase the mutual information because the drop in the conditional entropy outweighed the drop in the response entropy. The information transmitted by a single spike also increased under adaptation. As population size increased, the information content of individual spikes declined but the relative improvement attributable to adaptation was maintained.

The Holographic Entropy Cone

DOE PAGES

Bao, Ning; Nezami, Sepehr; Ooguri, Hirosi; ...

2015-09-21

We initiate a systematic enumeration and classification of entropy inequalities satisfied by the Ryu-Takayanagi formula for conformal field theory states with smooth holographic dual geometries. For 2, 3, and 4 regions, we prove that the strong subadditivity and the monogamy of mutual information give the complete set of inequalities. This is in contrast to the situation for generic quantum systems, where a complete set of entropy inequalities is not known for 4 or more regions. We also find an infinite new family of inequalities applicable to 5 or more regions. The set of all holographic entropy inequalities bounds the phasemore » space of Ryu-Takayanagi entropies, defining the holographic entropy cone. We characterize this entropy cone by reducing geometries to minimal graph models that encode the possible cutting and gluing relations of minimal surfaces. We find that, for a fixed number of regions, there are only finitely many independent entropy inequalities. To establish new holographic entropy inequalities, we introduce a combinatorial proof technique that may also be of independent interest in Riemannian geometry and graph theory.« less

Efficient Computation of Small-Molecule Configurational Binding Entropy and Free Energy Changes by Ensemble Enumeration

PubMed Central

2013-01-01

Here we present a novel, end-point method using the dead-end-elimination and A* algorithms to efficiently and accurately calculate the change in free energy, enthalpy, and configurational entropy of binding for ligand–receptor association reactions. We apply the new approach to the binding of a series of human immunodeficiency virus (HIV-1) protease inhibitors to examine the effect ensemble reranking has on relative accuracy as well as to evaluate the role of the absolute and relative ligand configurational entropy losses upon binding in affinity differences for structurally related inhibitors. Our results suggest that most thermodynamic parameters can be estimated using only a small fraction of the full configurational space, and we see significant improvement in relative accuracy when using an ensemble versus single-conformer approach to ligand ranking. We also find that using approximate metrics based on the single-conformation enthalpy differences between the global minimum energy configuration in the bound as well as unbound states also correlates well with experiment. Using a novel, additive entropy expansion based on conditional mutual information, we also analyze the source of ligand configurational entropy loss upon binding in terms of both uncoupled per degree of freedom losses as well as changes in coupling between inhibitor degrees of freedom. We estimate entropic free energy losses of approximately +24 kcal/mol, 12 kcal/mol of which stems from loss of translational and rotational entropy. Coupling effects contribute only a small fraction to the overall entropy change (1–2 kcal/mol) but suggest differences in how inhibitor dihedral angles couple to each other in the bound versus unbound states. The importance of accounting for flexibility in drug optimization and design is also discussed. PMID:24250277

Nonlinear Complexity Analysis of Brain fMRI Signals in Schizophrenia

PubMed Central

Sokunbi, Moses O.; Gradin, Victoria B.; Waiter, Gordon D.; Cameron, George G.; Ahearn, Trevor S.; Murray, Alison D.; Steele, Douglas J.; Staff, Roger T.

2014-01-01

We investigated the differences in brain fMRI signal complexity in patients with schizophrenia while performing the Cyberball social exclusion task, using measures of Sample entropy and Hurst exponent (H). 13 patients meeting diagnostic and Statistical Manual of Mental Disorders, 4th Edition (DSM IV) criteria for schizophrenia and 16 healthy controls underwent fMRI scanning at 1.5 T. The fMRI data of both groups of participants were pre-processed, the entropy characterized and the Hurst exponent extracted. Whole brain entropy and H maps of the groups were generated and analysed. The results after adjusting for age and sex differences together show that patients with schizophrenia exhibited higher complexity than healthy controls, at mean whole brain and regional levels. Also, both Sample entropy and Hurst exponent agree that patients with schizophrenia have more complex fMRI signals than healthy controls. These results suggest that schizophrenia is associated with more complex signal patterns when compared to healthy controls, supporting the increase in complexity hypothesis, where system complexity increases with age or disease, and also consistent with the notion that schizophrenia is characterised by a dysregulation of the nonlinear dynamics of underlying neuronal systems. PMID:24824731

Statistical mechanical theory of liquid entropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wallace, D.C.

The multiparticle correlation expansion for the entropy of a classical monatomic liquid is presented. This entropy expresses the physical picture in which there is no free particle motion, but rather, each atom moves within a cage formed by its neighbors. The liquid expansion, including only pair correlations, gives an excellent account of the experimental entropy of most liquid metals, of liquid argon, and the hard sphere liquid. The pair correlation entropy is well approximated by a universal function of temperature. Higher order correlation entropy, due to n-particle irreducible correlations for n{ge}3, is significant in only a few liquid metals, andmore » its occurrence suggests the presence of n-body forces. When the liquid theory is applied to the study of melting, the author discovers the important classification of normal and anomalous melting, according to whether there is not or is a significant change in the electronic structure upon melting, and he discovers the universal disordering entropy for melting of a monatomic crystal. Interesting directions for future research are: extension to include orientational correlations of molecules, theoretical calculation of the entropy of water, application to the entropy of the amorphous state, and correlational entropy of compressed argon. The author clarifies the relation among different entropy expansions in the recent literature.« less

Beyond the Shannon–Khinchin formulation: The composability axiom and the universal-group entropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tempesta, Piergiulio, E-mail: p.tempesta@fis.ucm.es

2016-02-15

The notion of entropy is ubiquitous both in natural and social sciences. In the last two decades, a considerable effort has been devoted to the study of new entropic forms, which generalize the standard Boltzmann–Gibbs (BG) entropy and could be applicable in thermodynamics, quantum mechanics and information theory. In Khinchin (1957), by extending previous ideas of Shannon (1948) and Shannon and Weaver (1949), Khinchin proposed a characterization of the BG entropy, based on four requirements, nowadays known as the Shannon–Khinchin (SK) axioms. The purpose of this paper is twofold. First, we show that there exists an intrinsic group-theoretical structure behindmore » the notion of entropy. It comes from the requirement of composability of an entropy with respect to the union of two statistically independent systems, that we propose in an axiomatic formulation. Second, we show that there exists a simple universal family of trace-form entropies. This class contains many well known examples of entropies and infinitely many new ones, a priori multi-parametric. Due to its specific relation with Lazard’s universal formal group of algebraic topology, the new general entropy introduced in this work will be called the universal-group entropy. A new example of multi-parametric entropy is explicitly constructed.« less

Formal groups and Z-entropies

PubMed Central

2016-01-01

We shall prove that the celebrated Rényi entropy is the first example of a new family of infinitely many multi-parametric entropies. We shall call them the Z-entropies. Each of them, under suitable hypotheses, generalizes the celebrated entropies of Boltzmann and Rényi. A crucial aspect is that every Z-entropy is composable (Tempesta 2016 Ann. Phys. 365, 180–197. (doi:10.1016/j.aop.2015.08.013)). This property means that the entropy of a system which is composed of two or more independent systems depends, in all the associated probability space, on the choice of the two systems only. Further properties are also required to describe the composition process in terms of a group law. The composability axiom, introduced as a generalization of the fourth Shannon–Khinchin axiom (postulating additivity), is a highly non-trivial requirement. Indeed, in the trace-form class, the Boltzmann entropy and Tsallis entropy are the only known composable cases. However, in the non-trace form class, the Z-entropies arise as new entropic functions possessing the mathematical properties necessary for information-theoretical applications, in both classical and quantum contexts. From a mathematical point of view, composability is intimately related to formal group theory of algebraic topology. The underlying group-theoretical structure determines crucially the statistical properties of the corresponding entropies. PMID:27956871

Consistent maximum entropy representations of pipe flow networks

NASA Astrophysics Data System (ADS)

Waldrip, Steven H.; Niven, Robert K.; Abel, Markus; Schlegel, Michael

2017-06-01

The maximum entropy method is used to predict flows on water distribution networks. This analysis extends the water distribution network formulation of Waldrip et al. (2016) Journal of Hydraulic Engineering (ASCE), by the use of a continuous relative entropy defined on a reduced parameter set. This reduction in the parameters that the entropy is defined over ensures consistency between different representations of the same network. The performance of the proposed reduced parameter method is demonstrated with a one-loop network case study.

Entropy Stable Spectral Collocation Schemes for the Navier-Stokes Equations: Discontinuous Interfaces

NASA Technical Reports Server (NTRS)

Carpenter, Mark H.; Fisher, Travis C.; Nielsen, Eric J.; Frankel, Steven H.

2013-01-01

Nonlinear entropy stability and a summation-by-parts framework are used to derive provably stable, polynomial-based spectral collocation methods of arbitrary order. The new methods are closely related to discontinuous Galerkin spectral collocation methods commonly known as DGFEM, but exhibit a more general entropy stability property. Although the new schemes are applicable to a broad class of linear and nonlinear conservation laws, emphasis herein is placed on the entropy stability of the compressible Navier-Stokes equations.

Detecting entanglement with Jarzynski's equality

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hide, Jenny; Vedral, Vlatko; Centre for Quantum Technologies, National University of Singapore, 3 Science Drive 2, Singapore 117543

2010-06-15

We present a method for detecting the entanglement of a state using nonequilibrium processes. A comparison of relative entropies allows us to construct an entanglement witness. The relative entropy can further be related to the quantum Jarzynski equality, allowing nonequilibrium work to be used in entanglement detection. To exemplify our results, we consider two different spin chains.

Modeling Loop Entropy

PubMed Central

Chirikjian, Gregory S.

2011-01-01

Proteins fold from a highly disordered state into a highly ordered one. Traditionally, the folding problem has been stated as one of predicting ‘the’ tertiary structure from sequential information. However, new evidence suggests that the ensemble of unfolded forms may not be as disordered as once believed, and that the native form of many proteins may not be described by a single conformation, but rather an ensemble of its own. Quantifying the relative disorder in the folded and unfolded ensembles as an entropy difference may therefore shed light on the folding process. One issue that clouds discussions of ‘entropy’ is that many different kinds of entropy can be defined: entropy associated with overall translational and rotational Brownian motion, configurational entropy, vibrational entropy, conformational entropy computed in internal or Cartesian coordinates (which can even be different from each other), conformational entropy computed on a lattice; each of the above with different solvation and solvent models; thermodynamic entropy measured experimentally, etc. The focus of this work is the conformational entropy of coil/loop regions in proteins. New mathematical modeling tools for the approximation of changes in conformational entropy during transition from unfolded to folded ensembles are introduced. In particular, models for computing lower and upper bounds on entropy for polymer models of polypeptide coils both with and without end constraints are presented. The methods reviewed here include kinematics (the mathematics of rigid-body motions), classical statistical mechanics and information theory. PMID:21187223

Subgrid-scale Condensation Modeling for Entropy-based Large Eddy Simulations of Clouds

NASA Astrophysics Data System (ADS)

Kaul, C. M.; Schneider, T.; Pressel, K. G.; Tan, Z.

2015-12-01

An entropy- and total water-based formulation of LES thermodynamics, such as that used by the recently developed code PyCLES, is advantageous from physical and numerical perspectives. However, existing closures for subgrid-scale thermodynamic fluctuations assume more traditional choices for prognostic thermodynamic variables, such as liquid potential temperature, and are not directly applicable to entropy-based modeling. Since entropy and total water are generally nonlinearly related to diagnosed quantities like temperature and condensate amounts, neglecting their small-scale variability can lead to bias in simulation results. Here we present the development of a subgrid-scale condensation model suitable for use with entropy-based thermodynamic formulations.

The entropy of the life table: A reappraisal.

PubMed

Fernandez, Oscar E; Beltrán-Sánchez, Hiram

2015-09-01

The life table entropy provides useful information for understanding improvements in mortality and survival in a population. In this paper we take a closer look at the life table entropy and use advanced mathematical methods to provide additional insights for understanding how it relates to changes in mortality and survival. By studying the entropy (H) as a functional, we show that changes in the entropy depend on both the relative change in life expectancy lost due to death (e(†)) and in life expectancy at birth (e0). We also show that changes in the entropy can be further linked to improvements in premature and older deaths. We illustrate our methods with empirical data from Latin American countries, which suggests that at high mortality levels declines in H (which are associated with survival increases) linked with larger improvements in e0, whereas at low mortality levels e(†) made larger contributions to H. We additionally show that among countries with low mortality level, contributions of e(†) to changes in the life table entropy resulted from averting early deaths. These findings indicate that future increases in overall survival in low mortality countries will likely result from improvements in e(†). Copyright © 2015 Elsevier Inc. All rights reserved.

Reversible and irreversible heat transfer by radiation

NASA Astrophysics Data System (ADS)

del Río, Fernando; de la Selva, Sara María Teresa

2015-05-01

The theme of heat transfer by radiation is absent from most textbooks on thermodynamics, and its treatment in the applied literature presents some basic discrepancies concerning the validity of the Clausius relation between the quantity of heat exchanged, δ Q, and the accompanying entropy change, dS. We review the reversible and irreversible heat transfers by radiation to clarify the validity of the Clausius relation, and we show that in both cases, the Clausius relation is obeyed, as it should be. We also deal with radiation diluted by the presence of matter, introducing a dilution coefficient, ϕ, and an irreversibility factor, χ (φ ). This treatment requires the use of the correct relation between energy and heat fluxes, the spectral fluxes of energy and entropy, and Planck’s equation for the entropy of monochromatic radiation. For the irreversible case of diluted radiation, we recover the ratio between the fluxes of heat and entropy that agree with Clausius’ inequality, including an irreversibility factor, (4/3)χ (φ ). An improved modification for the explicit function χ (φ ) is given. As an illustration, the fluxes of energy and entropy from the Sun to the Earth are obtained. We also calculate the fluxes re-emitted by the Earth, taking into account the greenhouse effect. We find the value of 1.258 W{{m}-2}{{K}-1} for the re-emitted entropy flux after the radiation has been thermalized, which is much larger than the incident flux, in agreement with other authors.

Conditional quantum entropy power inequality for d-level quantum systems

NASA Astrophysics Data System (ADS)

Jeong, Kabgyun; Lee, Soojoon; Jeong, Hyunseok

2018-04-01

We propose an extension of the quantum entropy power inequality for finite dimensional quantum systems, and prove a conditional quantum entropy power inequality by using the majorization relation as well as the concavity of entropic functions also given by Audenaert et al (2016 J. Math. Phys. 57 052202). Here, we make particular use of the fact that a specific local measurement after a partial swap operation (or partial swap quantum channel) acting only on finite dimensional bipartite subsystems does not affect the majorization relation for the conditional output states when a separable ancillary subsystem is involved. We expect our conditional quantum entropy power inequality to be useful, and applicable in bounding and analyzing several capacity problems for quantum channels.

Towards operational interpretations of generalized entropies

NASA Astrophysics Data System (ADS)

Topsøe, Flemming

2010-12-01

The driving force behind our study has been to overcome the difficulties you encounter when you try to extend the clear and convincing operational interpretations of classical Boltzmann-Gibbs-Shannon entropy to other notions, especially to generalized entropies as proposed by Tsallis. Our approach is philosophical, based on speculations regarding the interplay between truth, belief and knowledge. The main result demonstrates that, accepting philosophically motivated assumptions, the only possible measures of entropy are those suggested by Tsallis - which, as we know, include classical entropy. This result constitutes, so it seems, a more transparent interpretation of entropy than previously available. However, further research to clarify the assumptions is still needed. Our study points to the thesis that one should never consider the notion of entropy in isolation - in order to enable a rich and technically smooth study, further concepts, such as divergence, score functions and descriptors or controls should be included in the discussion. This will clarify the distinction between Nature and Observer and facilitate a game theoretical discussion. The usefulness of this distinction and the subsequent exploitation of game theoretical results - such as those connected with the notion of Nash equilibrium - is demonstrated by a discussion of the Maximum Entropy Principle.

Deficit of entropy modulation of the EEG in schizophrenia associated to cognitive performance and symptoms. A replication study.

PubMed

Molina, Vicente; Bachiller, Alejandro; Gomez-Pilar, Javier; Lubeiro, Alba; Hornero, Roberto; Cea-Cañas, Benjamín; Valcárcel, César; Haidar, Mahmoun-Karim; Poza, Jesús

2018-05-01

Spectral entropy (SE) is a measurement from information theory field that provides an estimation of EEG regularity and may be useful as a summary of its spectral properties. Previous studies using small samples reported a deficit of EEG entropy modulation in schizophrenia during cognitive activity. The present study is aimed at replicating this finding in a larger sample, to explore its cognitive and clinical correlates and to discard antipsychotic treatment as the main source of that deficit. We included 64 schizophrenia patients (21 first episodes, FE) and 65 healthy controls. We computed SE during performance of an odd-ball paradigm, at the windows prior (-300 to 0ms) and following (150 to 450ms) stimulus presentation. Modulation of SE was defined as the difference between post- and pre-stimulus windows. In comparison to controls, patients showed a deficit of SE modulation over frontal and central regions, also shown by FE patients. Baseline SE did not differ between patients and controls. Modulation deficit was directly associated with cognitive deficits and negative symptoms, and inversely with positive symptoms. SE modulation was not related to antipsychotic doses. Patients also showed a smaller change of median frequency (i.e., smaller slowing of oscillatory activity) of the EEG from pre- to post-stimulus windows. These results support that a deficit of fast modulation contributes to cognitive deficits and symptoms in schizophrenia patients. Copyright © 2017 Elsevier B.V. All rights reserved.

Universal bounds on the time evolution of entanglement entropy.

PubMed

Avery, Steven G; Paulos, Miguel F

2014-12-05

Using relative entropy, we derive bounds on the time rate of change of geometric entanglement entropy for any relativistic quantum field theory in any dimension. The bounds apply to both mixed and pure states, and may be extended to curved space. We illustrate the bounds in a few examples and comment on potential applications and future extensions.

Entanglement entropy in a boundary impurity model.

PubMed

Levine, G C

2004-12-31

Boundary impurities are known to dramatically alter certain bulk properties of (1+1)-dimensional strongly correlated systems. The entanglement entropy of a zero temperature Luttinger liquid bisected by a single impurity is computed using a novel finite size scaling or bosonization scheme. For a Luttinger liquid of length 2L and UV cutoff epsilon, the boundary impurity correction (deltaSimp) to the logarithmic entanglement entropy (Sent proportional, variant lnL/epsilon scales as deltaSimp approximately yrlnL/epsilon, where yr is the renormalized backscattering coupling constant. In this way, the entanglement entropy within a region is related to scattering through the region's boundary. In the repulsive case (g<1), deltaSimp diverges (negatively) suggesting that the entropy vanishes. Our results are consistent with the recent conjecture that entanglement entropy decreases irreversibly along renormalization group flow.

General monogamy of Tsallis q -entropy entanglement in multiqubit systems

NASA Astrophysics Data System (ADS)

Luo, Yu; Tian, Tian; Shao, Lian-He; Li, Yongming

2016-06-01

In this paper, we study the monogamy inequality of Tsallis q -entropy entanglement. We first provide an analytic formula of Tsallis q -entropy entanglement in two-qubit systems for 5/-√{13 } 2 ≤q ≤5/+√{13 } 2 . The analytic formula of Tsallis q -entropy entanglement in 2 ⊗d system is also obtained and we show that Tsallis q -entropy entanglement satisfies a set of hierarchical monogamy equalities. Furthermore, we prove the squared Tsallis q -entropy entanglement follows a general inequality in the qubit systems. Based on the monogamy relations, a set of multipartite entanglement indicators is constructed, which can detect all genuine multiqubit entangled states even in the case of N -tangle vanishes. Moreover, we study some examples in multipartite higher-dimensional system for the monogamy inequalities.

Validity of the Stokes-Einstein relation in liquids: simple rules from the excess entropy.

PubMed

Pasturel, A; Jakse, N

2016-12-07

It is becoming common practice to consider that the Stokes-Einstein relation D/T~ η -1 usually works for liquids above their melting temperatures although there is also experimental evidence for its failure. Here we investigate numerically this commonly-invoked assumption for simple liquid metals as well as for their liquid alloys. Using ab initio molecular dynamics simulations we show how entropy scaling relationships developed by Rosenfeld can be used to predict the conditions for the validity of the Stokes-Einstein relation in the liquid phase. Specifically, we demonstrate the Stokes-Einstein relation may break down in the liquid phase of some liquid alloys mainly due to the presence of local structural ordering as evidenced in their partial two-body excess entropies. Our findings shed new light on the understanding of transport properties of liquid materials and will trigger more experimental and theoretical studies since excess entropy and its two-body approximation are readily obtainable from standard experiments and simulations.

Entropy stable high order discontinuous Galerkin methods for ideal compressible MHD on structured meshes

NASA Astrophysics Data System (ADS)

Liu, Yong; Shu, Chi-Wang; Zhang, Mengping

2018-02-01

We present a discontinuous Galerkin (DG) scheme with suitable quadrature rules [15] for ideal compressible magnetohydrodynamic (MHD) equations on structural meshes. The semi-discrete scheme is analyzed to be entropy stable by using the symmetrizable version of the equations as introduced by Godunov [32], the entropy stable DG framework with suitable quadrature rules [15], the entropy conservative flux in [14] inside each cell and the entropy dissipative approximate Godunov type numerical flux at cell interfaces to make the scheme entropy stable. The main difficulty in the generalization of the results in [15] is the appearance of the non-conservative "source terms" added in the modified MHD model introduced by Godunov [32], which do not exist in the general hyperbolic system studied in [15]. Special care must be taken to discretize these "source terms" adequately so that the resulting DG scheme satisfies entropy stability. Total variation diminishing / bounded (TVD/TVB) limiters and bound-preserving limiters are applied to control spurious oscillations. We demonstrate the accuracy and robustness of this new scheme on standard MHD examples.

Investigating Neuromagnetic Brain Responses against Chromatic Flickering Stimuli by Wavelet Entropies

PubMed Central

Bhagat, Mayank; Bhushan, Chitresh; Saha, Goutam; Shimjo, Shinsuke; Watanabe, Katsumi; Bhattacharya, Joydeep

2009-01-01

Background Photosensitive epilepsy is a type of reflexive epilepsy triggered by various visual stimuli including colourful ones. Despite the ubiquitous presence of colorful displays, brain responses against different colour combinations are not properly studied. Methodology/Principal Findings Here, we studied the photosensitivity of the human brain against three types of chromatic flickering stimuli by recording neuromagnetic brain responses (magnetoencephalogram, MEG) from nine adult controls, an unmedicated patient, a medicated patient, and two controls age-matched with patients. Dynamical complexities of MEG signals were investigated by a family of wavelet entropies. Wavelet entropy is a newly proposed measure to characterize large scale brain responses, which quantifies the degree of order/disorder associated with a multi-frequency signal response. In particular, we found that as compared to the unmedicated patient, controls showed significantly larger wavelet entropy values. We also found that Renyi entropy is the most powerful feature for the participant classification. Finally, we also demonstrated the effect of combinational chromatic sensitivity on the underlying order/disorder in MEG signals. Conclusions/Significance Our results suggest that when perturbed by potentially epileptic-triggering stimulus, healthy human brain manages to maintain a non-deterministic, possibly nonlinear state, with high degree of disorder, but an epileptic brain represents a highly ordered state which making it prone to hyper-excitation. Further, certain colour combination was found to be more threatening than other combinations. PMID:19779630

Investigating neuromagnetic brain responses against chromatic flickering stimuli by wavelet entropies.

PubMed

Bhagat, Mayank; Bhushan, Chitresh; Saha, Goutam; Shimjo, Shinsuke; Watanabe, Katsumi; Bhattacharya, Joydeep

2009-09-25

Photosensitive epilepsy is a type of reflexive epilepsy triggered by various visual stimuli including colourful ones. Despite the ubiquitous presence of colorful displays, brain responses against different colour combinations are not properly studied. Here, we studied the photosensitivity of the human brain against three types of chromatic flickering stimuli by recording neuromagnetic brain responses (magnetoencephalogram, MEG) from nine adult controls, an unmedicated patient, a medicated patient, and two controls age-matched with patients. Dynamical complexities of MEG signals were investigated by a family of wavelet entropies. Wavelet entropy is a newly proposed measure to characterize large scale brain responses, which quantifies the degree of order/disorder associated with a multi-frequency signal response. In particular, we found that as compared to the unmedicated patient, controls showed significantly larger wavelet entropy values. We also found that Renyi entropy is the most powerful feature for the participant classification. Finally, we also demonstrated the effect of combinational chromatic sensitivity on the underlying order/disorder in MEG signals. Our results suggest that when perturbed by potentially epileptic-triggering stimulus, healthy human brain manages to maintain a non-deterministic, possibly nonlinear state, with high degree of disorder, but an epileptic brain represents a highly ordered state which making it prone to hyper-excitation. Further, certain colour combination was found to be more threatening than other combinations.

The stochastic thermodynamics of a rotating Brownian particle in a gradient flow

PubMed Central

Lan, Yueheng; Aurell, Erik

2015-01-01

We compute the entropy production engendered in the environment from a single Brownian particle which moves in a gradient flow, and show that it corresponds in expectation to classical near-equilibrium entropy production in the surrounding fluid with specific mesoscopic transport coefficients. With temperature gradient, extra terms are found which result from the nonlinear interaction between the particle and the non-equilibrated environment. The calculations are based on the fluctuation relations which relate entropy production to the probabilities of stochastic paths and carried out in a multi-time formalism. PMID:26194015

Altered postural control variability in older-aged individuals with a history of lateral ankle sprain.

PubMed

Terada, Masafumi; Kosik, Kyle; Johnson, Nathan; Gribble, Phillip

2018-02-01

The current study aimed to examine postural control performance during a single-leg balance task in elderly individuals with and without a previous history of lateral ankle sprain (LAS). Eighteen adults with a previous history of LAS (mean age = 66 years old) and 12 healthy controls (mean age = 65 years old) were included in the study. Participants performed three trials of a single-leg balance task during an eyes-opened condition for 20-s. Center of pressure (COP) trajectories in the anteroposterior (AP) and mediolateral (ML) directions were collected with a force plate. The following postural control measures were calculated in the AP and ML directions: 1) Sample Entropy (SampEn); 2) Approximate Entropy (ApEn); 3) mean of Time-to-Boundary minima (mean TTB); and 4) COP velocity (COPV). Older-age participants with a history LAS exhibited lower ApEn-AP, SampEn-AP, and SampEn-ML values compared to healthy controls (p < 0.05). The information gained from this investigation indicates more rigid postural control patterns, less adaptability, and more difficulty maintaining COP during a single-leg balance task in adults with a previous history of LAS. Our data suggest that there is a need to consider history of musculoskeletal injury when evaluating factors for postural control and fall risk in the elderly. Future investigations are needed to assess the effect of LAS on age-related declines in postural control and discern associations between potential risk factors of fall-related injuries and LAS in an elderly population. Copyright © 2017 Elsevier B.V. All rights reserved.

Rényi entropies and observables.

PubMed

Lesche, Bernhard

2004-01-01

Evidence is given that Rényi entropies of macroscopic thermodynamic systems defined on the bases of probabilities of microstates cannot be related to observables. The notion of observable is clarified.

Moisture sorption isotherms and thermodynamic properties of mexican mennonite-style cheese.

PubMed

Martinez-Monteagudo, Sergio I; Salais-Fierro, Fabiola

2014-10-01

Moisture adsorption isotherms of fresh and ripened Mexican Mennonite-style cheese were investigated using the static gravimetric method at 4, 8, and 12 °C in a water activity range (aw) of 0.08-0.96. These isotherms were modeled using GAB, BET, Oswin and Halsey equations through weighed non-linear regression. All isotherms were sigmoid in shape, showing a type II BET isotherm, and the data were best described by GAB model. GAB model coefficients revealed that water adsorption by cheese matrix is a multilayer process characterized by molecules that are strongly bound in the monolayer and molecules that are slightly structured in a multilayer. Using the GAB model, it was possible to estimate thermodynamic functions (net isosteric heat, differential entropy, integral enthalpy and entropy, and enthalpy-entropy compensation) as function of moisture content. For both samples, the isosteric heat and differential entropy decreased with moisture content in exponential fashion. The integral enthalpy gradually decreased with increasing moisture content after reached a maximum value, while the integral entropy decreased with increasing moisture content after reached a minimum value. A linear compensation was found between integral enthalpy and entropy suggesting enthalpy controlled adsorption. Determination of moisture content and aw relationship yields to important information of controlling the ripening, drying and storage operations as well as understanding of the water state within a cheese matrix.

Performance of children with developmental dyslexia on high and low topological entropy artificial grammar learning task.

PubMed

Katan, Pesia; Kahta, Shani; Sasson, Ayelet; Schiff, Rachel

2017-07-01

Graph complexity as measured by topological entropy has been previously shown to affect performance on artificial grammar learning tasks among typically developing children. The aim of this study was to examine the effect of graph complexity on implicit sequential learning among children with developmental dyslexia. Our goal was to determine whether children's performance depends on the complexity level of the grammar system learned. We conducted two artificial grammar learning experiments that compared performance of children with developmental dyslexia with that of age- and reading level-matched controls. Experiment 1 was a high topological entropy artificial grammar learning task that aimed to establish implicit learning phenomena in children with developmental dyslexia using previously published experimental conditions. Experiment 2 is a lower topological entropy variant of that task. Results indicated that given a high topological entropy grammar system, children with developmental dyslexia who were similar to the reading age-matched control group had substantial difficulty in performing the task as compared to typically developing children, who exhibited intact implicit learning of the grammar. On the other hand, when tested on a lower topological entropy grammar system, all groups performed above chance level, indicating that children with developmental dyslexia were able to identify rules from a given grammar system. The results reinforced the significance of graph complexity when experimenting with artificial grammar learning tasks, particularly with dyslexic participants.

Measuring Complexity and Predictability of Time Series with Flexible Multiscale Entropy for Sensor Networks

PubMed Central

Zhou, Renjie; Yang, Chen; Wan, Jian; Zhang, Wei; Guan, Bo; Xiong, Naixue

2017-01-01

Measurement of time series complexity and predictability is sometimes the cornerstone for proposing solutions to topology and congestion control problems in sensor networks. As a method of measuring time series complexity and predictability, multiscale entropy (MSE) has been widely applied in many fields. However, sample entropy, which is the fundamental component of MSE, measures the similarity of two subsequences of a time series with either zero or one, but without in-between values, which causes sudden changes of entropy values even if the time series embraces small changes. This problem becomes especially severe when the length of time series is getting short. For solving such the problem, we propose flexible multiscale entropy (FMSE), which introduces a novel similarity function measuring the similarity of two subsequences with full-range values from zero to one, and thus increases the reliability and stability of measuring time series complexity. The proposed method is evaluated on both synthetic and real time series, including white noise, 1/f noise and real vibration signals. The evaluation results demonstrate that FMSE has a significant improvement in reliability and stability of measuring complexity of time series, especially when the length of time series is short, compared to MSE and composite multiscale entropy (CMSE). The proposed method FMSE is capable of improving the performance of time series analysis based topology and traffic congestion control techniques. PMID:28383496

Measuring Complexity and Predictability of Time Series with Flexible Multiscale Entropy for Sensor Networks.

PubMed

Zhou, Renjie; Yang, Chen; Wan, Jian; Zhang, Wei; Guan, Bo; Xiong, Naixue

2017-04-06

Measurement of time series complexity and predictability is sometimes the cornerstone for proposing solutions to topology and congestion control problems in sensor networks. As a method of measuring time series complexity and predictability, multiscale entropy (MSE) has been widely applied in many fields. However, sample entropy, which is the fundamental component of MSE, measures the similarity of two subsequences of a time series with either zero or one, but without in-between values, which causes sudden changes of entropy values even if the time series embraces small changes. This problem becomes especially severe when the length of time series is getting short. For solving such the problem, we propose flexible multiscale entropy (FMSE), which introduces a novel similarity function measuring the similarity of two subsequences with full-range values from zero to one, and thus increases the reliability and stability of measuring time series complexity. The proposed method is evaluated on both synthetic and real time series, including white noise, 1/f noise and real vibration signals. The evaluation results demonstrate that FMSE has a significant improvement in reliability and stability of measuring complexity of time series, especially when the length of time series is short, compared to MSE and composite multiscale entropy (CMSE). The proposed method FMSE is capable of improving the performance of time series analysis based topology and traffic congestion control techniques.

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy.

PubMed

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy

NASA Astrophysics Data System (ADS)

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

An Equation for Moist Entropy in a Precipitating and Icy Atmosphere

NASA Technical Reports Server (NTRS)

Tao, Wei-Kuo; Simpson, Joanne; Zeng, Xiping

2003-01-01

Moist entropy is nearly conserved in adiabatic motion. It is redistributed rather than created by moist convection. Thus moist entropy and its equation, as a healthy direction, can be used to construct analytical and numerical models for the interaction between tropical convective clouds and large-scale circulations. Hence, an accurate equation of moist entropy is needed for the analysis and modeling of atmospheric convective clouds. On the basis of the consistency between the energy and the entropy equations, a complete equation of moist entropy is derived from the energy equation. The equation expresses explicitly the internal and external sources of moist entropy, including those in relation to the microphysics of clouds and precipitation. In addition, an accurate formula for the surface flux of moist entropy from the underlying surface into the air above is derived. Because moist entropy deals "easily" with the transition among three water phases, it will be used as a prognostic variable in the next generation of cloud-resolving models (e. g. a global cloud-resolving model) for low computational noise. Its equation that is derived in this paper is accurate and complete, providing a theoretical basis for using moist entropy as a prognostic variable in the long-term modeling of clouds and large-scale circulations.

Connectivity in the human brain dissociates entropy and complexity of auditory inputs☆

PubMed Central

Nastase, Samuel A.; Iacovella, Vittorio; Davis, Ben; Hasson, Uri

2015-01-01

Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. PMID:25536493

Action and entanglement in gravity and field theory.

PubMed

Neiman, Yasha

2013-12-27

In nongravitational quantum field theory, the entanglement entropy across a surface depends on the short-distance regularization. Quantum gravity should not require such regularization, and it has been conjectured that the entanglement entropy there is always given by the black hole entropy formula evaluated on the entangling surface. We show that these statements have precise classical counterparts at the level of the action. Specifically, we point out that the action can have a nonadditive imaginary part. In gravity, the latter is fixed by the black hole entropy formula, while in nongravitating theories it is arbitrary. From these classical facts, the entanglement entropy conjecture follows by heuristically applying the relation between actions and wave functions.

Minimum entropy deconvolution and blind equalisation

NASA Technical Reports Server (NTRS)

Satorius, E. H.; Mulligan, J. J.

1992-01-01

Relationships between minimum entropy deconvolution, developed primarily for geophysics applications, and blind equalization are pointed out. It is seen that a large class of existing blind equalization algorithms are directly related to the scale-invariant cost functions used in minimum entropy deconvolution. Thus the extensive analyses of these cost functions can be directly applied to blind equalization, including the important asymptotic results of Donoho.

Generalized Entropic Uncertainty Relations with Tsallis' Entropy

NASA Technical Reports Server (NTRS)

Portesi, M.; Plastino, A.

1996-01-01

A generalization of the entropic formulation of the Uncertainty Principle of Quantum Mechanics is considered with the introduction of the q-entropies recently proposed by Tsallis. The concomitant generalized measure is illustrated for the case of phase and number operators in quantum optics. Interesting results are obtained when making use of q-entropies as the basis for constructing generalized entropic uncertainty measures.

Entanglement entropy in Fermi gases and Anderson's orthogonality catastrophe.

PubMed

Ossipov, A

2014-09-26

We study the ground-state entanglement entropy of a finite subsystem of size L of an infinite system of noninteracting fermions scattered by a potential of finite range a. We derive a general relation between the scattering matrix and the overlap matrix and use it to prove that for a one-dimensional symmetric potential the von Neumann entropy, the Rényi entropies, and the full counting statistics are robust against potential scattering, provided that L/a≫1. The results of numerical calculations support the validity of this conclusion for a generic potential.

Permutation entropy of fractional Brownian motion and fractional Gaussian noise

NASA Astrophysics Data System (ADS)

Zunino, L.; Pérez, D. G.; Martín, M. T.; Garavaglia, M.; Plastino, A.; Rosso, O. A.

2008-06-01

We have worked out theoretical curves for the permutation entropy of the fractional Brownian motion and fractional Gaussian noise by using the Bandt and Shiha [C. Bandt, F. Shiha, J. Time Ser. Anal. 28 (2007) 646] theoretical predictions for their corresponding relative frequencies. Comparisons with numerical simulations show an excellent agreement. Furthermore, the entropy-gap in the transition between these processes, observed previously via numerical results, has been here theoretically validated. Also, we have analyzed the behaviour of the permutation entropy of the fractional Gaussian noise for different time delays.

Shannon entropy and avoided crossings in closed and open quantum billiards

NASA Astrophysics Data System (ADS)

Park, Kyu-Won; Moon, Songky; Shin, Younghoon; Kim, Jinuk; Jeong, Kabgyun; An, Kyungwon

2018-06-01

The relation between Shannon entropy and avoided crossings is investigated in dielectric microcavities. The Shannon entropy of the probability density for eigenfunctions in an open elliptic billiard as well as a closed quadrupole billiard increases as the center of the avoided crossing is approached. These results are opposite to those of atomic physics for electrons. It is found that the collective Lamb shift of the open quantum system and the symmetry breaking in the closed chaotic quantum system have equivalent effects on the Shannon entropy.

A New Thermodynamic Parameter to Predict Formation of Solid Solution or Intermetallic Phases in High Entropy Alloys (Postprint)

DTIC Science & Technology

2015-11-02

George , Relative effects of enthalpy and entropy on the phase stability of equiatomic high-entropy alloys, Acta Mater. 61 (2013) 2628e2638. [4] B... Cantor , I.T.H. Chang, P. Knight, A.J.B. Vincent, Microstructural development in equiatomic multicomponent alloys, Mater. Sci. Eng. A 375e377 (2004...an Al0.5CoCrCuFeNi high entropy alloy, In- termetallics 31 (2012) 165e172. [24] Z. Wu, H. Bei, F. Otto, G.M. Pharr, E.P. George , Recovery

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhou Huanqiang; School of Physical Sciences, University of Queensland, Brisbane, Queensland 4072; Barthel, Thomas

We investigate boundary critical phenomena from a quantum-information perspective. Bipartite entanglement in the ground state of one-dimensional quantum systems is quantified using the Renyi entropy S{sub {alpha}}, which includes the von Neumann entropy ({alpha}{yields}1) and the single-copy entanglement ({alpha}{yields}{infinity}) as special cases. We identify the contribution of the boundaries to the Renyi entropy, and show that there is an entanglement loss along boundary renormalization group (RG) flows. This property, which is intimately related to the Affleck-Ludwig g theorem, is a consequence of majorization relations between the spectra of the reduced density matrix along the boundary RG flows. We also pointmore » out that the bulk contribution to the single-copy entanglement is half of that to the von Neumann entropy, whereas the boundary contribution is the same.« less

A new one-dimensional radiative equilibrium model for investigating atmospheric radiation entropy flux.

PubMed

Wu, Wei; Liu, Yangang

2010-05-12

A new one-dimensional radiative equilibrium model is built to analytically evaluate the vertical profile of the Earth's atmospheric radiation entropy flux under the assumption that atmospheric longwave radiation emission behaves as a greybody and shortwave radiation as a diluted blackbody. Results show that both the atmospheric shortwave and net longwave radiation entropy fluxes increase with altitude, and the latter is about one order in magnitude greater than the former. The vertical profile of the atmospheric net radiation entropy flux follows approximately that of the atmospheric net longwave radiation entropy flux. Sensitivity study further reveals that a 'darker' atmosphere with a larger overall atmospheric longwave optical depth exhibits a smaller net radiation entropy flux at all altitudes, suggesting an intrinsic connection between the atmospheric net radiation entropy flux and the overall atmospheric longwave optical depth. These results indicate that the overall strength of the atmospheric irreversible processes at all altitudes as determined by the corresponding atmospheric net entropy flux is closely related to the amount of greenhouse gases in the atmosphere.

Investigation of FeNiCrWMn - a new high entropy alloy

NASA Astrophysics Data System (ADS)

Buluc, G.; Florea, I.; Bălţătescu, O.; Florea, R. M.; Carcea, I.

2015-11-01

The term of high entropy alloys started from the analysis of multicomponent alloys, which were produced at an experimental level since 1995 by developing a new concept related to the development of metallic materials. Recent developments in the field of high-entropy alloys have revealed that they have versatile properties like: ductility, toughness, hardness and corrosion resistance [1]. Up until now, it has been demonstrated that the explored this alloys are feasible to be synthesized, processed and analyzed contrary to the misunderstanding based on traditional experiences. Moreover, there are many opportunities in this field for academic studies and industrial applications [1, 2]. As the combinations of composition and process for producing high entropy alloys are numerous and each high entropy alloy has its own microstructure and properties to be identified and understood, the research work is truly limitless. The novelty of these alloys consists of chemical composition. These alloys have been named high entropy alloys due to the atomic scale mixing entropies higher than traditional alloys. In this paper, I will present the microscopy and the mechanical properties of high entropy alloy FeNiCrWMn.

Conformational Entropy of Intrinsically Disordered Proteins from Amino Acid Triads

PubMed Central

Baruah, Anupaul; Rani, Pooja; Biswas, Parbati

2015-01-01

This work quantitatively characterizes intrinsic disorder in proteins in terms of sequence composition and backbone conformational entropy. Analysis of the normalized relative composition of the amino acid triads highlights a distinct boundary between globular and disordered proteins. The conformational entropy is calculated from the dihedral angles of the middle amino acid in the amino acid triad for the conformational ensemble of the globular, partially and completely disordered proteins relative to the non-redundant database. Both Monte Carlo (MC) and Molecular Dynamics (MD) simulations are used to characterize the conformational ensemble of the representative proteins of each group. The results show that the globular proteins span approximately half of the allowed conformational states in the Ramachandran space, while the amino acid triads in disordered proteins sample the entire range of the allowed dihedral angle space following Flory’s isolated-pair hypothesis. Therefore, only the sequence information in terms of the relative amino acid triad composition may be sufficient to predict protein disorder and the backbone conformational entropy, even in the absence of well-defined structure. The predicted entropies are found to agree with those calculated using mutual information expansion and the histogram method. PMID:26138206

An uncertainty principle for unimodular quantum groups

DOE Office of Scientific and Technical Information (OSTI.GOV)

Crann, Jason; Université Lille 1 - Sciences et Technologies, UFR de Mathématiques, Laboratoire de Mathématiques Paul Painlevé - UMR CNRS 8524, 59655 Villeneuve d'Ascq Cédex; Kalantar, Mehrdad, E-mail: jason-crann@carleton.ca, E-mail: mkalanta@math.carleton.ca

2014-08-15

We present a generalization of Hirschman's entropic uncertainty principle for locally compact Abelian groups to unimodular locally compact quantum groups. As a corollary, we strengthen a well-known uncertainty principle for compact groups, and generalize the relation to compact quantum groups of Kac type. We also establish the complementarity of finite-dimensional quantum group algebras. In the non-unimodular setting, we obtain an uncertainty relation for arbitrary locally compact groups using the relative entropy with respect to the Haar weight as the measure of uncertainty. We also show that when restricted to q-traces of discrete quantum groups, the relative entropy with respect tomore » the Haar weight reduces to the canonical entropy of the random walk generated by the state.« less

Measuring the potential utility of seasonal climate predictions

NASA Astrophysics Data System (ADS)

Tippett, Michael K.; Kleeman, Richard; Tang, Youmin

2004-11-01

Variation of sea surface temperature (SST) on seasonal-to-interannual time-scales leads to changes in seasonal weather statistics and seasonal climate anomalies. Relative entropy, an information theory measure of utility, is used to quantify the impact of SST variations on seasonal precipitation compared to natural variability. An ensemble of general circulation model (GCM) simulations is used to estimate this quantity in three regions where tropical SST has a large impact on precipitation: South Florida, the Nordeste of Brazil and Kenya. We find the yearly variation of relative entropy is strongly correlated with shifts in ensemble mean precipitation and weakly correlated with ensemble variance. Relative entropy is also found to be related to measures of the ability of the GCM to reproduce observations.

Entropy Generation and Human Aging: Lifespan Entropy and Effect of Physical Activity Level

NASA Astrophysics Data System (ADS)

Silva, Carlos; Annamalai, Kalyan

2008-06-01

The first and second laws of thermodynamics were applied to biochemical reactions typical of human metabolism. An open-system model was used for a human body. Energy conservation, availability and entropy balances were performed to obtain the entropy generated for the main food components. Quantitative results for entropy generation were obtained as a function of age using the databases from the U.S. Food and Nutrition Board (FNB) and Centers for Disease Control and Prevention (CDC), which provide energy requirements and food intake composition as a function of age, weight and stature. Numerical integration was performed through human lifespan for different levels of physical activity. Results were presented and analyzed. Entropy generated over the lifespan of average individuals (natural death) was found to be 11,404 kJ/ºK per kg of body mass with a rate of generation three times higher on infants than on the elderly. The entropy generated predicts a life span of 73.78 and 81.61 years for the average U.S. male and female individuals respectively, which are values that closely match the average lifespan from statistics (74.63 and 80.36 years). From the analysis of the effect of different activity levels, it is shown that entropy generated increases with physical activity, suggesting that exercise should be kept to a “healthy minimum” if entropy generation is to be minimized.

Problem-Solving Phase Transitions During Team Collaboration.

PubMed

Wiltshire, Travis J; Butner, Jonathan E; Fiore, Stephen M

2018-01-01

Multiple theories of problem-solving hypothesize that there are distinct qualitative phases exhibited during effective problem-solving. However, limited research has attempted to identify when transitions between phases occur. We integrate theory on collaborative problem-solving (CPS) with dynamical systems theory suggesting that when a system is undergoing a phase transition it should exhibit a peak in entropy and that entropy levels should also relate to team performance. Communications from 40 teams that collaborated on a complex problem were coded for occurrence of problem-solving processes. We applied a sliding window entropy technique to each team's communications and specified criteria for (a) identifying data points that qualify as peaks and (b) determining which peaks were robust. We used multilevel modeling, and provide a qualitative example, to evaluate whether phases exhibit distinct distributions of communication processes. We also tested whether there was a relationship between entropy values at transition points and CPS performance. We found that a proportion of entropy peaks was robust and that the relative occurrence of communication codes varied significantly across phases. Peaks in entropy thus corresponded to qualitative shifts in teams' CPS communications, providing empirical evidence that teams exhibit phase transitions during CPS. Also, lower average levels of entropy at the phase transition points predicted better CPS performance. We specify future directions to improve understanding of phase transitions during CPS, and collaborative cognition, more broadly. Copyright © 2017 Cognitive Science Society, Inc.

On the morphological instability of a bubble during inertia-controlled growth

NASA Astrophysics Data System (ADS)

Martyushev, L. M.; Birzina, A. I.; Soboleva, A. S.

2018-06-01

The morphological stability of a spherical bubble growing under inertia control is analyzed. Based on the comparison of entropy productions for a distorted and undistorted surface and using the maximum entropy production principle, the morphological instability of the bubble under arbitrary amplitude distortions is shown. This result allows explaining a number of experiments where the surface roughness of bubbles was observed during their explosive-type growth.

Maximum Entropy/Optimal Projection (MEOP) control design synthesis: Optimal quantification of the major design tradeoffs

NASA Technical Reports Server (NTRS)

Hyland, D. C.; Bernstein, D. S.

1987-01-01

The underlying philosophy and motivation of the optimal projection/maximum entropy (OP/ME) stochastic modeling and reduced control design methodology for high order systems with parameter uncertainties are discussed. The OP/ME design equations for reduced-order dynamic compensation including the effect of parameter uncertainties are reviewed. The application of the methodology to several Large Space Structures (LSS) problems of representative complexity is illustrated.

Entropy, matter, and cosmology.

PubMed

Prigogine, I; Géhéniau, J

1986-09-01

The role of irreversible processes corresponding to creation of matter in general relativity is investigated. The use of Landau-Lifshitz pseudotensors together with conformal (Minkowski) coordinates suggests that this creation took place in the early universe at the stage of the variation of the conformal factor. The entropy production in this creation process is calculated. It is shown that these dissipative processes lead to the possibility of cosmological models that start from empty conditions and gradually build up matter and entropy. Gravitational entropy takes a simple meaning as associated to the entropy that is necessary to produce matter. This leads to an extension of the third law of thermodynamics, as now the zero point of entropy becomes the space-time structure out of which matter is generated. The theory can be put into a convenient form using a supplementary "C" field in Einstein's field equations. The role of the C field is to express the coupling between gravitation and matter leading to irreversible entropy production.

Entropy generation in biophysical systems

NASA Astrophysics Data System (ADS)

Lucia, U.; Maino, G.

2013-03-01

Recently, in theoretical biology and in biophysical engineering the entropy production has been verified to approach asymptotically its maximum rate, by using the probability of individual elementary modes distributed in accordance with the Boltzmann distribution. The basis of this approach is the hypothesis that the entropy production rate is maximum at the stationary state. In the present work, this hypothesis is explained and motivated, starting from the entropy generation analysis. This latter quantity is obtained from the entropy balance for open systems considering the lifetime of the natural real process. The Lagrangian formalism is introduced in order to develop an analytical approach to the thermodynamic analysis of the open irreversible systems. The stationary conditions of the open systems are thus obtained in relation to the entropy generation and the least action principle. Consequently, the considered hypothesis is analytically proved and it represents an original basic approach in theoretical and mathematical biology and also in biophysical engineering. It is worth remarking that the present results show that entropy generation not only increases but increases as fast as possible.

Invariant density analysis: modeling and analysis of the postural control system using Markov chains.

PubMed

Hur, Pilwon; Shorter, K Alex; Mehta, Prashant G; Hsiao-Wecksler, Elizabeth T

2012-04-01

In this paper, a novel analysis technique, invariant density analysis (IDA), is introduced. IDA quantifies steady-state behavior of the postural control system using center of pressure (COP) data collected during quiet standing. IDA relies on the analysis of a reduced-order finite Markov model to characterize stochastic behavior observed during postural sway. Five IDA parameters characterize the model and offer physiological insight into the long-term dynamical behavior of the postural control system. Two studies were performed to demonstrate the efficacy of IDA. Study 1 showed that multiple short trials can be concatenated to create a dataset suitable for IDA. Study 2 demonstrated that IDA was effective at distinguishing age-related differences in postural control behavior between young, middle-aged, and older adults. These results suggest that the postural control system of young adults converges more quickly to their steady-state behavior while maintaining COP nearer an overall centroid than either the middle-aged or older adults. Additionally, larger entropy values for older adults indicate that their COP follows a more stochastic path, while smaller entropy values for young adults indicate a more deterministic path. These results illustrate the potential of IDA as a quantitative tool for the assessment of the quiet-standing postural control system.

Hyper-resting brain entropy within chronic smokers and its moderation by Sex.

PubMed

Li, Zhengjun; Fang, Zhuo; Hager, Nathan; Rao, Hengyi; Wang, Ze

2016-07-05

Cigarette smoking is a chronic relapsing brain disorder, and remains a premier cause of morbidity and mortality. Functional neuroimaging has been used to assess differences in the mean strength of brain activity in smokers' brains, however less is known about the temporal dynamics within smokers' brains. Temporal dynamics is a key feature of a dynamic system such as the brain, and may carry information critical to understanding the brain mechanisms underlying cigarette smoking. We measured the temporal dynamics of brain activity using brain entropy (BEN) mapping and compared BEN between chronic non-deprived smokers and non-smoking controls. Because of the known sex differences in neural and behavioral smoking characteristics, comparisons were also made between males and females. Associations between BEN and smoking related clinical measures were assessed in smokers. Our data showed globally higher BEN in chronic smokers compared to controls. The escalated BEN was associated with more years of smoking in the right limbic area and frontal region. Female nonsmokers showed higher BEN than male nonsmokers in prefrontal cortex, insula, and precuneus, but the BEN sex difference in smokers was less pronounced. These findings suggest that BEN mapping may provide a useful tool for probing brain mechanisms related to smoking.

Experimental Rectification of Entropy Production by Maxwell's Demon in a Quantum System

NASA Astrophysics Data System (ADS)

Camati, Patrice A.; Peterson, John P. S.; Batalhão, Tiago B.; Micadei, Kaonan; Souza, Alexandre M.; Sarthour, Roberto S.; Oliveira, Ivan S.; Serra, Roberto M.

2016-12-01

Maxwell's demon explores the role of information in physical processes. Employing information about microscopic degrees of freedom, this "intelligent observer" is capable of compensating entropy production (or extracting work), apparently challenging the second law of thermodynamics. In a modern standpoint, it is regarded as a feedback control mechanism and the limits of thermodynamics are recast incorporating information-to-energy conversion. We derive a trade-off relation between information-theoretic quantities empowering the design of an efficient Maxwell's demon in a quantum system. The demon is experimentally implemented as a spin-1 /2 quantum memory that acquires information, and employs it to control the dynamics of another spin-1 /2 system, through a natural interaction. Noise and imperfections in this protocol are investigated by the assessment of its effectiveness. This realization provides experimental evidence that the irreversibility in a nonequilibrium dynamics can be mitigated by assessing microscopic information and applying a feed-forward strategy at the quantum scale.

Experimental Rectification of Entropy Production by Maxwell's Demon in a Quantum System.

PubMed

Camati, Patrice A; Peterson, John P S; Batalhão, Tiago B; Micadei, Kaonan; Souza, Alexandre M; Sarthour, Roberto S; Oliveira, Ivan S; Serra, Roberto M

2016-12-09

Maxwell's demon explores the role of information in physical processes. Employing information about microscopic degrees of freedom, this "intelligent observer" is capable of compensating entropy production (or extracting work), apparently challenging the second law of thermodynamics. In a modern standpoint, it is regarded as a feedback control mechanism and the limits of thermodynamics are recast incorporating information-to-energy conversion. We derive a trade-off relation between information-theoretic quantities empowering the design of an efficient Maxwell's demon in a quantum system. The demon is experimentally implemented as a spin-1/2 quantum memory that acquires information, and employs it to control the dynamics of another spin-1/2 system, through a natural interaction. Noise and imperfections in this protocol are investigated by the assessment of its effectiveness. This realization provides experimental evidence that the irreversibility in a nonequilibrium dynamics can be mitigated by assessing microscopic information and applying a feed-forward strategy at the quantum scale.

Retention behavior of neutral solutes in pressurized flow-driven capillary electrochromatography using an ODS column.

PubMed

Nakagawa, Hiroyuki; Kitagawa, Shinya; Araki, Shuki; Ohtani, Hajime

2006-02-01

Several alkyl benzenes are separated by pressurized flow-driven capillary electrochromatography using a temperature-controlled capillary column packed with octadecyl siloxane-modified silica gel, and the effect of applied voltage on the retention is investigated. The van't Hoff plot shows good linearity at the column temperature between 305 and 330 K under applications from -6 to +6 kV. The applied voltage causes a relatively large variation in the enthalpy and the entropy of transfer of the solute from the mobile phase to the stationary phase (> 20%). However, the direction of variation in the enthalpy is almost opposite to that in the entropy, both of which might compensate each other. Therefore, the retention factor is not significantly varied (< 4%) by the application of voltage.

Quantifying control effort of biological and technical movements: an information-entropy-based approach.

PubMed

Haeufle, D F B; Günther, M; Wunner, G; Schmitt, S

2014-01-01

In biomechanics and biorobotics, muscles are often associated with reduced movement control effort and simplified control compared to technical actuators. This is based on evidence that the nonlinear muscle properties positively influence movement control. It is, however, open how to quantify the simplicity aspect of control effort and compare it between systems. Physical measures, such as energy consumption, stability, or jerk, have already been applied to compare biological and technical systems. Here a physical measure of control effort based on information entropy is presented. The idea is that control is simpler if a specific movement is generated with less processed sensor information, depending on the control scheme and the physical properties of the systems being compared. By calculating the Shannon information entropy of all sensor signals required for control, an information cost function can be formulated allowing the comparison of models of biological and technical control systems. Exemplarily applied to (bio-)mechanical models of hopping, the method reveals that the required information for generating hopping with a muscle driven by a simple reflex control scheme is only I=32 bits versus I=660 bits with a DC motor and a proportional differential controller. This approach to quantifying control effort captures the simplicity of a control scheme and can be used to compare completely different actuators and control approaches.

Multiscale Entropy of Electroencephalogram as a Potential Predictor for the Prognosis of Neonatal Seizures.

PubMed

Lu, Wen-Yu; Chen, Jyun-Yu; Chang, Chi-Feng; Weng, Wen-Chin; Lee, Wang-Tso; Shieh, Jiann-Shing

2015-01-01

Increasing animal studies supported the harmful effects of prolonged or frequent neonatal seizures in developing brain, including increased risk of later epilepsy. Various nonlinear analytic measures had been applied to investigate the change of brain complexity with age. This study focuses on clarifying the relationship between later epilepsy and the changes of electroencephalogram (EEG) complexity in neonatal seizures. EEG signals from 19 channels of the whole brain from 32 neonates below 2 months old were acquired. The neonates were classified into 3 groups: 9 were normal controls, 9 were neonatal seizures without later epilepsy, and 14 were neonatal seizures with later epilepsy. Sample entropy (SamEn), multiscale entropy (MSE) and complexity index (CI) were analyzed. Although there was no significant change in SamEn, the CI values showed significantly decreased over Channels C3, C4, and Cz in patients with neonatal seizures and later epilepsy compared with control group. More multifocal epileptiform discharges in EEG, more abnormal neuroimaging findings, and higher incidence of future developmental delay were noted in the group with later epilepsy. Decreased MSE and CI values in patients with neonatal seizures and later epilepsy may reflect the mixed effects of acute insults, underlying brain immaturity, and prolonged seizures-related injuries. The analysis of MSE and CI can therefore provide a quantifiable and accurate way to decrypt the mystery of neonatal seizures, and could be a promising predictor.

Experiments and Model for Serration Statistics in Low-Entropy, Medium-Entropy, and High-Entropy Alloys

DOE PAGES

Carroll, Robert; Lee, Chi; Tsai, Che-Wei; ...

2015-11-23

In this study, high-entropy alloys (HEAs) are new alloys that contain five or more elements in roughly-equal proportion. We present new experiments and theory on the deformation behavior of HEAs under slow stretching (straining), and observe differences, compared to conventional alloys with fewer elements. For a specific range of temperatures and strain-rates, HEAs deform in a jerky way, with sudden slips that make it difficult to precisely control the deformation. An analytic model explains these slips as avalanches of slipping weak spots and predicts the observed slip statistics, stress-strain curves, and their dependence on temperature, strain-rate, and material composition. Themore » ratio of the weak spots’ healing rate to the strain-rate is the main tuning parameter, reminiscent of the Portevin- LeChatellier effect and time-temperature superposition in polymers. Our model predictions agree with the experimental results. The proposed widely-applicable deformation mechanism is useful for deformation control and alloy design.« less

Entropic cohering power in quantum operations

NASA Astrophysics Data System (ADS)

Xi, Zhengjun; Hu, Ming-Liang; Li, Yongming; Fan, Heng

2018-02-01

Coherence is a basic feature of quantum systems and a common necessary condition for quantum correlations. It is also an important physical resource in quantum information processing. In this paper, using relative entropy, we consider a more general definition of the cohering power of quantum operations. First, we calculate the cohering power of unitary quantum operations and show that the amount of distributed coherence caused by non-unitary quantum operations cannot exceed the quantum-incoherent relative entropy between system of interest and its environment. We then find that the difference between the distributed coherence and the cohering power is larger than the quantum-incoherent relative entropy. As an application, we consider the distributed coherence caused by purification.

Machine learning with quantum relative entropy

NASA Astrophysics Data System (ADS)

Tsuda, Koji

2009-12-01

Density matrices are a central tool in quantum physics, but it is also used in machine learning. A positive definite matrix called kernel matrix is used to represent the similarities between examples. Positive definiteness assures that the examples are embedded in an Euclidean space. When a positive definite matrix is learned from data, one has to design an update rule that maintains the positive definiteness. Our update rule, called matrix exponentiated gradient update, is motivated by the quantum relative entropy. Notably, the relative entropy is an instance of Bregman divergences, which are asymmetric distance measures specifying theoretical properties of machine learning algorithms. Using the calculus commonly used in quantum physics, we prove an upperbound of the generalization error of online learning.

Perceptual suppression revealed by adaptive multi-scale entropy analysis of local field potential in monkey visual cortex.

PubMed

Hu, Meng; Liang, Hualou

2013-04-01

Generalized flash suppression (GFS), in which a salient visual stimulus can be rendered invisible despite continuous retinal input, provides a rare opportunity to directly study the neural mechanism of visual perception. Previous work based on linear methods, such as spectral analysis, on local field potential (LFP) during GFS has shown that the LFP power at distinctive frequency bands are differentially modulated by perceptual suppression. Yet, the linear method alone may be insufficient for the full assessment of neural dynamic due to the fundamentally nonlinear nature of neural signals. In this study, we set forth to analyze the LFP data collected from multiple visual areas in V1, V2 and V4 of macaque monkeys while performing the GFS task using a nonlinear method - adaptive multi-scale entropy (AME) - to reveal the neural dynamic of perceptual suppression. In addition, we propose a new cross-entropy measure at multiple scales, namely adaptive multi-scale cross-entropy (AMCE), to assess the nonlinear functional connectivity between two cortical areas. We show that: (1) multi-scale entropy exhibits percept-related changes in all three areas, with higher entropy observed during perceptual suppression; (2) the magnitude of the perception-related entropy changes increases systematically over successive hierarchical stages (i.e. from lower areas V1 to V2, up to higher area V4); and (3) cross-entropy between any two cortical areas reveals higher degree of asynchrony or dissimilarity during perceptual suppression, indicating a decreased functional connectivity between cortical areas. These results, taken together, suggest that perceptual suppression is related to a reduced functional connectivity and increased uncertainty of neural responses, and the modulation of perceptual suppression is more effective at higher visual cortical areas. AME is demonstrated to be a useful technique in revealing the underlying dynamic of nonlinear/nonstationary neural signal.

Another resolution of the configurational entropy paradox as applied to hard spheres

NASA Astrophysics Data System (ADS)

Baranau, Vasili; Tallarek, Ulrich

2017-12-01

Ozawa and Berthier [J. Chem. Phys. 146, 014502 (2017)] recently studied the configurational and vibrational entropies Sconf and Svib from the relation Stot = Sconf + Svib for polydisperse mixtures of spheres. They noticed that because the total entropy per particle Stot/N shall contain the mixing entropy per particle kBsmix and Svib/N shall not, the configurational entropy per particle Sconf/N shall diverge in the thermodynamic limit for continuous polydispersity due to the diverging smix. They also provided a resolution for this paradox and related problems—it relies on a careful redefining of Sconf and Svib. Here, we note that the relation Stot = Sconf + Svib is essentially a geometric relation in the phase space and shall hold without redefining Sconf and Svib. We also note that Stot/N diverges with N → ∞ with continuous polydispersity as well. The usual way to avoid this and other difficulties with Stot/N is to work with the excess entropy ΔStot (relative to the ideal gas of the same polydispersity). Speedy applied this approach to the relation above in his work [Mol. Phys. 95, 169 (1998)] and wrote this relation as ΔStot = Sconf + ΔSvib. This form has flaws as well because Svib/N does not contain the kBsmix term and the latter is introduced into ΔSvib/N instead. Here, we suggest that this relation shall actually be written as ΔStot = ΔcSconf + ΔvSvib, where Δ = Δc + Δv, while ΔcSconf = Sconf - kBNsmix and ΔvSvib=Svib-kBN [1 +ln (V/ΛdN ]+U/N kBT) with N, V, T, U, d, and Λ standing for the number of particles, volume, temperature, internal energy, dimensionality, and de Broglie wavelength, respectively. In this form, all the terms per particle are always finite for N → ∞ and continuous when introducing a small polydispersity to a monodisperse system. We also suggest that the Adam-Gibbs and related relations shall in fact contain ΔcSconf/N instead of Sconf/N.

Parametric scaling from species relative abundances to absolute abundances in the computation of biological diversity: a first proposal using Shannon's entropy.

PubMed

Ricotta, Carlo

2003-01-01

Traditional diversity measures such as the Shannon entropy are generally computed from the species' relative abundance vector of a given community to the exclusion of species' absolute abundances. In this paper, I first mention some examples where the total information content associated with a given community may be more adequate than Shannon's average information content for a better understanding of ecosystem functioning. Next, I propose a parametric measure of statistical information that contains both Shannon's entropy and total information content as special cases of this more general function.

Stochastic approach to equilibrium and nonequilibrium thermodynamics.

PubMed

Tomé, Tânia; de Oliveira, Mário J

2015-04-01

We develop the stochastic approach to thermodynamics based on stochastic dynamics, which can be discrete (master equation) and continuous (Fokker-Planck equation), and on two assumptions concerning entropy. The first is the definition of entropy itself and the second the definition of entropy production rate, which is non-negative and vanishes in thermodynamic equilibrium. Based on these assumptions, we study interacting systems with many degrees of freedom in equilibrium or out of thermodynamic equilibrium and how the macroscopic laws are derived from the stochastic dynamics. These studies include the quasiequilibrium processes; the convexity of the equilibrium surface; the monotonic time behavior of thermodynamic potentials, including entropy; the bilinear form of the entropy production rate; the Onsager coefficients and reciprocal relations; and the nonequilibrium steady states of chemical reactions.

Identification of segregated regions in the functional brain connectome of autistic patients by a combination of fuzzy spectral clustering and entropy analysis

PubMed Central

Sato, João Ricardo; Balardin, Joana; Vidal, Maciel Calebe; Fujita, André

2016-01-01

Background Several neuroimaging studies support the model of abnormal development of brain connectivity in patients with autism-spectrum disorders (ASD). In this study, we aimed to test the hypothesis of reduced functional network segregation in autistic patients compared with controls. Methods Functional MRI data from children acquired under a resting-state protocol (Autism Brain Imaging Data Exchange [ABIDE]) were submitted to both fuzzy spectral clustering (FSC) with entropy analysis and graph modularity analysis. Results We included data from 814 children in our analysis. We identified 5 regions of interest comprising the motor, temporal and occipito-temporal cortices with increased entropy (p < 0.05) in the clustering structure (i.e., more segregation in the controls). Moreover, we noticed a statistically reduced modularity (p < 0.001) in the autistic patients compared with the controls. Significantly reduced eigenvector centrality values (p < 0.05) in the patients were observed in the same regions that were identified in the FSC analysis. Limitations There is considerable heterogeneity in the fMRI acquisition protocols among the sites that contributed to the ABIDE data set (e.g., scanner type, pulse sequence, duration of scan and resting-state protocol). Moreover, the sites differed in many variables related to sample characterization (e.g., age, IQ and ASD diagnostic criteria). Therefore, we cannot rule out the possibility that additional differences in functional network organization would be found in a more homogeneous data sample of individuals with ASD. Conclusion Our results suggest that the organization of the whole-brain functional network in patients with ASD is different from that observed in controls, which implies a reduced modularity of the brain functional networks involved in sensorimotor, social, affective and cognitive processing. PMID:26505141

A retrospective analysis of the effect of blood transfusion on cerebral oximetry entropy and acute kidney injury.

PubMed

Engoren, Milo; Brown, Russell R; Dubovoy, Anna

2017-01-01

Acute anemia is associated with both cerebral dysfunction and acute kidney injury and is often treated with red blood cell transfusion. We sought to determine if blood transfusion changed the cerebral oximetry entropy, a measure of the complexity or irregularity of the oximetry values, and if this change was associated with subsequent acute kidney injury. This was a retrospective, case-control study of patients undergoing cardiac surgery with cardiopulmonary bypass at a tertiary care hospital, comparing those who received a red blood cell transfusion to those who did not. Acute kidney injury was defined as a perioperative increase in serum creatinine by ⩾26.4 μmol/L or by ⩾50% increase. Entropy was measured using approximate entropy, sample entropy, forbidden word entropy and basescale4 entropy in 500-point sets. Forty-four transfused patients were matched to 88 randomly selected non-transfused patients. All measures of entropy had small changes in the transfused group, but increased in the non-transfused group (p<0.05, for all comparisons). Thirty-five of 132 patients (27%) suffered acute kidney injury. Based on preoperative factors, patients who suffered kidney injury were similar to those who did not, including baseline cerebral oximetry levels. After analysis with hierarchical logistic regression, the change in basescale4 entropy (odds ratio = 1.609, 95% confidence interval = 1.057-2.450, p = 0.027) and the interaction between basescale entropy and transfusion were significantly associated with subsequent development of acute kidney injury. The transfusion of red blood cells was associated with a smaller rise in entropy values compared to non-transfused patients, suggesting a change in the regulation of cerebral oxygenation, and these changes in cerebral oxygenation are also associated with acute kidney injury.

Studies on entanglement entropy for Hubbard model with hole-doping and external magnetic field [rapid communication

NASA Astrophysics Data System (ADS)

Yao, K. L.; Li, Y. C.; Sun, X. Z.; Liu, Q. M.; Qin, Y.; Fu, H. H.; Gao, G. Y.

2005-10-01

By using the density matrix renormalization group (DMRG) method for the one-dimensional (1D) Hubbard model, we have studied the von Neumann entropy of a quantum system, which describes the entanglement of the system block and the rest of the chain. It is found that there is a close relation between the entanglement entropy and properties of the system. The hole-doping can alter the charge charge and spin spin interactions, resulting in charge polarization along the chain. By comparing the results before and after the doping, we find that doping favors increase of the von Neumann entropy and thus also favors the exchange of information along the chain. Furthermore, we calculated the spin and entropy distribution in external magnetic filed. It is confirmed that both the charge charge and the spin spin interactions affect the exchange of information along the chain, making the entanglement entropy redistribute.

Entropy of finite random binary sequences with weak long-range correlations.

PubMed

Melnik, S S; Usatenko, O V

2014-11-01

We study the N-step binary stationary ergodic Markov chain and analyze its differential entropy. Supposing that the correlations are weak we express the conditional probability function of the chain through the pair correlation function and represent the entropy as a functional of the pair correlator. Since the model uses the two-point correlators instead of the block probability, it makes it possible to calculate the entropy of strings at much longer distances than using standard methods. A fluctuation contribution to the entropy due to finiteness of random chains is examined. This contribution can be of the same order as its regular part even at the relatively short lengths of subsequences. A self-similar structure of entropy with respect to the decimation transformations is revealed for some specific forms of the pair correlation function. Application of the theory to the DNA sequence of the R3 chromosome of Drosophila melanogaster is presented.

Entropy of finite random binary sequences with weak long-range correlations

NASA Astrophysics Data System (ADS)

Melnik, S. S.; Usatenko, O. V.

2014-11-01

We study the N -step binary stationary ergodic Markov chain and analyze its differential entropy. Supposing that the correlations are weak we express the conditional probability function of the chain through the pair correlation function and represent the entropy as a functional of the pair correlator. Since the model uses the two-point correlators instead of the block probability, it makes it possible to calculate the entropy of strings at much longer distances than using standard methods. A fluctuation contribution to the entropy due to finiteness of random chains is examined. This contribution can be of the same order as its regular part even at the relatively short lengths of subsequences. A self-similar structure of entropy with respect to the decimation transformations is revealed for some specific forms of the pair correlation function. Application of the theory to the DNA sequence of the R3 chromosome of Drosophila melanogaster is presented.

Scaling of the entropy budget with surface temperature in radiative-convective equilibrium

NASA Astrophysics Data System (ADS)

Singh, Martin S.; O'Gorman, Paul A.

2016-09-01

The entropy budget of the atmosphere is examined in simulations of radiative-convective equilibrium with a cloud-system resolving model over a wide range of surface temperatures from 281 to 311 K. Irreversible phase changes and the diffusion of water vapor account for more than half of the irreversible entropy production within the atmosphere, even in the coldest simulation. As the surface temperature is increased, the atmospheric radiative cooling rate increases, driving a greater entropy sink that must be matched by greater irreversible entropy production. The entropy production resulting from irreversible moist processes increases at a similar fractional rate as the entropy sink and at a lower rate than that implied by Clausius-Clapeyron scaling. This allows the entropy production from frictional drag on hydrometeors and on the atmospheric flow to also increase with warming, in contrast to recent results for simulations with global climate models in which the work output decreases with warming. A set of approximate scaling relations is introduced for the terms in the entropy budget as the surface temperature is varied, and many of the terms are found to scale with the mean surface precipitation rate. The entropy budget provides some insight into changes in frictional dissipation in response to warming or changes in model resolution, but it is argued that frictional dissipation is not closely linked to other measures of convective vigor.

DNA entropy reveals a significant difference in complexity between housekeeping and tissue specific gene promoters.

PubMed

Thomas, David; Finan, Chris; Newport, Melanie J; Jones, Susan

2015-10-01

The complexity of DNA can be quantified using estimates of entropy. Variation in DNA complexity is expected between the promoters of genes with different transcriptional mechanisms; namely housekeeping (HK) and tissue specific (TS). The former are transcribed constitutively to maintain general cellular functions, and the latter are transcribed in restricted tissue and cells types for specific molecular events. It is known that promoter features in the human genome are related to tissue specificity, but this has been difficult to quantify on a genomic scale. If entropy effectively quantifies DNA complexity, calculating the entropies of HK and TS gene promoters as profiles may reveal significant differences. Entropy profiles were calculated for a total dataset of 12,003 human gene promoters and for 501 housekeeping (HK) and 587 tissue specific (TS) human gene promoters. The mean profiles show the TS promoters have a significantly lower entropy (p<2.2e-16) than HK gene promoters. The entropy distributions for the 3 datasets show that promoter entropies could be used to identify novel HK genes. Functional features comprise DNA sequence patterns that are non-random and hence they have lower entropies. The lower entropy of TS gene promoters can be explained by a higher density of positive and negative regulatory elements, required for genes with complex spatial and temporary expression. Copyright © 2015 Elsevier Ltd. All rights reserved.

Connectivity in the human brain dissociates entropy and complexity of auditory inputs.

PubMed

Nastase, Samuel A; Iacovella, Vittorio; Davis, Ben; Hasson, Uri

2015-03-01

Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. Copyright © 2014. Published by Elsevier Inc.

Quantum entropy and special relativity.

PubMed

Peres, Asher; Scudo, Petra F; Terno, Daniel R

2002-06-10

We consider a single free spin- 1 / 2 particle. The reduced density matrix for its spin is not covariant under Lorentz transformations. The spin entropy is not a relativistic scalar and has no invariant meaning.

Minimum relative entropy distributions with a large mean are Gaussian

NASA Astrophysics Data System (ADS)

Smerlak, Matteo

2016-12-01

Entropy optimization principles are versatile tools with wide-ranging applications from statistical physics to engineering to ecology. Here we consider the following constrained problem: Given a prior probability distribution q , find the posterior distribution p minimizing the relative entropy (also known as the Kullback-Leibler divergence) with respect to q under the constraint that mean (p ) is fixed and large. We show that solutions to this problem are approximately Gaussian. We discuss two applications of this result. In the context of dissipative dynamics, the equilibrium distribution of a Brownian particle confined in a strong external field is independent of the shape of the confining potential. We also derive an H -type theorem for evolutionary dynamics: The entropy of the (standardized) distribution of fitness of a population evolving under natural selection is eventually increasing in time.

Comparison of entropy and bispectral index during propofol and fentanyl sedation in monitored anaesthesia care.

PubMed

Balci, Canan; Karabekir, H S; Kahraman, F; Sivaci, R G

2009-01-01

Comparison of entropy (state entropy [SE] and response entropy [RE]) with the bispectral index (BIS) during propofol sedation in monitored anaesthesia care (MAC) was carried out in patients undergoing hand surgery. Thirty candidates for elective hand surgery were pre-medicated with midazolam 0.06 mg/kg and atropine 0.01 mg/kg. Sedation was induced with intravenous propofol and fentanyl was also administered. The Modified Observer's Assessment of Alertness/Sedation Scale (MOAA/S) was used to determine sedation level and pain was maintained at < 4 on a 0 - 10 verbal rating scale. The BIS, entropy, MOAA/S and pain values were recorded before initiation of sedation (control), during initiation of sedation, during surgery, and for 30 min after the end of surgery and anaesthesia. On initiation of sedation, entropy decreased more rapidly than BIS. At 10 min after initiation of sedation, the mean +/- SD values for MOAA/S, BIS, RE and SE were 3.00 +/- 0.36, 85.45 +/- 0.15, 74.00 +/- 0.60 and 72.02 +/- 0.12, respectively. During recovery, BIS and RE and SE increased in parallel with MOAA/S. It is concluded that entropy monitoring is as reliable as BIS monitoring in MAC.

Singular spectrum and singular entropy used in signal processing of NC table

NASA Astrophysics Data System (ADS)

Wang, Linhong; He, Yiwen

2011-12-01

NC (numerical control) table is a complex dynamic system. The dynamic characteristics caused by backlash, friction and elastic deformation among each component are so complex that they have become the bottleneck of enhancing the positioning accuracy, tracking accuracy and dynamic behavior of NC table. This paper collects vibration acceleration signals from NC table, analyzes the signals with SVD (singular value decomposition) method, acquires the singular spectrum and calculates the singular entropy of the signals. The signal characteristics and their regulations of NC table are revealed via the characteristic quantities such as singular spectrum, singular entropy etc. The steep degrees of singular spectrums can be used to discriminate complex degrees of signals. The results show that the signals in direction of driving axes are the simplest and the signals in perpendicular direction are the most complex. The singular entropy values can be used to study the indetermination of signals. The results show that the signals of NC table are not simple signal nor white noise, the entropy values in direction of driving axe are lower, the entropy values increase along with the increment of driving speed and the entropy values at the abnormal working conditions such as resonance or creeping etc decrease obviously.

Thermodynamic contribution of backbone conformational entropy in the binding between SH3 domain and proline-rich motif.

PubMed

Zeng, Danyun; Shen, Qingliang; Cho, Jae-Hyun

2017-02-26

Biological functions of intrinsically disordered proteins (IDPs), and proteins containing intrinsically disordered regions (IDRs) are often mediated by short linear motifs, like proline-rich motifs (PRMs). Upon binding to their target proteins, IDPs undergo a disorder-to-order transition which is accompanied by a large conformational entropy penalty. Hence, the molecular mechanisms underlying control of conformational entropy are critical for understanding the binding affinity and selectivity of IDPs-mediated protein-protein interactions (PPIs). Here, we investigated the backbone conformational entropy change accompanied by binding of the N-terminal SH3 domain (nSH3) of CrkII and PRM derived from guanine nucleotide exchange factor 1 (C3G). In particular, we focused on the estimation of conformational entropy change of disordered PRM upon binding to the nSH3 domain. Quantitative characterization of conformational dynamics of disordered peptides like PRMs is limited. Hence, we combined various methods, including NMR model-free analysis, δ2D, DynaMine, and structure-based calculation of entropy loss. This study demonstrates that the contribution of backbone conformational entropy change is significant in the PPIs mediated by IDPs/IDRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Gait alterations in the UAE population with and without diabetic complications using both traditional and entropy measures.

PubMed

Khalaf, Kinda; Al-Angari, Haitham M; Khandoker, Ahsan H; Lee, Sungmun; Almahmeed, Wael; Al Safar, Habiba S; Jelinek, Herbert F

2017-10-01

Diabetic foot, one of the most common and debilitating manifestations of type 2 diabetes mellitus (T2DM), is the leading cause of worldwide non-traumatic lower extremity amputations. Diabetics who are at risk of ulceration are currently mainly identified by a thorough clinical examination of the feet, which typically does not show clear symptoms during the early stages of disease progression. In this study, we used a non-linear dynamics tool, gait entropy (GaitEN), in addition to traditional linear gait analysis methods, to investigate gait alterations amongst diabetic patients with combinations of three types of T2DM related complications: retinopathy, diabetic peripheral neuropathy (DPN) and nephropathy. Peak plantar pressure (PPP) was not significantly different in the group with DPN as compared to the control group (diabetics with no complications, CONT) in the forefoot region (DPN: mean±SD: 396±69.4kPa, CONT: 409±68.9kPa), although it was significantly lower in the heel region (DPN: mean±SD: 285±43.1.4kPa, CONT: 295±61.8kPa). On the other hand, gait entropy was significantly lower for the DPN compared to CONT group (DPN: 0.95±0.34, CONT: 1.03±0.28, p<0.05). The significant low entropy was maintained when neuropathy was combined with either retinopathy or nephropathy. For the group with all three complications (ALL-C), the entropy was higher than CONT (ALL-C: 1.07±0.26). This may indicate an intrinsic sensorimotor feedback mechanism for the DPN patients to regulate their gait. However, this feedback gets weaker as patients develop multiple complications. Further analysis with longer walking time and different speeds is needed to verify the entropy results. Copyright © 2017 Elsevier B.V. All rights reserved.

Recoverability in quantum information theory

NASA Astrophysics Data System (ADS)

Wilde, Mark

The fact that the quantum relative entropy is non-increasing with respect to quantum physical evolutions lies at the core of many optimality theorems in quantum information theory and has applications in other areas of physics. In this work, we establish improvements of this entropy inequality in the form of physically meaningful remainder terms. One of the main results can be summarized informally as follows: if the decrease in quantum relative entropy between two quantum states after a quantum physical evolution is relatively small, then it is possible to perform a recovery operation, such that one can perfectly recover one state while approximately recovering the other. This can be interpreted as quantifying how well one can reverse a quantum physical evolution. Our proof method is elementary, relying on the method of complex interpolation, basic linear algebra, and the recently introduced Renyi generalization of a relative entropy difference. The theorem has a number of applications in quantum information theory, which have to do with providing physically meaningful improvements to many known entropy inequalities. This is based on arXiv:1505.04661, now accepted for publication in Proceedings of the Royal Society A. I acknowledge support from startup funds from the Department of Physics and Astronomy at LSU, the NSF under Award No. CCF-1350397, and the DARPA Quiness Program through US Army Research Office award W31P4Q-12-1-0019.

The pressure and entropy of a unitary Fermi gas with particle-hole fluctuation

NASA Astrophysics Data System (ADS)

Gong, Hao; Ruan, Xiao-Xia; Zong, Hong-Shi

2018-01-01

We calculate the pressure and entropy of a unitary Fermi gas based on universal relations combined with our previous prediction of energy which was calculated within the framework of the non-self-consistent T-matrix approximation with particle-hole fluctuation. The resulting entropy and pressure are compared with the experimental data and the theoretical results without induced interaction. For entropy, we find good agreement between our results with particle-hole fluctuation and the experimental measurements reported by ENS group and MIT experiment. For pressure, our results suffer from a systematic upshift compared to MIT data.

Effect of extreme data loss on heart rate signals quantified by entropy analysis

NASA Astrophysics Data System (ADS)

Li, Yu; Wang, Jun; Li, Jin; Liu, Dazhao

2015-02-01

The phenomenon of data loss always occurs in the analysis of large databases. Maintaining the stability of analysis results in the event of data loss is very important. In this paper, we used a segmentation approach to generate a synthetic signal that is randomly wiped from data according to the Gaussian distribution and the exponential distribution of the original signal. Then, the logistic map is used as verification. Finally, two methods of measuring entropy-base-scale entropy and approximate entropy-are comparatively analyzed. Our results show the following: (1) Two key parameters-the percentage and the average length of removed data segments-can change the sequence complexity according to logistic map testing. (2) The calculation results have preferable stability for base-scale entropy analysis, which is not sensitive to data loss. (3) The loss percentage of HRV signals should be controlled below the range (p = 30 %), which can provide useful information in clinical applications.

Maximum entropy and equations of state for random cellular structures

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rivier, N.

Random, space-filling cellular structures (biological tissues, metallurgical grain aggregates, foams, etc.) are investigated. Maximum entropy inference under a few constraints yields structural equations of state, relating the size of cells to their topological shape. These relations are known empirically as Lewis's law in Botany, or Desch's relation in Metallurgy. Here, the functional form of the constraints is now known as a priori, and one takes advantage of this arbitrariness to increase the entropy further. The resulting structural equations of state are independent of priors, they are measurable experimentally and constitute therefore a direct test for the applicability of MaxEnt inferencemore » (given that the structure is in statistical equilibrium, a fact which can be tested by another simple relation (Aboav's law)). 23 refs., 2 figs., 1 tab.« less

Secure uniform random-number extraction via incoherent strategies

NASA Astrophysics Data System (ADS)

Hayashi, Masahito; Zhu, Huangjun

2018-01-01

To guarantee the security of uniform random numbers generated by a quantum random-number generator, we study secure extraction of uniform random numbers when the environment of a given quantum state is controlled by the third party, the eavesdropper. Here we restrict our operations to incoherent strategies that are composed of the measurement on the computational basis and incoherent operations (or incoherence-preserving operations). We show that the maximum secure extraction rate is equal to the relative entropy of coherence. By contrast, the coherence of formation gives the extraction rate when a certain constraint is imposed on the eavesdropper's operations. The condition under which the two extraction rates coincide is then determined. Furthermore, we find that the exponential decreasing rate of the leaked information is characterized by Rényi relative entropies of coherence. These results clarify the power of incoherent strategies in random-number generation, and can be applied to guarantee the quality of random numbers generated by a quantum random-number generator.

The Entropy of Non-Ergodic Complex Systems — a Derivation from First Principles

NASA Astrophysics Data System (ADS)

Thurner, Stefan; Hanel, Rudolf

In information theory the 4 Shannon-Khinchin1,2 (SK) axioms determine Boltzmann Gibbs entropy, S -∑i pilog pi, as the unique entropy. Physics is different from information in the sense that physical systems can be non-ergodic or non-Markovian. To characterize such strongly interacting, statistical systems - complex systems in particular - within a thermodynamical framework it might be necessary to introduce generalized entropies. A series of such entropies have been proposed in the past decades. Until now the understanding of their fundamental origin and their deeper relations to complex systems remains unclear. To clarify the situation we note that non-ergodicity explicitly violates the fourth SK axiom. We show that by relaxing this axiom the entropy generalizes to, S ∑i Γ(d + 1, 1 - c log pi), where Γ is the incomplete Gamma function, and c and d are scaling exponents. All recently proposed entropies compatible with the first 3 SK axioms appear to be special cases. We prove that each statistical system is uniquely characterized by the pair of the two scaling exponents (c, d), which defines equivalence classes for all systems. The corresponding distribution functions are special forms of Lambert-W exponentials containing, as special cases, Boltzmann, stretched exponential and Tsallis distributions (power-laws) - all widely abundant in nature. This derivation is the first ab initio justification for generalized entropies. We next show how the phasespace volume of a system is related to its generalized entropy, and provide a concise criterion when it is not of Boltzmann-Gibbs type but assumes a generalized form. We show that generalized entropies only become relevant when the dynamically (statistically) relevant fraction of degrees of freedom in a system vanishes in the thermodynamic limit. These are systems where the bulk of the degrees of freedom is frozen. Systems governed by generalized entropies are therefore systems whose phasespace volume effectively collapses to a lower-dimensional 'surface'. We explicitly illustrate the situation for accelerating random walks, and a spin system on a constant-conectancy network. We argue that generalized entropies should be relevant for self-organized critical systems such as sand piles, for spin systems which form meta-structures such as vortices, domains, instantons, etc., and for problems associated with anomalous diffusion.

Enthalpy-entropy compensation: the role of solvation.

PubMed

Dragan, Anatoliy I; Read, Christopher M; Crane-Robinson, Colyn

2017-05-01

Structural modifications to interacting systems frequently lead to changes in both the enthalpy (heat) and entropy of the process that compensate each other, so that the Gibbs free energy is little changed: a major barrier to the development of lead compounds in drug discovery. The conventional explanation for such enthalpy-entropy compensation (EEC) is that tighter contacts lead to a more negative enthalpy but increased molecular constraints, i.e., a compensating conformational entropy reduction. Changes in solvation can also contribute to EEC but this contribution is infrequently discussed. We review long-established and recent cases of EEC and conclude that the large fluctuations in enthalpy and entropy observed are too great to be a result of only conformational changes and must result, to a considerable degree, from variations in the amounts of water immobilized or released on forming complexes. Two systems exhibiting EEC show a correlation between calorimetric entropies and local mobilities, interpreted to mean conformational control of the binding entropy/free energy. However, a substantial contribution from solvation gives the same effect, as a consequence of a structural link between the amount of bound water and the protein flexibility. Only by assuming substantial changes in solvation-an intrinsically compensatory process-can a more complete understanding of EEC be obtained. Faced with such large, and compensating, changes in the enthalpies and entropies of binding, the best approach to engineering elevated affinities must be through the addition of ionic links, as they generate increased entropy without affecting the enthalpy.

Microscopic origin of entropy-driven polymorphism in hybrid organic-inorganic perovskite materials

NASA Astrophysics Data System (ADS)

Butler, Keith T.; Svane, Katrine; Kieslich, Gregor; Cheetham, Anthony K.; Walsh, Aron

2016-11-01

Entropy is a critical, but often overlooked, factor in determining the relative stabilities of crystal phases. The importance of entropy is most pronounced in softer materials, where small changes in free energy can drive phase transitions, which has recently been demonstrated in the case of organic-inorganic hybrid-formate perovskites. In this Rapid Communication we demonstrate the interplay between composition and crystal structure that is responsible for the particularly pronounced role of entropy in determining polymorphism in hybrid organic-inorganic materials. Using ab initio based lattice dynamics, we probe the origins and effects of vibrational entropy of four archetype perovskite (A B X3 ) structures. We consider an inorganic material (SrTiO3), an A -site hybrid-halide material (CH3NH3) PbI3 , a X -site hybrid material KSr (BH4)3 , and a mixed A - and X -site hybrid-formate material (N2H5) Zn (HCO2)3 , comparing the differences in entropy between two common polymorphs. The results demonstrate the importance of low-frequency intermolecular modes in determining the phase stability in these materials. The understanding gained allows us to propose a general principle for the relative stability of different polymorphs of hybrid materials as temperature is increased.

[Maximum entropy model versus remote sensing-based methods for extracting Oncomelania hupensis snail habitats].

PubMed

Cong-Cong, Xia; Cheng-Fang, Lu; Si, Li; Tie-Jun, Zhang; Sui-Heng, Lin; Yi, Hu; Ying, Liu; Zhi-Jie, Zhang

2016-12-02

To explore the technique of maximum entropy model for extracting Oncomelania hupensis snail habitats in Poyang Lake zone. The information of snail habitats and related environment factors collected in Poyang Lake zone were integrated to set up the maximum entropy based species model and generate snail habitats distribution map. Two Landsat 7 ETM+ remote sensing images of both wet and drought seasons in Poyang Lake zone were obtained, where the two indices of modified normalized difference water index (MNDWI) and normalized difference vegetation index (NDVI) were applied to extract snail habitats. The ROC curve, sensitivities and specificities were applied to assess their results. Furthermore, the importance of the variables for snail habitats was analyzed by using Jackknife approach. The evaluation results showed that the area under receiver operating characteristic curve (AUC) of testing data by the remote sensing-based method was only 0.56, and the sensitivity and specificity were 0.23 and 0.89 respectively. Nevertheless, those indices above-mentioned of maximum entropy model were 0.876, 0.89 and 0.74 respectively. The main concentration of snail habitats in Poyang Lake zone covered the northeast part of Yongxiu County, northwest of Yugan County, southwest of Poyang County and middle of Xinjian County, and the elevation was the most important environment variable affecting the distribution of snails, and the next was land surface temperature (LST). The maximum entropy model is more reliable and accurate than the remote sensing-based method for the sake of extracting snail habitats, which has certain guiding significance for the relevant departments to carry out measures to prevent and control high-risk snail habitats.

Optimality and inference in hydrology from entropy production considerations: synthetic hillslope numerical experiments

NASA Astrophysics Data System (ADS)

Kollet, S. J.

2015-05-01

In this study, entropy production optimization and inference principles are applied to a synthetic semi-arid hillslope in high-resolution, physics-based simulations. The results suggest that entropy or power is indeed maximized, because of the strong nonlinearity of variably saturated flow and competing processes related to soil moisture fluxes, the depletion of gradients, and the movement of a free water table. Thus, it appears that the maximum entropy production (MEP) principle may indeed be applicable to hydrologic systems. In the application to hydrologic system, the free water table constitutes an important degree of freedom in the optimization of entropy production and may also relate the theory to actual observations. In an ensuing analysis, an attempt is made to transfer the complex, "microscopic" hillslope model into a macroscopic model of reduced complexity using the MEP principle as an interference tool to obtain effective conductance coefficients and forces/gradients. The results demonstrate a new approach for the application of MEP to hydrologic systems and may form the basis for fruitful discussions and research in future.

Exploration of the Maximum Entropy/Optimal Projection Approach to Control Design Synthesis for Large Space Structures.

DTIC Science & Technology

1985-02-01

Energy Analysis , a branch of dynamic modal analysis developed for analyzing acoustic vibration problems, its present stage of development embodies a...Maximum Entropy Stochastic Modelling and Reduced-Order Design Synthesis is a rigorous new approach to this class of problems. Inspired by Statistical

Characterization of postural control deficit in whiplash patients by means of linear and nonlinear analyses - A pilot study.

PubMed

Madeleine, Pascal; Nielsen, Mogens; Arendt-Nielsen, Lars

2011-04-01

The ability to maintain balance is diminished in patients suffering from a whiplash injury. The aim of this study was to characterize the variability of postural control in patients with chronic whiplash injury. For this purpose, we analyzed static postural recordings from 11 whiplash patients and sex- and age-matched asymptomatic healthy volunteers. Static postural recordings were performed randomly with eyes open, eyes closed, and eyes open and speaking (dual task). Spatial-temporal changes of the center of pressure displacement were analyzed to assess the amplitude and structure of postural variability by computing, respectively, the standard deviation/coefficient of variation and sample entropy/fractal dimension of the time series. The amplitude of variability of the center of pressure was larger among whiplash patients compared with controls (P<0.001) while fractal dimension was lower (P<0.001). The sample entropy increased during both eyes closed and a simple dual task compared with eyes open (P<0.05). The analysis of postural control dynamics revealed increased amplitude of postural variability and decreased signal dimensionality related to the deficit in postural stability found in whiplash patients. Linear and nonlinear analyses can thus be helpful for the quantification of postural control in normal and pathological conditions. Copyright © 2010 Elsevier Ltd. All rights reserved.

Analytical design of intelligent machines

NASA Technical Reports Server (NTRS)

Saridis, George N.; Valavanis, Kimon P.

1987-01-01

The problem of designing 'intelligent machines' to operate in uncertain environments with minimum supervision or interaction with a human operator is examined. The structure of an 'intelligent machine' is defined to be the structure of a Hierarchically Intelligent Control System, composed of three levels hierarchically ordered according to the principle of 'increasing precision with decreasing intelligence', namely: the organizational level, performing general information processing tasks in association with a long-term memory; the coordination level, dealing with specific information processing tasks with a short-term memory; and the control level, which performs the execution of various tasks through hardware using feedback control methods. The behavior of such a machine may be managed by controls with special considerations and its 'intelligence' is directly related to the derivation of a compatible measure that associates the intelligence of the higher levels with the concept of entropy, which is a sufficient analytic measure that unifies the treatment of all the levels of an 'intelligent machine' as the mathematical problem of finding the right sequence of internal decisions and controls for a system structured in the order of intelligence and inverse order of precision such that it minimizes its total entropy. A case study on the automatic maintenance of a nuclear plant illustrates the proposed approach.

Strength training improves the tri-digit finger-pinch force control of older adults.

PubMed

Keogh, Justin W; Morrison, Steve; Barrett, Rod

2007-08-01

To investigate the effect of unilateral upper-limb strength training on the finger-pinch force control of older men. Pretest and post-test 6-week intervention study. Exercise science research laboratory. Eleven neurologically fit older men (age range, 70-80y). The strength training group (n=7) trained twice a week for 6 weeks, performing dumbbell bicep curls, wrist flexions, and wrists extensions, while the control group subjects (n=4) maintained their normal activities. Changes in force variability, targeting error, peak power frequency, proportional power, sample entropy, digit force sharing, and coupling relations were assessed during a series of finger-pinch tasks. These tasks involved maintaining a constant or sinusoidal force output at 20% and 40% of each subject's maximum voluntary contraction. All participants performed the finger-pinch tasks with both the preferred and nonpreferred limbs. Analysis of covariance for between-group change scores indicated that the strength training group (trained limb) experienced significantly greater reductions in finger-pinch force variability and targeting error, as well as significantly greater increases in finger-pinch force, sample entropy, bicep curl, and wrist flexion strength than did the control group. A nonspecific upper-limb strength-training program may improve the finger-pinch force control of older men.

Entropic nonadditivity, H theorem, and nonlinear Klein-Kramers equations.

PubMed

Dos Santos, M A F; Lenzi, E K

2017-11-01

We use the H theorem to establish the entropy and the entropic additivity law for a system composed of subsystems, with the dynamics governed by the Klein-Kramers equations, by considering relations among the dynamics of these subsystems and their entropies. We start considering the subsystems governed by linear Klein-Kramers equations and verify that the Boltzmann-Gibbs entropy is appropriated to this dynamics, leading us to the standard entropic additivity, S_{BG}^{(1∪2)}=S_{BG}^{1}+S_{BG}^{2}, consistent with the fact that the distributions of the subsystem are independent. We then extend the dynamics of these subsystems to independent nonlinear Klein-Kramers equations. For this case, the results show that the H theorem is verified for a generalized entropy, which does not preserve the standard entropic additivity for independent distributions. In this scenario, consistent results are obtained when a suitable coupling among the nonlinear Klein-Kramers equations is considered, in which each subsystem modifies the other until an equilibrium state is reached. This dynamics, for the subsystems, results in the Tsallis entropy for the system and, consequently, verifies the relation S_{q}^{(1∪2)}=S_{q}^{1}+S_{q}^{2}+(1-q)S_{q}^{1}S_{q}^{2}/k, which is a nonadditive entropic relation.

Respiration and heart rate complexity: Effects of age and gender assessed by band-limited transfer entropy

PubMed Central

Nemati, Shamim; Edwards, Bradley A.; Lee, Joon; Pittman-Polletta, Benjamin; Butler, James P.; Malhotra, Atul

2013-01-01

Aging and disease are accompanied with a reduction of complex variability in the temporal patterns of heart rate. This reduction has been attributed to a break down of the underlying regulatory feedback mechanisms that maintain a homeodynamic state. Previous work has established the utility of entropy as an index of disorder, for quantification of changes in heart rate complexity. However, questions remain regarding the origin of heart rate complexity and the mechanisms involved in its reduction with aging and disease. In this work we use a newly developed technique based on the concept of band-limited transfer entropy to assess the aging-related changes in contribution of respiration and blood pressure to entropy of heart rate at different frequency bands. Noninvasive measurements of heart beat interval, respiration, and systolic blood pressure were recorded from 20 young (21–34 years) and 20 older (68–85 years) healthy adults. Band-limited transfer entropy analysis revealed a reduction in high-frequency contribution of respiration to heart rate complexity (p < 0.001) with normal aging, particularly in men. These results have the potential for dissecting the relative contributions of respiration and blood pressure-related reflexes to heart rate complexity and their degeneration with normal aging. PMID:23811194

Informational temperature concept and the nature of self-organization

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lin, Shu-Kun

1996-12-31

Self-organization phenomena are spontaneous processes. Their behavior should be governed by the second law of thermodynamics. The dissipative structure theory of the Prigogine school of thermodynamics claims that {open_quotes}order out of chaos{close_quotes} through {open_quotes}self-organization{close_quotes} and challenges the validity of the second law of thermodynamics. Unfortunately this theory is questionable. Therefore we have to reconsider the related fundamental theoretical problems. Informational entropy (S) and information (I) are related by S = S{sub max} - I, where S{sub max} is the maximum informational entropy. This conforms with the broadly accepted definition that entropy is the information loss. As informational entropy concept hasmore » been proved to be useful, it will be convenient to define an informational temperature, T{sub I}. This can be related to energy E and the informational entropy S. Information registration is a process of {Delta}I > 0, or {Delta}S < 0, and involves the energetically excited states ({Delta}E > 0). Therefore, T{sub I} is negative, and has the opposite sign of the conventional thermodynamic temperature, T. This concept is useful for clarifying the concepts of {open_quotes}order{close_quotes} and {open_quotes}disorder{close_quotes} of static structures and characterizing many typical information loss processes of self-organization.« less

Diffusion imaging quality control via entropy of principal direction distribution.

PubMed

Farzinfar, Mahshid; Oguz, Ipek; Smith, Rachel G; Verde, Audrey R; Dietrich, Cheryl; Gupta, Aditya; Escolar, Maria L; Piven, Joseph; Pujol, Sonia; Vachet, Clement; Gouttard, Sylvain; Gerig, Guido; Dager, Stephen; McKinstry, Robert C; Paterson, Sarah; Evans, Alan C; Styner, Martin A

2013-11-15

Diffusion MR imaging has received increasing attention in the neuroimaging community, as it yields new insights into the microstructural organization of white matter that are not available with conventional MRI techniques. While the technology has enormous potential, diffusion MRI suffers from a unique and complex set of image quality problems, limiting the sensitivity of studies and reducing the accuracy of findings. Furthermore, the acquisition time for diffusion MRI is longer than conventional MRI due to the need for multiple acquisitions to obtain directionally encoded Diffusion Weighted Images (DWI). This leads to increased motion artifacts, reduced signal-to-noise ratio (SNR), and increased proneness to a wide variety of artifacts, including eddy-current and motion artifacts, "venetian blind" artifacts, as well as slice-wise and gradient-wise inconsistencies. Such artifacts mandate stringent Quality Control (QC) schemes in the processing of diffusion MRI data. Most existing QC procedures are conducted in the DWI domain and/or on a voxel level, but our own experiments show that these methods often do not fully detect and eliminate certain types of artifacts, often only visible when investigating groups of DWI's or a derived diffusion model, such as the most-employed diffusion tensor imaging (DTI). Here, we propose a novel regional QC measure in the DTI domain that employs the entropy of the regional distribution of the principal directions (PD). The PD entropy quantifies the scattering and spread of the principal diffusion directions and is invariant to the patient's position in the scanner. High entropy value indicates that the PDs are distributed relatively uniformly, while low entropy value indicates the presence of clusters in the PD distribution. The novel QC measure is intended to complement the existing set of QC procedures by detecting and correcting residual artifacts. Such residual artifacts cause directional bias in the measured PD and here called dominant direction artifacts. Experiments show that our automatic method can reliably detect and potentially correct such artifacts, especially the ones caused by the vibrations of the scanner table during the scan. The results further indicate the usefulness of this method for general quality assessment in DTI studies. Copyright © 2013 Elsevier Inc. All rights reserved.

Diffusion imaging quality control via entropy of principal direction distribution

PubMed Central

Oguz, Ipek; Smith, Rachel G.; Verde, Audrey R.; Dietrich, Cheryl; Gupta, Aditya; Escolar, Maria L.; Piven, Joseph; Pujol, Sonia; Vachet, Clement; Gouttard, Sylvain; Gerig, Guido; Dager, Stephen; McKinstry, Robert C.; Paterson, Sarah; Evans, Alan C.; Styner, Martin A.

2013-01-01

Diffusion MR imaging has received increasing attention in the neuroimaging community, as it yields new insights into the microstructural organization of white matter that are not available with conventional MRI techniques. While the technology has enormous potential, diffusion MRI suffers from a unique and complex set of image quality problems, limiting the sensitivity of studies and reducing the accuracy of findings. Furthermore, the acquisition time for diffusion MRI is longer than conventional MRI due to the need for multiple acquisitions to obtain directionally encoded Diffusion Weighted Images (DWI). This leads to increased motion artifacts, reduced signal-to-noise ratio (SNR), and increased proneness to a wide variety of artifacts, including eddy-current and motion artifacts, “venetian blind” artifacts, as well as slice-wise and gradient-wise inconsistencies. Such artifacts mandate stringent Quality Control (QC) schemes in the processing of diffusion MRI data. Most existing QC procedures are conducted in the DWI domain and/or on a voxel level, but our own experiments show that these methods often do not fully detect and eliminate certain types of artifacts, often only visible when investigating groups of DWI's or a derived diffusion model, such as the most-employed diffusion tensor imaging (DTI). Here, we propose a novel regional QC measure in the DTI domain that employs the entropy of the regional distribution of the principal directions (PD). The PD entropy quantifies the scattering and spread of the principal diffusion directions and is invariant to the patient's position in the scanner. High entropy value indicates that the PDs are distributed relatively uniformly, while low entropy value indicates the presence of clusters in the PD distribution. The novel QC measure is intended to complement the existing set of QC procedures by detecting and correcting residual artifacts. Such residual artifacts cause directional bias in the measured PD and here called dominant direction artifacts. Experiments show that our automatic method can reliably detect and potentially correct such artifacts, especially the ones caused by the vibrations of the scanner table during the scan. The results further indicate the usefulness of this method for general quality assessment in DTI studies. PMID:23684874

An estimator for the relative entropy rate of path measures for stochastic differential equations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Opper, Manfred, E-mail: manfred.opper@tu-berlin.de

2017-02-01

We address the problem of estimating the relative entropy rate (RER) for two stochastic processes described by stochastic differential equations. For the case where the drift of one process is known analytically, but one has only observations from the second process, we use a variational bound on the RER to construct an estimator.

Effect of Chunk Strength on the Performance of Children with Developmental Dyslexia on Artificial Grammar Learning Task May Be Related to Complexity

ERIC Educational Resources Information Center

Schiff, Rachel; Katan, Pesia; Sasson, Ayelet; Kahta, Shani

2017-01-01

There is a long held view that chunks play a crucial role in artificial grammar learning performance. We compared chunk strength influences on performance, in high and low topological entropy (a measure of complexity) grammar systems, with dyslexic children, age-matched and reading-level-matched control participants. Findings show that age-matched…

Sort entropy-based for the analysis of EEG during anesthesia

NASA Astrophysics Data System (ADS)

Ma, Liang; Huang, Wei-Zhi

2010-08-01

The monitoring of anesthetic depth is an absolutely necessary procedure in the process of surgical operation. To judge and control the depth of anesthesia has become a clinical issue which should be resolved urgently. EEG collected wiil be processed by sort entrop in this paper. Signal response of the surface of the cerebral cortex is determined for different stages of patients in the course of anesthesia. EEG is simulated and analyzed through the fast algorithm of sort entropy. The results show that discipline of phasic changes for EEG is very detected accurately,and it has better noise immunity in detecting the EEG anaesthetized than approximate entropy. In conclusion,the computing of Sort entropy algorithm requires shorter time. It has high efficiency and strong anti-interference.

Reply to "Comment on 'Quantum Kaniadakis entropy under projective measurement' ".

PubMed

Ourabah, Kamel; Tribeche, Mouloud

2016-08-01

We rely on our proof of the nondecreasing character of quantum Kaniadakis entropy under projective measurement [Phys. Rev. E 92, 032114 (2015)PLEEE81539-375510.1103/PhysRevE.92.032114], and we put it into perspective with the results of Bosyk et al. [Quantum Inf Process 15, 3393 (2016)10.1007/s11128-016-1329-5]. Our method, adopted for the proof that Kaniadakis entropy does not decrease under a projective measurement, is based on Jensen's inequalities, while the method proposed by the authors of the Comment represents another alternative and clearly correct method to prove the same thing. Furthermore, we clarify that our interest in Kaniadakis entropy is due to the fact that this entropy has a transparent physical significance, emerging within the special relativity.

Applications of quantum entropy to statistics

NASA Astrophysics Data System (ADS)

Silver, R. N.; Martz, H. F.

This paper develops two generalizations of the maximum entropy (ME) principle. First, Shannon classical entropy is replaced by von Neumann quantum entropy to yield a broader class of information divergences (or penalty functions) for statistics applications. Negative relative quantum entropy enforces convexity, positivity, non-local extensivity and prior correlations such as smoothness. This enables the extension of ME methods from their traditional domain of ill-posed in-verse problems to new applications such as non-parametric density estimation. Second, given a choice of information divergence, a combination of ME and Bayes rule is used to assign both prior and posterior probabilities. Hyperparameters are interpreted as Lagrange multipliers enforcing constraints. Conservation principles are proposed to act statistical regularization and other hyperparameters, such as conservation of information and smoothness. ME provides an alternative to hierarchical Bayes methods.

Entropy density of an adiabatic relativistic Bose-Einstein condensate star

DOE Office of Scientific and Technical Information (OSTI.GOV)

Khaidir, Ahmad Firdaus; Kassim, Hasan Abu; Yusof, Norhasliza

Inspired by recent works, we investigate how the thermodynamics parameters (entropy, temperature, number density, energy density, etc) of Bose-Einstein Condensate star scale with the structure of the star. Below the critical temperature in which the condensation starts to occur, we study how the entropy behaves with varying temperature till it reaches its own stability against gravitational collapse and singularity. Compared to photon gases (pressure is described by radiation) where the chemical potential, μ is zero, entropy of photon gases obeys the Stefan-Boltzmann Law for a small values of T while forming a spiral structure for a large values of Tmore » due to general relativity. The entropy density of Bose-Einstein Condensate is obtained following the similar sequence but limited under critical temperature condition. We adopt the scalar field equation of state in Thomas-Fermi limit to study the characteristics of relativistic Bose-Einstein condensate under varying temperature and entropy. Finally, we obtain the entropy density proportional to (σT{sup 3}-3T) which obeys the Stefan-Boltzmann Law in ultra-relativistic condition.« less

All the entropies on the light-cone

NASA Astrophysics Data System (ADS)

Casini, Horacio; Testé, Eduardo; Torroba, Gonzalo

2018-05-01

We determine the explicit universal form of the entanglement and Renyi entropies, for regions with arbitrary boundary on a null plane or the light-cone. All the entropies are shown to saturate the strong subadditive inequality. This Renyi Markov property implies that the vacuum behaves like a product state. For the null plane, our analysis applies to general quantum field theories, and we show that the entropies do not depend on the region. For the light-cone, our approach is restricted to conformal field theories. In this case, the construction of the entropies is related to dilaton effective actions in two less dimensions. In particular, the universal logarithmic term in the entanglement entropy arises from a Wess-Zumino anomaly action. We also consider these properties in theories with holographic duals, for which we construct the minimal area surfaces for arbitrary shapes on the light-cone. We recover the Markov property and the universal form of the entropy, and argue that these properties continue to hold upon including stringy and quantum corrections. We end with some remarks on the recently proved entropic a-theorem in four spacetime dimensions.

Entanglement entropy in critical phenomena and analog models of quantum gravity

NASA Astrophysics Data System (ADS)

Fursaev, Dmitri V.

2006-06-01

A general geometrical structure of the entanglement entropy for spatial partition of a relativistic QFT system is established by using methods of the effective gravity action and the spectral geometry. A special attention is payed to the subleading terms in the entropy in different dimensions and to behavior in different states. It is conjectured, on the base of relation between the entropy and the action, that in a fundamental theory the ground state entanglement entropy per unit area equals 1/(4GN), where GN is the Newton constant in the low-energy gravity sector of the theory. The conjecture opens a new avenue in analogue gravity models. For instance, in higher-dimensional condensed matter systems, which near a critical point are described by relativistic QFT’s, the entanglement entropy density defines an effective gravitational coupling. By studying the properties of this constant one can get new insights in quantum gravity phenomena, such as the universality of the low-energy physics, the renormalization group behavior of GN, the statistical meaning of the Bekenstein-Hawking entropy.

Using Link Disconnection Entropy Disorder to Detect Fast Moving Nodes in MANETs.

PubMed

Alvarez, Carlos F; Palafox, Luis E; Aguilar, Leocundo; Sanchez, Mauricio A; Martinez, Luis G

2016-01-01

Mobile ad-hoc networks (MANETs) are dynamic by nature; this dynamism comes from node mobility, traffic congestion, and other transmission conditions. Metrics to evaluate the effects of those conditions shine a light on node's behavior in an ad-hoc network, helping to identify the node or nodes with better conditions of connection. In this paper, we propose a relative index to evaluate a single node reliability, based on the link disconnection entropy disorder using neighboring nodes as reference. Link disconnection entropy disorder is best used to identify fast moving nodes or nodes with unstable communications, this without the need of specialized sensors such as GPS. Several scenarios were studied to verify the index, measuring the effects of Speed and traffic density on the link disconnection entropy disorder. Packet delivery ratio is associated to the metric detecting a strong relationship, enabling the use of the link disconnection entropy disorder to evaluate the stability of a node to communicate with other nodes. To expand the utilization of the link entropy disorder, we identified nodes with higher speeds in network simulations just by using the link entropy disorder.

Cleavage Entropy as Quantitative Measure of Protease Specificity

PubMed Central

Fuchs, Julian E.; von Grafenstein, Susanne; Huber, Roland G.; Margreiter, Michael A.; Spitzer, Gudrun M.; Wallnoefer, Hannes G.; Liedl, Klaus R.

2013-01-01

A purely information theory-guided approach to quantitatively characterize protease specificity is established. We calculate an entropy value for each protease subpocket based on sequences of cleaved substrates extracted from the MEROPS database. We compare our results with known subpocket specificity profiles for individual proteases and protease groups (e.g. serine proteases, metallo proteases) and reflect them quantitatively. Summation of subpocket-wise cleavage entropy contributions yields a measure for overall protease substrate specificity. This total cleavage entropy allows ranking of different proteases with respect to their specificity, separating unspecific digestive enzymes showing high total cleavage entropy from specific proteases involved in signaling cascades. The development of a quantitative cleavage entropy score allows an unbiased comparison of subpocket-wise and overall protease specificity. Thus, it enables assessment of relative importance of physicochemical and structural descriptors in protease recognition. We present an exemplary application of cleavage entropy in tracing substrate specificity in protease evolution. This highlights the wide range of substrate promiscuity within homologue proteases and hence the heavy impact of a limited number of mutations on individual substrate specificity. PMID:23637583

Higher Curvature Gravity from Entanglement in Conformal Field Theories.

PubMed

Haehl, Felix M; Hijano, Eliot; Parrikar, Onkar; Rabideau, Charles

2018-05-18

By generalizing different recent works to the context of higher curvature gravity, we provide a unifying framework for three related results: (i) If an asymptotically anti-de Sitter (AdS) spacetime computes the entanglement entropies of ball-shaped regions in a conformal field theory using a generalized Ryu-Takayanagi formula up to second order in state deformations around the vacuum, then the spacetime satisfies the correct gravitational equations of motion up to second order around the AdS background. (ii) The holographic dual of entanglement entropy in higher curvature theories of gravity is given by the Wald entropy plus a particular correction term involving extrinsic curvatures. (iii) Conformal field theory relative entropy is dual to gravitational canonical energy (also in higher curvature theories of gravity). Especially for the second point, our novel derivation of this previously known statement does not involve the Euclidean replica trick.

Higher Curvature Gravity from Entanglement in Conformal Field Theories

NASA Astrophysics Data System (ADS)

Haehl, Felix M.; Hijano, Eliot; Parrikar, Onkar; Rabideau, Charles

2018-05-01

By generalizing different recent works to the context of higher curvature gravity, we provide a unifying framework for three related results: (i) If an asymptotically anti-de Sitter (AdS) spacetime computes the entanglement entropies of ball-shaped regions in a conformal field theory using a generalized Ryu-Takayanagi formula up to second order in state deformations around the vacuum, then the spacetime satisfies the correct gravitational equations of motion up to second order around the AdS background. (ii) The holographic dual of entanglement entropy in higher curvature theories of gravity is given by the Wald entropy plus a particular correction term involving extrinsic curvatures. (iii) Conformal field theory relative entropy is dual to gravitational canonical energy (also in higher curvature theories of gravity). Especially for the second point, our novel derivation of this previously known statement does not involve the Euclidean replica trick.

Hawking radiation and entropy of a black hole in Lovelock-Born-Infeld gravity from the quantum tunneling approach

NASA Astrophysics Data System (ADS)

Li, Gu-Qiang

2017-04-01

The tunneling radiation of particles from black holes in Lovelock-Born-Infeld (LBI) gravity is studied by using the Parikh-Wilczek (PW) method, and the emission rate of a particle is calculated. It is shown that the emission spectrum deviates from the purely thermal spectrum but is consistent with an underlying unitary theory. Compared to the conventional tunneling rate related to the increment of black hole entropy, the entropy of the black hole in LBI gravity is obtained. The entropy does not obey the area law unless all the Lovelock coefficients equal zero, but it satisfies the first law of thermodynamics and is in accordance with earlier results. It is distinctly shown that the PW tunneling framework is related to the thermodynamic laws of the black hole. Supported by Guangdong Natural Science Foundation (2016A030307051, 2015A030313789)

On extremals of the entropy production by ‘Langevin-Kramers’ dynamics

NASA Astrophysics Data System (ADS)

Muratore-Ginanneschi, Paolo

2014-05-01

We refer as ‘Langevin-Kramers’ dynamics to a class of stochastic differential systems exhibiting a degenerate ‘metriplectic’ structure. This means that the drift field can be decomposed into a symplectic and a gradient-like component with respect to a pseudo-metric tensor associated with random fluctuations affecting increments of only a sub-set of the degrees of freedom. Systems in this class are often encountered in applications as elementary models of Hamiltonian dynamics in a heat bath eventually relaxing to a Boltzmann steady state. Entropy production control in Langevin-Kramers models differs from the now well-understood case of Langevin-Smoluchowski dynamics for two reasons. First, the definition of entropy production stemming from fluctuation theorems specifies a cost functional which does not act coercively on all degrees of freedom of control protocols. Second, the presence of a symplectic structure imposes a non-local constraint on the class of admissible controls. Using Pontryagin control theory and restricting the attention to additive noise, we show that smooth protocols attaining extremal values of the entropy production appear generically in continuous parametric families as a consequence of a trade-off between smoothness of the admissible protocols and non-coercivity of the cost functional. Uniqueness is, however, always recovered in the over-damped limit as extremal equations reduce at leading order to the Monge-Ampère-Kantorovich optimal mass-transport equations.

Brain entropy and human intelligence: A resting-state fMRI study

PubMed Central

Calderone, Daniel; Morales, Leah J.

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns. PMID:29432427

Brain entropy and human intelligence: A resting-state fMRI study.

PubMed

Saxe, Glenn N; Calderone, Daniel; Morales, Leah J

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns.

Entropy Production and Fluctuation Theorems for Active Matter

NASA Astrophysics Data System (ADS)

Mandal, Dibyendu; Klymko, Katherine; DeWeese, Michael R.

2017-12-01

Active biological systems reside far from equilibrium, dissipating heat even in their steady state, thus requiring an extension of conventional equilibrium thermodynamics and statistical mechanics. In this Letter, we have extended the emerging framework of stochastic thermodynamics to active matter. In particular, for the active Ornstein-Uhlenbeck model, we have provided consistent definitions of thermodynamic quantities such as work, energy, heat, entropy, and entropy production at the level of single, stochastic trajectories and derived related fluctuation relations. We have developed a generalization of the Clausius inequality, which is valid even in the presence of the non-Hamiltonian dynamics underlying active matter systems. We have illustrated our results with explicit numerical studies.

Topological nearly entropy

NASA Astrophysics Data System (ADS)

Gulamsarwar, Syazwani; Salleh, Zabidin

2017-08-01

The purpose of this paper is to generalize the notions of Adler's topological entropy along with their several fundamental properties. A function f : X → Y is said to be R-map if f-1 (V) is regular open in X for every regular open set V in Y. Thus, we initiated a notion of topological nearly entropy for topological R-dynamical systems which is based on nearly compact relative to the space by using R-map.

Entropy and complexity analysis of hydrogenic Rydberg atoms

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lopez-Rosa, S.; Departamento de Fisica Aplicada II, Universidad de Sevilla, 41012-Sevilla; Toranzo, I. V.

The internal disorder of hydrogenic Rydberg atoms as contained in their position and momentum probability densities is examined by means of the following information-theoretic spreading quantities: the radial and logarithmic expectation values, the Shannon entropy, and the Fisher information. As well, the complexity measures of Cramer-Rao, Fisher-Shannon, and Lopez Ruiz-Mancini-Calvet types are investigated in both reciprocal spaces. The leading term of these quantities is rigorously calculated by use of the asymptotic properties of the concomitant entropic functionals of the Laguerre and Gegenbauer orthogonal polynomials which control the wavefunctions of the Rydberg states in both position and momentum spaces. The associatedmore » generalized Heisenberg-like, logarithmic and entropic uncertainty relations are also given. Finally, application to linear (l= 0), circular (l=n- 1), and quasicircular (l=n- 2) states is explicitly done.« less

Local entropy difference upon a substrate binding of a psychrophilic α-amylase and a mesophilic homologue

NASA Astrophysics Data System (ADS)

Kosugi, Takahiro; Hayashi, Shigehiko

2011-01-01

Psychrophilic α-amylase from the antarctic bacterium pseudoalteromonashaloplanktis (AHA) and its mesophilic homologue, porcine pancreatic α-amylase (PPA) are theoretically investigated with molecular dynamics (MD) simulations. We carried out 240-ns MD simulations for four systems, AHA and PPA with/without the bound substrate, and examined protein conformational entropy changes upon the substrate binding. We developed an analysis that decomposes the entropy changes into contributions of individual amino acids, and successfully identified protein regions responsible for the entropy changes. The results provide a molecular insight into the structural flexibilities of those enzymes related to the temperature dependences of the enzymatic activity.

The Shannon entropy as a measure of diffusion in multidimensional dynamical systems

NASA Astrophysics Data System (ADS)

Giordano, C. M.; Cincotta, P. M.

2018-05-01

In the present work, we introduce two new estimators of chaotic diffusion based on the Shannon entropy. Using theoretical, heuristic and numerical arguments, we show that the entropy, S, provides a measure of the diffusion extent of a given small initial ensemble of orbits, while an indicator related with the time derivative of the entropy, S', estimates the diffusion rate. We show that in the limiting case of near ergodicity, after an appropriate normalization, S' coincides with the standard homogeneous diffusion coefficient. The very first application of this formulation to a 4D symplectic map and to the Arnold Hamiltonian reveals very successful and encouraging results.

Charged Rényi entropies in CFTs with Einstein-Gauss-Bonnet holographic duals

NASA Astrophysics Data System (ADS)

Pastras, Georgios; Manolopoulos, Dimitrios

2014-11-01

We calculate the Rényi entropy S q ( μ, λ), for spherical entangling surfaces in CFT's with Einstein-Gauss-Bonnet-Maxwell holographic duals. Rényi entropies must obey some interesting inequalities by definition. However, for Gauss-Bonnet couplings λ, larger than specific value, but still allowed by causality, we observe a violation of the inequality , which is related to the existence of negative entropy black holes, providing interesting restrictions in the bulk theory. Moreover, we find an interesting distinction of the behaviour of the analytic continuation of S q ( μ, λ) for imaginary chemical potential, between negative and non-negative λ.

Continuous time wavelet entropy of auditory evoked potentials.

PubMed

Cek, M Emre; Ozgoren, Murat; Savaci, F Acar

2010-01-01

In this paper, the continuous time wavelet entropy (CTWE) of auditory evoked potentials (AEP) has been characterized by evaluating the relative wavelet energies (RWE) in specified EEG frequency bands. Thus, the rapid variations of CTWE due to the auditory stimulation could be detected in post-stimulus time interval. This approach removes the probability of missing the information hidden in short time intervals. The discrete time and continuous time wavelet based wavelet entropy variations were compared on non-target and target AEP data. It was observed that CTWE can also be an alternative method to analyze entropy as a function of time. 2009 Elsevier Ltd. All rights reserved.

Formulating the shear stress distribution in circular open channels based on the Renyi entropy

NASA Astrophysics Data System (ADS)

Khozani, Zohreh Sheikh; Bonakdari, Hossein

2018-01-01

The principle of maximum entropy is employed to derive the shear stress distribution by maximizing the Renyi entropy subject to some constraints and by assuming that dimensionless shear stress is a random variable. A Renyi entropy-based equation can be used to model the shear stress distribution along the entire wetted perimeter of circular channels and circular channels with flat beds and deposited sediments. A wide range of experimental results for 12 hydraulic conditions with different Froude numbers (0.375 to 1.71) and flow depths (20.3 to 201.5 mm) were used to validate the derived shear stress distribution. For circular channels, model performance enhanced with increasing flow depth (mean relative error (RE) of 0.0414) and only deteriorated slightly at the greatest flow depth (RE of 0.0573). For circular channels with flat beds, the Renyi entropy model predicted the shear stress distribution well at lower sediment depth. The Renyi entropy model results were also compared with Shannon entropy model results. Both models performed well for circular channels, but for circular channels with flat beds the Renyi entropy model displayed superior performance in estimating the shear stress distribution. The Renyi entropy model was highly precise and predicted the shear stress distribution in a circular channel with RE of 0.0480 and in a circular channel with a flat bed with RE of 0.0488.

An entropy-based statistic for genomewide association studies.

PubMed

Zhao, Jinying; Boerwinkle, Eric; Xiong, Momiao

2005-07-01

Efficient genotyping methods and the availability of a large collection of single-nucleotide polymorphisms provide valuable tools for genetic studies of human disease. The standard chi2 statistic for case-control studies, which uses a linear function of allele frequencies, has limited power when the number of marker loci is large. We introduce a novel test statistic for genetic association studies that uses Shannon entropy and a nonlinear function of allele frequencies to amplify the differences in allele and haplotype frequencies to maintain statistical power with large numbers of marker loci. We investigate the relationship between the entropy-based test statistic and the standard chi2 statistic and show that, in most cases, the power of the entropy-based statistic is greater than that of the standard chi2 statistic. The distribution of the entropy-based statistic and the type I error rates are validated using simulation studies. Finally, we apply the new entropy-based test statistic to two real data sets, one for the COMT gene and schizophrenia and one for the MMP-2 gene and esophageal carcinoma, to evaluate the performance of the new method for genetic association studies. The results show that the entropy-based statistic obtained smaller P values than did the standard chi2 statistic.

Antipsychotics reverse abnormal EEG complexity in drug-naïve schizophrenia: A multiscale entropy analysis

PubMed Central

Takahashi, Tetsuya; Cho, Raymond Y.; Mizuno, Tomoyuki; Kikuchi, Mitsuru; Murata, Tetsuhito; Takahashi, Koichi; Wada, Yuji

2010-01-01

Multiscale entropy (MSE) analysis is a novel entropy-based approach for measuring dynamical complexity in physiological systems over a range of temporal scales. To evaluate this analytic approach as an aid to elucidating the pathophysiologic mechanisms in schizophrenia, we examined MSE in EEG activity in drug-naïve schizophrenia subjects pre- and post-treatment with antipsychotics in comparison with traditional EEG analysis. We recorded eyes-closed resting state EEG from frontal, temporal, parietal and occipital regions in drug-naïve 22 schizophrenia and 24 age-matched healthy control subjects. Fifteen patients were re-evaluated within 2–8 weeks after the initiation of antipsychotic treatment. For each participant, MSE was calculated on one continuous 60 second epoch for each experimental session. Schizophrenia subjects showed significantly higher complexity at higher time scales (lower frequencies), than that of healthy controls in fronto-centro-temporal, but not in parieto-occipital regions. Post-treatment, this higher complexity decreased to healthy control subject levels selectively in fronto-central regions, while the increased complexity in temporal sites remained higher. Comparative power analysis identified spectral slowing in frontal regions in pre-treatment schizophrenia subjects, consistent with previous findings, whereas no antipsychotic treatment effect was observed. In summary, multiscale entropy measures identified abnormal dynamical EEG signal complexity in anterior brain areas in schizophrenia that normalized selectively in fronto-central areas with antipsychotic treatment. These findings show that entropy-based analytic methods may serve as a novel approach for characterizing and understanding abnormal cortical dynamics in schizophrenia, and elucidating the therapeutic mechanisms of antipsychotics. PMID:20149880

Heat capacty, relative enthalpy, and calorimetric entropy of silicate minerals: an empirical method of prediction.

USGS Publications Warehouse

Robinson, G.R.; Haas, J.L.

1983-01-01

Through the evaluation of experimental calorimetric data and estimates of the molar isobaric heat capacities, relative enthalpies and entropies of constituent oxides, a procedure for predicting the thermodynamic properties of silicates is developed. Estimates of the accuracy and precision of the technique and examples of its application are also presented. -J.A.Z.

Safety Assessment of Dangerous Goods Transport Enterprise Based on the Relative Entropy Aggregation in Group Decision Making Model

PubMed Central

Wu, Jun; Li, Chengbing; Huo, Yueying

2014-01-01

Safety of dangerous goods transport is directly related to the operation safety of dangerous goods transport enterprise. Aiming at the problem of the high accident rate and large harm in dangerous goods logistics transportation, this paper took the group decision making problem based on integration and coordination thought into a multiagent multiobjective group decision making problem; a secondary decision model was established and applied to the safety assessment of dangerous goods transport enterprise. First of all, we used dynamic multivalue background and entropy theory building the first level multiobjective decision model. Secondly, experts were to empower according to the principle of clustering analysis, and combining with the relative entropy theory to establish a secondary rally optimization model based on relative entropy in group decision making, and discuss the solution of the model. Then, after investigation and analysis, we establish the dangerous goods transport enterprise safety evaluation index system. Finally, case analysis to five dangerous goods transport enterprises in the Inner Mongolia Autonomous Region validates the feasibility and effectiveness of this model for dangerous goods transport enterprise recognition, which provides vital decision making basis for recognizing the dangerous goods transport enterprises. PMID:25477954

Safety assessment of dangerous goods transport enterprise based on the relative entropy aggregation in group decision making model.

PubMed

Wu, Jun; Li, Chengbing; Huo, Yueying

2014-01-01

Safety of dangerous goods transport is directly related to the operation safety of dangerous goods transport enterprise. Aiming at the problem of the high accident rate and large harm in dangerous goods logistics transportation, this paper took the group decision making problem based on integration and coordination thought into a multiagent multiobjective group decision making problem; a secondary decision model was established and applied to the safety assessment of dangerous goods transport enterprise. First of all, we used dynamic multivalue background and entropy theory building the first level multiobjective decision model. Secondly, experts were to empower according to the principle of clustering analysis, and combining with the relative entropy theory to establish a secondary rally optimization model based on relative entropy in group decision making, and discuss the solution of the model. Then, after investigation and analysis, we establish the dangerous goods transport enterprise safety evaluation index system. Finally, case analysis to five dangerous goods transport enterprises in the Inner Mongolia Autonomous Region validates the feasibility and effectiveness of this model for dangerous goods transport enterprise recognition, which provides vital decision making basis for recognizing the dangerous goods transport enterprises.

The Role of the Total Entropy Production in the Dynamics of Open Quantum Systems in Detection of Non-Markovianity

NASA Astrophysics Data System (ADS)

Salimi, S.; Haseli, S.; Khorashad, A. S.; Adabi, F.

2016-09-01

The interaction between system and environment is a fundamental concept in the theory of open quantum systems. As a result of the interaction, an amount of correlation (both classical and quantum) emerges between the system and the environment. In this work, we recall the quantity that will be very useful to describe the emergence of the correlation between the system and the environment, namely, the total entropy production. Appearance of total entropy production is due to the entanglement production between the system and the environment. In this work, we discuss about the role of the total entropy production for detecting the non-Markovianity. By utilizing the relation between the total entropy production and total correlation between subsystems, one can see a temporary decrease of total entropy production is a signature of non-Markovianity. We apply our criterion for the special case, where the composite system has initial correlation with environment.

Good Use of a `Bad' Metaphor. Entropy as Disorder

NASA Astrophysics Data System (ADS)

Haglund, Jesper

2017-05-01

Entropy is often introduced to students through the use of the disorder metaphor. However, many weaknesses and limitations of this metaphor have been identified, and it has therefore been argued that it is more harmful than useful in teaching. For instance, under the influence of the disorder metaphor, students tend to focus on spatial configuration with regard to entropy but disregard the role of energy, which may lead their intuition astray in problem solving. Albeit so, a review of research of students' ideas about entropy in relation to the disorder metaphor shows that students can use the metaphor in developing a more nuanced, complex view of the concept, by connecting entropy as disorder to other concepts such as microstates and spreading. The disorder metaphor—in combination with other explanatory approaches—can be used as a resource for learning, in giving students an early flavour of what entropy means, so long as we acknowledge its limitations; we can put this "bad" metaphor to good use in teaching.

Competition between conceptual relations affects compound recognition: the role of entropy.

PubMed

Schmidtke, Daniel; Kuperman, Victor; Gagné, Christina L; Spalding, Thomas L

2016-04-01

Previous research has suggested that the conceptual representation of a compound is based on a relational structure linking the compound's constituents. Existing accounts of the visual recognition of modifier-head or noun-noun compounds posit that the process involves the selection of a relational structure out of a set of competing relational structures associated with the same compound. In this article, we employ the information-theoretic metric of entropy to gauge relational competition and investigate its effect on the visual identification of established English compounds. The data from two lexical decision megastudies indicates that greater entropy (i.e., increased competition) in a set of conceptual relations associated with a compound is associated with longer lexical decision latencies. This finding indicates that there exists competition between potential meanings associated with the same complex word form. We provide empirical support for conceptual composition during compound word processing in a model that incorporates the effect of the integration of co-activated and competing relational information.

Multidimensional entropic uncertainty relation based on a commutator matrix in position and momentum spaces

NASA Astrophysics Data System (ADS)

Hertz, Anaelle; Vanbever, Luc; Cerf, Nicolas J.

2018-01-01

The uncertainty relation for continuous variables due to Byałinicki-Birula and Mycielski [I. Białynicki-Birula and J. Mycielski, Commun. Math. Phys. 44, 129 (1975), 10.1007/BF01608825] expresses the complementarity between two n -tuples of canonically conjugate variables (x1,x2,...,xn) and (p1,p2,...,pn) in terms of Shannon differential entropy. Here we consider the generalization to variables that are not canonically conjugate and derive an entropic uncertainty relation expressing the balance between any two n -variable Gaussian projective measurements. The bound on entropies is expressed in terms of the determinant of a matrix of commutators between the measured variables. This uncertainty relation also captures the complementarity between any two incompatible linear canonical transforms, the bound being written in terms of the corresponding symplectic matrices in phase space. Finally, we extend this uncertainty relation to Rényi entropies and also prove a covariance-based uncertainty relation which generalizes the Robertson relation.

Spectral Variability in the Aged Brain during Fine Motor Control

PubMed Central

Quandt, Fanny; Bönstrup, Marlene; Schulz, Robert; Timmermann, Jan E.; Zimerman, Maximo; Nolte, Guido; Hummel, Friedhelm C.

2016-01-01

Physiological aging is paralleled by a decline of fine motor skills accompanied by structural and functional alterations of the underlying brain network. Here, we aim to investigate age-related changes in the spectral distribution of neuronal oscillations during fine skilled motor function. We employ the concept of spectral entropy in order to describe the flatness and peaked-ness of a frequency spectrum to quantify changes in the spectral distribution of the oscillatory motor response in the aged brain. Electroencephalogram was recorded in elderly (n = 32) and young (n = 34) participants who performed either a cued finger movement or a pinch or a whole hand grip task with their dominant right hand. Whereas young participant showed distinct, well-defined movement-related power decreases in the alpha and upper beta band, elderly participants exhibited a flat broadband, frequency-unspecific power desynchronization. This broadband response was reflected by an increase of spectral entropy over sensorimotor and frontal areas in the aged brain. Neuronal activation patterns differed between motor tasks in the young brain, while the aged brain showed a similar activation pattern in all tasks. Moreover, we found a wider recruitment of the cortical motor network in the aged brain. The present study adds to the understanding of age-related changes of neural coding during skilled motor behavior, revealing a less predictable signal with great variability across frequencies in a wide cortical motor network in the aged brain. The increase in entropy in the aged brain could be a reflection of random noise-like activity or could represent a compensatory mechanism that serves a functional role. PMID:28066231

Effect of neuromuscular blockade reversal by pyridostigmine on spectral entropy values during recovery from desflurane anesthesia: a prospective, randomized, double-blind, controlled trial.

PubMed

Kim, Eugene; Ryu, Jae Hun; Byun, Sung Hye

2016-06-01

According to several studies investigating the relationship between muscle activity and electroencephalogram results, reversal of neuromuscular blockade (NMB) may affect depth of anesthesia indices. Therefore, we investigated the effect of pyridostigmine on these indices via spectral entropy. Fifty-six patients scheduled for thyroidectomy or parotidectomy were included in this study and randomized into two groups. At the start of skin suturing, the desflurane concentration was adjusted to 4.2 vol% in both groups. Following this, the pyridostigmine group (group P, n = 28) was administered pyridostigmine 0.2 mg/kg mixed with glycopyrrolate 0.04 mg/kg, while the control group (group C, n = 28) received normal saline. Entropy values (response entropy [RE] and state entropy [SE]), train of four (TOF) ratio, and end-tidal desflurane concentration were recorded from point of drug administration to 15 minutes post-drug administration. Mean RE values at 15 minutes, when the maximum effect of pyridostigmine was anticipated, showed a statistically significant difference between groups (53.8 ± 10.5 in group P and 48.0 ± 8.8 in group C; P = 0.030). However, mean SE at 15 minutes showed no significant difference between the two groups (P = 0.066). At 15 minutes, there were significant differences in the TOF ratio between the two groups (P < 0.001). NMB reversal by pyridostigmine significantly increased RE values but not SE values. This finding suggests that spectral entropy may be a useful alternative tool for monitoring anesthetic depth during recovery from anesthesia in the presence of electromyogram activity.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bialynicki-Birula, Iwo

Quantum-mechanical uncertainty relations for position and momentum are expressed in the form of inequalities involving the Renyi entropies. The proof of these inequalities requires the use of the exact expression for the (p,q)-norm of the Fourier transformation derived by Babenko and Beckner. Analogous uncertainty relations are derived for angle and angular momentum and also for a pair of complementary observables in N-level systems. All these uncertainty relations become more attractive when expressed in terms of the symmetrized Renyi entropies.

Client-controlled case information: a general system theory perspective.

PubMed

Fitch, Dale

2004-07-01

The author proposes a model for client control of case information via the World Wide Web built on principles of general system theory. It incorporates the client into the design, resulting in an information structure that differs from traditional human services information-sharing practices. Referencing general system theory, the concepts of controller and controlled system, as well as entropy and negentropy, are applied to the information flow and autopoietic behavior as they relate to the boundary-maintaining functions of today's organizations. The author's conclusions synthesize general system theory and human services values to lay the foundation for an information-sharing framework for human services in the 21st century.

Mixing times towards demographic equilibrium in insect populations with temperature variable age structures.

PubMed

Damos, Petros

2015-08-01

In this study, we use entropy related mixing rate modules to measure the effects of temperature on insect population stability and demographic breakdown. The uncertainty in the age of the mother of a randomly chosen newborn, and how it is moved after a finite act of time steps, is modeled using a stochastic transformation of the Leslie matrix. Age classes are represented as a cycle graph and its transitions towards the stable age distribution are brought forth as an exact Markov chain. The dynamics of divergence, from a non equilibrium state towards equilibrium, are evaluated using the Kolmogorov-Sinai entropy. Moreover, Kullback-Leibler distance is applied as information-theoretic measure to estimate exact mixing times of age transitions probabilities towards equilibrium. Using empirically data, we show that on the initial conditions and simulated projection's trough time, that population entropy can effectively be applied to detect demographic variability towards equilibrium under different temperature conditions. Changes in entropy are correlated with the fluctuations of the insect population decay rates (i.e. demographic stability towards equilibrium). Moreover, shorter mixing times are directly linked to lower entropy rates and vice versa. This may be linked to the properties of the insect model system, which in contrast to warm blooded animals has the ability to greatly change its metabolic and demographic rates. Moreover, population entropy and the related distance measures that are applied, provide a means to measure these rates. The current results and model projections provide clear biological evidence why dynamic population entropy may be useful to measure population stability. Copyright © 2015 Elsevier Inc. All rights reserved.

Beyond the classical theory of heat conduction: a perspective view of future from entropy

PubMed Central

Lai, Xiang; Zhu, Pingan

2016-01-01

Energy is conserved by the first law of thermodynamics; its quality degrades constantly due to entropy generation, by the second law of thermodynamics. It is thus important to examine the entropy generation regarding the way to reduce its magnitude and the limit of entropy generation as time tends to infinity regarding whether it is bounded or not. This work initiates such an analysis with one-dimensional heat conduction. The work not only offers some fundamental insights of universe and its future, but also builds up the relation between the second law of thermodynamics and mathematical inequalities via developing the latter of either new or classical nature. A concise review of entropy is also included for the interest of performing the analysis in this work and the similar analysis for other processes in the future. PMID:27843400

Relationship between dynamical entropy and energy dissipation far from thermodynamic equilibrium.

PubMed

Green, Jason R; Costa, Anthony B; Grzybowski, Bartosz A; Szleifer, Igal

2013-10-08

Connections between microscopic dynamical observables and macroscopic nonequilibrium (NE) properties have been pursued in statistical physics since Boltzmann, Gibbs, and Maxwell. The simulations we describe here establish a relationship between the Kolmogorov-Sinai entropy and the energy dissipated as heat from a NE system to its environment. First, we show that the Kolmogorov-Sinai or dynamical entropy can be separated into system and bath components and that the entropy of the system characterizes the dynamics of energy dissipation. Second, we find that the average change in the system dynamical entropy is linearly related to the average change in the energy dissipated to the bath. The constant energy and time scales of the bath fix the dynamical relationship between these two quantities. These results provide a link between microscopic dynamical variables and the macroscopic energetics of NE processes.

Relationship between dynamical entropy and energy dissipation far from thermodynamic equilibrium

PubMed Central

Green, Jason R.; Costa, Anthony B.; Grzybowski, Bartosz A.; Szleifer, Igal

2013-01-01

Connections between microscopic dynamical observables and macroscopic nonequilibrium (NE) properties have been pursued in statistical physics since Boltzmann, Gibbs, and Maxwell. The simulations we describe here establish a relationship between the Kolmogorov–Sinai entropy and the energy dissipated as heat from a NE system to its environment. First, we show that the Kolmogorov–Sinai or dynamical entropy can be separated into system and bath components and that the entropy of the system characterizes the dynamics of energy dissipation. Second, we find that the average change in the system dynamical entropy is linearly related to the average change in the energy dissipated to the bath. The constant energy and time scales of the bath fix the dynamical relationship between these two quantities. These results provide a link between microscopic dynamical variables and the macroscopic energetics of NE processes. PMID:24065832

Long memory and volatility clustering: Is the empirical evidence consistent across stock markets?

NASA Astrophysics Data System (ADS)

Bentes, Sónia R.; Menezes, Rui; Mendes, Diana A.

2008-06-01

Long memory and volatility clustering are two stylized facts frequently related to financial markets. Traditionally, these phenomena have been studied based on conditionally heteroscedastic models like ARCH, GARCH, IGARCH and FIGARCH, inter alia. One advantage of these models is their ability to capture nonlinear dynamics. Another interesting manner to study the volatility phenomenon is by using measures based on the concept of entropy. In this paper we investigate the long memory and volatility clustering for the SP 500, NASDAQ 100 and Stoxx 50 indexes in order to compare the US and European Markets. Additionally, we compare the results from conditionally heteroscedastic models with those from the entropy measures. In the latter, we examine Shannon entropy, Renyi entropy and Tsallis entropy. The results corroborate the previous evidence of nonlinear dynamics in the time series considered.

Entropy, pricing and macroeconomics of pumped-storage systems

NASA Astrophysics Data System (ADS)

Karakatsanis, Georgios; Mamassis, Nikos; Koutsoyiannis, Demetris; Efstratiadis, Andreas

2014-05-01

We propose a pricing scheme for the enhancement of macroeconomic performance of pumped-storage systems, based on the statistical properties of both geophysical and economic variables. The main argument consists in the need of a context of economic values concerning the hub energy resource; defined as the resource that comprises the reference energy currency for all involved renewable energy sources (RES) and discounts all related uncertainty. In the case of pumped-storage systems the hub resource is the reservoir's water, as a benchmark for all connected intermittent RES. The uncertainty of all involved natural and economic processes is statistically quantifiable by entropy. It is the relation between the entropies of all involved RES that shapes the macroeconomic state of the integrated pumped-storage system. Consequently, there must be consideration on the entropy of wind, solar and precipitation patterns, as well as on the entropy of economic processes -such as demand preferences on either current energy use or storage for future availability. For pumped-storage macroeconomics, a price on the reservoir's capacity scarcity should also be imposed in order to shape a pricing field with upper and lower limits for the long-term stability of the pricing range and positive net energy benefits, which is the primary issue of the generalized deployment of pumped-storage technology. Keywords: Entropy, uncertainty, pricing, hub energy resource, RES, energy storage, capacity scarcity, macroeconomics

Correction of Cardy–Verlinde formula for Fermions and Bosons with modified dispersion relation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sadatian, S. Davood, E-mail: sd-sadatian@um.ac.ir; Dareyni, H.

Cardy–Verlinde formula links the entropy of conformal symmetry field to the total energy and its Casimir energy in a D-dimensional space. To correct black hole thermodynamics, modified dispersion relation can be used which is proposed as a general feature of quantum gravity approaches. In this paper, the thermodynamics of Schwarzschild four-dimensional black hole is corrected using the modified dispersion relation for Fermions and Bosons. Finally, using modified thermodynamics of Schwarzschild four-dimensional black hole, generalization for Cardy–Verlinde formula is obtained. - Highlights: • The modified Cardy–Verlinde formula obtained using MDR for Fermions and Bosons. • The modified entropy of the blackmore » hole used to correct the Cardy–Verlinde formula. • The modified entropy of the CFT has been obtained.« less

Magnetic stirling cycles: A new application for magnetic materials

NASA Technical Reports Server (NTRS)

Brown, G. V.

1977-01-01

The elements of the cycle are summarized. The basic advantages include high entropy density in the magnetic material, completely reversible processes, convenient control of the entropy by the applied field, the feature that heat transfer is possible during all processes, and the ability of the ideal cycle to attain Carnot efficiency. The mean field theory is used to predict the entropy of a ferromagnet in an applied field and also the isothermal entropy change and isentropic temperature change caused by applying a field. The results for isentropic temperature change are compared with experimental data on Gd. Coarse mixtures of ferromagnetic materials with different Curie points are proposed to modify the path of the cycle in the T-S diagram in order to improve the efficiency or to increase the specific power.

Entropy for Mechanically Vibrating Systems

NASA Astrophysics Data System (ADS)

Tufano, Dante

The research contained within this thesis deals with the subject of entropy as defined for and applied to mechanically vibrating systems. This work begins with an overview of entropy as it is understood in the fields of classical thermodynamics, information theory, statistical mechanics, and statistical vibroacoustics. Khinchin's definition of entropy, which is the primary definition used for the work contained in this thesis, is introduced in the context of vibroacoustic systems. The main goal of this research is to to establish a mathematical framework for the application of Khinchin's entropy in the field of statistical vibroacoustics by examining the entropy context of mechanically vibrating systems. The introduction of this thesis provides an overview of statistical energy analysis (SEA), a modeling approach to vibroacoustics that motivates this work on entropy. The objective of this thesis is given, and followed by a discussion of the intellectual merit of this work as well as a literature review of relevant material. Following the introduction, an entropy analysis of systems of coupled oscillators is performed utilizing Khinchin's definition of entropy. This analysis develops upon the mathematical theory relating to mixing entropy, which is generated by the coupling of vibroacoustic systems. The mixing entropy is shown to provide insight into the qualitative behavior of such systems. Additionally, it is shown that the entropy inequality property of Khinchin's entropy can be reduced to an equality using the mixing entropy concept. This equality can be interpreted as a facet of the second law of thermodynamics for vibroacoustic systems. Following this analysis, an investigation of continuous systems is performed using Khinchin's entropy. It is shown that entropy analyses using Khinchin's entropy are valid for continuous systems that can be decomposed into a finite number of modes. The results are shown to be analogous to those obtained for simple oscillators, which demonstrates the applicability of entropy-based approaches to real-world systems. Three systems are considered to demonstrate these findings: 1) a rod end-coupled to a simple oscillator, 2) two end-coupled rods, and 3) two end-coupled beams. The aforementioned work utilizes the weak coupling assumption to determine the entropy of composite systems. Following this discussion, a direct method of finding entropy is developed which does not rely on this limiting assumption. The resulting entropy provides a useful benchmark for evaluating the accuracy of the weak coupling approach, and is validated using systems of coupled oscillators. The later chapters of this work discuss Khinchin's entropy as applied to nonlinear and nonconservative systems, respectively. The discussion of entropy for nonlinear systems is motivated by the desire to expand the applicability of SEA techniques beyond the linear regime. The discussion of nonconservative systems is also crucial, since real-world systems interact with their environment, and it is necessary to confirm the validity of an entropy approach for systems that are relevant in the context of SEA. Having developed a mathematical framework for determining entropy under a number of previously unexplored cases, the relationship between thermodynamics and statistical vibroacoustics can be better understood. Specifically, vibroacoustic temperatures can be obtained for systems that are not necessarily linear or weakly coupled. In this way, entropy provides insight into how the power flow proportionality of statistical energy analysis (SEA) can be applied to a broader class of vibroacoustic systems. As such, entropy is a useful tool for both justifying and expanding the foundational results of SEA.

Hyper-resting brain entropy within chronic smokers and its moderation by Sex

PubMed Central

Li, Zhengjun; Fang, Zhuo; Hager, Nathan; Rao, Hengyi; Wang, Ze

2016-01-01

Cigarette smoking is a chronic relapsing brain disorder, and remains a premier cause of morbidity and mortality. Functional neuroimaging has been used to assess differences in the mean strength of brain activity in smokers’ brains, however less is known about the temporal dynamics within smokers’ brains. Temporal dynamics is a key feature of a dynamic system such as the brain, and may carry information critical to understanding the brain mechanisms underlying cigarette smoking. We measured the temporal dynamics of brain activity using brain entropy (BEN) mapping and compared BEN between chronic non-deprived smokers and non-smoking controls. Because of the known sex differences in neural and behavioral smoking characteristics, comparisons were also made between males and females. Associations between BEN and smoking related clinical measures were assessed in smokers. Our data showed globally higher BEN in chronic smokers compared to controls. The escalated BEN was associated with more years of smoking in the right limbic area and frontal region. Female nonsmokers showed higher BEN than male nonsmokers in prefrontal cortex, insula, and precuneus, but the BEN sex difference in smokers was less pronounced. These findings suggest that BEN mapping may provide a useful tool for probing brain mechanisms related to smoking. PMID:27377552

Universal Entropy of Word Ordering Across Linguistic Families

PubMed Central

Montemurro, Marcelo A.; Zanette, Damián H.

2011-01-01

Background The language faculty is probably the most distinctive feature of our species, and endows us with a unique ability to exchange highly structured information. In written language, information is encoded by the concatenation of basic symbols under grammatical and semantic constraints. As is also the case in other natural information carriers, the resulting symbolic sequences show a delicate balance between order and disorder. That balance is determined by the interplay between the diversity of symbols and by their specific ordering in the sequences. Here we used entropy to quantify the contribution of different organizational levels to the overall statistical structure of language. Methodology/Principal Findings We computed a relative entropy measure to quantify the degree of ordering in word sequences from languages belonging to several linguistic families. While a direct estimation of the overall entropy of language yielded values that varied for the different families considered, the relative entropy quantifying word ordering presented an almost constant value for all those families. Conclusions/Significance Our results indicate that despite the differences in the structure and vocabulary of the languages analyzed, the impact of word ordering in the structure of language is a statistical linguistic universal. PMID:21603637

Entropy Inequalities for Stable Densities and Strengthened Central Limit Theorems

NASA Astrophysics Data System (ADS)

Toscani, Giuseppe

2016-10-01

We consider the central limit theorem for stable laws in the case of the standardized sum of independent and identically distributed random variables with regular probability density function. By showing decay of different entropy functionals along the sequence we prove convergence with explicit rate in various norms to a Lévy centered density of parameter λ >1 . This introduces a new information-theoretic approach to the central limit theorem for stable laws, in which the main argument is shown to be the relative fractional Fisher information, recently introduced in Toscani (Ricerche Mat 65(1):71-91, 2016). In particular, it is proven that, with respect to the relative fractional Fisher information, the Lévy density satisfies an analogous of the logarithmic Sobolev inequality, which allows to pass from the monotonicity and decay to zero of the relative fractional Fisher information in the standardized sum to the decay to zero in relative entropy with an explicit decay rate.

A practical comparison of algorithms for the measurement of multiscale entropy in neural time series data.

PubMed

Kuntzelman, Karl; Jack Rhodes, L; Harrington, Lillian N; Miskovic, Vladimir

2018-06-01

There is a broad family of statistical methods for capturing time series regularity, with increasingly widespread adoption by the neuroscientific community. A common feature of these methods is that they permit investigators to quantify the entropy of brain signals - an index of unpredictability/complexity. Despite the proliferation of algorithms for computing entropy from neural time series data there is scant evidence concerning their relative stability and efficiency. Here we evaluated several different algorithmic implementations (sample, fuzzy, dispersion and permutation) of multiscale entropy in terms of their stability across sessions, internal consistency and computational speed, accuracy and precision using a combination of electroencephalogram (EEG) and synthetic 1/ƒ noise signals. Overall, we report fair to excellent internal consistency and longitudinal stability over a one-week period for the majority of entropy estimates, with several caveats. Computational timing estimates suggest distinct advantages for dispersion and permutation entropy over other entropy estimates. Considered alongside the psychometric evidence, we suggest several ways in which researchers can maximize computational resources (without sacrificing reliability), especially when working with high-density M/EEG data or multivoxel BOLD time series signals. Copyright © 2018 Elsevier Inc. All rights reserved.

Using Link Disconnection Entropy Disorder to Detect Fast Moving Nodes in MANETs

PubMed Central

Palafox, Luis E.; Aguilar, Leocundo; Sanchez, Mauricio A.; Martinez, Luis G.

2016-01-01

Mobile ad-hoc networks (MANETs) are dynamic by nature; this dynamism comes from node mobility, traffic congestion, and other transmission conditions. Metrics to evaluate the effects of those conditions shine a light on node’s behavior in an ad-hoc network, helping to identify the node or nodes with better conditions of connection. In this paper, we propose a relative index to evaluate a single node reliability, based on the link disconnection entropy disorder using neighboring nodes as reference. Link disconnection entropy disorder is best used to identify fast moving nodes or nodes with unstable communications, this without the need of specialized sensors such as GPS. Several scenarios were studied to verify the index, measuring the effects of Speed and traffic density on the link disconnection entropy disorder. Packet delivery ratio is associated to the metric detecting a strong relationship, enabling the use of the link disconnection entropy disorder to evaluate the stability of a node to communicate with other nodes. To expand the utilization of the link entropy disorder, we identified nodes with higher speeds in network simulations just by using the link entropy disorder. PMID:27219671

n-Order and maximum fuzzy similarity entropy for discrimination of signals of different complexity: Application to fetal heart rate signals.

PubMed

Zaylaa, Amira; Oudjemia, Souad; Charara, Jamal; Girault, Jean-Marc

2015-09-01

This paper presents two new concepts for discrimination of signals of different complexity. The first focused initially on solving the problem of setting entropy descriptors by varying the pattern size instead of the tolerance. This led to the search for the optimal pattern size that maximized the similarity entropy. The second paradigm was based on the n-order similarity entropy that encompasses the 1-order similarity entropy. To improve the statistical stability, n-order fuzzy similarity entropy was proposed. Fractional Brownian motion was simulated to validate the different methods proposed, and fetal heart rate signals were used to discriminate normal from abnormal fetuses. In all cases, it was found that it was possible to discriminate time series of different complexity such as fractional Brownian motion and fetal heart rate signals. The best levels of performance in terms of sensitivity (90%) and specificity (90%) were obtained with the n-order fuzzy similarity entropy. However, it was shown that the optimal pattern size and the maximum similarity measurement were related to intrinsic features of the time series. Copyright © 2015 Elsevier Ltd. All rights reserved.

Entanglement entropy between real and virtual particles in ϕ4 quantum field theory

NASA Astrophysics Data System (ADS)

Ardenghi, Juan Sebastián

2015-04-01

The aim of this work is to compute the entanglement entropy of real and virtual particles by rewriting the generating functional of ϕ4 theory as a mean value between states and observables defined through the correlation functions. Then the von Neumann definition of entropy can be applied to these quantum states and in particular, for the partial traces taken over the internal or external degrees of freedom. This procedure can be done for each order in the perturbation expansion showing that the entanglement entropy for real and virtual particles behaves as ln (m0). In particular, entanglement entropy is computed at first order for the correlation function of two external points showing that mutual information is identical to the external entropy and that conditional entropies are negative for all the domain of m0. In turn, from the definition of the quantum states, it is possible to obtain general relations between total traces between different quantum states of a ϕr theory. Finally, discussion about the possibility of taking partial traces over external degrees of freedom is considered, which implies the introduction of some observables that measure space-time points where an interaction occurs.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jafferis, Daniel L.; Lewkowycz, Aitor; Maldacena, Juan

We consider the gravity dual of the modular Hamiltonian associated to a general subregion of a boundary theory. We use it to argue that the relative entropy of nearby states is given by the relative entropy in the bulk, to leading order in the bulk gravitational coupling. We also argue that the boundary modular flow is dual to the bulk modular flow in the entanglement wedge, with implications for entanglement wedge reconstruction.

An entropy maximization problem related to optical communication

NASA Technical Reports Server (NTRS)

Mceliece, R. J.; Rodemich, E. R.; Swanson, L.

1986-01-01

In relation to a problem in optical communication, the paper considers the general problem of maximizing the entropy of a stationary radom process that is subject to an average transition cost constraint. By using a recent result of Justesen and Hoholdt, an exact solution to the problem is presented and a class of finite state encoders that give a good approximation to the exact solution is suggested.

Hierarchical Polygamy Inequality for Entanglement of Tsallis q-Entropy

NASA Astrophysics Data System (ADS)

Luo, Yu; Li, Yong-Ming

2018-05-01

In this paper, we study the polygamy inequality of quantum entanglement in terms of Tsallis q-entropy. We first give a lower bound of Tsallis q-entropy entanglement of assistance (TOA) in the 2 ⊗ d systems. The relation-ships between Tsallis q-entropy entanglement (TEE) and TOA are also given. Furthermore, we prove TOA follows a hierarchical polygamy inequality in a 2 ⊗ 2 ⊗ 2 N‑2 systems. Supported by the National Natural Science Foundation of China under Grant No. 11671244, the Higher School Doctoral Subject Foun- dation of Ministry of Education of China under Grant No. 20130202110001, and Fundamental Research Funds for the Central Universities under Grants Nos. 2016TS060 and 2016CBY003

DEM interpolation weight calculation modulus based on maximum entropy

NASA Astrophysics Data System (ADS)

Chen, Tian-wei; Yang, Xia

2015-12-01

There is negative-weight in traditional interpolation of gridding DEM, in the article, the principle of Maximum Entropy is utilized to analyze the model system which depends on modulus of space weight. Negative-weight problem of the DEM interpolation is researched via building Maximum Entropy model, and adding nonnegative, first and second order's Moment constraints, the negative-weight problem is solved. The correctness and accuracy of the method was validated with genetic algorithm in matlab program. The method is compared with the method of Yang Chizhong interpolation and quadratic program. Comparison shows that the volume and scaling of Maximum Entropy's weight is fit to relations of space and the accuracy is superior to the latter two.

Integrating planning and reaction: A preliminary report

NASA Technical Reports Server (NTRS)

Bresina, John L.; Drummond, Mark

1990-01-01

The Entropy Reduction Engine architecture for integrating planning, scheduling, and control is examined. The architecture is motivated through a NASA mission scenario and a brief list of design goals. An overview is presented of the Entropy Reduction Engine architecture by describing its major components, their interactions, and the way in which these interacting components satisfy the design goals.

Statistical Entropy of Vaidya-de Sitter Black Hole to All Orders in Planck Length

NASA Astrophysics Data System (ADS)

Sun, HangBin; He, Feng; Huang, Hai

2012-06-01

Considering corrections to all orders in Planck length on the quantum state density from generalized uncertainty principle, we calculate the statistical entropy of scalar field near event horizon and cosmological horizon of Vaidya-de Sitter black hole without any artificial cutoff. It is shown that the entropy is linear sum of event horizon area and cosmological horizon area and there are similar proportional parameters related to changing rate of the horizon position. This is different from the static and stationary cases.

Decreased Complexity in Alzheimer's Disease: Resting-State fMRI Evidence of Brain Entropy Mapping.

PubMed

Wang, Bin; Niu, Yan; Miao, Liwen; Cao, Rui; Yan, Pengfei; Guo, Hao; Li, Dandan; Guo, Yuxiang; Yan, Tianyi; Wu, Jinglong; Xiang, Jie; Zhang, Hui

2017-01-01

Alzheimer's disease (AD) is a frequently observed, irreversible brain function disorder among elderly individuals. Resting-state functional magnetic resonance imaging (rs-fMRI) has been introduced as an alternative approach to assessing brain functional abnormalities in AD patients. However, alterations in the brain rs-fMRI signal complexities in mild cognitive impairment (MCI) and AD patients remain unclear. Here, we described the novel application of permutation entropy (PE) to investigate the abnormal complexity of rs-fMRI signals in MCI and AD patients. The rs-fMRI signals of 30 normal controls (NCs), 33 early MCI (EMCI), 32 late MCI (LMCI), and 29 AD patients were obtained from the Alzheimer's disease Neuroimaging Initiative (ADNI) database. After preprocessing, whole-brain entropy maps of the four groups were extracted and subjected to Gaussian smoothing. We performed a one-way analysis of variance (ANOVA) on the brain entropy maps of the four groups. The results after adjusting for age and sex differences together revealed that the patients with AD exhibited lower complexity than did the MCI and NC controls. We found five clusters that exhibited significant differences and were distributed primarily in the occipital, frontal, and temporal lobes. The average PE of the five clusters exhibited a decreasing trend from MCI to AD. The AD group exhibited the least complexity. Additionally, the average PE of the five clusters was significantly positively correlated with the Mini-Mental State Examination (MMSE) scores and significantly negatively correlated with Functional Assessment Questionnaire (FAQ) scores and global Clinical Dementia Rating (CDR) scores in the patient groups. Significant correlations were also found between the PE and regional homogeneity (ReHo) in the patient groups. These results indicated that declines in PE might be related to changes in regional functional homogeneity in AD. These findings suggested that complexity analyses using PE in rs-fMRI signals can provide important information about the fMRI characteristics of cognitive impairments in MCI and AD.

Decreased Complexity in Alzheimer's Disease: Resting-State fMRI Evidence of Brain Entropy Mapping

PubMed Central

Wang, Bin; Niu, Yan; Miao, Liwen; Cao, Rui; Yan, Pengfei; Guo, Hao; Li, Dandan; Guo, Yuxiang; Yan, Tianyi; Wu, Jinglong; Xiang, Jie; Zhang, Hui

2017-01-01

Alzheimer's disease (AD) is a frequently observed, irreversible brain function disorder among elderly individuals. Resting-state functional magnetic resonance imaging (rs-fMRI) has been introduced as an alternative approach to assessing brain functional abnormalities in AD patients. However, alterations in the brain rs-fMRI signal complexities in mild cognitive impairment (MCI) and AD patients remain unclear. Here, we described the novel application of permutation entropy (PE) to investigate the abnormal complexity of rs-fMRI signals in MCI and AD patients. The rs-fMRI signals of 30 normal controls (NCs), 33 early MCI (EMCI), 32 late MCI (LMCI), and 29 AD patients were obtained from the Alzheimer's disease Neuroimaging Initiative (ADNI) database. After preprocessing, whole-brain entropy maps of the four groups were extracted and subjected to Gaussian smoothing. We performed a one-way analysis of variance (ANOVA) on the brain entropy maps of the four groups. The results after adjusting for age and sex differences together revealed that the patients with AD exhibited lower complexity than did the MCI and NC controls. We found five clusters that exhibited significant differences and were distributed primarily in the occipital, frontal, and temporal lobes. The average PE of the five clusters exhibited a decreasing trend from MCI to AD. The AD group exhibited the least complexity. Additionally, the average PE of the five clusters was significantly positively correlated with the Mini-Mental State Examination (MMSE) scores and significantly negatively correlated with Functional Assessment Questionnaire (FAQ) scores and global Clinical Dementia Rating (CDR) scores in the patient groups. Significant correlations were also found between the PE and regional homogeneity (ReHo) in the patient groups. These results indicated that declines in PE might be related to changes in regional functional homogeneity in AD. These findings suggested that complexity analyses using PE in rs-fMRI signals can provide important information about the fMRI characteristics of cognitive impairments in MCI and AD. PMID:29209199

Two aspects of black hole entropy in Lanczos-Lovelock models of gravity

NASA Astrophysics Data System (ADS)

Kolekar, Sanved; Kothawala, Dawood; Padmanabhan, T.

2012-03-01

We consider two specific approaches to evaluate the black hole entropy which are known to produce correct results in the case of Einstein’s theory and generalize them to Lanczos-Lovelock models. In the first approach (which could be called extrinsic), we use a procedure motivated by earlier work by Pretorius, Vollick, and Israel, and by Oppenheim, and evaluate the entropy of a configuration of densely packed gravitating shells on the verge of forming a black hole in Lanczos-Lovelock theories of gravity. We find that this matter entropy is not equal to (it is less than) Wald entropy, except in the case of Einstein theory, where they are equal. The matter entropy is proportional to the Wald entropy if we consider a specific mth-order Lanczos-Lovelock model, with the proportionality constant depending on the spacetime dimensions D and the order m of the Lanczos-Lovelock theory as (D-2m)/(D-2). Since the proportionality constant depends on m, the proportionality between matter entropy and Wald entropy breaks down when we consider a sum of Lanczos-Lovelock actions involving different m. In the second approach (which could be called intrinsic), we generalize a procedure, previously introduced by Padmanabhan in the context of general relativity, to study off-shell entropy of a class of metrics with horizon using a path integral method. We consider the Euclidean action of Lanczos-Lovelock models for a class of metrics off shell and interpret it as a partition function. We show that in the case of spherically symmetric metrics, one can interpret the Euclidean action as the free energy and read off both the entropy and energy of a black hole spacetime. Surprisingly enough, this leads to exactly the Wald entropy and the energy of the spacetime in Lanczos-Lovelock models obtained by other methods. We comment on possible implications of the result.

Stochastic driven systems far from equilibrium

NASA Astrophysics Data System (ADS)

Kim, Kyung Hyuk

We study the dynamics and steady states of two systems far from equilibrium: a 1-D driven lattice gas and a driven Brownian particle with inertia. (1) We investigate the dynamical scaling behavior of a 1-D driven lattice gas model with two species of particles hopping in opposite directions. We confirm numerically that the dynamic exponent is equal to z = 1.5. We show analytically that a quasi-particle representation relates all phase points to a special phase line directly related to the single-species asymmetric simple exclusion process. Quasi-particle two-point correlations decay exponentially, and in such a manner that quasi-particles of opposite charge dynamically screen each other with a special balance. The balance encompasses all over the phase space. These results indicate that the model belongs to the Kardar-Parisi-Zhang (KPZ) universality class. (2) We investigate the non-equilibrium thermodynamics of a Brownian particle with inertia under feedback control of its inertia. We find such open systems can act as a molecular refrigerator due to an entropy pumping mechanism. We extend the fluctuation theorems to the refrigerator. The entropy pumping modifies both the Jarzynski equality and the fluctuation theorems. We discover that the entropy pumping has a dual role of work and heat. We also investigate the thermodynamics of the particle under a hydrodynamic interaction described by a Langevin equation with a multiplicative noise. The Stratonovich stochastic integration prescription involved in the definition of heat is shown to be the unique physical choice.

Entropy of Movement Outcome in Space-Time.

PubMed

Lai, Shih-Chiung; Hsieh, Tsung-Yu; Newell, Karl M

2015-07-01

Information entropy of the joint spatial and temporal (space-time) probability of discrete movement outcome was investigated in two experiments as a function of different movement strategies (space-time, space, and time instructional emphases), task goals (point-aiming and target-aiming) and movement speed-accuracy constraints. The variance of the movement spatial and temporal errors was reduced by instructional emphasis on the respective spatial or temporal dimension, but increased on the other dimension. The space-time entropy was lower in targetaiming task than the point aiming task but did not differ between instructional emphases. However, the joint probabilistic measure of spatial and temporal entropy showed that spatial error is traded for timing error in tasks with space-time criteria and that the pattern of movement error depends on the dimension of the measurement process. The unified entropy measure of movement outcome in space-time reveals a new relation for the speed-accuracy.

Landauer-Büttiker Approach to Strongly Coupled Quantum Thermodynamics: Inside-Outside Duality of Entropy Evolution

NASA Astrophysics Data System (ADS)

Bruch, Anton; Lewenkopf, Caio; von Oppen, Felix

2018-03-01

We develop a Landauer-Büttiker theory of entropy evolution in time-dependent, strongly coupled electron systems. The formalism naturally avoids the problem of the system-bath distinction by defining the entropy current in the attached leads. This current can then be used to infer changes of the entropy of the system which we refer to as the inside-outside duality. We carry out this program in an adiabatic expansion up to first order beyond the quasistatic limit. When combined with particle and energy currents, as well as the work required to change an external potential, our formalism provides a full thermodynamic description, applicable to arbitrary noninteracting electron systems in contact with reservoirs. This provides a clear understanding of the relation between heat and entropy currents generated by time-dependent potentials and their connection to the occurring dissipation.

Rényi squashed entanglement, discord, and relative entropy differences

NASA Astrophysics Data System (ADS)

Seshadreesan, Kaushik P.; Berta, Mario; Wilde, Mark M.

2015-10-01

The squashed entanglement quantifies the amount of entanglement in a bipartite quantum state, and it satisfies all of the axioms desired for an entanglement measure. The quantum discord is a measure of quantum correlations that are different from those due to entanglement. What these two measures have in common is that they are both based upon the conditional quantum mutual information. In Berta et al (2015 J. Math. Phys. 56 022205), we recently proposed Rényi generalizations of the conditional quantum mutual information of a tripartite state on ABC (with C being the conditioning system), which were shown to satisfy some properties that hold for the original quantity, such as non-negativity, duality, and monotonicity with respect to local operations on the system B (with it being left open to show that the Rényi quantity is monotone with respect to local operations on system A). Here we define a Rényi squashed entanglement and a Rényi quantum discord based on a Rényi conditional quantum mutual information and investigate these quantities in detail. Taking as a conjecture that the Rényi conditional quantum mutual information is monotone with respect to local operations on both systems A and B, we prove that the Rényi squashed entanglement and the Rényi quantum discord satisfy many of the properties of the respective original von Neumann entropy based quantities. In our prior work (Berta et al 2015 Phys. Rev. A 91 022333), we also detailed a procedure to obtain Rényi generalizations of any quantum information measure that is equal to a linear combination of von Neumann entropies with coefficients chosen from the set \\{-1,0,1\\}. Here, we extend this procedure to include differences of relative entropies. Using the extended procedure and a conjectured monotonicity of the Rényi generalizations in the Rényi parameter, we discuss potential remainder terms for well known inequalities such as monotonicity of the relative entropy, joint convexity of the relative entropy, and the Holevo bound.

On the Enthalpy and Entropy of Point Defect Formation in Crystals

NASA Astrophysics Data System (ADS)

Kobelev, N. P.; Khonik, V. A.

2018-03-01

A standard way to determine the formation enthalpy H and entropy S of point defect formation in crystals consists in the application of the Arrhenius equation for the defect concentration. In this work, we show that a formal use of this method actually gives the effective (apparent) values of these quantities, which appear to be significantly overestimated. The underlying physical reason lies in temperature-dependent formation enthalpy of the defects, which is controlled by temperature dependence of the elastic moduli. We present an evaluation of the "true" H- and S-values for aluminum, which are derived on the basis of experimental data by taking into account temperature dependence of the formation enthalpy related to temperature dependence of the elastic moduli. The knowledge of the "true" activation parameters is needed for a correct calculation of the defect concentration constituting thus an issue of major importance for different fundamental and application issues of condensed matter physics and chemistry.

Information and Entropy

NASA Astrophysics Data System (ADS)

Caticha, Ariel

2007-11-01

What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore it is the force that induces us to change our minds. This problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), which is designed for updating from arbitrary priors given information in the form of arbitrary constraints, includes as special cases both MaxEnt (which allows arbitrary constraints) and Bayes' rule (which allows arbitrary priors). Thus, ME unifies the two themes of these workshops—the Maximum Entropy and the Bayesian methods—into a single general inference scheme that allows us to handle problems that lie beyond the reach of either of the two methods separately. I conclude with a couple of simple illustrative examples.

Nonlinear Analysis of Motor Activity Shows Differences between Schizophrenia and Depression: A Study Using Fourier Analysis and Sample Entropy

PubMed Central

Hauge, Erik R.; Berle, Jan Øystein; Oedegaard, Ketil J.; Holsten, Fred; Fasmer, Ole Bernt

2011-01-01

The purpose of this study has been to describe motor activity data obtained by using wrist-worn actigraphs in patients with schizophrenia and major depression by the use of linear and non-linear methods of analysis. Different time frames were investigated, i.e., activity counts measured every minute for up to five hours and activity counts made hourly for up to two weeks. The results show that motor activity was lower in the schizophrenic patients and in patients with major depression, compared to controls. Using one minute intervals the depressed patients had a higher standard deviation (SD) compared to both the schizophrenic patients and the controls. The ratio between the root mean square successive differences (RMSSD) and SD was higher in the schizophrenic patients compared to controls. The Fourier analysis of the activity counts measured every minute showed that the relation between variance in the low and the high frequency range was lower in the schizophrenic patients compared to the controls. The sample entropy was higher in the schizophrenic patients compared to controls in the time series from the activity counts made every minute. The main conclusions of the study are that schizophrenic and depressive patients have distinctly different profiles of motor activity and that the results differ according to period length analysed. PMID:21297977

Research of MPPT for photovoltaic generation based on two-dimensional cloud model

NASA Astrophysics Data System (ADS)

Liu, Shuping; Fan, Wei

2013-03-01

The cloud model is a mathematical representation to fuzziness and randomness in linguistic concepts. It represents a qualitative concept with expected value Ex, entropy En and hyper entropy He, and integrates the fuzziness and randomness of a linguistic concept in a unified way. This model is a new method for transformation between qualitative and quantitative in the knowledge. This paper is introduced MPPT (maximum power point tracking, MPPT) controller based two- dimensional cloud model through analysis of auto-optimization MPPT control of photovoltaic power system and combining theory of cloud model. Simulation result shows that the cloud controller is simple and easy, directly perceived through the senses, and has strong robustness, better control performance.

Generalized relative entropies in the classical limit

NASA Astrophysics Data System (ADS)

Kowalski, A. M.; Martin, M. T.; Plastino, A.

2015-03-01

Our protagonists are (i) the Cressie-Read family of divergences (characterized by the parameter γ), (ii) Tsallis' generalized relative entropies (characterized by the q one), and, as a particular instance of both, (iii) the Kullback-Leibler (KL) relative entropy. In their normalized versions, we ascertain the equivalence between (i) and (ii). Additionally, we employ these three entropic quantifiers in order to provide a statistical investigation of the classical limit of a semiclassical model, whose properties are well known from a purely dynamic viewpoint. This places us in a good position to assess the appropriateness of our statistical quantifiers for describing involved systems. We compare the behaviour of (i), (ii), and (iii) as one proceeds towards the classical limit. We determine optimal ranges for γ and/or q. It is shown the Tsallis-quantifier is better than KL's for 1.5 < q < 2.5.

Low-temperature heat capacity of diopside glass (CaMgSi2O6): A calorimetric test of the configurational-entropy theory applied to the viscosity of liquid silicates

USGS Publications Warehouse

Richet, P.; Robie, R.A.; Hemingway, B.S.

1986-01-01

Heat-capacity measurements have been made between 8 and 370 K on an annealed and a rapidly quenched diopside glass. Between 15 and 200 K, Cp does not depend significantly on the thermal history of the glass. Below 15 K Cp is larger for the quenched than for the annealed specimen. The opposite is true above 200 K as a result of what is interpreted as a secondary relaxation around room temperature. The magnitude of these effects, however, is small enough that the relative entropies S(298)-S(0) of the glasses differ by only 0.5 J/mol K, i.e., a figure within the combined experimental uncertainties. The insensitivity of relative entropies to thermal history supports the assumption that the configurational heat capacity of the liquid may be taken as the heat capacity difference between the liquid and the glass (??Cp). Furthermore, this insensitivity allows calculation of the residual entropies at 0 K of diopside glasses as a function of the fictive temperature from the entropy of fusion of diopside and the heat capacities of the crystalline, glassy and liquid phases. For a glass with a fictive temperature of 1005 K, for example, this calorimetric residual entropy is 24.3 ?? 3 J/mol K, in agreement with the prediction made by RICHET (1984) from an analysis of the viscosity data with the configurational-entropy theory of relaxation processes of Adam and Gibbs (1965). In turn, all the viscosity measurements for liquid diopside, which span the range 0.5-4?? 1013 poise, can be quantitatively reproduced through this theory with the calorimetrically determined entropies and ??Cp data. Finally, the unclear significance of "activation energies" for structural interpretations of viscosity data is emphasized, and the importance of ??Cp and glass-transition temperature systematics for determining the composition and temperature dependences of the viscosity is pointed out. ?? 1986.

Multiscale sample entropy and cross-sample entropy based on symbolic representation and similarity of stock markets

NASA Astrophysics Data System (ADS)

Wu, Yue; Shang, Pengjian; Li, Yilong

2018-03-01

A modified multiscale sample entropy measure based on symbolic representation and similarity (MSEBSS) is proposed in this paper to research the complexity of stock markets. The modified algorithm reduces the probability of inducing undefined entropies and is confirmed to be robust to strong noise. Considering the validity and accuracy, MSEBSS is more reliable than Multiscale entropy (MSE) for time series mingled with much noise like financial time series. We apply MSEBSS to financial markets and results show American stock markets have the lowest complexity compared with European and Asian markets. There are exceptions to the regularity that stock markets show a decreasing complexity over the time scale, indicating a periodicity at certain scales. Based on MSEBSS, we introduce the modified multiscale cross-sample entropy measure based on symbolic representation and similarity (MCSEBSS) to consider the degree of the asynchrony between distinct time series. Stock markets from the same area have higher synchrony than those from different areas. And for stock markets having relative high synchrony, the entropy values will decrease with the increasing scale factor. While for stock markets having high asynchrony, the entropy values will not decrease with the increasing scale factor sometimes they tend to increase. So both MSEBSS and MCSEBSS are able to distinguish stock markets of different areas, and they are more helpful if used together for studying other features of financial time series.

Entropy-Aided Evaluation of Meteorological Droughts Over China

NASA Astrophysics Data System (ADS)

Sang, Yan-Fang; Singh, Vijay P.; Hu, Zengyun; Xie, Ping; Li, Xinxin

2018-01-01

Evaluation of drought and its spatial distribution is essential to develop mitigation measures. In this study, we employed the entropy index to investigate the spatiotemporal variability of meteorological droughts over China. Entropy values, with a reliable hydrological and geographical basis, are closely related to the months of precipitation deficit and its mean magnitude and can thus represent the physical formation of droughts. The value of entropy index can be roughly classified as <0.35, 0.36-0.90, and >0.90, reflecting high, middle, and low occurrence probabilities of droughts. The accumulated precipitation deficits, based on the standardized precipitation-evapotranspiration index at the 1, 3, 6, and 12 month scales, consistently increase with entropy decrease, no matter considering the moderately, severely, or extremely dry conditions. Therefore, Northwest China and North China, with smaller entropy values, have higher occurrence probability of droughts than South China, with a break at 38°N latitude. The aggravating droughts in North China and Southwest China over recent decades are represented by the increase in both the occurrence frequency and the magnitude. The entropy, determined by absolute magnitude of the difference between precipitation and potential evapotranspiration, as well as its scatter and skewness characteristics, is easily calculated and can be an effective index for evaluating drought and its spatial distribution. We therefore identified dominant thresholds for entropy values and statistical characteristics of precipitation deficit, which would help evaluate the occurrence probability of droughts worldwide.

Entropy considerations applied to shock unsteadiness in hypersonic inlets

NASA Astrophysics Data System (ADS)

Bussey, Gillian Mary Harding

The stability of curved or rectangular shocks in hypersonic inlets in response to flow perturbations can be determined analytically from the principle of minimum entropy. Unsteady shock wave motion can have a significant effect on the flow in a hypersonic inlet or combustor. According to the principle of minimum entropy, a stable thermodynamic state is one with the lowest entropy gain. A model based on piston theory and its limits has been developed for applying the principle of minimum entropy to quasi-steady flow. Relations are derived for analyzing the time-averaged entropy gain flux across a shock for quasi-steady perturbations in atmospheric conditions and angle as a perturbation in entropy gain flux from the steady state. Initial results from sweeping a wedge at Mach 10 through several degrees in AEDC's Tunnel 9 indicates the bow shock becomes unsteady near the predicted normal Mach number. Several curved shocks of varying curvature are compared to a straight shock with the same mean normal Mach number, pressure ratio, or temperature ratio. The present work provides analysis and guidelines for designing an inlet robust to off- design flight or perturbations in flow conditions an inlet is likely to face. It also suggests that inlets with curved shocks are less robust to off-design flight than those with straight shocks such as rectangular inlets. Relations for evaluating entropy perturbations for highly unsteady flow across a shock and limits on their use were also developed. The normal Mach number at which a shock could be stable to high frequency upstream perturbations increases as the speed of the shock motion increases and slightly decreases as the perturbation size increases. The present work advances the principle of minimum entropy theory by providing additional validity for using the theory for time-varying flows and applying it to shocks, specifically those in inlets. While this analytic tool is applied in the present work for evaluating the stability of shocks in hypersonic inlets, it can be used for an arbitrary application with a shock.

Dynamics of glass-forming liquids. XVIII. Does entropy control structural relaxation times?

NASA Astrophysics Data System (ADS)

Samanta, Subarna; Richert, Ranko

2015-01-01

We study the dielectric dynamics of viscous glycerol in the presence of a large bias field. Apart from dielectric saturation and polarization anisotropy, we observe that the steady state structural relaxation time is longer by 2.7% in the presence of a 225 kV/cm dc-field relative to the linear response counterpart, equivalent to a field induced glass transition (Tg) shift of +84 mK. This result compares favorably with the 3.0% time constant increase predicted on the basis of a recent report [G. P. Johari, J. Chem. Phys. 138, 154503 (2013)], where the field induced reduction of the configurational entropy translates into slower dynamics by virtue of the Adam-Gibbs relation. Other models of field dependent glass transition temperatures are also discussed. Similar to observations related to the electro-optical Kerr effect, the rise time of the field induced effect is much longer than its collapse when the field is removed again. The orientational relaxation time of the plastic crystal cyclo-octanol is more sensitive to a bias field, showing a 13.5% increase at a field of 150 kV/cm, equivalent to an increase of Tg by 0.58 K.

Quantum coherence and correlations in quantum system

PubMed Central

Xi, Zhengjun; Li, Yongming; Fan, Heng

2015-01-01

Criteria of measure quantifying quantum coherence, a unique property of quantum system, are proposed recently. In this paper, we first give an uncertainty-like expression relating the coherence and the entropy of quantum system. This finding allows us to discuss the relations between the entanglement and the coherence. Further, we discuss in detail the relations among the coherence, the discord and the deficit in the bipartite quantum system. We show that, the one-way quantum deficit is equal to the sum between quantum discord and the relative entropy of coherence of measured subsystem. PMID:26094795

Large entropy derived from low-frequency vibrations and its implications for hydrogen storage

NASA Astrophysics Data System (ADS)

Wang, Xiaoxia; Chen, Hongshan

2018-02-01

Adsorption and desorption are driven by the energy and entropy competition, but the entropy effect is often ignored in hydrogen storage and the optimal adsorption strength for the ambient storage is controversial in the literature. This letter investigated the adsorption states of the H2 molecule on M-B12C6N6 (M = Li, Na, Mg, Ca, and Sc) and analyzed the correlation among the zero point energy (ZPE), the entropy change, and the adsorption energy and their effects on the delivery capacities. The ZPE has large correction to the adsorption energy due to the light mass of hydrogen. The computations show that the potential energies along the spherical surface centered at the alkali metals are very flat and it leads to large entropy (˜70 J/mol.K) of the adsorbed H2 molecules. The entropy change can compensate the enthalpy change effectively, and the ambient storage can be realized with relatively weak adsorption of ΔH = -12 kJ/mol. The results are encouraging and instructive for the design of hydrogen storage materials.

Resolving the Schwarzschild singularity in both classic and quantum gravity

NASA Astrophysics Data System (ADS)

Zeng, Ding-fang

2017-04-01

The Schwarzschild singularity's resolution has key values in cracking the key mysteries related with black holes, the origin of their horizon entropy and the information missing puzzle involved in their evaporations. We provide in this work the general dynamic inner metric of collapsing stars with horizons and with non-trivial radial mass distributions. We find that static central singularities are not the final state of the system. Instead, the final state of the system is a periodically zero-cross breathing ball. Through 3+1 decomposed general relativity and its quantum formulation, we establish a functional Schrödinger equation controlling the micro-state of this breathing ball and show that, the system configuration with all the matter concentrating on the central point is not the unique eigen-energy-density solution. Using a Bohr-Sommerfield like "orbital" quantisation assumption, we show that for each black hole of horizon radius rh, there are about e rh2 / ℓpl2 allowable eigen-energy-density profiles. This naturally leads to physic interpretations for the micro-origin of horizon entropy, as well as solutions to the information missing puzzle involved in Hawking radiations.

Pressure Studies of Protein Dynamics

DTIC Science & Technology

1990-02-28

a frozen and metastable complex system In the present section was generated by a flashlamp-pumped dye laser (Phase-R DL- treat the equilibrium region...determination of the relative thermodynamic parameters of the and the temperature was monitored with a Si diode on the pressure We assume that the A substates...temperature controller (Model proteins is essentially linear from 200 to 320 K. 2" The entropy 93C). A silicon diode mounted on the sample cell

A homotopy algorithm for synthesizing robust controllers for flexible structures via the maximum entropy design equations

NASA Technical Reports Server (NTRS)

Collins, Emmanuel G., Jr.; Richter, Stephen

1990-01-01

One well known deficiency of LQG compensators is that they do not guarantee any measure of robustness. This deficiency is especially highlighted when considering control design for complex systems such as flexible structures. There has thus been a need to generalize LQG theory to incorporate robustness constraints. Here we describe the maximum entropy approach to robust control design for flexible structures, a generalization of LQG theory, pioneered by Hyland, which has proved useful in practice. The design equations consist of a set of coupled Riccati and Lyapunov equations. A homotopy algorithm that is used to solve these design equations is presented.

Elevated BIS and Entropy values after sugammadex or neostigmine: an electroencephalographic or electromyographic phenomenon?

PubMed

Aho, A J; Kamata, K; Yli-Hankala, A; Lyytikäinen, L-P; Kulkas, A; Jäntti, V

2012-04-01

Sugammadex is designed to antagonize neuromuscular blockade (NMB) induced by rocuronium or vecuronium. In clinical practice, we have noticed a rise in the numerical values of bispectral index (BIS) and Entropy, two electroencephalogram (EEG) - based depth of anesthesia monitors, during the reversal of the NMB with sugammadex. The aim of this prospective, randomized, double-blind study was to test this impression and to compare the effects of sugammadex and neostigmine on the BIS and Entropy values during the reversal of the NMB. Thirty patients undergoing gynecological operations were studied. Patients were anesthetized with target-controlled infusions of propofol and remifentanil, and rocuronium was used to induce NMB. After operation, during light propofol-remifentanil anesthesia, NMB was antagonized with sugammadex or neostigmine. During the following 5 min, the numerical values of BIS, BIS electromyographic (BIS EMG) and Entropy were recorded on a laptop computer, as well as the biosignal recorded by the Entropy strip. The Entropy biosignal was studied off-line both in time and frequency domain to see if NMB reversal causes changes in EEG. In some patients, administration of sugammadex or neostigmine caused a significant rise in the numerical values of BIS, BIS EMG and Entropy. This phenomenon was most likely caused by increased electromyographic (EMG) activity. The administration of sugammadex or neostigmine appeared to have only minimal effect on EEG. The EMG contamination of EEG causes BIS and Entropy values to rise during reversal of rocuronium-induced NMB in light propofol-remifentanil anesthesia. © 2012 The Authors. Acta Anaesthesiologica Scandinavica © 2012 The Acta Anaesthesiologica Scandinavica Foundation.

Image coding using entropy-constrained residual vector quantization

NASA Technical Reports Server (NTRS)

Kossentini, Faouzi; Smith, Mark J. T.; Barnes, Christopher F.

1993-01-01

The residual vector quantization (RVQ) structure is exploited to produce a variable length codeword RVQ. Necessary conditions for the optimality of this RVQ are presented, and a new entropy-constrained RVQ (ECRVQ) design algorithm is shown to be very effective in designing RVQ codebooks over a wide range of bit rates and vector sizes. The new EC-RVQ has several important advantages. It can outperform entropy-constrained VQ (ECVQ) in terms of peak signal-to-noise ratio (PSNR), memory, and computation requirements. It can also be used to design high rate codebooks and codebooks with relatively large vector sizes. Experimental results indicate that when the new EC-RVQ is applied to image coding, very high quality is achieved at relatively low bit rates.

Linear response of entanglement entropy from holography

NASA Astrophysics Data System (ADS)

Lokhande, Sagar F.; Oling, Gerben W. J.; Pedraza, Juan F.

2017-10-01

For time-independent excited states in conformal field theories, the entanglement entropy of small subsystems satisfies a `first law'-like relation, in which the change in entanglement is proportional to the energy within the entangling region. Such a law holds for time-dependent scenarios as long as the state is perturbatively close to the vacuum, but is not expected otherwise. In this paper we use holography to investigate the spread of entanglement entropy for unitary evolutions of special physical interest, the so-called global quenches. We model these using AdS-Vaidya geometries. We find that the first law of entanglement is replaced by a linear response relation, in which the energy density takes the role of the source and is integrated against a time-dependent kernel with compact support. For adiabatic quenches the standard first law is recovered, while for rapid quenches the linear response includes an extra term that encodes the process of thermalization. This extra term has properties that resemble a time-dependent `relative entropy'. We propose that this quantity serves as a useful order parameter to characterize far-from-equilibrium excited states. We illustrate our findings with concrete examples, including generic power-law and periodically driven quenches.

Understanding the Thermodynamic Properties of the Elastocaloric Effect Through Experimentation and Modelling

NASA Astrophysics Data System (ADS)

Tušek, Jaka; Engelbrecht, Kurt; Mañosa, Lluis; Vives, Eduard; Pryds, Nini

2016-12-01

This paper presents direct and indirect methods for studying the elastocaloric effect (eCE) in shape memory materials and its comparison. The eCE can be characterized by the adiabatic temperature change or the isothermal entropy change (both as a function of applied stress/strain). To get these quantities, the evaluation of the eCE can be done using either direct methods, where one measures (adiabatic) temperature changes or indirect methods where one can measure the stress-strain-temperature characteristics of the materials and from these deduce the adiabatic temperature and isothermal entropy changes. The former can be done using the basic thermodynamic relations, i.e. Maxwell relation and Clausius-Clapeyron equation. This paper further presents basic thermodynamic properties of shape memory materials, such as the adiabatic temperature change, isothermal entropy change and total entropy-temperature diagrams (all as a function of temperature and applied stress/strain) of two groups of materials (Ni-Ti and Cu-Zn-Al alloys) obtained using indirect methods through phenomenological modelling and Maxwell relation. In the last part of the paper, the basic definition of the efficiency of the elastocaloric thermodynamic cycle (coefficient of performance) is defined and discussed.

Statistical theory on the analytical form of cloud particle size distributions

NASA Astrophysics Data System (ADS)

Wu, Wei; McFarquhar, Greg

2017-11-01

Several analytical forms of cloud particle size distributions (PSDs) have been used in numerical modeling and remote sensing retrieval studies of clouds and precipitation, including exponential, gamma, lognormal, and Weibull distributions. However, there is no satisfying physical explanation as to why certain distribution forms preferentially occur instead of others. Theoretically, the analytical form of a PSD can be derived by directly solving the general dynamic equation, but no analytical solutions have been found yet. Instead of using a process level approach, the use of the principle of maximum entropy (MaxEnt) for determining the analytical form of PSDs from the perspective of system is examined here. Here, the issue of variability under coordinate transformations that arises using the Gibbs/Shannon definition of entropy is identified, and the use of the concept of relative entropy to avoid these problems is discussed. Focusing on cloud physics, the four-parameter generalized gamma distribution is proposed as the analytical form of a PSD using the principle of maximum (relative) entropy with assumptions on power law relations between state variables, scale invariance and a further constraint on the expectation of one state variable (e.g. bulk water mass). DOE ASR.

Quantifying ‘Causality’ in Complex Systems: Understanding Transfer Entropy

PubMed Central

Abdul Razak, Fatimah; Jensen, Henrik Jeldtoft

2014-01-01

‘Causal’ direction is of great importance when dealing with complex systems. Often big volumes of data in the form of time series are available and it is important to develop methods that can inform about possible causal connections between the different observables. Here we investigate the ability of the Transfer Entropy measure to identify causal relations embedded in emergent coherent correlations. We do this by firstly applying Transfer Entropy to an amended Ising model. In addition we use a simple Random Transition model to test the reliability of Transfer Entropy as a measure of ‘causal’ direction in the presence of stochastic fluctuations. In particular we systematically study the effect of the finite size of data sets. PMID:24955766

Field-temperature phase diagram and entropy landscape of CeAuSb 2

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zhao, Lishan; Yelland, Edward A.; Bruin, Jan A. N.

2016-05-12

Here, we report a field-temperature phase diagram and an entropy map for the heavy-fermion compound CeAuSb 2. CeAuSb 2 orders antiferromagnetically below T N = 6.6 K and has two metamagnetic transitions, at 2.8 and 5.6 T. The locations of the critical end points of the metamagnetic transitions, which may play a strong role in the putative quantum criticality of CeAuSb 2 and related compounds, are identified. The entropy map reveals an apparent entropy balance with Fermi-liquid behavior, implying that above the Neel transition the Ce moments are incorporated into the Fermi liquid. High-field data showing that the magnetic behaviormore » is remarkably anisotropic are also reported.« less

Analysis of the anomalous mean-field like properties of Gaussian core model in terms of entropy

NASA Astrophysics Data System (ADS)

Nandi, Manoj Kumar; Maitra Bhattacharyya, Sarika

2018-01-01

Studies of the Gaussian core model (GCM) have shown that it behaves like a mean-field model and the properties are quite different from standard glass former. In this work, we investigate the entropies, namely, the excess entropy (Sex) and the configurational entropy (Sc) and their different components to address these anomalies. Our study corroborates most of the earlier observations and also sheds new light on the high and low temperature dynamics. We find that unlike in standard glass former where high temperature dynamics is dominated by two-body correlation and low temperature by many-body correlations, in the GCM both high and low temperature dynamics are dominated by many-body correlations. We also find that the many-body entropy which is usually positive at low temperatures and is associated with activated dynamics is negative in the GCM suggesting suppression of activation. Interestingly despite the suppression of activation, the Adam-Gibbs (AG) relation that describes activated dynamics holds in the GCM, thus suggesting a non-activated contribution in AG relation. We also find an overlap between the AG relation and mode coupling power law regime leading to a power law behavior of Sc. From our analysis of this power law behavior, we predict that in the GCM the high temperature dynamics will disappear at dynamical transition temperature and below that there will be a transition to the activated regime. Our study further reveals that the activated regime in the GCM is quite narrow.

LSD-induced entropic brain activity predicts subsequent personality change.

PubMed

Lebedev, A V; Kaelen, M; Lövdén, M; Nilsson, J; Feilding, A; Nutt, D J; Carhart-Harris, R L

2016-09-01

Personality is known to be relatively stable throughout adulthood. Nevertheless, it has been shown that major life events with high personal significance, including experiences engendered by psychedelic drugs, can have an enduring impact on some core facets of personality. In the present, balanced-order, placebo-controlled study, we investigated biological predictors of post-lysergic acid diethylamide (LSD) changes in personality. Nineteen healthy adults underwent resting state functional MRI scans under LSD (75µg, I.V.) and placebo (saline I.V.). The Revised NEO Personality Inventory (NEO-PI-R) was completed at screening and 2 weeks after LSD/placebo. Scanning sessions consisted of three 7.5-min eyes-closed resting-state scans, one of which involved music listening. A standardized preprocessing pipeline was used to extract measures of sample entropy, which characterizes the predictability of an fMRI time-series. Mixed-effects models were used to evaluate drug-induced shifts in brain entropy and their relationship with the observed increases in the personality trait openness at the 2-week follow-up. Overall, LSD had a pronounced global effect on brain entropy, increasing it in both sensory and hierarchically higher networks across multiple time scales. These shifts predicted enduring increases in trait openness. Moreover, the predictive power of the entropy increases was greatest for the music-listening scans and when "ego-dissolution" was reported during the acute experience. These results shed new light on how LSD-induced shifts in brain dynamics and concomitant subjective experience can be predictive of lasting changes in personality. Hum Brain Mapp 37:3203-3213, 2016. © 2016 Wiley Periodicals, Inc. © 2016 Wiley Periodicals, Inc.

Characterizing time series via complexity-entropy curves

NASA Astrophysics Data System (ADS)

Ribeiro, Haroldo V.; Jauregui, Max; Zunino, Luciano; Lenzi, Ervin K.

2017-06-01

The search for patterns in time series is a very common task when dealing with complex systems. This is usually accomplished by employing a complexity measure such as entropies and fractal dimensions. However, such measures usually only capture a single aspect of the system dynamics. Here, we propose a family of complexity measures for time series based on a generalization of the complexity-entropy causality plane. By replacing the Shannon entropy by a monoparametric entropy (Tsallis q entropy) and after considering the proper generalization of the statistical complexity (q complexity), we build up a parametric curve (the q -complexity-entropy curve) that is used for characterizing and classifying time series. Based on simple exact results and numerical simulations of stochastic processes, we show that these curves can distinguish among different long-range, short-range, and oscillating correlated behaviors. Also, we verify that simulated chaotic and stochastic time series can be distinguished based on whether these curves are open or closed. We further test this technique in experimental scenarios related to chaotic laser intensity, stock price, sunspot, and geomagnetic dynamics, confirming its usefulness. Finally, we prove that these curves enhance the automatic classification of time series with long-range correlations and interbeat intervals of healthy subjects and patients with heart disease.

Optimization of a Circular Microchannel With Entropy Generation Minimization Method

NASA Astrophysics Data System (ADS)

Jafari, Arash; Ghazali, Normah Mohd

2010-06-01

New advances in micro and nano scales are being realized and the contributions of micro and nano heat dissipation devices are of high importance in this novel technology development. Past studies showed that microchannel design depends on its thermal resistance and pressure drop. However, entropy generation minimization (EGM) as a new optimization theory stated that the rate of entropy generation should be also optimized. Application of EGM in microchannel heat sink design is reviewed and discussed in this paper. Latest principles for deriving the entropy generation relations are discussed to present how this approach can be achieved. An optimization procedure using EGM method with the entropy generation rate is derived for a circular microchannel heat sink based upon thermal resistance and pressure drop. The equations are solved using MATLAB and the obtained results are compared to similar past studies. The effects of channel diameter, number of channels, heat flux, and pumping power on the entropy generation rate and Reynolds number are investigated. Analytical correlations are utilized for heat transfer and friction coefficients. A minimum entropy generation has been observed for N = 40 and channel diameter of 90μm. It is concluded that for N = 40 and channel hydraulic diameter of 90μm, the circular microchannel heat sink is on its optimum operating point based on second law of thermodynamics.

Entropy production and optimization of geothermal power plants

NASA Astrophysics Data System (ADS)

Michaelides, Efstathios E.

2012-09-01

Geothermal power plants are currently producing reliable and low-cost, base load electricity. Three basic types of geothermal power plants are currently in operation: single-flashing, dual-flashing, and binary power plants. Typically, the single-flashing and dual-flashing geothermal power plants utilize geothermal water (brine) at temperatures in the range of 550-430 K. Binary units utilize geothermal resources at lower temperatures, typically 450-380 K. The entropy production in the various components of the three types of geothermal power plants determines the efficiency of the plants. It is axiomatic that a lower entropy production would improve significantly the energy utilization factor of the corresponding power plant. For this reason, the entropy production in the major components of the three types of geothermal power plants has been calculated. It was observed that binary power plants generate the lowest amount of entropy and, thus, convert the highest rate of geothermal energy into mechanical energy. The single-flashing units generate the highest amount of entropy, primarily because they re-inject fluid at relatively high temperature. The calculations for entropy production provide information on the equipment where the highest irreversibilities occur, and may be used to optimize the design of geothermal processes in future geothermal power plants and thermal cycles used for the harnessing of geothermal energy.

Subband Image Coding with Jointly Optimized Quantizers

NASA Technical Reports Server (NTRS)

Kossentini, Faouzi; Chung, Wilson C.; Smith Mark J. T.

1995-01-01

An iterative design algorithm for the joint design of complexity- and entropy-constrained subband quantizers and associated entropy coders is proposed. Unlike conventional subband design algorithms, the proposed algorithm does not require the use of various bit allocation algorithms. Multistage residual quantizers are employed here because they provide greater control of the complexity-performance tradeoffs, and also because they allow efficient and effective high-order statistical modeling. The resulting subband coder exploits statistical dependencies within subbands, across subbands, and across stages, mainly through complexity-constrained high-order entropy coding. Experimental results demonstrate that the complexity-rate-distortion performance of the new subband coder is exceptional.

Diffusivity anomaly in modified Stillinger-Weber liquids

NASA Astrophysics Data System (ADS)

Sengupta, Shiladitya; Vasisht, Vishwas V.; Sastry, Srikanth

2014-01-01

By modifying the tetrahedrality (the strength of the three body interactions) in the well-known Stillinger-Weber model for silicon, we study the diffusivity of a series of model liquids as a function of tetrahedrality and temperature at fixed pressure. Previous work has shown that at constant temperature, the diffusivity exhibits a maximum as a function of tetrahedrality, which we refer to as the diffusivity anomaly, in analogy with the well-known anomaly in water upon variation of pressure at constant temperature. We explore to what extent the structural and thermodynamic changes accompanying changes in the interaction potential can help rationalize the diffusivity anomaly, by employing the Rosenfeld relation between diffusivity and the excess entropy (over the ideal gas reference value), and the pair correlation entropy, which provides an approximation to the excess entropy in terms of the pair correlation function. We find that in the modified Stillinger-Weber liquids, the Rosenfeld relation works well above the melting temperatures but exhibits deviations below, with the deviations becoming smaller for smaller tetrahedrality. Further we find that both the excess entropy and the pair correlation entropy at constant temperature go through maxima as a function of the tetrahedrality, thus demonstrating the close relationship between structural, thermodynamic, and dynamical anomalies in the modified Stillinger-Weber liquids.

Shannon information entropy in the canonical genetic code.

PubMed

Nemzer, Louis R

2017-02-21

The Shannon entropy measures the expected information value of messages. As with thermodynamic entropy, the Shannon entropy is only defined within a system that identifies at the outset the collections of possible messages, analogous to microstates, that will be considered indistinguishable macrostates. This fundamental insight is applied here for the first time to amino acid alphabets, which group the twenty common amino acids into families based on chemical and physical similarities. To evaluate these schemas objectively, a novel quantitative method is introduced based the inherent redundancy in the canonical genetic code. Each alphabet is taken as a separate system that partitions the 64 possible RNA codons, the microstates, into families, the macrostates. By calculating the normalized mutual information, which measures the reduction in Shannon entropy, conveyed by single nucleotide messages, groupings that best leverage this aspect of fault tolerance in the code are identified. The relative importance of properties related to protein folding - like hydropathy and size - and function, including side-chain acidity, can also be estimated. This approach allows the quantification of the average information value of nucleotide positions, which can shed light on the coevolution of the canonical genetic code with the tRNA-protein translation mechanism. Copyright © 2016 Elsevier Ltd. All rights reserved.

Quasiparticle entropy in superconductor/normal metal/superconductor proximity junctions in the diffusive limit

NASA Astrophysics Data System (ADS)

Virtanen, P.; Vischi, F.; Strambini, E.; Carrega, M.; Giazotto, F.

2017-12-01

We discuss the quasiparticle entropy and heat capacity of a dirty superconductor/normal metal/superconductor junction. In the case of short junctions, the inverse proximity effect extending in the superconducting banks plays a crucial role in determining the thermodynamic quantities. In this case, commonly used approximations can violate thermodynamic relations between supercurrent and quasiparticle entropy. We provide analytical and numerical results as a function of different geometrical parameters. Quantitative estimates for the heat capacity can be relevant for the design of caloritronic devices or radiation sensor applications.

Measuring entanglement entropy of a generic many-body system with a quantum switch.

PubMed

Abanin, Dmitry A; Demler, Eugene

2012-07-13

Entanglement entropy has become an important theoretical concept in condensed matter physics because it provides a unique tool for characterizing quantum mechanical many-body phases and new kinds of quantum order. However, the experimental measurement of entanglement entropy in a many-body system is widely believed to be unfeasible, owing to the nonlocal character of this quantity. Here, we propose a general method to measure the entanglement entropy. The method is based on a quantum switch (a two-level system) coupled to a composite system consisting of several copies of the original many-body system. The state of the switch controls how different parts of the composite system connect to each other. We show that, by studying the dynamics of the quantum switch only, the Rényi entanglement entropy of the many-body system can be extracted. We propose a possible design of the quantum switch, which can be realized in cold atomic systems. Our work provides a route towards testing the scaling of entanglement in critical systems as well as a method for a direct experimental detection of topological order.

Equilibrium Polymerization of Butyl Methacrylate in Bulk and in Nanopore Confinement

NASA Astrophysics Data System (ADS)

Tian, Qian; Simon, Sindee

The equilibrium between monomer and polymer in free radical polymerization can be shifted towards monomer under nanoconfinement. This decrease in ceiling temperature is due to a decrease in the entropy associated with the constrained polymer chains, resulting in a larger negative change in entropy of reaction. Here, we investigate the equilibrium polymerization of butyl methacrylate (BMA) in bulk and in nanopore confinement with differential scanning calorimetry (DSC) using di-tert-butyl peroxide (DTBP) as initiator. This system has several advantages compare to the previously studied system of methyl methacrylate (MMA) initiated with 2,2'-azo-bis-isobutyronitrile (AIBN), namely, a reduced rate of reaction, higher boiling point of monomer, and higher initiator utilization temperature range, all of which facilitate the study of the reaction at high temperatures near the ceiling temperature. Interestingly, for BMA, there is no change in limiting conversion between material reacted in bulk and that in controlled pore glass having pore diameters of 7.5 and 50 nm. This unexpected result may be due to the greater flexibility of the PBMA chains compared to PMMA, suggesting that in the BMA/PBMA system, the degree of confinement is relatively low. Future studies will continue to investigate how the entropy change on reaction is affected by confinement.

Neural-scaled entropy predicts the effects of nonlinear frequency compression on speech perception

PubMed Central

Rallapalli, Varsha H.; Alexander, Joshua M.

2015-01-01

The Neural-Scaled Entropy (NSE) model quantifies information in the speech signal that has been altered beyond simple gain adjustments by sensorineural hearing loss (SNHL) and various signal processing. An extension of Cochlear-Scaled Entropy (CSE) [Stilp, Kiefte, Alexander, and Kluender (2010). J. Acoust. Soc. Am. 128(4), 2112–2126], NSE quantifies information as the change in 1-ms neural firing patterns across frequency. To evaluate the model, data from a study that examined nonlinear frequency compression (NFC) in listeners with SNHL were used because NFC can recode the same input information in multiple ways in the output, resulting in different outcomes for different speech classes. Overall, predictions were more accurate for NSE than CSE. The NSE model accurately described the observed degradation in recognition, and lack thereof, for consonants in a vowel-consonant-vowel context that had been processed in different ways by NFC. While NSE accurately predicted recognition of vowel stimuli processed with NFC, it underestimated them relative to a low-pass control condition without NFC. In addition, without modifications, it could not predict the observed improvement in recognition for word final /s/ and /z/. Findings suggest that model modifications that include information from slower modulations might improve predictions across a wider variety of conditions. PMID:26627780

Diffusion Entropy: A Potential Neuroimaging Biomarker of Bipolar Disorder in the Temporal Pole.

PubMed

Spuhler, Karl; Bartlett, Elizabeth; Ding, Jie; DeLorenzo, Christine; Parsey, Ramin; Huang, Chuan

2018-02-01

Despite much research, bipolar depression remains poorly understood, with no clinically useful biomarkers for its diagnosis. The paralimbic system has become a target for biomarker research, with paralimbic structural connectivity commonly reported to distinguish bipolar patients from controls in tractography-based diffusion MRI studies, despite inconsistent findings in voxel-based studies. The purpose of this analysis was to validate existing findings with traditional diffusion MRI metrics and investigate the utility of a novel diffusion MRI metric, entropy of diffusion, in the search for bipolar depression biomarkers. We performed group-level analysis on 9 un-medicated (6 medication-naïve; 3 medication-free for at least 33 days) bipolar patients in a major depressive episode and 9 matched healthy controls to compare: (1) average mean diffusivity (MD) and fractional anisotropy (FA) and; (2) MD and FA histogram entropy-a statistical measure of distribution homogeneity-in the amygdala, hippocampus, orbitofrontal cortex and temporal pole. We also conducted classification analyses with leave-one-out and separate testing dataset (N = 11) approaches. We did not observe statistically significant differences in average MD or FA between the groups in any region. However, in the temporal pole, we observed significantly lower MD entropy in bipolar patients; this finding suggests a regional difference in MD distributions in the absence of an average difference. This metric allowed us to accurately characterize bipolar patients from controls in leave-one-out (accuracy = 83%) and prediction (accuracy = 73%) analyses. This novel application of diffusion MRI yielded not only an interesting separation between bipolar patients and healthy controls, but also accurately classified bipolar patients from controls. © 2017 Wiley Periodicals, Inc.

Reduced nocturnal ACTH-driven cortisol secretion during critical illness

PubMed Central

Boonen, Eva; Meersseman, Philippe; Vervenne, Hilke; Meyfroidt, Geert; Guïza, Fabian; Wouters, Pieter J.; Veldhuis, Johannes D.

2014-01-01

Recently, during critical illness, cortisol metabolism was found to be reduced. We hypothesize that such reduced cortisol breakdown may suppress pulsatile ACTH and cortisol secretion via feedback inhibition. To test this hypothesis, nocturnal ACTH and cortisol secretory profiles were constructed by deconvolution analysis from plasma concentration time series in 40 matched critically ill patients and eight healthy controls, excluding diseases or drugs that affect the hypothalamic-pituitary-adrenal axis. Blood was sampled every 10 min between 2100 and 0600 to quantify plasma concentrations of ACTH and (free) cortisol. Approximate entropy, an estimation of process irregularity, cross-approximate entropy, a measure of ACTH-cortisol asynchrony, and ACTH-cortisol dose-response relationships were calculated. Total and free plasma cortisol concentrations were higher at all times in patients than in controls (all P < 0.04). Pulsatile cortisol secretion was 54% lower in patients than in controls (P = 0.005), explained by reduced cortisol burst mass (P = 0.03), whereas cortisol pulse frequency (P = 0.35) and nonpulsatile cortisol secretion (P = 0.80) were unaltered. Pulsatile ACTH secretion was 31% lower in patients than in controls (P = 0.03), again explained by a lower ACTH burst mass (P = 0.02), whereas ACTH pulse frequency (P = 0.50) and nonpulsatile ACTH secretion (P = 0.80) were unchanged. ACTH-cortisol dose response estimates were similar in patients and controls. ACTH and cortisol approximate entropy were higher in patients (P ≤ 0.03), as was ACTH-cortisol cross-approximate entropy (P ≤ 0.001). We conclude that hypercortisolism during critical illness coincided with suppressed pulsatile ACTH and cortisol secretion and a normal ACTH-cortisol dose response. Increased irregularity and asynchrony of the ACTH and cortisol time series supported non-ACTH-dependent mechanisms driving hypercortisolism during critical illness. PMID:24569590

Complexity Measures in Magnetoencephalography: Measuring "Disorder" in Schizophrenia

PubMed Central

Brookes, Matthew J.; Hall, Emma L.; Robson, Siân E.; Price, Darren; Palaniyappan, Lena; Liddle, Elizabeth B.; Liddle, Peter F.; Robinson, Stephen E.; Morris, Peter G.

2015-01-01

This paper details a methodology which, when applied to magnetoencephalography (MEG) data, is capable of measuring the spatio-temporal dynamics of ‘disorder’ in the human brain. Our method, which is based upon signal entropy, shows that spatially separate brain regions (or networks) generate temporally independent entropy time-courses. These time-courses are modulated by cognitive tasks, with an increase in local neural processing characterised by localised and transient increases in entropy in the neural signal. We explore the relationship between entropy and the more established time-frequency decomposition methods, which elucidate the temporal evolution of neural oscillations. We observe a direct but complex relationship between entropy and oscillatory amplitude, which suggests that these metrics are complementary. Finally, we provide a demonstration of the clinical utility of our method, using it to shed light on aberrant neurophysiological processing in schizophrenia. We demonstrate significantly increased task induced entropy change in patients (compared to controls) in multiple brain regions, including a cingulo-insula network, bilateral insula cortices and a right fronto-parietal network. These findings demonstrate potential clinical utility for our method and support a recent hypothesis that schizophrenia can be characterised by abnormalities in the salience network (a well characterised distributed network comprising bilateral insula and cingulate cortices). PMID:25886553

Power spectrum entropy of acceleration time-series during movement as an indicator of smoothness of movement.

PubMed

Kojima, Motonaga; Obuchi, Shuichi; Mizuno, Kousuke; Henmi, Osamu; Ikeda, Noriaki

2008-06-01

We propose a novel indicator for smoothness of movement, i.e., the power spectrum entropy of the acceleration time-series, and compare it with conventional indices of smoothness. For this purpose, nineteen healthy adults (21.3+/-2.5 years old) performed the task of raising and lowering a beaker between the level of the umbilicus and eye level under the two following conditions: one with the beaker containing water and the other with the beaker containing a weight of the same mass as the water. Moving the beaker up and down when it contained water required extra control to prevent the water from being spilled. This means that movement was not as smooth as when the beaker contained a weight. Under these two conditions, entropy was measured along with a traditional indicator of smoothness of movement, the jerk index. The entropy could distinguish just as well as the jerk index (p<0.01) between when water was used and when the weight was used. The entropy correlated highly with the jerk index, with Spearman's rho at 0.88 (p<0.01). These results showed that the entropy derived from the spectrum of the acceleration time-series during movement is useful as an indicator of the smoothness of that movement.

Maximum one-shot dissipated work from Rényi divergences

NASA Astrophysics Data System (ADS)

Yunger Halpern, Nicole; Garner, Andrew J. P.; Dahlsten, Oscar C. O.; Vedral, Vlatko

2018-05-01

Thermodynamics describes large-scale, slowly evolving systems. Two modern approaches generalize thermodynamics: fluctuation theorems, which concern finite-time nonequilibrium processes, and one-shot statistical mechanics, which concerns small scales and finite numbers of trials. Combining these approaches, we calculate a one-shot analog of the average dissipated work defined in fluctuation contexts: the cost of performing a protocol in finite time instead of quasistatically. The average dissipated work has been shown to be proportional to a relative entropy between phase-space densities, to a relative entropy between quantum states, and to a relative entropy between probability distributions over possible values of work. We derive one-shot analogs of all three equations, demonstrating that the order-infinity Rényi divergence is proportional to the maximum possible dissipated work in each case. These one-shot analogs of fluctuation-theorem results contribute to the unification of these two toolkits for small-scale, nonequilibrium statistical physics.

Maximum one-shot dissipated work from Rényi divergences.

PubMed

Yunger Halpern, Nicole; Garner, Andrew J P; Dahlsten, Oscar C O; Vedral, Vlatko

2018-05-01

Thermodynamics describes large-scale, slowly evolving systems. Two modern approaches generalize thermodynamics: fluctuation theorems, which concern finite-time nonequilibrium processes, and one-shot statistical mechanics, which concerns small scales and finite numbers of trials. Combining these approaches, we calculate a one-shot analog of the average dissipated work defined in fluctuation contexts: the cost of performing a protocol in finite time instead of quasistatically. The average dissipated work has been shown to be proportional to a relative entropy between phase-space densities, to a relative entropy between quantum states, and to a relative entropy between probability distributions over possible values of work. We derive one-shot analogs of all three equations, demonstrating that the order-infinity Rényi divergence is proportional to the maximum possible dissipated work in each case. These one-shot analogs of fluctuation-theorem results contribute to the unification of these two toolkits for small-scale, nonequilibrium statistical physics.

Fluctuation relations and Maxwell's demon in a circuit QED setup

NASA Astrophysics Data System (ADS)

Nakamura, Yasunobu

The recent progress in information thermodynamics has resolved the paradox of Maxwell's demon and clarified the relationship between the information and the entropy. Its extension to quantum mechanical systems has also attracted much interest, and experimental demonstrations are awaited. Circuit QED systems offer the following tools suitable for investigating the properties of a quantum system coupled with a controlled environment: (i) a well-controlled qubit with a long coherence time, (ii) dispersive readout allowing high-fidelity quantum nondemolition measurement, and (iii) fast feedback control. We first apply the so-called two-measurement protocol (TMP) to a superconducting transmon qubit in a microwave cavity and study how the decoherence affects the nonequilibrium thermodynamic relations. Next, we implement Maxwell's demon in the circuit QED system by introducing a feedback loop and confirm the fluctuation relation including the effect of the information obtained in the feedback process. These results constitute a first step towards quantum thermodynamics in circuit QED systems.

Directionality theory and the evolution of body size.

PubMed

Demetrius, L

2000-12-07

Directionality theory, a dynamic theory of evolution that integrates population genetics with demography, is based on the concept of evolutionary entropy, a measure of the variability in the age of reproducing individuals in a population. The main tenets of the theory are three principles relating the response to the ecological constraints a population experiences, with trends in entropy as the population evolves under mutation and natural selection. (i) Stationary size or fluctuations around a stationary size (bounded growth): a unidirectional increase in entropy; (ii) prolonged episodes of exponential growth (unbounded growth), large population size: a unidirectional decrease in entropy; and (iii) prolonged episodes of exponential growth (unbounded growth), small population size: random, non-directional change in entropy. We invoke these principles, together with an allometric relationship between entropy, and the morphometric variable body size, to provide evolutionary explanations of three empirical patterns pertaining to trends in body size, namely (i) Cope's rule, the tendency towards size increase within phyletic lineages; (ii) the island rule, which pertains to changes in body size that occur as species migrate from mainland populations to colonize island habitats; and (iii) Bergmann's rule, the tendency towards size increase with increasing latitude. The observation that these ecotypic patterns can be explained in terms of the directionality principles for entropy underscores the significance of evolutionary entropy as a unifying concept in forging a link between micro-evolution, the dynamics of gene frequency change, and macro-evolution, dynamic changes in morphometric variables.

Heart rate variability analysis based on time-frequency representation and entropies in hypertrophic cardiomyopathy patients.

PubMed

Clariá, F; Vallverdú, M; Baranowski, R; Chojnowska, L; Caminal, P

2008-03-01

In hypertrophic cardiomyopathy (HCM) patients there is an increased risk of premature death, which can occur with little or no warning. Furthermore, classification for sudden cardiac death on patients with HCM is very difficult. The aim of our study was to improve the prognostic value of heart rate variability (HRV) in HCM patients, giving insight into changes of the autonomic nervous system. In this way, the suitability of linear and nonlinear measures was studied to assess the HRV. These measures were based on time-frequency representation (TFR) and on Shannon and Rényi entropies, and compared with traditional HRV measures. Holter recordings of 64 patients with HCM and 55 healthy subjects were analyzed. The HCM patients consisted of two groups: 13 high risk patients, after aborted sudden cardiac death (SCD); 51 low risk patients, without SCD. Five-hour RR signals, corresponding to the sleep period of the subjects, were considered for the analysis as a comparable standard situation. These RR signals were filtered in the three frequency bands: very low frequency band (VLF, 0-0.04 Hz), low frequency band (LF, 0.04-0.15 Hz) and high frequency band (HF, 0.15-0.45 Hz). TFR variables based on instantaneous frequency and energy functions were able to classify HCM patients and healthy subjects (control group). Results revealed that measures obtained from TFR analysis of the HRV better classified the groups of subjects than traditional HRV parameters. However, results showed that nonlinear measures improved group classification. It was observed that entropies calculated in the HF band showed the highest statistically significant levels comparing the HCM group and the control group, p-value < 0.0005. The values of entropy measures calculated in the HCM group presented lower values, indicating a decreasing of complexity, than those calculated from the control group. Moreover, similar behavior was observed comparing high and low risk of premature death, the values of the entropy being lower in high risk patients, p-value < 0.05, indicating an increase of predictability. Furthermore, measures from information entropy, but not from TFR, seem to be useful for enhanced risk stratification in HCM patients with an increased risk of sudden cardiac death.

The relative entropy is fundamental to adaptive resolution simulations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kreis, Karsten; Graduate School Materials Science in Mainz, Staudingerweg 9, 55128 Mainz; Potestio, Raffaello, E-mail: potestio@mpip-mainz.mpg.de

Adaptive resolution techniques are powerful methods for the efficient simulation of soft matter systems in which they simultaneously employ atomistic and coarse-grained (CG) force fields. In such simulations, two regions with different resolutions are coupled with each other via a hybrid transition region, and particles change their description on the fly when crossing this boundary. Here we show that the relative entropy, which provides a fundamental basis for many approaches in systematic coarse-graining, is also an effective instrument for the understanding of adaptive resolution simulation methodologies. We demonstrate that the use of coarse-grained potentials which minimize the relative entropy withmore » respect to the atomistic system can help achieve a smoother transition between the different regions within the adaptive setup. Furthermore, we derive a quantitative relation between the width of the hybrid region and the seamlessness of the coupling. Our results do not only shed light on the what and how of adaptive resolution techniques but will also help setting up such simulations in an optimal manner.« less

The relative entropy is fundamental to adaptive resolution simulations

NASA Astrophysics Data System (ADS)

Kreis, Karsten; Potestio, Raffaello

2016-07-01

Adaptive resolution techniques are powerful methods for the efficient simulation of soft matter systems in which they simultaneously employ atomistic and coarse-grained (CG) force fields. In such simulations, two regions with different resolutions are coupled with each other via a hybrid transition region, and particles change their description on the fly when crossing this boundary. Here we show that the relative entropy, which provides a fundamental basis for many approaches in systematic coarse-graining, is also an effective instrument for the understanding of adaptive resolution simulation methodologies. We demonstrate that the use of coarse-grained potentials which minimize the relative entropy with respect to the atomistic system can help achieve a smoother transition between the different regions within the adaptive setup. Furthermore, we derive a quantitative relation between the width of the hybrid region and the seamlessness of the coupling. Our results do not only shed light on the what and how of adaptive resolution techniques but will also help setting up such simulations in an optimal manner.

Stochastic thermodynamics

NASA Astrophysics Data System (ADS)

Eichhorn, Ralf; Aurell, Erik

2014-04-01

'Stochastic thermodynamics as a conceptual framework combines the stochastic energetics approach introduced a decade ago by Sekimoto [1] with the idea that entropy can consistently be assigned to a single fluctuating trajectory [2]'. This quote, taken from Udo Seifert's [3] 2008 review, nicely summarizes the basic ideas behind stochastic thermodynamics: for small systems, driven by external forces and in contact with a heat bath at a well-defined temperature, stochastic energetics [4] defines the exchanged work and heat along a single fluctuating trajectory and connects them to changes in the internal (system) energy by an energy balance analogous to the first law of thermodynamics. Additionally, providing a consistent definition of trajectory-wise entropy production gives rise to second-law-like relations and forms the basis for a 'stochastic thermodynamics' along individual fluctuating trajectories. In order to construct meaningful concepts of work, heat and entropy production for single trajectories, their definitions are based on the stochastic equations of motion modeling the physical system of interest. Because of this, they are valid even for systems that are prevented from equilibrating with the thermal environment by external driving forces (or other sources of non-equilibrium). In that way, the central notions of equilibrium thermodynamics, such as heat, work and entropy, are consistently extended to the non-equilibrium realm. In the (non-equilibrium) ensemble, the trajectory-wise quantities acquire distributions. General statements derived within stochastic thermodynamics typically refer to properties of these distributions, and are valid in the non-equilibrium regime even beyond the linear response. The extension of statistical mechanics and of exact thermodynamic statements to the non-equilibrium realm has been discussed from the early days of statistical mechanics more than 100 years ago. This debate culminated in the development of linear response theory for small deviations from equilibrium, in which a general framework is constructed from the analysis of non-equilibrium states close to equilibrium. In a next step, Prigogine and others developed linear irreversible thermodynamics, which establishes relations between transport coefficients and entropy production on a phenomenological level in terms of thermodynamic forces and fluxes. However, beyond the realm of linear response no general theoretical results were available for quite a long time. This situation has changed drastically over the last 20 years with the development of stochastic thermodynamics, revealing that the range of validity of thermodynamic statements can indeed be extended deep into the non-equilibrium regime. Early developments in that direction trace back to the observations of symmetry relations between the probabilities for entropy production and entropy annihilation in non-equilibrium steady states [5-8] (nowadays categorized in the class of so-called detailed fluctuation theorems), and the derivations of the Bochkov-Kuzovlev [9, 10] and Jarzynski relations [11] (which are now classified as so-called integral fluctuation theorems). Apart from its fundamental theoretical interest, the developments in stochastic thermodynamics have experienced an additional boost from the recent experimental progress in fabricating, manipulating, controlling and observing systems on the micro- and nano-scale. These advances are not only of formidable use for probing and monitoring biological processes on the cellular, sub-cellular and molecular level, but even include the realization of a microscopic thermodynamic heat engine [12] or the experimental verification of Landauer's principle in a colloidal system [13]. The scientific program Stochastic Thermodynamics held between 4 and 15 March 2013, and hosted by The Nordic Institute for Theoretical Physics (Nordita), was attended by more than 50 scientists from the Nordic countries and elsewhere, amongst them many leading experts in the field. During the program, the most recent developments, open questions and new ideas in stochastic thermodynamics were presented and discussed. From the talks and debates, the notion of information in stochastic thermodynamics, the fundamental properties of entropy production (rate) in non-equilibrium, the efficiency of small thermodynamic machines and the characteristics of optimal protocols for the applied (cyclic) forces were crystallizing as main themes. Surprisingly, the long-studied adiabatic piston, its peculiarities and its relation to stochastic thermodynamics were also the subject of intense discussions. The comment on the Nordita program Stochastic Thermodynamics published in this issue of Physica Scripta exploits the Jarzynski relation for determining free energy differences in the adiabatic piston. This scientific program and the contribution presented here were made possible by the financial and administrative support of The Nordic Institute for Theoretical Physics.

Computing the Entropy of Kerr-Newman Black Hole Without Brick Walls Method

NASA Astrophysics Data System (ADS)

Zhang, Li-Chun; Wu, Yue-Qin; Li, Huai-Fan; Ren, Zhao

By using the entanglement entropy method, the statistical entropy of the Bose and Fermi fields in a thin film is calculated and the Bekenstein-Hawking entropy of Kerr-Newman black hole is obtained. Here, the Bose and Fermi fields are entangled with the quantum states in Kerr-Newman black hole and are outside of the horizon. The divergence of brick-wall model is avoided without any cutoff by the new equation of state density obtained with the generalized uncertainty principle. The calculation implies that the high density quantum states near the event horizon are strongly correlated with the quantum states in black hole. The black hole entropy is a quantum effect. It is an intrinsic characteristic of space-time. The ultraviolet cutoff in the brick-wall model is unreasonable. The generalized uncertainty principle should be considered in the high energy quantum field near the event horizon. From the calculation, the constant λ introduced in the generalized uncertainty principle is related to polar angle θ in an axisymmetric space-time.

Large magnetic entropy change and magnetoresistance in a Ni 41Co 9Mn 40Sn 10 magnetic shape memory alloy

DOE PAGES

Huang, L.; Cong, D. Y.; Ma, L.; ...

2015-07-02

A polycrystalline Ni 41Co 9Mn 40Sn 10 (at. %) magnetic shape memory alloy was prepared by arc melting and characterized mainly by magnetic measurements, in-situ high-energy X-ray diffraction (HEXRD), and mechanical testing. A large magnetoresistance of 53.8% (under 5 T) and a large magnetic entropy change of 31.9 J/(kg K) (under 5 T) were simultaneously achieved. Both of these values are among the highest values reported so far in Ni-Mn-Sn-based Heusler alloys. The large magnetic entropy change, closely related to the structural entropy change, is attributed to the large unit cell volume change across martensitic transformation as revealed by ourmore » in-situ HEXRD experiment. Furthermore, good compressive properties were also obtained. Lastly, the combination of large magnetoresistance, large magnetic entropy change, and good compressive properties, as well as low cost makes this alloy a promising candidate for multifunctional applications.« less

Entropy and convexity for nonlinear partial differential equations

PubMed Central

Ball, John M.; Chen, Gui-Qiang G.

2013-01-01

Partial differential equations are ubiquitous in almost all applications of mathematics, where they provide a natural mathematical description of many phenomena involving change in physical, chemical, biological and social processes. The concept of entropy originated in thermodynamics and statistical physics during the nineteenth century to describe the heat exchanges that occur in the thermal processes in a thermodynamic system, while the original notion of convexity is for sets and functions in mathematics. Since then, entropy and convexity have become two of the most important concepts in mathematics. In particular, nonlinear methods via entropy and convexity have been playing an increasingly important role in the analysis of nonlinear partial differential equations in recent decades. This opening article of the Theme Issue is intended to provide an introduction to entropy, convexity and related nonlinear methods for the analysis of nonlinear partial differential equations. We also provide a brief discussion about the content and contributions of the papers that make up this Theme Issue. PMID:24249768

Generalized Entanglement Entropies of Quantum Designs.

PubMed

Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun

2018-03-30

The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.

A modified belief entropy in Dempster-Shafer framework.

PubMed

Zhou, Deyun; Tang, Yongchuan; Jiang, Wen

2017-01-01

How to quantify the uncertain information in the framework of Dempster-Shafer evidence theory is still an open issue. Quite a few uncertainty measures have been proposed in Dempster-Shafer framework, however, the existing studies mainly focus on the mass function itself, the available information represented by the scale of the frame of discernment (FOD) in the body of evidence is ignored. Without taking full advantage of the information in the body of evidence, the existing methods are somehow not that efficient. In this paper, a modified belief entropy is proposed by considering the scale of FOD and the relative scale of a focal element with respect to FOD. Inspired by Deng entropy, the new belief entropy is consistent with Shannon entropy in the sense of probability consistency. What's more, with less information loss, the new measure can overcome the shortage of some other uncertainty measures. A few numerical examples and a case study are presented to show the efficiency and superiority of the proposed method.

A modified belief entropy in Dempster-Shafer framework

PubMed Central

Zhou, Deyun; Jiang, Wen

2017-01-01

How to quantify the uncertain information in the framework of Dempster-Shafer evidence theory is still an open issue. Quite a few uncertainty measures have been proposed in Dempster-Shafer framework, however, the existing studies mainly focus on the mass function itself, the available information represented by the scale of the frame of discernment (FOD) in the body of evidence is ignored. Without taking full advantage of the information in the body of evidence, the existing methods are somehow not that efficient. In this paper, a modified belief entropy is proposed by considering the scale of FOD and the relative scale of a focal element with respect to FOD. Inspired by Deng entropy, the new belief entropy is consistent with Shannon entropy in the sense of probability consistency. What’s more, with less information loss, the new measure can overcome the shortage of some other uncertainty measures. A few numerical examples and a case study are presented to show the efficiency and superiority of the proposed method. PMID:28481914

Generalized Entanglement Entropies of Quantum Designs

NASA Astrophysics Data System (ADS)

Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun

2018-03-01

The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.

A Discrete Constraint for Entropy Conservation and Sound Waves in Cloud-Resolving Modeling

NASA Technical Reports Server (NTRS)

Zeng, Xi-Ping; Tao, Wei-Kuo; Simpson, Joanne

2003-01-01

Ideal cloud-resolving models contain little-accumulative errors. When their domain is so large that synoptic large-scale circulations are accommodated, they can be used for the simulation of the interaction between convective clouds and the large-scale circulations. This paper sets up a framework for the models, using moist entropy as a prognostic variable and employing conservative numerical schemes. The models possess no accumulative errors of thermodynamic variables when they comply with a discrete constraint on entropy conservation and sound waves. Alternatively speaking, the discrete constraint is related to the correct representation of the large-scale convergence and advection of moist entropy. Since air density is involved in entropy conservation and sound waves, the challenge is how to compute sound waves efficiently under the constraint. To address the challenge, a compensation method is introduced on the basis of a reference isothermal atmosphere whose governing equations are solved analytically. Stability analysis and numerical experiments show that the method allows the models to integrate efficiently with a large time step.

Entropy and convexity for nonlinear partial differential equations.

PubMed

Ball, John M; Chen, Gui-Qiang G

2013-12-28

Partial differential equations are ubiquitous in almost all applications of mathematics, where they provide a natural mathematical description of many phenomena involving change in physical, chemical, biological and social processes. The concept of entropy originated in thermodynamics and statistical physics during the nineteenth century to describe the heat exchanges that occur in the thermal processes in a thermodynamic system, while the original notion of convexity is for sets and functions in mathematics. Since then, entropy and convexity have become two of the most important concepts in mathematics. In particular, nonlinear methods via entropy and convexity have been playing an increasingly important role in the analysis of nonlinear partial differential equations in recent decades. This opening article of the Theme Issue is intended to provide an introduction to entropy, convexity and related nonlinear methods for the analysis of nonlinear partial differential equations. We also provide a brief discussion about the content and contributions of the papers that make up this Theme Issue.

Protein flexibility and conformational entropy in ligand design targeting the carbohydrate recognition domain of galectin-3.

PubMed

Diehl, Carl; Engström, Olof; Delaine, Tamara; Håkansson, Maria; Genheden, Samuel; Modig, Kristofer; Leffler, Hakon; Ryde, Ulf; Nilsson, Ulf J; Akke, Mikael

2010-10-20

Rational drug design is predicated on knowledge of the three-dimensional structure of the protein-ligand complex and the thermodynamics of ligand binding. Despite the fundamental importance of both enthalpy and entropy in driving ligand binding, the role of conformational entropy is rarely addressed in drug design. In this work, we have probed the conformational entropy and its relative contribution to the free energy of ligand binding to the carbohydrate recognition domain of galectin-3. Using a combination of NMR spectroscopy, isothermal titration calorimetry, and X-ray crystallography, we characterized the binding of three ligands with dissociation constants ranging over 2 orders of magnitude. (15)N and (2)H spin relaxation measurements showed that the protein backbone and side chains respond to ligand binding by increased conformational fluctuations, on average, that differ among the three ligand-bound states. Variability in the response to ligand binding is prominent in the hydrophobic core, where a distal cluster of methyl groups becomes more rigid, whereas methyl groups closer to the binding site become more flexible. The results reveal an intricate interplay between structure and conformational fluctuations in the different complexes that fine-tunes the affinity. The estimated change in conformational entropy is comparable in magnitude to the binding enthalpy, demonstrating that it contributes favorably and significantly to ligand binding. We speculate that the relatively weak inherent protein-carbohydrate interactions and limited hydrophobic effect associated with oligosaccharide binding might have exerted evolutionary pressure on carbohydrate-binding proteins to increase the affinity by means of conformational entropy.

Entropy of balance - some recent results

PubMed Central

2010-01-01

Background Entropy when applied to biological signals is expected to reflect the state of the biological system. However the physiological interpretation of the entropy is not always straightforward. When should high entropy be interpreted as a healthy sign, and when as marker of deteriorating health? We address this question for the particular case of human standing balance and the Center of Pressure data. Methods We have measured and analyzed balance data of 136 participants (young, n = 45; elderly, n = 91) comprising in all 1085 trials, and calculated the Sample Entropy (SampEn) for medio-lateral (M/L) and anterior-posterior (A/P) Center of Pressure (COP) together with the Hurst self-similariy (ss) exponent α using Detrended Fluctuation Analysis (DFA). The COP was measured with a force plate in eight 30 seconds trials with eyes closed, eyes open, foam, self-perturbation and nudge conditions. Results 1) There is a significant difference in SampEn for the A/P-direction between the elderly and the younger groups Old > young. 2) For the elderly we have in general A/P > M/L. 3) For the younger group there was no significant A/P-M/L difference with the exception for the nudge trials where we had the reverse situation, A/P < M/L. 4) For the elderly we have, Eyes Closed > Eyes Open. 5) In case of the Hurst ss-exponent we have for the elderly, M/L > A/P. Conclusions These results seem to be require some modifications of the more or less established attention-constraint interpretation of entropy. This holds that higher entropy correlates with a more automatic and a less constrained mode of balance control, and that a higher entropy reflects, in this sense, a more efficient balancing. PMID:20670457

It is not the entropy you produce, rather, how you produce it

PubMed Central

Volk, Tyler; Pauluis, Olivier

2010-01-01

The principle of maximum entropy production (MEP) seeks to better understand a large variety of the Earth's environmental and ecological systems by postulating that processes far from thermodynamic equilibrium will ‘adapt to steady states at which they dissipate energy and produce entropy at the maximum possible rate’. Our aim in this ‘outside view’, invited by Axel Kleidon, is to focus on what we think is an outstanding challenge for MEP and for irreversible thermodynamics in general: making specific predictions about the relative contribution of individual processes to entropy production. Using studies that compared entropy production in the atmosphere of a dry versus humid Earth, we show that two systems might have the same entropy production rate but very different internal dynamics of dissipation. Using the results of several of the papers in this special issue and a thought experiment, we show that components of life-containing systems can evolve to either lower or raise the entropy production rate. Our analysis makes explicit fundamental questions for MEP that should be brought into focus: can MEP predict not just the overall state of entropy production of a system but also the details of the sub-systems of dissipaters within the system? Which fluxes of the system are those that are most likely to be maximized? How it is possible for MEP theory to be so domain-neutral that it can claim to apply equally to both purely physical–chemical systems and also systems governed by the ‘laws’ of biological evolution? We conclude that the principle of MEP needs to take on the issue of exactly how entropy is produced. PMID:20368249

Remarks on entanglement entropy in string theory

NASA Astrophysics Data System (ADS)

Balasubramanian, Vijay; Parrikar, Onkar

2018-03-01

Entanglement entropy for spatial subregions is difficult to define in string theory because of the extended nature of strings. Here we propose a definition for bosonic open strings using the framework of string field theory. The key difference (compared to ordinary quantum field theory) is that the subregion is chosen inside a Cauchy surface in the "space of open string configurations." We first present a simple calculation of this entanglement entropy in free light-cone string field theory, ignoring subtleties related to the factorization of the Hilbert space. We reproduce the answer expected from an effective field theory point of view, namely a sum over the one-loop entanglement entropies corresponding to all the particle-excitations of the string, and further show that the full string theory regulates ultraviolet divergences in the entanglement entropy. We then revisit the question of factorization of the Hilbert space by analyzing the covariant phase-space associated with a subregion in Witten's covariant string field theory. We show that the pure gauge (i.e., BRST exact) modes in the string field become dynamical at the entanglement cut. Thus, a proper definition of the entropy must involve an extended Hilbert space, with new stringy edge modes localized at the entanglement cut.

On Entropy Production in the Madelung Fluid and the Role of Bohm's Potential in Classical Diffusion

NASA Astrophysics Data System (ADS)

Heifetz, Eyal; Tsekov, Roumen; Cohen, Eliahu; Nussinov, Zohar

2016-07-01

The Madelung equations map the non-relativistic time-dependent Schrödinger equation into hydrodynamic equations of a virtual fluid. While the von Neumann entropy remains constant, we demonstrate that an increase of the Shannon entropy, associated with this Madelung fluid, is proportional to the expectation value of its velocity divergence. Hence, the Shannon entropy may grow (or decrease) due to an expansion (or compression) of the Madelung fluid. These effects result from the interference between solutions of the Schrödinger equation. Growth of the Shannon entropy due to expansion is common in diffusive processes. However, in the latter the process is irreversible while the processes in the Madelung fluid are always reversible. The relations between interference, compressibility and variation of the Shannon entropy are then examined in several simple examples. Furthermore, we demonstrate that for classical diffusive processes, the "force" accelerating diffusion has the form of the positive gradient of the quantum Bohm potential. Expressing then the diffusion coefficient in terms of the Planck constant reveals the lower bound given by the Heisenberg uncertainty principle in terms of the product between the gas mean free path and the Brownian momentum.

Entropy in DNA Double-Strand Break, Detection and Signaling

NASA Astrophysics Data System (ADS)

Zhang, Yang; Schindler, Christina; Heermann, Dieter

2014-03-01

In biology, the term entropy is often understood as a measure of disorder - a restrictive interpretation that can even be misleading. Recently it has become clearer and clearer that entropy, contrary to conventional wisdom, can help to order and guide biological processes in living cells. DNA double-strand breaks (DSBs) are among the most dangerous lesions and efficient damage detection and repair is essential for organism viability. However, what remains unknown is the precise mechanism of targeting the site of damage within billions of intact nucleotides and a crowded nuclear environment, a process which is often referred to as recruitment or signaling. Here we show that the change in entropy associated with inflicting a DSB facilitates the recruitment of damage sensor proteins. By means of computational modeling we found that higher mobility and local chromatin structure accelerate protein association at DSB ends. We compared the effect of different chromatin architectures on protein dynamics and concentrations in the vicinity of DSBs, and related these results to experiments on repair in heterochromatin. Our results demonstrate how entropy contributes to a more efficient damage detection. We identify entropy as the physical basis for DNA double-strand break signaling.

Entropy vs. energy waveform processing: A comparison based on the heat equation

DOE PAGES

Hughes, Michael S.; McCarthy, John E.; Bruillard, Paul J.; ...

2015-05-25

Virtually all modern imaging devices collect electromagnetic or acoustic waves and use the energy carried by these waves to determine pixel values to create what is basically an “energy” picture. However, waves also carry “information”, as quantified by some form of entropy, and this may also be used to produce an “information” image. Numerous published studies have demonstrated the advantages of entropy, or “information imaging”, over conventional methods. The most sensitive information measure appears to be the joint entropy of the collected wave and a reference signal. The sensitivity of repeated experimental observations of a slowly-changing quantity may be definedmore » as the mean variation (i.e., observed change) divided by mean variance (i.e., noise). Wiener integration permits computation of the required mean values and variances as solutions to the heat equation, permitting estimation of their relative magnitudes. There always exists a reference, such that joint entropy has larger variation and smaller variance than the corresponding quantities for signal energy, matching observations of several studies. Moreover, a general prescription for finding an “optimal” reference for the joint entropy emerges, which also has been validated in several studies.« less

Pressure transfer function of a JT15D nozzle due to acoustic and convected entropy fluctuations

NASA Astrophysics Data System (ADS)

Miles, J. H.

An acoustic transmission matrix analysis of sound propagation in a variable area duct with and without flow is extended to include convected entropy fluctuations. The boundary conditions used in the analysis are a transfer function relating entropy and pressure at the nozzle inlet and the nozzle exit impedance. The nozzle pressure transfer function calculated is compared with JT15D turbofan engine nozzle data. The one dimensional theory for sound propagation in a variable area nozzle with flow but without convected entropy is good at the low engine speeds where the nozzle exit Mach number is low (M=0.2) and the duct exit impedance model is good. The effect of convected entropy appears to be so negligible that it is obscured by the inaccuracy of the nozzle exit impedance model, the lack of information on the magnitude of the convected entropy and its phase relationship with the pressure, and the scatter in the data. An improved duct exit impedance model is required at the higher engine speeds where the nozzle exit Mach number is high (M=0.56) and at low frequencies (below 120 Hz).

Dissipation and entropy production in open quantum systems

NASA Astrophysics Data System (ADS)

Majima, H.; Suzuki, A.

2010-11-01

A microscopic description of an open system is generally expressed by the Hamiltonian of the form: Htot = Hsys + Henviron + Hsys-environ. We developed a microscopic theory of entropy and derived a general formula, so-called "entropy-Hamiltonian relation" (EHR), that connects the entropy of the system to the interaction Hamiltonian represented by Hsys-environ for a nonequilibrium open quantum system. To derive the EHR formula, we mapped the open quantum system to the representation space of the Liouville-space formulation or thermo field dynamics (TFD), and thus worked on the representation space Script L := Script H otimes , where Script H denotes the ordinary Hilbert space while the tilde Hilbert space conjugates to Script H. We show that the natural transformation (mapping) of nonequilibrium open quantum systems is accomplished within the theoretical structure of TFD. By using the obtained EHR formula, we also derived the equation of motion for the distribution function of the system. We demonstrated that by knowing the microscopic description of the interaction, namely, the specific form of Hsys-environ on the representation space Script L, the EHR formulas enable us to evaluate the entropy of the system and to gain some information about entropy for nonequilibrium open quantum systems.

Entropy and Galilean Invariance of Lattice Boltzmann Theories

NASA Astrophysics Data System (ADS)

Chikatamarla, Shyam S.; Karlin, Iliya V.

2006-11-01

A theory of lattice Boltzmann (LB) models for hydrodynamic simulation is developed upon a novel relation between entropy construction and roots of Hermite polynomials. A systematic procedure is described for constructing numerically stable and complete Galilean invariant LB models. The stability of the new LB models is illustrated with a shock tube simulation.

Entropy bound of horizons for accelerating, rotating and charged Plebanski–Demianski black hole

DOE Office of Scientific and Technical Information (OSTI.GOV)

Debnath, Ujjal, E-mail: ujjaldebnath@yahoo.com

We first review the accelerating, rotating and charged Plebanski–Demianski (PD) black hole, which includes the Kerr–Newman rotating black hole and the Taub-NUT spacetime. The main feature of this black hole is that it has 4 horizons like event horizon, Cauchy horizon and two accelerating horizons. In the non-extremal case, the surface area, entropy, surface gravity, temperature, angular velocity, Komar energy and irreducible mass on the event horizon and Cauchy horizon are presented for PD black hole. The entropy product, temperature product, Komar energy product and irreducible mass product have been found for event horizon and Cauchy horizon. Also their sumsmore » are found for both horizons. All these relations are dependent on the mass of the PD black hole and other parameters. So all the products are not universal for PD black hole. The entropy and area bounds for two horizons have been investigated. Also we found the Christodoulou–Ruffini mass for extremal PD black hole. Finally, using first law of thermodynamics, we also found the Smarr relation for PD black hole.« less

Entropic bounds on currents in Langevin systems

NASA Astrophysics Data System (ADS)

Dechant, Andreas; Sasa, Shin-ichi

2018-06-01

We derive a bound on generalized currents for Langevin systems in terms of the total entropy production in the system and its environment. For overdamped dynamics, any generalized current is bounded by the total rate of entropy production. We show that this entropic bound on the magnitude of generalized currents imposes power-efficiency tradeoff relations for ratchets in contact with a heat bath: Maximum efficiency—Carnot efficiency for a Smoluchowski-Feynman ratchet and unity for a flashing or rocking ratchet—can only be reached at vanishing power output. For underdamped dynamics, while there may be reversible currents that are not bounded by the entropy production rate, we show that the output power and heat absorption rate are irreversible currents and thus obey the same bound. As a consequence, a power-efficiency tradeoff relation holds not only for underdamped ratchets but also for periodically driven heat engines. For weak driving, the bound results in additional constraints on the Onsager matrix beyond those imposed by the second law. Finally, we discuss the connection between heat and entropy in a nonthermal situation where the friction and noise intensity are state dependent.

Non-linear Heart Rate Variability as a Discriminator of Internalizing Psychopathology and Negative Affect in Children With Internalizing Problems and Healthy Controls

PubMed Central

Fiskum, Charlotte; Andersen, Tonje G.; Bornas, Xavier; Aslaksen, Per M.; Flaten, Magne A.; Jacobsen, Karl

2018-01-01

Background: Internalizing psychopathology and dysregulated negative affect are characterized by dysregulation in the autonomic nervous system and reduced heart rate variability (HRV) due to increases in sympathetic activity alongside reduced vagal tone. The neurovisceral system is however, a complex nonlinear system, and nonlinear indices related to psychopathology are so far less studied in children. Essential nonlinear properties of a system can be found in two main domains: the informational domain and the invariant domain. sample entropy (SampEn) is a much-used method from the informational domain, while detrended fluctuation analysis (DFA) represents a widely-used method from the invariant domain. To see if nonlinear HRV can provide information beyond linear indices of autonomic activation, this study investigated SampEn and DFA as discriminators of internalizing psychopathology and negative affect alongside measures of vagally-mediated HRV and sympathetic activation. Material and Methods: Thirty-Two children with internalizing difficulties and 25 healthy controls (aged 9–13) were assessed with the Child Behavior Checklist and the Early Adolescent Temperament Questionnaire, Revised, giving an estimate of internalizing psychopathology, negative affect and effortful control, a protective factor against psychopathology. Five minute electrocardiogram and impedance cardiography recordings were collected during a resting baseline, giving estimates of SampEn, DFA short-term scaling exponent α1, root mean square of successive differences (RMSSD), and pre-ejection period (PEP). Between-group differences and correlations were assessed with parametric and non-parametric tests, and the relationships between cardiac variables, psychopathology and negative affect were assessed using generalized linear modeling. Results: SampEn and DFA were not significantly different between the groups. SampEn was weakly negatively related to heart rate (HR) in the controls, while DFA was moderately negatively related to RMSSD in both groups, and moderately positively related to HR in the clinical sample. SampEn was significantly associated with internalizing psychopathology and negative affect. DFA was significantly related to internalizing psychopathology. Conclusions: Higher invariant self-similarity was linked to less psychopathology. Higher informational entropy was related to less psychopathology and less negative affect, and may provide an index of the organizational flexibility of the neurovisceral system. PMID:29875679

Non-linear Heart Rate Variability as a Discriminator of Internalizing Psychopathology and Negative Affect in Children With Internalizing Problems and Healthy Controls.

PubMed

Fiskum, Charlotte; Andersen, Tonje G; Bornas, Xavier; Aslaksen, Per M; Flaten, Magne A; Jacobsen, Karl

2018-01-01

Background: Internalizing psychopathology and dysregulated negative affect are characterized by dysregulation in the autonomic nervous system and reduced heart rate variability (HRV) due to increases in sympathetic activity alongside reduced vagal tone. The neurovisceral system is however, a complex nonlinear system, and nonlinear indices related to psychopathology are so far less studied in children. Essential nonlinear properties of a system can be found in two main domains: the informational domain and the invariant domain. sample entropy (SampEn) is a much-used method from the informational domain, while detrended fluctuation analysis (DFA) represents a widely-used method from the invariant domain. To see if nonlinear HRV can provide information beyond linear indices of autonomic activation, this study investigated SampEn and DFA as discriminators of internalizing psychopathology and negative affect alongside measures of vagally-mediated HRV and sympathetic activation. Material and Methods: Thirty-Two children with internalizing difficulties and 25 healthy controls (aged 9-13) were assessed with the Child Behavior Checklist and the Early Adolescent Temperament Questionnaire, Revised, giving an estimate of internalizing psychopathology, negative affect and effortful control, a protective factor against psychopathology. Five minute electrocardiogram and impedance cardiography recordings were collected during a resting baseline, giving estimates of SampEn, DFA short-term scaling exponent α 1 , root mean square of successive differences (RMSSD), and pre-ejection period (PEP). Between-group differences and correlations were assessed with parametric and non-parametric tests, and the relationships between cardiac variables, psychopathology and negative affect were assessed using generalized linear modeling. Results: SampEn and DFA were not significantly different between the groups. SampEn was weakly negatively related to heart rate (HR) in the controls, while DFA was moderately negatively related to RMSSD in both groups, and moderately positively related to HR in the clinical sample. SampEn was significantly associated with internalizing psychopathology and negative affect. DFA was significantly related to internalizing psychopathology. Conclusions: Higher invariant self-similarity was linked to less psychopathology. Higher informational entropy was related to less psychopathology and less negative affect, and may provide an index of the organizational flexibility of the neurovisceral system.

Unifying three perspectives on information processing in stochastic thermodynamics.

PubMed

Barato, A C; Seifert, U

2014-03-07

So far, feedback-driven systems have been discussed using (i) measurement and control, (ii) a tape interacting with a system, or (iii) by identifying an implicit Maxwell demon in steady-state transport. We derive the corresponding second laws from one master fluctuation theorem and discuss their relationship. In particular, we show that both the entropy production involving mutual information between system and controller and the one involving a Shannon entropy difference of an information reservoir like a tape carry an extra term different from the usual current times affinity. We, thus, generalize stochastic thermodynamics to the presence of an information reservoir.

Shuffled Cards, Messy Desks, and Disorderly Dorm Rooms - Examples of Entropy Increase? Nonsense!

NASA Astrophysics Data System (ADS)

Lambert, Frank L.

1999-10-01

The order of presentation in this article is unusual; its conclusion is first. This is done because the title entails text and lecture examples so familiar to all teachers that most may find a preliminary discussion redundant. Conclusion The dealer shuffling cards in Monte Carlo or Las Vegas, the professor who mixes the papers and books on a desk, the student who tosses clothing about his or her room, the fuel for the huge cranes and trucks that would be necessary to move the nonbonded stones of the Great Pyramid of Cheops all across Egypteach undergoes physical, thermodynamic entropy increase in these specific processes. The thermodynamic entropy change from human-defined order to disorder in the giant Egyptian stones themselves, in the clothing and books in a room or papers on a desk, and in the millions of cards in the world's casinos is precisely the same: Zero. K. G. Denbigh succinctly summarizes the case against identifying changes in position in one macro object or in a group with physical entropy change (1): If one wishes to substantiate a claim or a guess that some particular process involves a change of thermodynamic or statistical entropy, one should ask oneself whether there exists a reversible heat effect, or a change in the number of accessible energy eigenstates, pertaining to the process in question. If not, there has been no change of physical entropy (even though there may have been some change in our "information"). Thus, simply changing the location of everyday macro objects from an arrangement that we commonly judge as orderly (relatively singular) to one that appears disorderly (relatively probable) is a "zero change" in the thermodynamic entropy of the objects because the number of accessible energetic microstates in any of them has not been changed. Finally, although it may appear obvious, a collection of ordinary macro things does not constitute a thermodynamic system as does a group of microparticles. The crucial difference is that such things are not ceaselessly colliding and exchanging energy under the thermal dominance of their environment as are microparticles. A postulate can be derived from this fundamental criterion: The movement of macro objects from one location to another by an external agent involves no change in the objects' physical (thermodynamic) entropy. The agent of movement undergoes a thermodynamic entropy increase in the process. A needed corollary, considering the number of erroneous statements in print, is: There is no spontaneous tendency in groups of macro objects to become disorderly or randomly scattered. The tendency in nature toward increased entropy does not reside in the arrangement of any chemically unchanging objects but rather in the external agent moving them. It is the sole cause of their transport toward more probable locations. The Error There is no more widespread error in chemistry and physics texts than the identification of a thermodynamic entropy increase with a change in the pattern of a group of macro objects. The classic example is that of playing cards. Shuffling a new deck is widely said to result in an increase in entropy in the cards. This erroneous impression is often extended to all kinds of things when they are changed from humanly designated order to what is commonly considered disorder: a group of marbles to scattered marbles, racked billiard balls to a broken rack, neat groups of papers on a desk to the more usual disarray. In fact, there is no thermodynamic entropy change in the objects in the "after" state compared to the "before". Further, such alterations in arrangement have been used in at least one text to support a "law" that is stated, "things move spontaneously in the direction of maximum chaos or disorder".1 The foregoing examples and "law" seriously mislead the student by focusing on macro objects that are only a passive part of a system. They are deceptive in omitting the agent that actually is changed in entropy as it follows the second lawthat is, whatever energy source is involved in the process of moving the static macro objects to more probable random locations. Entropy is increased in the shuffler's and in the billiard cue holder's muscles, in the tornado's wind and the earthquake's stressnot in the objects shifted. Chemically unchanged macro things do not spontaneously, by some innate tendency, leap or even slowly lurch toward visible disorder. Energy concentrated in the ATP of a person's muscles or in wind or in earth-stress is ultimately responsible for moving objects and is partly degraded to diffuse thermal energy as a result. Discussion To discover the origin of this text and lecture error, a brief review of some aspects of physical entropy is useful. Of course, the original definition of Clausius, dS = Dq(rev)/T, applies to a system plus its surroundings, and the Gibbsian relation of pertains to a system at constant pressure and constant temperature. Only in the present discussion (where an unfortunate term, information "entropy", must be dealt with) would it be necessary to emphasize that temperature is integral to any physical thermodynamic entropy change described via Clausius or Gibbs. In our era we are surer even than they could be that temperature is indispensable in understanding thermodynamic entropy because it indicates the thermal environment of microparticles in a system. That environment sustains the intermolecular motions whereby molecules continuously interchange energy and are able to access the wide range of energetic microstates available to them. It is this ever-present thermal motion that makes spontaneous change possible, even at constant temperature and in the absence of chemical reaction, because it is the mechanism whereby molecules can occupy new energetic microstates if the boundaries of a system are altered. Prime examples of such spontaneous change are diffusion in fluids and the expansion of gases into vacua, both fundamentally due to the additional translational energetic microstates in the enlarged systems. (Of course, spontaneous endothermic processes ranging from phase changes to chemical reactions are also due to mobile energy-transferring microparticles that can access new rotational and vibrational as well as translational energetic microstatesin the thermal surroundings as well as in the chemical system.) Misinterpretation of the Boltzmann equation for entropy change, ln(number of energetic microstates after change/number of energetic microstates before change), is the source of much of the confusion regarding the behavior of macro objects. R, the gas constant, embeds temperature in Boltzmann's entropy as integrally as in the Clausius or Gibbs relation and, to repeat, the environment's temperature indicates the degree of energy dispersion that makes access to available energy microstates possible. The Boltzmann equation is revelatory in uniting the macrothermodynamics of classic Clausian entropy with what has been described above as the behavior of a system of microparticles occupying energetic microstates. In discussing how probability enters the Boltzmann equation (i.e., the number of possible energetic microstates and their occupancy by microparticles), texts and teachers often enumerate the many ways a few symbolic molecules can be distributed on lines representing energy levels, or in similar cells or boxes, or with combinations of playing cards. Of course these are good analogs for depicting an energetic microsystem. However, even if there are warnings by the instructor, the use of playing cards as a model is probably intellectually hazardous; these objects are so familiar that the student can too easily warp this macro analog of a microsystem into an example of actual entropic change in the cards. Another major source of confusion about entropy change as the result of simply rearranging macro objects comes from information theory "entropy".2 Claude E. Shannon's 1948 paper began the era of quantification of information and in it he adopted the word "entropy" to name the quantity that his equation defined (2). This occurred because a friend, the brilliant mathematician John von Neumann, told him "call it entropy no one knows what entropy really is, so in a debate you will always have the advantage" (3). Wryly funny for that moment, Shannon's unwise acquiescence has produced enormous scientific confusion due to the increasingly widespread usefulness of his equation and its fertile mathematical variations in many fields other than communications (4, 5). Certainly most non-experts hearing of the widely touted information "entropy" would assume its overlap with thermodynamic entropy. However, the great success of information "entropy" has been in areas totally divorced from experimental chemistry, whose objective macro results are dependent on the behavior of energetic microparticles. Nevertheless, many instructors in chemistry have the impression that information "entropy" is not only relevant to the calculations and conclusions of thermodynamic entropy but may change them. This is not true. There is no invariant function corresponding to energy embedded in each of the hundreds of equations of information "entropy" and thus no analog of temperature universally present in them. In contrast, inherent in all thermodynamic entropy, temperature is the objective indicator of a system's energetic state. Probability distributions in information "entropy" represent human selections; therefore information "entropy" is strongly subjective. Probability distributions in thermodynamic entropy are dependent on the microparticulate and physicochemical nature of the system; limited thereby, thermodynamic entropy is strongly objective. This is not to say that the extremely general mathematics of information theory cannot be modified ad hoc and further specifically constrained to yield results that are identical to Gibbs' or Boltzmann's relations (6). This may be important theoretically but it is totally immaterial here; such a modification simply supports conventional thermodynamic results without changing themno lesser nor any greater thermodynamic entropy. The point is that information "entropy" in all of its myriad nonphysicochemical forms as a measure of information or abstract communication has no relevance to the evaluation of thermodynamic entropy change in the movement of macro objects because such information "entropy" does not deal with microparticles whose perturbations are related to temperature.3 Even those who are very competent chemists and physicists have become confused when they have melded or mixed information "entropy" in their consideration of physical thermodynamic entropy. This is shown by the results in textbooks and by the lectures of professors found on the Internet.1 Overall then, how did such an error (concerning entropy changes in macro objects that are simply moved) become part of mainstream instruction, being repeated in print even by distinguished physicists and chemists? The modern term for distorting a photograph, morphing, is probably the best answer. Correct statements of statistical thermodynamics have been progressively altered so that their dependence on the energetics of atoms and molecules is obliterated for the nonprofessional reader and omitted by some author-scientists. The morphing process can be illustrated by the sequence of statements 1 to 4 below.

1. Isolated systems of atoms and molecules spontaneously tend to occupy all available energetic microstates thermally accessible to them and tend to change to any arrangement or macro state that provides more such microstates. Thus, spontaneous change is toward a condition of greater probability of energy dispersion. After a spontaneous change, the logarithm of the ratio of the number of available microstates to those in the prior state is related to the system's increase in entropy by a constant, R/N per mole. It is the presence of temperature in R that distinguishes physical entropy from all information "entropy".
2. Systems of atoms and molecules spontaneously tend to go from a less probable state in which they are relatively "orderly" (few microstates, low entropy) to one that is more probable in which they are "disorderly" (many microstates, high entropy).
3. Spontaneous (natural) processes go from order to disorder and entropy increases. Order is what we see as neat, patterned. Disorder is what we see as messy, random.
4. Things naturally become disorderly.

1. Singling out individual authors from many could appear invidious. Thus, references to quotations or errors are not listed.
2. It is important that information "entropy" always be in quotes whenever thermodynamic entropy is mentioned in the same article or book. Otherwise, the unfortunate confusion of the past half-century is amplified rather than attenuated.
3. It has been said that an information "entropy" equationcompared to those for thermodynamic entropymay look like a duck but, without any empowering thermal energy, it can't quack like a duck or walk like a duck.

1. Denbigh, K. G. Br. J. Philos. Sci. 1989, 40, 323-332.
2. Shannon, C. E. Bell System Tech. J. 1948, 27, 329-423, 623-656.
3. Tribus, M.; McIrvine, E. C. Sci. Am. 1971, 225, 180.
4. Including: Golembiewski, R. T. Handbook of Organizational Behavior; Dekker: New York, 1993.
5. Hillman, C. Entropy on the World Wide Web; http://www.math.washington.edu/~hillman/entropy.html. Extensive references to print and WWW sites, primarily information "entropy" but thermodynamic entropy in the physical sciences in http://www.math.washington.edu/~hillman/Entropy/phys.html (The "e" in entropy is case sensitive in these two URLs.). A European mirror site (via China) is at http://www.unibas.ch/mdpi/entropy (accessed June 1999).
6. Tribus, M. Am. Sci. 1966, 54, 201-210.

Emergent Geometry from Entropy and Causality

NASA Astrophysics Data System (ADS)

Engelhardt, Netta

In this thesis, we investigate the connections between the geometry of spacetime and aspects of quantum field theory such as entanglement entropy and causality. This work is motivated by the idea that spacetime geometry is an emergent phenomenon in quantum gravity, and that the physics responsible for this emergence is fundamental to quantum field theory. Part I of this thesis is focused on the interplay between spacetime and entropy, with a special emphasis on entropy due to entanglement. In general spacetimes, there exist locally-defined surfaces sensitive to the geometry that may act as local black hole boundaries or cosmological horizons; these surfaces, known as holographic screens, are argued to have a connection with the second law of thermodynamics. Holographic screens obey an area law, suggestive of an association with entropy; they are also distinguished surfaces from the perspective of the covariant entropy bound, a bound on the total entropy of a slice of the spacetime. This construction is shown to be quite general, and is formulated in both classical and perturbatively quantum theories of gravity. The remainder of Part I uses the Anti-de Sitter/ Conformal Field Theory (AdS/CFT) correspondence to both expand and constrain the connection between entanglement entropy and geometry. The AdS/CFT correspondence posits an equivalence between string theory in the "bulk" with AdS boundary conditions and certain quantum field theories. In the limit where the string theory is simply classical General Relativity, the Ryu-Takayanagi and more generally, the Hubeny-Rangamani-Takayanagi (HRT) formulae provide a way of relating the geometry of surfaces to entanglement entropy. A first-order bulk quantum correction to HRT was derived by Faulkner, Lewkowycz and Maldacena. This formula is generalized to include perturbative quantum corrections in the bulk at any (finite) order. Hurdles to spacetime emergence from entanglement entropy as described by HRT and its quantum generalizations are discussed, both at the classical and perturbatively quantum limits. In particular, several No Go Theorems are proven, indicative of a conclusion that supplementary approaches or information may be necessary to recover the full spacetime geometry. Part II of this thesis involves the relation between geometry and causality, the property that information cannot travel faster than light. Requiring this of any quantum field theory results in constraints on string theory setups that are dual to quantum field theories via the AdS/CFT correspondence. At the level of perturbative quantum gravity, it is shown that causality in the field theory constraints the causal structure in the bulk. At the level of nonperturbative quantum string theory, we find that constraints on causal signals restrict the possible ways in which curvature singularities can be resolved in string theory. Finally, a new program of research is proposed for the construction of bulk geometry from the divergences of correlation functions in the dual field theory. This divergence structure is linked to the causal structure of the bulk and of the field theory.

Entropy generation method to quantify thermal comfort.

PubMed

Boregowda, S C; Tiwari, S N; Chaturvedi, S K

2001-12-01

The present paper presents a thermodynamic approach to assess the quality of human-thermal environment interaction and quantify thermal comfort. The approach involves development of entropy generation term by applying second law of thermodynamics to the combined human-environment system. The entropy generation term combines both human thermal physiological responses and thermal environmental variables to provide an objective measure of thermal comfort. The original concepts and definitions form the basis for establishing the mathematical relationship between thermal comfort and entropy generation term. As a result of logic and deterministic approach, an Objective Thermal Comfort Index (OTCI) is defined and established as a function of entropy generation. In order to verify the entropy-based thermal comfort model, human thermal physiological responses due to changes in ambient conditions are simulated using a well established and validated human thermal model developed at the Institute of Environmental Research of Kansas State University (KSU). The finite element based KSU human thermal computer model is being utilized as a "Computational Environmental Chamber" to conduct series of simulations to examine the human thermal responses to different environmental conditions. The output from the simulation, which include human thermal responses and input data consisting of environmental conditions are fed into the thermal comfort model. Continuous monitoring of thermal comfort in comfortable and extreme environmental conditions is demonstrated. The Objective Thermal Comfort values obtained from the entropy-based model are validated against regression based Predicted Mean Vote (PMV) values. Using the corresponding air temperatures and vapor pressures that were used in the computer simulation in the regression equation generates the PMV values. The preliminary results indicate that the OTCI and PMV values correlate well under ideal conditions. However, an experimental study is needed in the future to fully establish the validity of the OTCI formula and the model. One of the practical applications of this index is that could it be integrated in thermal control systems to develop human-centered environmental control systems for potential use in aircraft, mass transit vehicles, intelligent building systems, and space vehicles.

Entropy generation method to quantify thermal comfort

NASA Technical Reports Server (NTRS)

Boregowda, S. C.; Tiwari, S. N.; Chaturvedi, S. K.

2001-01-01

The present paper presents a thermodynamic approach to assess the quality of human-thermal environment interaction and quantify thermal comfort. The approach involves development of entropy generation term by applying second law of thermodynamics to the combined human-environment system. The entropy generation term combines both human thermal physiological responses and thermal environmental variables to provide an objective measure of thermal comfort. The original concepts and definitions form the basis for establishing the mathematical relationship between thermal comfort and entropy generation term. As a result of logic and deterministic approach, an Objective Thermal Comfort Index (OTCI) is defined and established as a function of entropy generation. In order to verify the entropy-based thermal comfort model, human thermal physiological responses due to changes in ambient conditions are simulated using a well established and validated human thermal model developed at the Institute of Environmental Research of Kansas State University (KSU). The finite element based KSU human thermal computer model is being utilized as a "Computational Environmental Chamber" to conduct series of simulations to examine the human thermal responses to different environmental conditions. The output from the simulation, which include human thermal responses and input data consisting of environmental conditions are fed into the thermal comfort model. Continuous monitoring of thermal comfort in comfortable and extreme environmental conditions is demonstrated. The Objective Thermal Comfort values obtained from the entropy-based model are validated against regression based Predicted Mean Vote (PMV) values. Using the corresponding air temperatures and vapor pressures that were used in the computer simulation in the regression equation generates the PMV values. The preliminary results indicate that the OTCI and PMV values correlate well under ideal conditions. However, an experimental study is needed in the future to fully establish the validity of the OTCI formula and the model. One of the practical applications of this index is that could it be integrated in thermal control systems to develop human-centered environmental control systems for potential use in aircraft, mass transit vehicles, intelligent building systems, and space vehicles.

Dynamics of non-stationary processes that follow the maximum of the Rényi entropy principle.

PubMed

Shalymov, Dmitry S; Fradkov, Alexander L

2016-01-01

We propose dynamics equations which describe the behaviour of non-stationary processes that follow the maximum Rényi entropy principle. The equations are derived on the basis of the speed-gradient principle originated in the control theory. The maximum of the Rényi entropy principle is analysed for discrete and continuous cases, and both a discrete random variable and probability density function (PDF) are used. We consider mass conservation and energy conservation constraints and demonstrate the uniqueness of the limit distribution and asymptotic convergence of the PDF for both cases. The coincidence of the limit distribution of the proposed equations with the Rényi distribution is examined.

Dynamics of non-stationary processes that follow the maximum of the Rényi entropy principle

PubMed Central

2016-01-01

We propose dynamics equations which describe the behaviour of non-stationary processes that follow the maximum Rényi entropy principle. The equations are derived on the basis of the speed-gradient principle originated in the control theory. The maximum of the Rényi entropy principle is analysed for discrete and continuous cases, and both a discrete random variable and probability density function (PDF) are used. We consider mass conservation and energy conservation constraints and demonstrate the uniqueness of the limit distribution and asymptotic convergence of the PDF for both cases. The coincidence of the limit distribution of the proposed equations with the Rényi distribution is examined. PMID:26997886

Germinal center texture entropy as possible indicator of humoral immune response: immunophysiology viewpoint.

PubMed

Pantic, Igor; Pantic, Senka

2012-10-01

In this article, we present the results indicating that spleen germinal center (GC) texture entropy determined by gray-level co-occurrence matrix (GLCM) method is related to humoral immune response. Spleen tissue was obtained from eight outbred male short-haired guinea pigs previously immunized by sheep red blood cells (SRBC). A total of 312 images from 39 germinal centers (156 GC light zone images and 156 GC dark zone images) were acquired and analyzed by GLCM method. Angular second moment, contrast, correlation, entropy, and inverse difference moment were calculated for each image. Humoral immune response to SRBC was measured using T cell-dependent antibody response (TDAR) assay. Statistically highly significant negative correlation was detected between light zone entropy and the number of TDAR plaque-forming cells (r (s) = -0.86, p < 0.01). The entropy decreased as the plaque-forming cells increased and vice versa. A statistically significant negative correlation was also detected between dark zone entropy values and the number of plaque-forming cells (r (s) = -0.69, p < 0.05). Germinal center texture entropy may be a powerful indicator of humoral immune response. This study is one of the first to point out the potential scientific value of GLCM image texture analysis in lymphoid tissue cytoarchitecture evaluation. Lymphoid tissue texture analysis could become an important and affordable addition to the conventional immunophysiology techniques.

Gibbs paradox of entropy of mixing experimental facts. Its rejection, and the theoretical consequences

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lin, Shu-Kun

1996-12-31

Gibbs paradox statement of entropy of mixing has been regarded as the theoretical foundation of statistical mechanics, quantum theory and biophysics. However, all the relevant chemical experimental observations and logical analyses indicate that the Gibbs paradox statement is false. I prove that this statement is wrong: Gibbs paradox statement implies that entropy decreases with the increase in symmetry (as represented by a symmetry number {sigma}; see any statistical mechanics textbook). From group theory any system has at least a symmetry number {sigma}=1 which is the identity operation for a strictly asymmetric system. It follows that the entropy of a systemmore » is equal to, or less than, zero. However, from either von Neumann-Shannon entropy formula (S(w) =-{Sigma}{sup {omega}} in p{sub 1}) or the Boltzmann entropy formula (S = in w) and the original definition, entropy is non-negative. Therefore, this statement is false. It should not be a surprise that for the first time, many outstanding problems such as the validity of Pauling`s resonance theory, the explanation of second order phase transition phenomena, the biophysical problem of protein folding and the related hydrophobic effect, etc., can be solved. Empirical principles such as Pauli principle (and Hund`s rule) and HSAB principle, etc., can also be given a theoretical explanation.« less

Relations between work and entropy production for general information-driven, finite-state engines

NASA Astrophysics Data System (ADS)

Merhav, Neri

2017-02-01

We consider a system model of a general finite-state machine (ratchet) that simultaneously interacts with three kinds of reservoirs: a heat reservoir, a work reservoir, and an information reservoir, the latter being taken to be a running digital tape whose symbols interact sequentially with the machine. As has been shown in earlier work, this finite-state machine can act as a demon (with memory), which creates a net flow of energy from the heat reservoir into the work reservoir (thus extracting useful work) at the price of increasing the entropy of the information reservoir. Under very few assumptions, we propose a simple derivation of a family of inequalities that relate the work extraction with the entropy production. These inequalities can be seen as either upper bounds on the extractable work or as lower bounds on the entropy production, depending on the point of view. Many of these bounds are relatively easy to calculate and they are tight in the sense that equality can be approached arbitrarily closely. In their basic forms, these inequalities are applicable to any finite number of cycles (and not only asymptotically), and for a general input information sequence (possibly correlated), which is not necessarily assumed even stationary. Several known results are obtained as special cases.

Analysis of the horizontal structure of a measurement and control geodetic network based on entropy

NASA Astrophysics Data System (ADS)

Mrówczyńska, Maria

2013-06-01

The paper attempts to determine an optimum structure of a directional measurement and control network intended for investigating horizontal displacements. For this purpose it uses the notion of entropy as a logarithmical measure of probability of the state of a particular observation system. An optimum number of observations results from the difference of the entropy of the vector of parameters ΔHX̂ (x)corresponding to one extra observation. An increment of entropy interpreted as an increment of the amount of information about the state of the system determines the adoption or rejection of another extra observation to be carried out. W pracy podjęto próbę określenia optymalnej struktury sieci kierunkowej pomiarowo-kontrolnej przeznaczonej do badań przemieszczeń poziomych. W tym celu wykorzystano pojęcie entropii jako logarytmicznej miary prawdopodobieństwa stanu określonego układu obserwacyjnego. Optymalna liczba realizowanych obserwacji wynika z różnicy entropii wektora parametrów ΔHX̂ (x) odpowiadającej jednej obserwacji nadliczbowej. Przyrost entropii interpretowany jako przyrost objętości informacji na temat stanu układu decyduje o przyjęciu względnie odrzuceniu do realizacji kolejnej obserwacji nadliczbowej.

Cause-and-effect relationships in tandem swimmer models using transfer entropy

NASA Astrophysics Data System (ADS)

Peterson, Sean; Rosen, Maxwell; Gementzopoulos, Antonios; Zhang, Peng; Porfiri, Maurizio

2017-11-01

Swimming in a group affords a number of advantages to fish, including an enhanced ability to escape from predators, search for food, and mate. To study coordinated movements of fish, principled approaches are needed to unravel cause-and-effect relationships from raw-time series of multiple bodies moving in an encompassing fluid. In this work, we aim at demonstrating the validity of transfer entropy to elucidate cause-and-effect relationships in a fluid-structure interaction problem. Specifically, we consider two tandem airfoils in a uniform flow, wherein the pitching angle of one airfoil is actively controlled while the other is allowed to passively rotate. The active control alternates the pitch angle based upon an underlying two-state ergodic Markov process. We monitor the pitch angle of both the active and passive airfoils in time and demonstrate that transfer entropy can detect causality independent of which airfoil is actuated. The influence estimated by transfer entropy is found to be modulated by the distance between the two airfoils. The proposed data-driven technique offers a model-free perspective on fluid-structure interactions that can help illuminate the mechanisms of swimming in coordination. This work was supported by the National Science Foundation under Grant Numbers CBET-1332204 and CMMI-1433670.

The smooth entropy formalism for von Neumann algebras

NASA Astrophysics Data System (ADS)

Berta, Mario; Furrer, Fabian; Scholz, Volkher B.

2016-01-01

We discuss information-theoretic concepts on infinite-dimensional quantum systems. In particular, we lift the smooth entropy formalism as introduced by Renner and collaborators for finite-dimensional systems to von Neumann algebras. For the smooth conditional min- and max-entropy, we recover similar characterizing properties and information-theoretic operational interpretations as in the finite-dimensional case. We generalize the entropic uncertainty relation with quantum side information of Tomamichel and Renner and discuss applications to quantum cryptography. In particular, we prove the possibility to perform privacy amplification and classical data compression with quantum side information modeled by a von Neumann algebra.

Conformal Field Theory and black hole physics

NASA Astrophysics Data System (ADS)

Sidhu, Steve

2012-01-01

This thesis reviews the use of 2-dimensional conformal field theory applied to gravity, specifically calculating Bekenstein-Hawking entropy of black holes in (2+1) dimensions. A brief review of general relativity, Conformal Field Theory, energy extraction from black holes, and black hole thermodynamics will be given. The Cardy formula, which calculates the entropy of a black hole from the AdS/CFT duality, will be shown to calculate the correct Bekenstein-Hawking entropy of the static and rotating BTZ black holes. The first law of black hole thermodynamics of the static, rotating, and charged-rotating BTZ black holes will be verified.

Exact valence bond entanglement entropy and probability distribution in the XXX spin chain and the potts model.

PubMed

Jacobsen, J L; Saleur, H

2008-02-29

We determine exactly the probability distribution of the number N_(c) of valence bonds connecting a subsystem of length L>1 to the rest of the system in the ground state of the XXX antiferromagnetic spin chain. This provides, in particular, the asymptotic behavior of the valence-bond entanglement entropy S_(VB)=N_(c)ln2=4ln2/pi(2)lnL disproving a recent conjecture that this should be related with the von Neumann entropy, and thus equal to 1/3lnL. Our results generalize to the Q-state Potts model.

The smooth entropy formalism for von Neumann algebras

DOE Office of Scientific and Technical Information (OSTI.GOV)

Berta, Mario, E-mail: berta@caltech.edu; Furrer, Fabian, E-mail: furrer@eve.phys.s.u-tokyo.ac.jp; Scholz, Volkher B., E-mail: scholz@phys.ethz.ch

2016-01-15

We discuss information-theoretic concepts on infinite-dimensional quantum systems. In particular, we lift the smooth entropy formalism as introduced by Renner and collaborators for finite-dimensional systems to von Neumann algebras. For the smooth conditional min- and max-entropy, we recover similar characterizing properties and information-theoretic operational interpretations as in the finite-dimensional case. We generalize the entropic uncertainty relation with quantum side information of Tomamichel and Renner and discuss applications to quantum cryptography. In particular, we prove the possibility to perform privacy amplification and classical data compression with quantum side information modeled by a von Neumann algebra.

Minimum entropy density method for the time series analysis

NASA Astrophysics Data System (ADS)

Lee, Jeong Won; Park, Joongwoo Brian; Jo, Hang-Hyun; Yang, Jae-Suk; Moon, Hie-Tae

2009-01-01

The entropy density is an intuitive and powerful concept to study the complicated nonlinear processes derived from physical systems. We develop the minimum entropy density method (MEDM) to detect the structure scale of a given time series, which is defined as the scale in which the uncertainty is minimized, hence the pattern is revealed most. The MEDM is applied to the financial time series of Standard and Poor’s 500 index from February 1983 to April 2006. Then the temporal behavior of structure scale is obtained and analyzed in relation to the information delivery time and efficient market hypothesis.

Adaptation of postural recovery responses to a vestibular sensory illusion in individuals with Parkinson disease and healthy controls.

PubMed

Lester, Mark E; Cavanaugh, James T; Foreman, K Bo; Shaffer, Scott W; Marcus, Robin; Dibble, Leland E

2017-10-01

The ability to adapt postural responses to sensory illusions diminishes with age and is further impaired by Parkinson disease. However, limited information exists regarding training-related adaptions of sensory reweighting in these populations. This study sought to determine whether Parkinson disease or age would differentially affect acute postural recovery or adaptive postural responses to novel or repeated exposure to sensory illusions using galvanic vestibular stimulation during quiet stance. Acutely, individuals with Parkinson disease demonstrated larger center of pressure coefficient of variation compared to controls. Unlike individuals with Parkinson disease and asymptomatic older adults, healthy young adults acutely demonstrated a reduction in Sample Entropy to the sensory illusion. Following a period of consolidation Sample Entropy increased in the healthy young group, which coincided with a decreased center of pressure coefficient of variation. Similar changes were not observed in the Parkinson disease or older adult groups. Taken together, these results suggest that young adults learn to adapt to vestibular illusion in a more robust manner than older adults or those with Parkinson disease. Further investigation into the nature of this adaptive difference is warranted. Published by Elsevier Ltd.

Causal holographic information does not satisfy the linearized quantum focusing condition

NASA Astrophysics Data System (ADS)

Fu, Zicao; Marolf, Donald; Qi, Marvin

2018-04-01

The Hubeny-Rangamani causal holographic information (CHI) defined by a region R of a holographic quantum field theory (QFT) is a modern version of the idea that the area of event horizons might be related to an entropy. Here the event horizon lives in a dual gravitational bulk theory with Newton's constant G bulk, and the relation involves a factor of 4 G bulk. The fact that CHI is bounded below by the von Neumann entropy S suggests that CHI is coarse-grained. Its properties could thus differ markedly from those of S. In particular, recent results imply that when d ≤ 4 holographic QFTs are perturbatively coupled to d-dimensional gravity, the combined system satisfies the so-called quantum focusing condition (QFC) at leading order in the new gravitational coupling G d when the QFT entropy is taken to be that of von Neumann. However, by studying states dual to spherical bulk (anti-de Sitter) Schwarschild black holes in the conformal frame for which the boundary is a (2 + 1)-dimensional de Sitter space, we find the QFC defined by CHI is violated even when perturbing about a Killing horizon and using a single null congruence. Since it is known that a generalized second law (GSL) holds in this context, our work demonstrates that the QFC is not required in order for an entropy, or an entropy-like quantity, to satisfy such a GSL.

Like Beauty, Complexity is Hard to Define

NASA Astrophysics Data System (ADS)

Tsallis, Constantino

Like beauty, complexity is hard to define and rather easy to identify: nonlinear dynamics, strongly interconnected simple elements, some sort of divisoria aquorum between order and disorder. Before focusing on complexity, let us remember that the theoretical pillars of contemporary physics are mechanics (Newtonian, relativistic, quantum), Maxwell electromagnetism, and (Boltzmann-Gibbs, BG) statistical mechanics - obligatory basic disciplines in any advanced course in physics. The firstprinciple statistical-mechanical approach starts from (microscopic) electro-mechanics and theory of probabilities, and, through a variety of possible mesoscopic descriptions, arrives to (oscopic) thermodynamics. In the middle of this trip, we cross energy and entropy. Energy is related to the possible microscopic configurations of the system, whereas entropy is related to the corresponding probabilities. Therefore, in some sense, entropy represents a concept which, epistemologically speaking, is one step further with regard to energy. The fact that energy is not parameter-independent is very familiar: the kinetic energy of a truck is very different from that of a fly, and the relativistic energy of a fast electron is very different from its classical value, and so on. What about entropy? One hundred and forty years of tradition, and hundreds - we may even say thousands - of impressive theoretical successes of the parameter-free BG entropy have sedimented, in the mind of many scientists, the conviction that it is unique. However, it can be straightforwardly argued that, in general, this is not the case...

Information loss in effective field theory: Entanglement and thermal entropies

NASA Astrophysics Data System (ADS)

Boyanovsky, Daniel

2018-03-01

Integrating out high energy degrees of freedom to yield a low energy effective field theory leads to a loss of information with a concomitant increase in entropy. We obtain the effective field theory of a light scalar field interacting with heavy fields after tracing out the heavy degrees of freedom from the time evolved density matrix. The initial density matrix describes the light field in its ground state and the heavy fields in equilibrium at a common temperature T . For T =0 , we obtain the reduced density matrix in a perturbative expansion; it reveals an emergent mixed state as a consequence of the entanglement between light and heavy fields. We obtain the effective action that determines the time evolution of the reduced density matrix for the light field in a nonperturbative Dyson resummation of one-loop correlations of the heavy fields. The Von-Neumann entanglement entropy associated with the reduced density matrix is obtained for the nonresonant and resonant cases in the asymptotic long time limit. In the nonresonant case the reduced density matrix displays an incipient thermalization albeit with a wave-vector, time and coupling dependent effective temperature as a consequence of memory of initial conditions. The entanglement entropy is time independent and is the thermal entropy for this effective, nonequilibrium temperature. In the resonant case the light field fully thermalizes with the heavy fields, the reduced density matrix loses memory of the initial conditions and the entanglement entropy becomes the thermal entropy of the light field. We discuss the relation between the entanglement entropy ultraviolet divergences and renormalization.

Entropy of orthogonal polynomials with Freud weights and information entropies of the harmonic oscillator potential

NASA Astrophysics Data System (ADS)

Van Assche, W.; Yáñez, R. J.; Dehesa, J. S.

1995-08-01

The information entropy of the harmonic oscillator potential V(x)=1/2λx2 in both position and momentum spaces can be expressed in terms of the so-called ``entropy of Hermite polynomials,'' i.e., the quantity Sn(H):= -∫-∞+∞H2n(x)log H2n(x) e-x2dx. These polynomials are instances of the polynomials orthogonal with respect to the Freud weights w(x)=exp(-||x||m), m≳0. Here, a very precise and general result of the entropy of Freud polynomials recently established by Aptekarev et al. [J. Math. Phys. 35, 4423-4428 (1994)], specialized to the Hermite kernel (case m=2), leads to an important refined asymptotic expression for the information entropies of very excited states (i.e., for large n) in both position and momentum spaces, to be denoted by Sρ and Sγ, respectively. Briefly, it is shown that, for large values of n, Sρ+1/2logλ≂log(π√2n/e)+o(1) and Sγ-1/2log λ≂log(π√2n/e)+o(1), so that Sρ+Sγ≂log(2π2n/e2)+o(1) in agreement with the generalized indetermination relation of Byalinicki-Birula and Mycielski [Commun. Math. Phys. 44, 129-132 (1975)]. Finally, the rate of convergence of these two information entropies is numerically analyzed. In addition, using a Rakhmanov result, we describe a totally new proof of the leading term of the entropy of Freud polynomials which, naturally, is just a weak version of the aforementioned general result.

SUPERMODEL ANALYSIS OF A1246 AND J255: ON THE EVOLUTION OF GALAXY CLUSTERS FROM HIGH TO LOW ENTROPY STATES

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fusco-Femiano, R.; Lapi, A., E-mail: roberto.fuscofemiano@iaps.inaf.it

2015-02-10

We present an analysis of high-quality X-ray data out to the virial radius for the two galaxy clusters A1246 and GMBCG J255.34805+64.23661 (J255) by means of our entropy-based SuperModel. For A1246 we find that the spherically averaged entropy profile of the intracluster medium (ICM) progressively flattens outward, and that a nonthermal pressure component amounting to ≈20% of the total is required to support hydrostatic equilibrium in the outskirts; there we also estimate a modest value C ≈ 1.6 of the ICM clumping factor. These findings agree with previous analyses on other cool-core, relaxed clusters, and lend further support to themore » picture by Lapi et al. that relates the entropy flattening, the development of the nonthermal pressure component, and the azimuthal variation of ICM properties to weakening boundary shocks. In this scenario clusters are born in a high-entropy state throughout, and are expected to develop on similar timescales a low-entropy state both at the center due to cooling, and in the outskirts due to weakening shocks. However, the analysis of J255 testifies how such a typical evolutionary course can be interrupted or even reversed by merging especially at intermediate redshift, as predicted by Cavaliere et al. In fact, a merger has rejuvenated the ICM of this cluster at z ≈ 0.45 by reestablishing a high-entropy state in the outskirts, while leaving intact or erasing only partially the low-entropy, cool core at the center.« less

Maximum Entropy Production As a Framework for Understanding How Living Systems Evolve, Organize and Function

NASA Astrophysics Data System (ADS)

Vallino, J. J.; Algar, C. K.; Huber, J. A.; Fernandez-Gonzalez, N.

2014-12-01

The maximum entropy production (MEP) principle holds that non equilibrium systems with sufficient degrees of freedom will likely be found in a state that maximizes entropy production or, analogously, maximizes potential energy destruction rate. The theory does not distinguish between abiotic or biotic systems; however, we will show that systems that can coordinate function over time and/or space can potentially dissipate more free energy than purely Markovian processes (such as fire or a rock rolling down a hill) that only maximize instantaneous entropy production. Biological systems have the ability to store useful information acquired via evolution and curated by natural selection in genomic sequences that allow them to execute temporal strategies and coordinate function over space. For example, circadian rhythms allow phototrophs to "predict" that sun light will return and can orchestrate metabolic machinery appropriately before sunrise, which not only gives them a competitive advantage, but also increases the total entropy production rate compared to systems that lack such anticipatory control. Similarly, coordination over space, such a quorum sensing in microbial biofilms, can increase acquisition of spatially distributed resources and free energy and thereby enhance entropy production. In this talk we will develop a modeling framework to describe microbial biogeochemistry based on the MEP conjecture constrained by information and resource availability. Results from model simulations will be compared to laboratory experiments to demonstrate the usefulness of the MEP approach.

Insights into neutrino decoupling gleaned from considerations of the role of electron mass

NASA Astrophysics Data System (ADS)

Grohs, E.; Fuller, George M.

2017-10-01

We present calculations showing how electron rest mass influences entropy flow, neutrino decoupling, and Big Bang Nucleosynthesis (BBN) in the early universe. To elucidate this physics and especially the sensitivity of BBN and related epochs to electron mass, we consider a parameter space of rest mass values larger and smaller than the accepted vacuum value. Electromagnetic equilibrium, coupled with the high entropy of the early universe, guarantees that significant numbers of electron-positron pairs are present, and dominate over the number of ionization electrons to temperatures much lower than the vacuum electron rest mass. Scattering between the electrons-positrons and the neutrinos largely controls the flow of entropy from the plasma into the neutrino seas. Moreover, the number density of electron-positron-pair targets can be exponentially sensitive to the effective in-medium electron mass. This entropy flow influences the phasing of scale factor and temperature, the charged current weak-interaction-determined neutron-to-proton ratio, and the spectral distortions in the relic neutrino energy spectra. Our calculations show the sensitivity of the physics of this epoch to three separate effects: finite electron mass, finite-temperature quantum electrodynamic (QED) effects on the plasma equation of state, and Boltzmann neutrino energy transport. The ratio of neutrino to plasma-component energy scales manifests in Cosmic Microwave Background (CMB) observables, namely the baryon density and the radiation energy density, along with the primordial helium and deuterium abundances. Our results demonstrate how the treatment of in-medium electron mass (i.e., QED effects) could translate into an important source of uncertainty in extracting neutrino and beyond-standard-model physics limits from future high-precision CMB data.

Improved Prediction of Falls in Community-Dwelling Older Adults Through Phase-Dependent Entropy of Daily-Life Walking

PubMed Central

Ihlen, Espen A. F.; van Schooten, Kimberley S.; Bruijn, Sjoerd M.; van Dieën, Jaap H.; Vereijken, Beatrix; Helbostad, Jorunn L.; Pijnappels, Mirjam

2018-01-01

Age and age-related diseases have been suggested to decrease entropy of human gait kinematics, which is thought to make older adults more susceptible to falls. In this study we introduce a new entropy measure, called phase-dependent generalized multiscale entropy (PGME), and test whether this measure improves fall-risk prediction in community-dwelling older adults. PGME can assess phase-dependent changes in the stability of gait dynamics that result from kinematic changes in events such as heel strike and toe-off. PGME was assessed for trunk acceleration of 30 s walking epochs in a re-analysis of 1 week of daily-life activity data from the FARAO study, originally described by van Schooten et al. (2016). The re-analyzed data set contained inertial sensor data from 52 single- and 46 multiple-time prospective fallers in a 6 months follow-up period, and an equal number of non-falling controls matched by age, weight, height, gender, and the use of walking aids. The predictive ability of PGME for falls was assessed using a partial least squares regression. PGME had a superior predictive ability of falls among single-time prospective fallers when compared to the other gait features. The single-time fallers had a higher PGME (p < 0.0001) of their trunk acceleration at 60% of their step cycle when compared with non-fallers. No significant differences were found between PGME of multiple-time fallers and non-fallers, but PGME was found to improve the prediction model of multiple-time fallers when combined with other gait features. These findings suggest that taking into account phase-dependent changes in the stability of the gait dynamics has additional value for predicting falls in older people, especially for single-time prospective fallers. PMID:29556188

Improved Prediction of Falls in Community-Dwelling Older Adults Through Phase-Dependent Entropy of Daily-Life Walking.

PubMed

Ihlen, Espen A F; van Schooten, Kimberley S; Bruijn, Sjoerd M; van Dieën, Jaap H; Vereijken, Beatrix; Helbostad, Jorunn L; Pijnappels, Mirjam

2018-01-01

Age and age-related diseases have been suggested to decrease entropy of human gait kinematics, which is thought to make older adults more susceptible to falls. In this study we introduce a new entropy measure, called phase-dependent generalized multiscale entropy (PGME), and test whether this measure improves fall-risk prediction in community-dwelling older adults. PGME can assess phase-dependent changes in the stability of gait dynamics that result from kinematic changes in events such as heel strike and toe-off. PGME was assessed for trunk acceleration of 30 s walking epochs in a re-analysis of 1 week of daily-life activity data from the FARAO study, originally described by van Schooten et al. (2016). The re-analyzed data set contained inertial sensor data from 52 single- and 46 multiple-time prospective fallers in a 6 months follow-up period, and an equal number of non-falling controls matched by age, weight, height, gender, and the use of walking aids. The predictive ability of PGME for falls was assessed using a partial least squares regression. PGME had a superior predictive ability of falls among single-time prospective fallers when compared to the other gait features. The single-time fallers had a higher PGME ( p < 0.0001) of their trunk acceleration at 60% of their step cycle when compared with non-fallers. No significant differences were found between PGME of multiple-time fallers and non-fallers, but PGME was found to improve the prediction model of multiple-time fallers when combined with other gait features. These findings suggest that taking into account phase-dependent changes in the stability of the gait dynamics has additional value for predicting falls in older people, especially for single-time prospective fallers.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Burke, K.; Smith, J. C.; Grabowski, P. E.

Universal exact conditions guided the construction of most ground-state density functional approximations in use today. Here, we derive the relation between the entropy and Mermin free energy density functionals for thermal density functional theory. Both the entropy and sum of kinetic and electron-electron repulsion functionals are shown to be monotonically increasing with temperature, while the Mermin functional is concave downwards. Analogous relations are found for both exchange and correlation. The importance of these conditions is illustrated in two extremes: the Hubbard dimer and the uniform gas.

Relative entropy as a universal metric for multiscale errors

NASA Astrophysics Data System (ADS)

Chaimovich, Aviel; Shell, M. Scott

2010-06-01

We show that the relative entropy, Srel , suggests a fundamental indicator of the success of multiscale studies, in which coarse-grained (CG) models are linked to first-principles (FP) ones. We demonstrate that Srel inherently measures fluctuations in the differences between CG and FP potential energy landscapes, and develop a theory that tightly and generally links it to errors associated with coarse graining. We consider two simple case studies substantiating these results, and suggest that Srel has important ramifications for evaluating and designing coarse-grained models.

Relative entropy as a universal metric for multiscale errors.

PubMed

Chaimovich, Aviel; Shell, M Scott

2010-06-01

We show that the relative entropy, Srel, suggests a fundamental indicator of the success of multiscale studies, in which coarse-grained (CG) models are linked to first-principles (FP) ones. We demonstrate that Srel inherently measures fluctuations in the differences between CG and FP potential energy landscapes, and develop a theory that tightly and generally links it to errors associated with coarse graining. We consider two simple case studies substantiating these results, and suggest that Srel has important ramifications for evaluating and designing coarse-grained models.

Effect of intravenous infusion of dexmedetomidine on perioperative haemodynamic changes and postoperative recovery: A study with entropy analysis

PubMed Central

Patel, Chirag Ramanlal; Engineer, Smita R; Shah, Bharat J; Madhu, S

2012-01-01

Background: Dexmedetomidine, an α2 agonist, when used as an adjuvant in general anaesthesia attenuates stress response to various noxious stimuli, maintains perioperative haemodynamic stability and provides sedation without significant respiratory depression postoperatively. Methods: Sixty patients were randomly divided into two groups of 30 each. In group A, fentanyl 2 μg/kg and in group B dexmedetomidine were given intravenously as loading dose of 1 μg/kg over 10 min prior to induction. After induction with thiopentone, in group B, dexmedetomidine was given as infusion at a dose of 0.2–0.8 μg/kg. Sevoflurane was used as inhalation agent in both groups. Haemodynamic variables and entropy (response entropy and state entropy) were recorded continuously. Postoperative sedation and recovery were assessed by sedation score and modified Aldrete's score, respectively. Results: Dexmedetomidine significantly attenuates stress response at intubation with lesser increase in heart rate (10% vs. 17%), systolic blood pressure (6% vs. 23%) and diastolic blood pressure (7% vs. 20%) as compared to the control group (P<0.05). Intraoperatively, an average of 8% fall in systolic blood pressure and 8.16% fall in diastolic pressure in the test group as compared to 3.6% rise in systolic and 3.3% in diastolic pressure of the control group was observed. Postoperatively, the test group showed significant sedation at 2 h as compared to the control group (P=0.00) and recovery was better in the control group for the first 2 h post extubation. Conclusion: Dexmedetomidine attenuates various stress responses during surgery and maintains the haemodynamic stability when used as an adjuvant in general anaesthesia. Also, the sedative action of dexmedetomidine delays recovery for the first few hours post extubation. PMID:23325938

Effect of intravenous infusion of dexmedetomidine on perioperative haemodynamic changes and postoperative recovery: A study with entropy analysis.

PubMed

Patel, Chirag Ramanlal; Engineer, Smita R; Shah, Bharat J; Madhu, S

2012-11-01

Dexmedetomidine, an α2 agonist, when used as an adjuvant in general anaesthesia attenuates stress response to various noxious stimuli, maintains perioperative haemodynamic stability and provides sedation without significant respiratory depression postoperatively. Sixty patients were randomly divided into two groups of 30 each. In group A, fentanyl 2 μg/kg and in group B dexmedetomidine were given intravenously as loading dose of 1 μg/kg over 10 min prior to induction. After induction with thiopentone, in group B, dexmedetomidine was given as infusion at a dose of 0.2-0.8 μg/kg. Sevoflurane was used as inhalation agent in both groups. Haemodynamic variables and entropy (response entropy and state entropy) were recorded continuously. Postoperative sedation and recovery were assessed by sedation score and modified Aldrete's score, respectively. Dexmedetomidine significantly attenuates stress response at intubation with lesser increase in heart rate (10% vs. 17%), systolic blood pressure (6% vs. 23%) and diastolic blood pressure (7% vs. 20%) as compared to the control group (P<0.05). Intraoperatively, an average of 8% fall in systolic blood pressure and 8.16% fall in diastolic pressure in the test group as compared to 3.6% rise in systolic and 3.3% in diastolic pressure of the control group was observed. Postoperatively, the test group showed significant sedation at 2 h as compared to the control group (P=0.00) and recovery was better in the control group for the first 2 h post extubation. Dexmedetomidine attenuates various stress responses during surgery and maintains the haemodynamic stability when used as an adjuvant in general anaesthesia. Also, the sedative action of dexmedetomidine delays recovery for the first few hours post extubation.

Information thermodynamics of near-equilibrium computation

NASA Astrophysics Data System (ADS)

Prokopenko, Mikhail; Einav, Itai

2015-06-01

In studying fundamental physical limits and properties of computational processes, one is faced with the challenges of interpreting primitive information-processing functions through well-defined information-theoretic as well as thermodynamic quantities. In particular, transfer entropy, characterizing the function of computational transmission and its predictability, is known to peak near critical regimes. We focus on a thermodynamic interpretation of transfer entropy aiming to explain the underlying critical behavior by associating information flows intrinsic to computational transmission with particular physical fluxes. Specifically, in isothermal systems near thermodynamic equilibrium, the gradient of the average transfer entropy is shown to be dynamically related to Fisher information and the curvature of system's entropy. This relationship explicitly connects the predictability, sensitivity, and uncertainty of computational processes intrinsic to complex systems and allows us to consider thermodynamic interpretations of several important extreme cases and trade-offs.

Seebeck Effects in N-Type and P-Type Polymers Driven Simultaneously by Surface Polarization and Entropy Differences Based on Conductor/Polymer/Conductor Thin-Film Devices

DOE PAGES

Hu, Dehua; Liu, Qing; Tisdale, Jeremy; ...

2015-04-15

This paper reports Seebeck effects driven by both surface polarization difference and entropy difference by using intramolecular charge-transfer states in n-type and p-type conjugated polymers, namely IIDT and IIDDT, based on vertical conductor/polymer/conductor thin-film devices. Large Seebeck coefficients of -898 V/K and 1300 V/K from are observed from n-type IIDT p-type IIDDT, respectively, when the charge-transfer states are generated by a white light illumination of 100 mW/cm2. Simultaneously, electrical conductivities are increased from almost insulating states in dark condition to conducting states under photoexcitation in both n-type IIDT and p-type IIDDT devices. We find that the intramolecular charge-transfer states canmore » largely enhance Seebeck effects in the n-type IIDT and p-type IIDDT devices driven by both surface polarization difference and entropy difference. Furthermore, the Seebeck effects can be shifted between polarization and entropy regimes when electrical conductivities are changed. This reveals a new concept to develop Seebeck effects by controlling polarization and entropy regimes based on charge-transfer states in vertical conductor/polymer/conductor thin-film devices.« less

Entropy and the Shelf Model: A Quantum Physical Approach to a Physical Property

ERIC Educational Resources Information Center

Jungermann, Arnd H.

2006-01-01

In contrast to most other thermodynamic data, entropy values are not given in relation to a certain--more or less arbitrarily defined--zero level. They are listed in standard thermodynamic tables as absolute values of specific substances. Therefore these values describe a physical property of the listed substances. One of the main tasks of…

Moments of the phase-space density, coincidence probabilities, and entropies of a multiparticle system

NASA Astrophysics Data System (ADS)

Bialas, A.

2006-04-01

A method to estimate moments of the phase-space density from event-by-event fluctuations is reviewed and its accuracy analyzed. Relation of these measurements to the determination of the entropy of the system is discussed. This is a summary of the results obtained recently together with W.Czyz and K.Zalewski.

Spectral entropy monitoring for adults and children undergoing general anaesthesia.

PubMed

Chhabra, Anjolie; Subramaniam, Rajeshwari; Srivastava, Anurag; Prabhakar, Hemanshu; Kalaivani, Mani; Paranjape, Saloni

2016-03-14

Anaesthetic drugs during general anaesthesia are titrated according to sympathetic or somatic responses to surgical stimuli. It is now possible to measure depth of anaesthesia using electroencephalography (EEG). Entropy, an EEG-based monitor can be used to assess the depth of anaesthesia using a strip of electrodes applied to the forehead, and this can guide intraoperative anaesthetic drug administration. The primary objective of this review was to assess the effectiveness of entropy monitoring in facilitating faster recovery from general anaesthesia. We also wanted to assess mortality at 24 hours, 30 days, and one year following general anaesthesia with entropy monitoring.The secondary objectives were to assess the effectiveness of the entropy monitor in: preventing postoperative recall of intraoperative events (awareness) following general anaesthesia; reducing the amount of anaesthetic drugs used; reducing cost of the anaesthetic as well as in reducing time to readiness to leave the postanaesthesia care unit (PACU). We searched the Cochrane Central Register of Controlled Trials (CENTRAL; 2014, Issue 10), MEDLINE via Ovid SP (1990 to September 2014) and EMBASE via Ovid SP (1990 to September 2014). We reran the search in CENTRAL, MEDLINE via Ovid SP and EMBASE via Ovid SP in January 2016. We added one potential new study of interest to the list of 'Studies awaiting Classification' and we will incorporate this study into the formal review findings during the review update. We included randomized controlled trials (RCTs) conducted in adults and children (aged greater than two years of age), where in one arm entropy monitoring was used for titrating anaesthesia, and in the other standard practice (increase in heart rate, mean arterial pressure, lacrimation, movement in response to noxious surgical stimuli) was used for titrating anaesthetic drug administration. We also included trials with an additional third arm, wherein another EEG monitor, the Bispectral index (BIS) monitor was used to assess anaesthetic depth. We used standard methodological procedures expected by Cochrane. Two review authors independently extracted details of trial methodology and outcome data from trials considered eligible for inclusion. All analyses were made on an intention-to-treat basis. We used a random-effect model where there was heterogeneity. For assessments of the overall quality of evidence for each outcome that included pooled data from RCTs, we downgraded evidence from 'high quality' by one level for serious (or by two for very serious) study limitations (risk of bias, indirectness of evidence, serious inconsistency, imprecision of effect or potential publication bias). We included 11 RCTs (962 participants). Eight RCTs (762 participants) were carried out on adults (18 to 80 years of age), two (128 participants) involved children (two to 16 years) and one RCT (72 participants) included patients aged 60 to 75 years. Of the 11 included studies, we judged three to be at low risk of bias, and the remaining eight RCTs at unclear or high risk of bias.Six RCTs (383 participants) estimated the primary outcome, time to awakening after stopping general anaesthesia, which was reduced in the entropy as compared to the standard practice group (mean difference (MD) -5.42 minutes, 95% confidence interval (CI) -8.77 to -2.08; moderate quality of evidence). We noted heterogeneity for this outcome; on performing subgroup analysis this was found to be due to studies that included participants undergoing major, long duration surgeries (off-pump coronary artery bypass grafting, major urological surgery). The MD for time to awakening with four studies on ambulatory procedures was -3.20 minutes (95% CI -3.94 to -2.45). No trial reported the second primary outcome, mortality at 24 hours, 30 days, and one year with the use of entropy monitoring.Eight trials (797 participants) compared the secondary outcome, postoperative recall of intraoperative events (awareness) in the entropy and standard practice groups. Awareness was reported by only one patient in the standard practice group, making meaningful estimation of benefit of entropy monitoring difficult; moderate quality of evidence.All 11 RCTs compared the amount of anaesthetic agent used between the entropy and standard practice groups. Six RCTs compared the amount of propofol, four compared the amount of sevoflurane and one the amount of isoflurane used between the groups. Analysis of three studies (166 participants) revealed that the MD of propofol consumption between the entropy group and control group was -11.56 mcg/kg/min (95% CI -24.05 to 0.92); low quality of evidence. Analysis of another two studies (156 participants) showed that the MD in sevoflurane consumption in the entropy group compared to the control group was -3.42 mL (95% CI -6.49 to -0.35); moderate quality of evidence.No trial reported on the secondary outcome of the cost of general anaesthesia.Three trials (170 participants) estimated MD in time to readiness to leave the PACU of the entropy group as compared to the control group (MD -5.94 minutes, 95% CI -16.08 to 4.20; low quality of evidence). Heterogeneity was noted, which was due to the difference in anaesthetic technique (propofol-based general anaesthesia) in one study. The remaining two studies had used volatile-based general anaesthesia. The MD in time to readiness to leave the PACU was -4.17 minutes (95% CI -6.84 to -1.51) with these two studies. The evidence as regards time to awakening, recall of intraoperative awareness and reduction in inhalational anaesthetic agent use was of moderate quality. The quality of evidence of as regards reduction in intravenous anaesthetic agent (propofol) use, as well as time to readiness to leave the PACU was found to be of low quality. As the data are limited, further studies consisting of more participants will be required for ascertaining benefits of entropy monitoring.Further studies are needed to assess the effect of entropy monitoring on focal issues such as short-term and long-term mortality, as well as cost of general anaesthesia.

Beating the Clauser-Horne-Shimony-Holt and the Svetlichny games with optimal states

NASA Astrophysics Data System (ADS)

Su, Hong-Yi; Ren, Changliang; Chen, Jing-Ling; Zhang, Fu-Lin; Wu, Chunfeng; Xu, Zhen-Peng; Gu, Mile; Vinjanampathy, Sai; Kwek, L. C.

2016-02-01

We study the relation between the maximal violation of Svetlichny's inequality and the mixedness of quantum states and obtain the optimal state (i.e., maximally nonlocal mixed states, or MNMS, for each value of linear entropy) to beat the Clauser-Horne-Shimony-Holt and the Svetlichny games. For the two-qubit and three-qubit MNMS, we showed that these states are also the most tolerant state against white noise, and thus serve as valuable quantum resources for such games. In particular, the quantum prediction of the MNMS decreases as the linear entropy increases, and then ceases to be nonlocal when the linear entropy reaches the critical points 2 /3 and 9 /14 for the two- and three-qubit cases, respectively. The MNMS are related to classical errors in experimental preparation of maximally entangled states.

Entropy uncertainty relations and stability of phase-temporal quantum cryptography with finite-length transmitted strings

DOE Office of Scientific and Technical Information (OSTI.GOV)

Molotkov, S. N., E-mail: sergei.molotkov@gmail.com

2012-12-15

Any key-generation session contains a finite number of quantum-state messages, and it is there-fore important to understand the fundamental restrictions imposed on the minimal length of a string required to obtain a secret key with a specified length. The entropy uncertainty relations for smooth min and max entropies considerably simplify and shorten the proof of security. A proof of security of quantum key distribution with phase-temporal encryption is presented. This protocol provides the maximum critical error compared to other protocols up to which secure key distribution is guaranteed. In addition, unlike other basic protocols (of the BB84 type), which aremore » vulnerable with respect to an attack by 'blinding' of avalanche photodetectors, this protocol is stable with respect to such an attack and guarantees key security.« less

A Subband Coding Method for HDTV

NASA Technical Reports Server (NTRS)

Chung, Wilson; Kossentini, Faouzi; Smith, Mark J. T.

1995-01-01

This paper introduces a new HDTV coder based on motion compensation, subband coding, and high order conditional entropy coding. The proposed coder exploits the temporal and spatial statistical dependencies inherent in the HDTV signal by using intra- and inter-subband conditioning for coding both the motion coordinates and the residual signal. The new framework provides an easy way to control the system complexity and performance, and inherently supports multiresolution transmission. Experimental results show that the coder outperforms MPEG-2, while still maintaining relatively low complexity.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bialynicki-Birula, Iwo

Quantum mechanical uncertainty relations for the position and the momentum and for the angle and the angular momentum are expressed in the form of inequalities involving the Renyi entropies. These uncertainty relations hold not only for pure but also for mixed states. Analogous uncertainty relations are valid also for a pair of complementary observables (the analogs of x and p) in N-level systems. All these uncertainty relations become more attractive when expressed in terms of the symmetrized Renyi entropies. The mathematical proofs of all the inequalities discussed in this paper can be found in Phys. Rev. A 74, No. 5more » (2006); arXiv:quant-ph/0608116.« less

Complexity of cardiovascular rhythms during head-up tilt test by entropy of patterns.

PubMed

Wejer, Dorota; Graff, Beata; Makowiec, Danuta; Budrejko, Szymon; Struzik, Zbigniew R

2017-05-01

The head-up tilt (HUT) test, which provokes transient dynamical alterations in the regulation of cardiovascular system, provides insights into complex organization of this system. Based on signals with heart period intervals (RR-intervals) and/or systolic blood pressure (SBP), differences in the cardiovascular regulation between vasovagal patients (VVS) and the healthy people group (CG) are investigated. Short-term relations among signal data represented symbolically by three-beat patterns allow to qualify and quantify the complexity of the cardiovascular regulation by Shannon entropy. Four types of patterns: permutation, ordinal, deterministic and dynamical, are used, and different resolutions of signal values in the the symbolization are applied in order to verify how entropy of patterns depends on a way in which values of signals are preprocessed. At rest, in the physiologically important signal resolution ranges, independently of the type of patterns used in estimates, the complexity of SBP signals in VVS is different from the complexity found in CG. Entropy of VVS is higher than CG what could be interpreted as substantial presence of noisy ingredients in SBP of VVS. After tilting this relation switches. Entropy of CG occurs significantly higher than VVS for SBP signals. In the case of RR-intervals and large resolutions, the complexity after the tilt becomes reduced when compared to the complexity of RR-intervals at rest for both groups. However, in the case of VVS patients this reduction is significantly stronger than in CG. Our observations about opposite switches in entropy between CG and VVS might support a hypothesis that baroreflex in VVS affects stronger the heart rate because of the inefficient regulation (possibly impaired local vascular tone alternations) of the blood pressure.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Maoyuan; Besford, Quinn Alexander; Mulvaney, Thomas

The entropy of hydrophobic solvation has been explained as the result of ordered solvation structures, of hydrogen bonds, of the small size of the water molecule, of dispersion forces, and of solvent density fluctuations. We report a new approach to the calculation of the entropy of hydrophobic solvation, along with tests of and comparisons to several other methods. The methods are assessed in the light of the available thermodynamic and spectroscopic information on the effects of temperature on hydrophobic solvation. Five model hydrophobes in SPC/E water give benchmark solvation entropies via Widom’s test-particle insertion method, and other methods and modelsmore » are tested against these particle-insertion results. Entropies associated with distributions of tetrahedral order, of electric field, and of solvent dipole orientations are examined. We find these contributions are small compared to the benchmark particle-insertion entropy. Competitive with or better than other theories in accuracy, but with no free parameters, is the new estimate of the entropy contributed by correlations between dipole moments. Dipole correlations account for most of the hydrophobic solvation entropy for all models studied and capture the distinctive temperature dependence seen in thermodynamic and spectroscopic experiments. Entropies based on pair and many-body correlations in number density approach the correct magnitudes but fail to describe temperature and size dependences, respectively. Hydrogen-bond definitions and free energies that best reproduce entropies from simulations are reported, but it is difficult to choose one hydrogen bond model that fits a variety of experiments. The use of information theory, scaled-particle theory, and related methods is discussed briefly. Our results provide a test of the Frank-Evans hypothesis that the negative solvation entropy is due to structured water near the solute, complement the spectroscopic detection of that solvation structure by identifying the structural feature responsible for the entropy change, and point to a possible explanation for the observed dependence on length scale. Our key results are that the hydrophobic effect, i.e. the signature, temperature-dependent, solvation entropy of nonpolar molecules in water, is largely due to a dispersion force arising from correlations between rotating permanent dipole moments, that the strength of this force depends on the Kirkwood g-factor, and that the strength of this force may be obtained exactly without simulation.« less

On the structure-bounded growth processes in plant populations.

PubMed

Kilian, H G; Kazda, M; Király, F; Kaufmann, D; Kemkemer, R; Bartkowiak, D

2010-07-01

If growing cells in plants are considered to be composed of increments (ICs) an extended version of the law of mass action can be formulated. It evidences that growth of plants runs optimal if the reaction-entropy term (entropy times the absolute temperature) matches the contact energy of ICs. Since these energies are small, thermal molecular movements facilitate via relaxation the removal of structure disturbances. Stem diameter distributions exhibit extra fluctuations likely to be caused by permanent constraints. Since the signal-response system enables in principle perfect optimization only within finite-sized cell ensembles, plants comprising relatively large cell numbers form a network of size-limited subsystems. The maximal number of these constituents depends both on genetic and environmental factors. Accounting for logistical structure-dynamics interrelations, equations can be formulated to describe the bimodal growth curves of very different plants. The reproduction of the S-bended growth curves verifies that the relaxation modes with a broad structure-controlled distribution freeze successively until finally growth is fully blocked thus bringing about "continuous solidification".

Lattice thermal conductivity of multi-component alloys

DOE PAGES

Caro, Magdalena; Béland, Laurent K.; Samolyuk, German D.; ...

2015-06-12

High entropy alloys (HEA) have unique properties including the potential to be radiation tolerant. These materials with extreme disorder could resist damage because disorder, stabilized by entropy, is the equilibrium thermodynamic state. Disorder also reduces electron and phonon conductivity keeping the damage energy longer at the deposition locations, eventually favoring defect recombination. In the short time-scales related to thermal spikes induced by collision cascades, phonons become the relevant energy carrier. In this paper, we perform a systematic study of phonon thermal conductivity in multiple component solid solutions represented by Lennard-Jones (LJ) potentials. We explore the conditions that minimize phonon meanmore » free path via extreme alloy complexity, by varying the composition and the elements (differing in mass, atomic radii, and cohesive energy). We show that alloy complexity can be tailored to modify the scattering mechanisms that control energy transport in the phonon subsystem. Finally, our analysis provides a qualitative guidance for the selection criteria used in the design of HEA alloys with low phonon thermal conductivity.« less

Perspective: Maximum caliber is a general variational principle for dynamical systems

NASA Astrophysics Data System (ADS)

Dixit, Purushottam D.; Wagoner, Jason; Weistuch, Corey; Pressé, Steve; Ghosh, Kingshuk; Dill, Ken A.

2018-01-01

We review here Maximum Caliber (Max Cal), a general variational principle for inferring distributions of paths in dynamical processes and networks. Max Cal is to dynamical trajectories what the principle of maximum entropy is to equilibrium states or stationary populations. In Max Cal, you maximize a path entropy over all possible pathways, subject to dynamical constraints, in order to predict relative path weights. Many well-known relationships of non-equilibrium statistical physics—such as the Green-Kubo fluctuation-dissipation relations, Onsager's reciprocal relations, and Prigogine's minimum entropy production—are limited to near-equilibrium processes. Max Cal is more general. While it can readily derive these results under those limits, Max Cal is also applicable far from equilibrium. We give examples of Max Cal as a method of inference about trajectory distributions from limited data, finding reaction coordinates in bio-molecular simulations, and modeling the complex dynamics of non-thermal systems such as gene regulatory networks or the collective firing of neurons. We also survey its basis in principle and some limitations.

Hamiltonian and Thermodynamic Modeling of Quantum Turbulence

NASA Astrophysics Data System (ADS)

Grmela, Miroslav

2010-10-01

The state variables in the novel model introduced in this paper are the fields playing this role in the classical Landau-Tisza model and additional fields of mass, entropy (or temperature), superfluid velocity, and gradient of the superfluid velocity, all depending on the position vector and another tree dimensional vector labeling the scale, describing the small-scale structure developed in 4He superfluid experiencing turbulent motion. The fluxes of mass, momentum, energy, and entropy in the position space as well as the fluxes of energy and entropy in scales, appear in the time evolution equations as explicit functions of the state variables and of their conjugates. The fundamental thermodynamic relation relating the fields to their conjugates is left in this paper undetermined. The GENERIC structure of the equations serves two purposes: (i) it guarantees that solutions to the governing equations, independently of the choice of the fundamental thermodynamic relation, agree with the observed compatibility with thermodynamics, and (ii) it is used as a guide in the construction of the novel model.

Perspective: Maximum caliber is a general variational principle for dynamical systems.

PubMed

Dixit, Purushottam D; Wagoner, Jason; Weistuch, Corey; Pressé, Steve; Ghosh, Kingshuk; Dill, Ken A

2018-01-07

We review here Maximum Caliber (Max Cal), a general variational principle for inferring distributions of paths in dynamical processes and networks. Max Cal is to dynamical trajectories what the principle of maximum entropy is to equilibrium states or stationary populations. In Max Cal, you maximize a path entropy over all possible pathways, subject to dynamical constraints, in order to predict relative path weights. Many well-known relationships of non-equilibrium statistical physics-such as the Green-Kubo fluctuation-dissipation relations, Onsager's reciprocal relations, and Prigogine's minimum entropy production-are limited to near-equilibrium processes. Max Cal is more general. While it can readily derive these results under those limits, Max Cal is also applicable far from equilibrium. We give examples of Max Cal as a method of inference about trajectory distributions from limited data, finding reaction coordinates in bio-molecular simulations, and modeling the complex dynamics of non-thermal systems such as gene regulatory networks or the collective firing of neurons. We also survey its basis in principle and some limitations.

Magnetocaloric cooling: the phenomenon and materials

NASA Astrophysics Data System (ADS)

Pecharsky, Vitalij

2015-03-01

The discovery of the giant magnetocaloric effect in Gd5Si2Ge2 and other R5T4 compounds (R = rare earth metal and T is a Group 14 element) generated a broad interest in the magnetocaloric effect and magnetic refrigeration near room temperature in particular, and in magnetostructural transitions in general. Reports on the giant magnetocaloric effect in other systems soon followed. These include MnFePxAs1-x and related compounds, La(Fe1-xSix)13 and their hydrides, Mn(AsxSb1-x) , CoMnSixGe1-x and related compounds, Ni2MnGa and some closely related Heusler phases, and a few non-metallic systems. A common feature observed in all giant magnetocaloric effect materials is the enhancement of the magnetic entropy change by the overlapping contribution from the lattice. In addition to the interplay between magnetic and lattice entropies, both of which are intrinsic materials' parameters that in principle can be modeled theoretically from first principles, extrinsic parameters such as microstructure and nanostructure, have been found to play a role in controlling both the magnetostructural transition(s) and magnetocaloric effect. Both the intrinsic and extrinsic parameters are, therefore, important in order to maximize magnetocaloric effect. The role of different control parameters and the potential pathways towards materials exhibiting advanced magnetocaloric effect will be discussed. This work is supported by the Division of Materials Science and Engineering, Office of Basic Energy Sciences of the U.S. Department of Energy under Contract No. DE-AC02-07CH11358 with Iowa State University.

A systems biology approach to studying Tai Chi, physiological complexity and healthy aging: design and rationale of a pragmatic randomized controlled trial.

PubMed

Wayne, Peter M; Manor, Brad; Novak, Vera; Costa, Madelena D; Hausdorff, Jeffrey M; Goldberger, Ary L; Ahn, Andrew C; Yeh, Gloria Y; Peng, C-K; Lough, Matthew; Davis, Roger B; Quilty, Mary T; Lipsitz, Lewis A

2013-01-01

Aging is typically associated with progressive multi-system impairment that leads to decreased physical and cognitive function and reduced adaptability to stress. Due to its capacity to characterize complex dynamics within and between physiological systems, the emerging field of complex systems biology and its array of quantitative tools show great promise for improving our understanding of aging, monitoring senescence, and providing biomarkers for evaluating novel interventions, including promising mind-body exercises, that treat age-related disease and promote healthy aging. An ongoing, two-arm randomized clinical trial is evaluating the potential of Tai Chi mind-body exercise to attenuate age-related loss of complexity. A total of 60 Tai Chi-naïve healthy older adults (aged 50-79) are being randomized to either six months of Tai Chi training (n=30), or to a waitlist control receiving unaltered usual medical care (n=30). Our primary outcomes are complexity-based measures of heart rate, standing postural sway and gait stride interval dynamics assessed at 3 and 6months. Multiscale entropy and detrended fluctuation analysis are used as entropy- and fractal-based measures of complexity, respectively. Secondary outcomes include measures of physical and psychological function and tests of physiological adaptability also assessed at 3 and 6months. Results of this study may lead to novel biomarkers that help us monitor and understand the physiological processes of aging and explore the potential benefits of Tai Chi and related mind-body exercises for healthy aging. Copyright © 2012 Elsevier Inc. All rights reserved.

A Phase-Locked Loop Epilepsy Network Emulator.

PubMed

Watson, P D; Horecka, K M; Cohen, N J; Ratnam, R

2016-10-15

Most seizure forecasting employs statistical learning techniques that lack a representation of the network interactions that give rise to seizures. We present an epilepsy network emulator (ENE) that uses a network of interconnected phase-locked loops (PLLs) to model synchronous, circuit-level oscillations between electrocorticography (ECoG) electrodes. Using ECoG data from a canine-epilepsy model (Davis et al. 2011) and a physiological entropy measure (approximate entropy or ApEn, Pincus 1995), we demonstrate the entropy of the emulator phases increases dramatically during ictal periods across all ECoG recording sites and across all animals in the sample. Further, this increase precedes the observable voltage spikes that characterize seizure activity in the ECoG data. These results suggest that the ENE is sensitive to phase-domain information in the neural circuits measured by ECoG and that an increase in the entropy of this measure coincides with increasing likelihood of seizure activity. Understanding this unpredictable phase-domain electrical activity present in ECoG recordings may provide a target for seizure detection and feedback control.

EEG based topography analysis in string recognition task

NASA Astrophysics Data System (ADS)

Ma, Xiaofei; Huang, Xiaolin; Shen, Yuxiaotong; Qin, Zike; Ge, Yun; Chen, Ying; Ning, Xinbao

2017-03-01

Vision perception and recognition is a complex process, during which different parts of brain are involved depending on the specific modality of the vision target, e.g. face, character, or word. In this study, brain activities in string recognition task compared with idle control state are analyzed through topographies based on multiple measurements, i.e. sample entropy, symbolic sample entropy and normalized rhythm power, extracted from simultaneously collected scalp EEG. Our analyses show that, for most subjects, both symbolic sample entropy and normalized gamma power in string recognition task are significantly higher than those in idle state, especially at locations of P4, O2, T6 and C4. It implies that these regions are highly involved in string recognition task. Since symbolic sample entropy measures complexity, from the perspective of new information generation, and normalized rhythm power reveals the power distributions in frequency domain, complementary information about the underlying dynamics can be provided through the two types of indices.

Existence regimes for shocks in inhomogeneous magneto-plasmas having entropy

NASA Astrophysics Data System (ADS)

Iqbal, Javed; Yaqub Khan, M.

2018-04-01

The finding of connection of plasma density and temperature with entropy gives an incitement to study different plasma models with respect to entropy. Nonlinear dissipative one- and two-dimensional structures (shocks) are investigated in nonuniform magnetized plasma with respect to entropy. The dissipation comes in the medium through ion-neutral collisions. The linear dispersion relation is derived. The Korteweg-deVries-Burgers and Kadomtsev-Petviashvili-Burgers equations are derived for nonlinear drift waves in 1-D and 2-D by employing the drift approximation. It is found that vd/u ( vd is the diamagnetic drift velocity and u is the velocity of nonlinear structure) plays a significant role in the shock formation. It is also found that entropy has a significant effect on the strength of shocks. It is noticed that v d/u determines the rarefactive and compressive nature of the shocks. It is observed that upper and lower bounds exist for the shock velocity. It is also observed that the existing regimes for both one- and two-dimensional shocks for kappa distributed electrons are different from shocks with Cairns distributed electrons. Both rarefactive and compressive shocks are found for the 1-D drift waves with kappa distributed electrons. Interestingly, it is noticed that entropy enhances the strength of one- and two-dimensional shocks.

Rényi entropy, stationarity, and entanglement of the conformal scalar

NASA Astrophysics Data System (ADS)

Lee, Jeongseog; Lewkowycz, Aitor; Perlmutter, Eric; Safdi, Benjamin R.

2015-03-01

We extend previous work on the perturbative expansion of the Rényi entropy, S q , around q = 1 for a spherical entangling surface in a general CFT. Applied to conformal scalar fields in various spacetime dimensions, the results appear to conflict with the known conformal scalar Rényi entropies. On the other hand, the perturbative results agree with known Rényi entropies in a variety of other theories, including theories of free fermions and vector fields and theories with Einstein gravity duals. We propose a resolution stemming from a careful consideration of boundary conditions near the entangling surface. This is equivalent to a proper treatment of total-derivative terms in the definition of the modular Hamiltonian. As a corollary, we are able to resolve an outstanding puzzle in the literature regarding the Rényi entropy of super-Yang-Mills near q = 1. A related puzzle regards the question of stationarity of the renormalized entanglement entropy (REE) across a circle for a (2+1)-dimensional massive scalar field. We point out that the boundary contributions to the modular Hamiltonian shed light on the previously-observed non-stationarity. Moreover, IR divergences appear in perturbation theory about the massless fixed point that inhibit our ability to reliably calculate the REE at small non-zero mass.

Group prioritisation with unknown expert weights in incomplete linguistic context

NASA Astrophysics Data System (ADS)

Cheng, Dong; Cheng, Faxin; Zhou, Zhili; Wang, Juan

2017-09-01

In this paper, we study a group prioritisation problem in situations when the expert weights are completely unknown and their judgement preferences are linguistic and incomplete. Starting from the theory of relative entropy (RE) and multiplicative consistency, an optimisation model is provided for deriving an individual priority vector without estimating the missing value(s) of an incomplete linguistic preference relation. In order to address the unknown expert weights in the group aggregating process, we define two new kinds of expert weight indicators based on RE: proximity entropy weight and similarity entropy weight. Furthermore, a dynamic-adjusting algorithm (DAA) is proposed to obtain an objective expert weight vector and capture the dynamic properties involved in it. Unlike the extant literature of group prioritisation, the proposed RE approach does not require pre-allocation of expert weights and can solve incomplete preference relations. An interesting finding is that once all the experts express their preference relations, the final expert weight vector derived from the DAA is fixed irrespective of the initial settings of expert weights. Finally, an application example is conducted to validate the effectiveness and robustness of the RE approach.

Calculation of heat transfer on shuttle type configurations including the effects of variable entropy at boundary layer edge

NASA Technical Reports Server (NTRS)

Dejarnette, F. R.

1972-01-01

A relatively simple method is presented for including the effect of variable entropy at the boundary-layer edge in a heat transfer method developed previously. For each inviscid surface streamline an approximate shockwave shape is calculated using a modified form of Maslen's method for inviscid axisymmetric flows. The entropy for the streamline at the edge of the boundary layer is determined by equating the mass flux through the shock wave to that inside the boundary layer. Approximations used in this technique allow the heating rates along each inviscid surface streamline to be calculated independent of the other streamlines. The shock standoff distances computed by the present method are found to compare well with those computed by Maslen's asymmetric method. Heating rates are presented for blunted circular and elliptical cones and a typical space shuttle orbiter at angles of attack. Variable entropy effects are found to increase heating rates downstream of the nose significantly higher than those computed using normal-shock entropy, and turbulent heating rates increased more than laminar rates. Effects of Reynolds number and angles of attack are also shown.

A bound on holographic entanglement entropy from inverse mean curvature flow

NASA Astrophysics Data System (ADS)

Fischetti, Sebastian; Wiseman, Toby

2017-06-01

Entanglement entropies are notoriously difficult to compute. Large-N strongly-coupled holographic CFTs are an important exception, where the AdS/CFT dictionary gives the entanglement entropy of a CFT region in terms of the area of an extremal bulk surface anchored to the AdS boundary. Using this prescription, we show—for quite general states of (2  +  1)-dimensional such CFTs—that the renormalized entanglement entropy of any region of the CFT is bounded from above by a weighted local energy density. The key ingredient in this construction is the inverse mean curvature (IMC) flow, which we suitably generalize to flows of surfaces anchored to the AdS boundary. Our bound can then be thought of as a ‘subregion’ Penrose inequality in asymptotically locally AdS spacetimes, similar to the Penrose inequalities obtained from IMC flows in asymptotically flat spacetimes. Combining the result with positivity of relative entropy, we argue that our bound is valid perturbatively in 1/N, and conjecture that a restricted version of it holds in any CFT.

Species Entropies in the Kinetic Range of Collisionless Plasma Turbulence: Particle-in-cell Simulations

NASA Astrophysics Data System (ADS)

Gary, S. Peter; Zhao, Yinjian; Hughes, R. Scott; Wang, Joseph; Parashar, Tulasi N.

2018-06-01

Three-dimensional particle-in-cell simulations of the forward cascade of decaying turbulence in the relatively short-wavelength kinetic range have been carried out as initial-value problems on collisionless, homogeneous, magnetized electron-ion plasma models. The simulations have addressed both whistler turbulence at β i = β e = 0.25 and kinetic Alfvén turbulence at β i = β e = 0.50, computing the species energy dissipation rates as well as the increase of the Boltzmann entropies for both ions and electrons as functions of the initial dimensionless fluctuating magnetic field energy density ε o in the range 0 ≤ ε o ≤ 0.50. This study shows that electron and ion entropies display similar rates of increase and that all four entropy rates increase approximately as ε o , consistent with the assumption that the quasilinear premise is valid for the initial conditions assumed for these simulations. The simulations further predict that the time rates of ion entropy increase should be substantially greater for kinetic Alfvén turbulence than for whistler turbulence.

How hidden are hidden processes? A primer on crypticity and entropy convergence

NASA Astrophysics Data System (ADS)

Mahoney, John R.; Ellison, Christopher J.; James, Ryan G.; Crutchfield, James P.

2011-09-01

We investigate a stationary process's crypticity—a measure of the difference between its hidden state information and its observed information—using the causal states of computational mechanics. Here, we motivate crypticity and cryptic order as physically meaningful quantities that monitor how hidden a hidden process is. This is done by recasting previous results on the convergence of block entropy and block-state entropy in a geometric setting, one that is more intuitive and that leads to a number of new results. For example, we connect crypticity to how an observer synchronizes to a process. We show that the block-causal-state entropy is a convex function of block length. We give a complete analysis of spin chains. We present a classification scheme that surveys stationary processes in terms of their possible cryptic and Markov orders. We illustrate related entropy convergence behaviors using a new form of foliated information diagram. Finally, along the way, we provide a variety of interpretations of crypticity and cryptic order to establish their naturalness and pervasiveness. This is also a first step in developing applications in spatially extended and network dynamical systems.

Structural transformations of heat treated Co-less high entropy alloys

NASA Astrophysics Data System (ADS)

Mitrica, D.; Tudor, A.; Rinaldi, A.; Soare, V.; Predescu, C.; Berbecaru, A.; Stoiciu, F.; Badilita, V.

2018-03-01

Co is considered to be one of the main ingredients in superalloys. Co is considered a critical element and its substitution is difficult due to its unique ability to form high temperature stable structures with high mechanical and corrosion/oxidation resistance. High entropy alloys (HEA) represent a relatively new concept in material design. HEA are characterised by a high number of alloying elements, in unusually high proportion. Due to their specific particularities, high entropy alloys tend to form predominant solid solution structures that develop potentially high chemical, physical and mechanical properties. Present paper is studying Co-less high entropy alloys with high potential in severe environment applications. The high entropy alloys based on Al-Cr-Fe-Mn-Ni system were prepared by induction melting and casting under protective atmosphere. The as-cast specimens were heat treated at various temperatures to determine the structure and property behaviour. Samples taken before and after heat treatment were investigated for chemical, physical, structural and mechanical characteristics. Sigma phase composition and heat treatment parameters had major influence over the resulted alloy structure and properties.

Force-Time Entropy of Isometric Impulse.

PubMed

Hsieh, Tsung-Yu; Newell, Karl M

2016-01-01

The relation between force and temporal variability in discrete impulse production has been viewed as independent (R. A. Schmidt, H. Zelaznik, B. Hawkins, J. S. Frank, & J. T. Quinn, 1979 ) or dependent on the rate of force (L. G. Carlton & K. M. Newell, 1993 ). Two experiments in an isometric single finger force task investigated the joint force-time entropy with (a) fixed time to peak force and different percentages of force level and (b) fixed percentage of force level and different times to peak force. The results showed that the peak force variability increased either with the increment of force level or through a shorter time to peak force that also reduced timing error variability. The peak force entropy and entropy of time to peak force increased on the respective dimension as the parameter conditions approached either maximum force or a minimum rate of force production. The findings show that force error and timing error are dependent but complementary when considered in the same framework with the joint force-time entropy at a minimum in the middle parameter range of discrete impulse.

Entropy of space-time outcome in a movement speed-accuracy task.

PubMed

Hsieh, Tsung-Yu; Pacheco, Matheus Maia; Newell, Karl M

2015-12-01

The experiment reported was set-up to investigate the space-time entropy of movement outcome as a function of a range of spatial (10, 20 and 30 cm) and temporal (250-2500 ms) criteria in a discrete aiming task. The variability and information entropy of the movement spatial and temporal errors considered separately increased and decreased on the respective dimension as a function of an increment of movement velocity. However, the joint space-time entropy was lowest when the relative contribution of spatial and temporal task criteria was comparable (i.e., mid-range of space-time constraints), and it increased with a greater trade-off between spatial or temporal task demands, revealing a U-shaped function across space-time task criteria. The traditional speed-accuracy functions of spatial error and temporal error considered independently mapped to this joint space-time U-shaped entropy function. The trade-off in movement tasks with joint space-time criteria is between spatial error and timing error, rather than movement speed and accuracy. Copyright © 2015 Elsevier B.V. All rights reserved.

Entropy in Collisionless Self-gravitating Systems

NASA Astrophysics Data System (ADS)

Barnes, Eric; Williams, L.

2010-01-01

Collisionless systems, like simulated dark matter halos or gas-less elliptical galaxies, often times have properties suggesting that a common physical principle controls their evolution. For example, N-body simulations of dark matter halos present nearly scale-free density/velocity-cubed profiles. In an attempt to understand the origins of such relationships, we adopt a thermodynamics approach. While it is well-known that self-gravitating systems do not have physically realizable thermal equilibrium configurations, we are interested in the behavior of entropy as mechanical equilibrium is acheived. We will discuss entropy production in these systems from a kinetic theory point of view. This material is based upon work supported by the National Aeronautics and Space Administration under grant NNX07AG86G issued through the Science Mission Directorate.

The nucleotide composition of microbial genomes indicates differential patterns of selection on core and accessory genomes.

PubMed

Bohlin, Jon; Eldholm, Vegard; Pettersson, John H O; Brynildsrud, Ola; Snipen, Lars

2017-02-10

The core genome consists of genes shared by the vast majority of a species and is therefore assumed to have been subjected to substantially stronger purifying selection than the more mobile elements of the genome, also known as the accessory genome. Here we examine intragenic base composition differences in core genomes and corresponding accessory genomes in 36 species, represented by the genomes of 731 bacterial strains, to assess the impact of selective forces on base composition in microbes. We also explore, in turn, how these results compare with findings for whole genome intragenic regions. We found that GC content in coding regions is significantly higher in core genomes than accessory genomes and whole genomes. Likewise, GC content variation within coding regions was significantly lower in core genomes than in accessory genomes and whole genomes. Relative entropy in coding regions, measured as the difference between observed and expected trinucleotide frequencies estimated from mononucleotide frequencies, was significantly higher in the core genomes than in accessory and whole genomes. Relative entropy was positively associated with coding region GC content within the accessory genomes, but not within the corresponding coding regions of core or whole genomes. The higher intragenic GC content and relative entropy, as well as the lower GC content variation, observed in the core genomes is most likely associated with selective constraints. It is unclear whether the positive association between GC content and relative entropy in the more mobile accessory genomes constitutes signatures of selection or selective neutral processes.

Implications, Consequences and Interpretations of Generalized Entropy in the Cosmological Setups

NASA Astrophysics Data System (ADS)

Moradpour, H.

2016-09-01

Recently, it was argued (Tsallis and Cirto, Eur. Phys. J. C 73, 2487 2013) that the total entropy of a gravitational system should be related to the volume of system instead of the system surface. Here, we show that this new proposal cannot satisfy the unified first law of thermodynamics and the Friedmans equation simultaneously, unless the effects of dark energy candidate on the horizon entropy are considered. In fact, our study shows that some types of dark energy candidate may admit this proposal. Some general properties of required dark energy are also addressed. Moreover, our investigation shows that this new proposal for entropy, while combined with the second law of thermodynamics (as the backbone of Verlinde's proposal), helps us in provideing a thermodynamic interpretation for the difference between the surface and bulk degrees of freedom which, according to Padmanabhan's proposal, leads to the emergence of spacetime and thus the universe expansion. In fact, our investigation shows that the entropy changes of system may be equal to the difference between the surface and bulk degrees of freedom falling from surface into the system volume. Briefly, our results signal us that this new proposal for entropy may be in agreement with the thermodynamics laws, the Friedmann equation, Padmanabhan's holographic proposal for the emergence of spacetime and therefore the universe expansion. In fact, this new definition of entropy may be used to make a bridge between Verlinde's and Padmanabhan's proposals.

Quantifying the entropic cost of cellular growth control

NASA Astrophysics Data System (ADS)

De Martino, Daniele; Capuani, Fabrizio; De Martino, Andrea

2017-07-01

Viewing the ways a living cell can organize its metabolism as the phase space of a physical system, regulation can be seen as the ability to reduce the entropy of that space by selecting specific cellular configurations that are, in some sense, optimal. Here we quantify the amount of regulation required to control a cell's growth rate by a maximum-entropy approach to the space of underlying metabolic phenotypes, where a configuration corresponds to a metabolic flux pattern as described by genome-scale models. We link the mean growth rate achieved by a population of cells to the minimal amount of metabolic regulation needed to achieve it through a phase diagram that highlights how growth suppression can be as costly (in regulatory terms) as growth enhancement. Moreover, we provide an interpretation of the inverse temperature β controlling maximum-entropy distributions based on the underlying growth dynamics. Specifically, we show that the asymptotic value of β for a cell population can be expected to depend on (i) the carrying capacity of the environment, (ii) the initial size of the colony, and (iii) the probability distribution from which the inoculum was sampled. Results obtained for E. coli and human cells are found to be remarkably consistent with empirical evidence.

Using Renyi entropy to detect early cardiac autonomic neuropathy.

PubMed

Cornforth, David J; Tarvainen, Mika P; Jelinek, Herbert F

2013-01-01

Cardiac Autonomic Neuropathy (CAN) is a disease that involves nerve damage leading to abnormal control of heart rate. CAN affects the correct operation of the heart and in turn leads to associated arrhythmias and heart attack. An open question is to what extent this condition is detectable by the measurement of Heart Rate Variability (HRV). An even more desirable option is to detect CAN in its early, preclinical stage, to improve treatment and outcomes. In previous work we have shown a difference in the Renyi spectrum between participants identified with well-defined CAN and controls. In this work we applied the multi-scale Renyi entropy for identification of early CAN in diabetes patients. Results suggest that Renyi entropy derived from a 20 minute, Lead-II ECG recording, forms a useful contribution to the detection of CAN even in the early stages of the disease. The positive α parameters (1 ≤ α ≤ 5) associated with the Renyi distribution indicated a significant difference (p < 0.00004) between controls and early CAN as well as definite CAN. This is a significant achievement given the simple nature of the information collected, and raises prospects of a simple screening test and improved outcomes of patients.

A Second Law Based Unstructured Finite Volume Procedure for Generalized Flow Simulation

NASA Technical Reports Server (NTRS)

Majumdar, Alok

1998-01-01

An unstructured finite volume procedure has been developed for steady and transient thermo-fluid dynamic analysis of fluid systems and components. The procedure is applicable for a flow network consisting of pipes and various fittings where flow is assumed to be one dimensional. It can also be used to simulate flow in a component by modeling a multi-dimensional flow using the same numerical scheme. The flow domain is discretized into a number of interconnected control volumes located arbitrarily in space. The conservation equations for each control volume account for the transport of mass, momentum and entropy from the neighboring control volumes. In addition, they also include the sources of each conserved variable and time dependent terms. The source term of entropy equation contains entropy generation due to heat transfer and fluid friction. Thermodynamic properties are computed from the equation of state of a real fluid. The system of equations is solved by a hybrid numerical method which is a combination of simultaneous Newton-Raphson and successive substitution schemes. The paper also describes the application and verification of the procedure by comparing its predictions with the analytical and numerical solution of several benchmark problems.

Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables

NASA Astrophysics Data System (ADS)

Barnett, Lionel; Barrett, Adam B.; Seth, Anil K.

2009-12-01

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.

H-theorem in quantum physics.

PubMed

Lesovik, G B; Lebedev, A V; Sadovskyy, I A; Suslov, M V; Vinokur, V M

2016-09-12

Remarkable progress of quantum information theory (QIT) allowed to formulate mathematical theorems for conditions that data-transmitting or data-processing occurs with a non-negative entropy gain. However, relation of these results formulated in terms of entropy gain in quantum channels to temporal evolution of real physical systems is not thoroughly understood. Here we build on the mathematical formalism provided by QIT to formulate the quantum H-theorem in terms of physical observables. We discuss the manifestation of the second law of thermodynamics in quantum physics and uncover special situations where the second law can be violated. We further demonstrate that the typical evolution of energy-isolated quantum systems occurs with non-diminishing entropy.

Spectral density of mixtures of random density matrices for qubits

NASA Astrophysics Data System (ADS)

Zhang, Lin; Wang, Jiamei; Chen, Zhihua

2018-06-01

We derive the spectral density of the equiprobable mixture of two random density matrices of a two-level quantum system. We also work out the spectral density of mixture under the so-called quantum addition rule. We use the spectral densities to calculate the average entropy of mixtures of random density matrices, and show that the average entropy of the arithmetic-mean-state of n qubit density matrices randomly chosen from the Hilbert-Schmidt ensemble is never decreasing with the number n. We also get the exact value of the average squared fidelity. Some conjectures and open problems related to von Neumann entropy are also proposed.

Expected Shannon Entropy and Shannon Differentiation between Subpopulations for Neutral Genes under the Finite Island Model.

PubMed

Chao, Anne; Jost, Lou; Hsieh, T C; Ma, K H; Sherwin, William B; Rollins, Lee Ann

2015-01-01

Shannon entropy H and related measures are increasingly used in molecular ecology and population genetics because (1) unlike measures based on heterozygosity or allele number, these measures weigh alleles in proportion to their population fraction, thus capturing a previously-ignored aspect of allele frequency distributions that may be important in many applications; (2) these measures connect directly to the rich predictive mathematics of information theory; (3) Shannon entropy is completely additive and has an explicitly hierarchical nature; and (4) Shannon entropy-based differentiation measures obey strong monotonicity properties that heterozygosity-based measures lack. We derive simple new expressions for the expected values of the Shannon entropy of the equilibrium allele distribution at a neutral locus in a single isolated population under two models of mutation: the infinite allele model and the stepwise mutation model. Surprisingly, this complex stochastic system for each model has an entropy expressable as a simple combination of well-known mathematical functions. Moreover, entropy- and heterozygosity-based measures for each model are linked by simple relationships that are shown by simulations to be approximately valid even far from equilibrium. We also identify a bridge between the two models of mutation. We apply our approach to subdivided populations which follow the finite island model, obtaining the Shannon entropy of the equilibrium allele distributions of the subpopulations and of the total population. We also derive the expected mutual information and normalized mutual information ("Shannon differentiation") between subpopulations at equilibrium, and identify the model parameters that determine them. We apply our measures to data from the common starling (Sturnus vulgaris) in Australia. Our measures provide a test for neutrality that is robust to violations of equilibrium assumptions, as verified on real world data from starlings.

Generalized Information Theory Meets Human Cognition: Introducing a Unified Framework to Model Uncertainty and Information Search.

PubMed

Crupi, Vincenzo; Nelson, Jonathan D; Meder, Björn; Cevolani, Gustavo; Tentori, Katya

2018-06-17

Searching for information is critical in many situations. In medicine, for instance, careful choice of a diagnostic test can help narrow down the range of plausible diseases that the patient might have. In a probabilistic framework, test selection is often modeled by assuming that people's goal is to reduce uncertainty about possible states of the world. In cognitive science, psychology, and medical decision making, Shannon entropy is the most prominent and most widely used model to formalize probabilistic uncertainty and the reduction thereof. However, a variety of alternative entropy metrics (Hartley, Quadratic, Tsallis, Rényi, and more) are popular in the social and the natural sciences, computer science, and philosophy of science. Particular entropy measures have been predominant in particular research areas, and it is often an open issue whether these divergences emerge from different theoretical and practical goals or are merely due to historical accident. Cutting across disciplinary boundaries, we show that several entropy and entropy reduction measures arise as special cases in a unified formalism, the Sharma-Mittal framework. Using mathematical results, computer simulations, and analyses of published behavioral data, we discuss four key questions: How do various entropy models relate to each other? What insights can be obtained by considering diverse entropy models within a unified framework? What is the psychological plausibility of different entropy models? What new questions and insights for research on human information acquisition follow? Our work provides several new pathways for theoretical and empirical research, reconciling apparently conflicting approaches and empirical findings within a comprehensive and unified information-theoretic formalism. Copyright © 2018 Cognitive Science Society, Inc.

Classifying the Quantum Phases of Matter

DTIC Science & Technology

2015-01-01

Kim related entanglement entropy to topological storage of quantum information [8]. Michalakis et al. showed that a particle-like excitation spectrum...Perturbative analysis of topological entanglement entropy from conditional independence, Phys. Rev. B 86, 254116 (2012), arXiv:1210.2360. [3] I. Kim...symmetries or long-range entanglement ), (2) elucidating the properties of three-dimensional quantum codes (in particular those which admit no string-like

Dynamical maps, quantum detailed balance, and the Petz recovery map

NASA Astrophysics Data System (ADS)

Alhambra, Álvaro M.; Woods, Mischa P.

2017-08-01

Markovian master equations (formally known as quantum dynamical semigroups) can be used to describe the evolution of a quantum state ρ when in contact with a memoryless thermal bath. This approach has had much success in describing the dynamics of real-life open quantum systems in the laboratory. Such dynamics increase the entropy of the state ρ and the bath until both systems reach thermal equilibrium, at which point entropy production stops. Our main result is to show that the entropy production at time t is bounded by the relative entropy between the original state and the state at time 2 t . The bound puts strong constraints on how quickly a state can thermalize, and we prove that the factor of 2 is tight. The proof makes use of a key physically relevant property of these dynamical semigroups, detailed balance, showing that this property is intimately connected with the field of recovery maps from quantum information theory. We envisage that the connections made here between the two fields will have further applications. We also use this connection to show that a similar relation can be derived when the fixed point is not thermal.

A new complexity measure for time series analysis and classification

NASA Astrophysics Data System (ADS)

Nagaraj, Nithin; Balasubramanian, Karthi; Dey, Sutirth

2013-07-01

Complexity measures are used in a number of applications including extraction of information from data such as ecological time series, detection of non-random structure in biomedical signals, testing of random number generators, language recognition and authorship attribution etc. Different complexity measures proposed in the literature like Shannon entropy, Relative entropy, Lempel-Ziv, Kolmogrov and Algorithmic complexity are mostly ineffective in analyzing short sequences that are further corrupted with noise. To address this problem, we propose a new complexity measure ETC and define it as the "Effort To Compress" the input sequence by a lossless compression algorithm. Here, we employ the lossless compression algorithm known as Non-Sequential Recursive Pair Substitution (NSRPS) and define ETC as the number of iterations needed for NSRPS to transform the input sequence to a constant sequence. We demonstrate the utility of ETC in two applications. ETC is shown to have better correlation with Lyapunov exponent than Shannon entropy even with relatively short and noisy time series. The measure also has a greater rate of success in automatic identification and classification of short noisy sequences, compared to entropy and a popular measure based on Lempel-Ziv compression (implemented by Gzip).

Correlation between magnetocaloric and electrical properties based on phenomenological models in La0.47Pr0.2Pb0.33MnO3 perovskite

NASA Astrophysics Data System (ADS)

Mechi, Nesrine; Alzahrani, Bandar; Hcini, Sobhi; Bouazizi, Mohamed Lamjed; Dhahri, Abdessalem

2018-06-01

We have investigated the correlation between magnetocaloric and electrical properties of La0.47Pr0.2Pb0.33MnO3 perovskite prepared using the sol-gel method. Rietveld analysis of X-ray diffraction (XRD) pattern shows pure crystalline phase with rhombohedral ? structure. Magnetic entropy change, relative cooling power (RCP) and specific heat were predicted from M(T, μ0H) data at different magnetic fields with the help of the phenomenological model. The magnetic entropy change reaches a maximum value ? of about 3.96 J kg-1 K-1 for μ0H = 5 T corresponding to RCP of 183 J kg-1. These values are relatively higher, making our sample a promising candidate for the magnetic refrigeration. Electrical-resistivity measurements were well fitted with the phenomenological percolation model, which is based on the phase segregation of ferromagnetic-metallic clusters and paramagnetic-semiconductor regions. The temperature and magnetic field dependences of resistivity data, ρ(T, μ0H), allowed us to determine the magnetic entropy change ?. Results show that the as-obtained magnetic entropy change values are similar to those determined from the phenomenological model.

Using the concept of Shannon's Entropy to evaluate impacts of climate extremes on interannual variability in ecosystem CO2 fluxes

NASA Astrophysics Data System (ADS)

Ma, S.; Baldocchi, D. D.

2016-12-01

Although interannual variability in ecosystem CO2 fluxes have been observed in the field and described with empirical or process-based models, we still lack tools for evaluating and comparing impacts of climate extremes or unusual biogeophysical events on the variability. We examined a 15-year-long dataset of net ecosystem exchange of CO2 (NEE) measured at a woody savanna and a grassland site in California from 2000 to 2015. We proposed a conceptual framework to quantify season contributions by computing relatively contributions of each season to annual anomalies of gross ecosystem productivity (GPP) and ecosystem respiration (Reco). According to the framework, we calculated the Shannon's Entropy for each year. The values of Shannon Entropy were higher in the year that variations in GPP and Reco were beyond predictions of empirical models established for the study site. We specifically examined the outliers compared to model predictions and concluded that the outliers were related to occurrences of unexpected biogeophysical events in those years. This study offers a new application of Shannon's Entropy in understanding complicated biophysical and ecological processes involved in ecosystem carbon cycling.

Thermal coefficients of the methyl groups within ubiquitin

PubMed Central

Sabo, T Michael; Bakhtiari, Davood; Walter, Korvin F A; McFeeters, Robert L; Giller, Karin; Becker, Stefan; Griesinger, Christian; Lee, Donghan

2012-01-01

Physiological processes such as protein folding and molecular recognition are intricately linked to their dynamic signature, which is reflected in their thermal coefficient. In addition, the local conformational entropy is directly related to the degrees of freedom, which each residue possesses within its conformational space. Therefore, the temperature dependence of the local conformational entropy may provide insight into understanding how local dynamics may affect the stability of proteins. Here, we analyze the temperature dependence of internal methyl group dynamics derived from the cross-correlated relaxation between dipolar couplings of two CH bonds within ubiquitin. Spanning a temperature range from 275 to 308 K, internal methyl group dynamics tend to increase with increasing temperature, which translates to a general increase in local conformational entropy. With this data measured over multiple temperatures, the thermal coefficient of the methyl group order parameter, the characteristic thermal coefficient, and the local heat capacity were obtained. By analyzing the distribution of methyl group thermal coefficients within ubiquitin, we found that the N-terminal region has relatively high thermostability. These results indicate that methyl groups contribute quite appreciably to the total heat capacity of ubiquitin through the regulation of local conformational entropy. PMID:22334336

Entanglement entropy of 2D conformal quantum critical points: hearing the shape of a quantum drum.

PubMed

Fradkin, Eduardo; Moore, Joel E

2006-08-04

The entanglement entropy of a pure quantum state of a bipartite system A union or logical sumB is defined as the von Neumann entropy of the reduced density matrix obtained by tracing over one of the two parts. In one dimension, the entanglement of critical ground states diverges logarithmically in the subsystem size, with a universal coefficient that for conformally invariant critical points is related to the central charge of the conformal field theory. We find that the entanglement entropy of a standard class of z=2 conformal quantum critical points in two spatial dimensions, in addition to a nonuniversal "area law" contribution linear in the size of the AB boundary, generically has a universal logarithmically divergent correction, which is completely determined by the geometry of the partition and by the central charge of the field theory that describes the critical wave function.

Tsirelson's bound from a generalized data processing inequality

NASA Astrophysics Data System (ADS)

Dahlsten, Oscar C. O.; Lercher, Daniel; Renner, Renato

2012-06-01

The strength of quantum correlations is bounded from above by Tsirelson's bound. We establish a connection between this bound and the fact that correlations between two systems cannot increase under local operations, a property known as the data processing inequality (DPI). More specifically, we consider arbitrary convex probabilistic theories. These can be equipped with an entropy measure that naturally generalizes the von Neumann entropy, as shown recently in Short and Wehner (2010 New J. Phys. 12 033023) and Barnum et al (2010 New J. Phys. 12 033024). We prove that if the DPI holds with respect to this generalized entropy measure then the underlying theory necessarily respects Tsirelson's bound. We, moreover, generalize this statement to any entropy measure satisfying certain minimal requirements. A consequence of our result is that not all the entropic relations used for deriving Tsirelson's bound via information causality in Pawlowski et al (2009 Nature 461 1101-4) are necessary.

Entropy: Thermodynamic definition and quantum expression

NASA Astrophysics Data System (ADS)

Gyftopoulos, Elias P.; Çubukçu, Erol

1997-04-01

Numerous expressions exist in the scientific literature purporting to represent entropy. Are they all acceptable? To answer this question, we review the thermodynamic definition of entropy, and establish eight criteria that must be satisfied by it. The definition and criteria are obtained by using solely the general, nonstatistical statements of the first and second laws presented in Thermodynamics: Foundations and Applications [Elias P. Gyftopoulos and Gian Paolo Beretta (Macmillan, New York, 1991)]. We apply the eight criteria to each of the entropy expressions proposed in the literature and find that only the relation S=-kTrρln ρ satisfies all the criteria, provided that the density operator ρ corresponds to a homogeneous ensemble of identical systems, identically prepared. Homogeneous ensemble means that every member of the ensemble is described by the same density operator ρ as any other member, that is, the ensemble is not a statistical mixture of projectors (wave functions).

Discrete gravity on random tensor network and holographic Rényi entropy

NASA Astrophysics Data System (ADS)

Han, Muxin; Huang, Shilin

2017-11-01

In this paper we apply the discrete gravity and Regge calculus to tensor networks and Anti-de Sitter/conformal field theory (AdS/CFT) correspondence. We construct the boundary many-body quantum state |Ψ〉 using random tensor networks as the holographic mapping, applied to the Wheeler-deWitt wave function of bulk Euclidean discrete gravity in 3 dimensions. The entanglement Rényi entropy of |Ψ〉 is shown to holographically relate to the on-shell action of Einstein gravity on a branch cover bulk manifold. The resulting Rényi entropy S n of |Ψ〉 approximates with high precision the Rényi entropy of ground state in 2-dimensional conformal field theory (CFT). In particular it reproduces the correct n dependence. Our results develop the framework of realizing the AdS3/CFT2 correspondence on random tensor networks, and provide a new proposal to approximate the CFT ground state.

Symmetry for the duration of entropy-consuming intervals.

PubMed

García-García, Reinaldo; Domínguez, Daniel

2014-05-01

We introduce the violation fraction υ as the cumulative fraction of time that a mesoscopic system spends consuming entropy at a single trajectory in phase space. We show that the fluctuations of this quantity are described in terms of a symmetry relation reminiscent of fluctuation theorems, which involve a function Φ, which can be interpreted as an entropy associated with the fluctuations of the violation fraction. The function Φ, when evaluated for arbitrary stochastic realizations of the violation fraction, is odd upon the symmetry transformations that are relevant for the associated stochastic entropy production. This fact leads to a detailed fluctuation theorem for the probability density function of Φ. We study the steady-state limit of this symmetry in the paradigmatic case of a colloidal particle dragged by optical tweezers through an aqueous solution. Finally, we briefly discuss possible applications of our results for the estimation of free-energy differences from single-molecule experiments.

Brane - Anti-Brane Democracy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rajaraman, Arvind

2003-06-02

We suggest a duality invariant formula for the entropy and temperature of nonextreme black holes in supersymmetric string theory. The entropy is given in terms of the duality invariant parameter of the deviation from extremality and 56 SU(8) covariant central charges. It interpolates between the entropies of Schwarzschild solution and extremal solutions with various amount of unbroken supersymmetries and therefore serves for classification of black holes in supersymmetric string theories. We introduce the second auxiliary 56 via E(7) symmetric constraint. The symmetric and antisymmetric combinations of these two multiplets are related via moduli to the corresponding two fundamental representations ofmore » E(7): brane and anti-brane ''numbers.'' Using the CPT as well as C symmetry of the entropy formula and duality one can explain the mysterious simplicity of the non-extreme black hole area formula in terms of branes and anti-branes.« less

Holographic definition of points and distances

NASA Astrophysics Data System (ADS)

Czech, Bartłomiej; Lamprou, Lampros

2014-11-01

We discuss the way in which field theory quantities assemble the spatial geometry of three-dimensional anti-de Sitter space (AdS3). The field theory ingredients are the entanglement entropies of boundary intervals. A point in AdS3 corresponds to a collection of boundary intervals which is selected by a variational principle we discuss. Coordinates in AdS3 are integration constants of the resulting equation of motion. We propose a distance function for this collection of points, which obeys the triangle inequality as a consequence of the strong subadditivity of entropy. Our construction correctly reproduces the static slice of AdS3 and the Ryu-Takayanagi relation between geodesics and entanglement entropies. We discuss how these results extend to quotients of AdS3 —the conical defect and the BTZ geometries. In these cases, the set of entanglement entropies must be supplemented by other field theory quantities, which can carry the information about lengths of nonminimal geodesics.

Entropy production of doubly stochastic quantum channels

DOE Office of Scientific and Technical Information (OSTI.GOV)

Müller-Hermes, Alexander, E-mail: muellerh@posteo.net; Department of Mathematical Sciences, University of Copenhagen, 2100 Copenhagen; Stilck França, Daniel, E-mail: dsfranca@mytum.de

2016-02-15

We study the entropy increase of quantum systems evolving under primitive, doubly stochastic Markovian noise and thus converging to the maximally mixed state. This entropy increase can be quantified by a logarithmic-Sobolev constant of the Liouvillian generating the noise. We prove a universal lower bound on this constant that stays invariant under taking tensor-powers. Our methods involve a new comparison method to relate logarithmic-Sobolev constants of different Liouvillians and a technique to compute logarithmic-Sobolev inequalities of Liouvillians with eigenvectors forming a projective representation of a finite abelian group. Our bounds improve upon similar results established before and as an applicationmore » we prove an upper bound on continuous-time quantum capacities. In the last part of this work we study entropy production estimates of discrete-time doubly stochastic quantum channels by extending the framework of discrete-time logarithmic-Sobolev inequalities to the quantum case.« less

Transfer Entropy and Transient Limits of Computation

PubMed Central

Prokopenko, Mikhail; Lizier, Joseph T.

2014-01-01

Transfer entropy is a recently introduced information-theoretic measure quantifying directed statistical coherence between spatiotemporal processes, and is widely used in diverse fields ranging from finance to neuroscience. However, its relationships to fundamental limits of computation, such as Landauer's limit, remain unknown. Here we show that in order to increase transfer entropy (predictability) by one bit, heat flow must match or exceed Landauer's limit. Importantly, we generalise Landauer's limit to bi-directional information dynamics for non-equilibrium processes, revealing that the limit applies to prediction, in addition to retrodiction (information erasure). Furthermore, the results are related to negentropy, and to Bremermann's limit and the Bekenstein bound, producing, perhaps surprisingly, lower bounds on the computational deceleration and information loss incurred during an increase in predictability about the process. The identified relationships set new computational limits in terms of fundamental physical quantities, and establish transfer entropy as a central measure connecting information theory, thermodynamics and theory of computation. PMID:24953547

Linear entropy and collapse–revival phenomenon for a general formalism N-type four-level atom interacting with a single-mode field

NASA Astrophysics Data System (ADS)

Eied, A. A.

2018-05-01

In this paper, the linear entropy and collapse-revival phenomenon through the relation (< {\\hat{a}}+{\\hat{a}} > -{\\bar{n}}) in a system of N-configuration four-level atom interacting with a single-mode field with additional forms of nonlinearities of both the field and the intensity-dependent atom-field coupling functional are investigated. A factorization of the initial density operator is assumed, considering the field to be initially in a squeezed coherent states and the atom initially in its most upper excited state. The dynamical behavior of the linear entropy and the time evolution of (< {\\hat{a}}+ {\\hat{a}} > -{\\bar{n}}) are analyzed. In particular, the effects of the mean photon number, detuning, Kerr-like medium and the intensity-dependent coupling functional on the entropy and the evolution of (< {\\hat{a}}+ {\\hat{a}} > -{\\bar{n}}) are examined.

Entropy bounds in terms of the w parameter

NASA Astrophysics Data System (ADS)

Abreu, Gabriel; Barceló, Carlos; Visser, Matt

2011-12-01

In a pair of recent articles [PRL 105 (2010) 041302; JHEP 1103 (2011) 056] two of the current authors have developed an entropy bound for equilibrium uncollapsed matter using only classical general relativity, basic thermodynamics, and the Unruh effect. An odd feature of that bound, [InlineMediaObject not available: see fulltext.], was that the proportionality constant, 1/2 , was weaker than that expected from black hole thermodynamics, 1/4 . In the current article we strengthen the previous results by obtaining a bound involving the (suitably averaged) w parameter. Simple causality arguments restrict this averaged < w> parameter to be ≤ 1. When equality holds, the entropy bound saturates at the value expected based on black hole thermodynamics. We also add some clarifying comments regarding the (net) positivity of the chemical potential. Overall, we find that even in the absence of any black hole region, we can nevertheless get arbitrarily close to the Bekenstein entropy.

Decoherence estimation in quantum theory and beyond

NASA Astrophysics Data System (ADS)

Pfister, Corsin

The quantum physics literature provides many different characterizations of decoherence. Most of them have in common that they describe decoherence as a kind of influence on a quantum system upon interacting with an another system. In the spirit of quantum information theory, we adapt a particular viewpoint on decoherence which describes it as the loss of information into a system that is possibly controlled by an adversary. We use a quantitative framework for decoherence that builds on operational characterizations of the min-entropy that have been developed in the quantum information literature. It characterizes decoherence as an influence on quantum channels that reduces their suitability for a variety of quantifiable tasks such as the distribution of secret cryptographic keys of a certain length or the distribution of a certain number of maximally entangled qubit pairs. This allows for a quantitative and operational characterization of decoherence via operational characterizations of the min-entropy. In this thesis, we present a series of results about the estimation of the minentropy, subdivided into three parts. The first part concerns the estimation of a quantum adversary's uncertainty about classical information--expressed by the smooth min-entropy--as it is done in protocols for quantum key distribution (QKD). We analyze this form of min-entropy estimation in detail and find that some of the more recently suggested QKD protocols have previously unnoticed security loopholes. We show that the specifics of the sifting subroutine of a QKD protocol are crucial for security by pointing out mistakes in the security analysis in the literature and by presenting eavesdropping attacks on those problematic protocols. We provide solutions to the identified problems and present a formalized analysis of the min-entropy estimate that incorporates the sifting stage of QKD protocols. In the second part, we extend ideas from QKD to a protocol that allows to estimate an adversary's uncertainty about quantum information, expressed by the fully quantum smooth min-entropy. Roughly speaking, we show that a protocol that resembles the parallel execution of two QKD protocols can be used to lower bound the min-entropy of some unmeasured qubits. We explain how this result may influence the ongoing search for protocols for entanglement distribution. The third part is dedicated to the development of a framework that allows the estimation of decoherence even in experiments that cannot be correctly described by quantum theory. Inspired by an equivalent formulation of the min-entropy that relates it to the fidelity with a maximally entangled state, we define a decoherence quantity for a very general class of probabilistic theories that reduces to the min-entropy in the special case of quantum theory. This entails a definition of maximal entanglement for generalized probabilistic theories. Using techniques from semidefinite and linear programming, we show how bounds on this quantity can be estimated through Bell-type experiments. This allows to test models for decoherence that cannot be described by quantum theory. As an example application, we devise an experimental test of a model for gravitational decoherence that has been suggested in the literature.

Entropy generation minimization for the sloshing phenomenon in half-full elliptical storage tanks

NASA Astrophysics Data System (ADS)

Saghi, Hassan

2018-02-01

In this paper, the entropy generation in the sloshing phenomenon was obtained in elliptical storage tanks and the optimum geometry of tank was suggested. To do this, a numerical model was developed to simulate the sloshing phenomenon by using coupled Reynolds-Averaged Navier-Stokes (RANS) solver and the Volume-of-Fluid (VOF) method. The RANS equations were discretized and solved using the staggered grid finite difference and SMAC methods, and the available data were used for the model validation. Some parameters consisting of maximum free surface displacement (MFSD), maximum horizontal force exerted on the tank perimeter (MHF), tank perimeter (TP), and total entropy generation (Sgen) were introduced as design criteria for elliptical storage tanks. The entropy generation distribution provides designers with useful information about the causes of the energy loss. In this step, horizontal periodic sway motions as X =amsin(ωt) were applied to elliptical storage tanks with different aspect ratios namely ratios of large diameter to small diameter of elliptical storage tank (AR). Then, the effect of am and ω was studied on the results. The results show that the relation between MFSD and MHF is almost linear relative to the sway motion amplitude. Moreover, the results show that an increase in the AR causes a decrease in the MFSD and MHF. The results, also, show that the relation between MFSD and MHF is nonlinear relative to the sway motion angular frequency. Furthermore, the results show that an increase in the AR causes that the relation between MFSD and MHF becomes linear relative to the sway motion angular frequency. In addition, MFSD and MHF were minimized in a sway motion with a 7 rad/s angular frequency. Finally, the results show that the elliptical storage tank with AR =1.2-1.4 is the optimum section.

Anorexia Nervosa: Analysis of Trabecular Texture with CT

PubMed Central

Tabari, Azadeh; Torriani, Martin; Miller, Karen K.; Klibanski, Anne; Kalra, Mannudeep K.

2017-01-01

Purpose To determine indexes of skeletal integrity by using computed tomographic (CT) trabecular texture analysis of the lumbar spine in patients with anorexia nervosa and normal-weight control subjects and to determine body composition predictors of trabecular texture. Materials and Methods This cross-sectional study was approved by the institutional review board and compliant with HIPAA. Written informed consent was obtained. The study included 30 women with anorexia nervosa (mean age ± standard deviation, 26 years ± 6) and 30 normal-weight age-matched women (control group). All participants underwent low-dose single-section quantitative CT of the L4 vertebral body with use of a calibration phantom. Trabecular texture analysis was performed by using software. Skewness (asymmetry of gray-level pixel distribution), kurtosis (pointiness of pixel distribution), entropy (inhomogeneity of pixel distribution), and mean value of positive pixels (MPP) were assessed. Bone mineral density and abdominal fat and paraspinal muscle areas were quantified with quantitative CT. Women with anorexia nervosa and normal-weight control subjects were compared by using the Student t test. Linear regression analyses were performed to determine associations between trabecular texture and body composition. Results Women with anorexia nervosa had higher skewness and kurtosis, lower MPP (P < .001), and a trend toward lower entropy (P = .07) compared with control subjects. Bone mineral density, abdominal fat area, and paraspinal muscle area were inversely associated with skewness and kurtosis and positively associated with MPP and entropy. Texture parameters, but not bone mineral density, were associated with lowest lifetime weight and duration of amenorrhea in anorexia nervosa. Conclusion Patients with anorexia nervosa had increased skewness and kurtosis and decreased entropy and MPP compared with normal-weight control subjects. These parameters were associated with lowest lifetime weight and duration of amenorrhea, but there were no such associations with bone mineral density. These findings suggest that trabecular texture analysis might contribute information about bone health in anorexia nervosa that is independent of that provided with bone mineral density. © RSNA, 2016 PMID:27797678

Anorexia Nervosa: Analysis of Trabecular Texture with CT.

PubMed

Tabari, Azadeh; Torriani, Martin; Miller, Karen K; Klibanski, Anne; Kalra, Mannudeep K; Bredella, Miriam A

2017-04-01

Purpose To determine indexes of skeletal integrity by using computed tomographic (CT) trabecular texture analysis of the lumbar spine in patients with anorexia nervosa and normal-weight control subjects and to determine body composition predictors of trabecular texture. Materials and Methods This cross-sectional study was approved by the institutional review board and compliant with HIPAA. Written informed consent was obtained. The study included 30 women with anorexia nervosa (mean age ± standard deviation, 26 years ± 6) and 30 normal-weight age-matched women (control group). All participants underwent low-dose single-section quantitative CT of the L4 vertebral body with use of a calibration phantom. Trabecular texture analysis was performed by using software. Skewness (asymmetry of gray-level pixel distribution), kurtosis (pointiness of pixel distribution), entropy (inhomogeneity of pixel distribution), and mean value of positive pixels (MPP) were assessed. Bone mineral density and abdominal fat and paraspinal muscle areas were quantified with quantitative CT. Women with anorexia nervosa and normal-weight control subjects were compared by using the Student t test. Linear regression analyses were performed to determine associations between trabecular texture and body composition. Results Women with anorexia nervosa had higher skewness and kurtosis, lower MPP (P < .001), and a trend toward lower entropy (P = .07) compared with control subjects. Bone mineral density, abdominal fat area, and paraspinal muscle area were inversely associated with skewness and kurtosis and positively associated with MPP and entropy. Texture parameters, but not bone mineral density, were associated with lowest lifetime weight and duration of amenorrhea in anorexia nervosa. Conclusion Patients with anorexia nervosa had increased skewness and kurtosis and decreased entropy and MPP compared with normal-weight control subjects. These parameters were associated with lowest lifetime weight and duration of amenorrhea, but there were no such associations with bone mineral density. These findings suggest that trabecular texture analysis might contribute information about bone health in anorexia nervosa that is independent of that provided with bone mineral density. © RSNA, 2016.

Non-extensive entropy and properties of polaron in RbCl delta quantum dot under an applied electric field and Coulombic impurity

NASA Astrophysics Data System (ADS)

Tiotsop, M.; Fotue, A. J.; Fotsin, H. B.; Fai, L. C.

2017-08-01

Bound polaron in RbCl delta quantum dot under electric field and Coulombic impurity were considered. The ground and first excited state energy were derived by employing Pekar variational and unitary transformation methods. Applying Fermi golden rule, the expression of temperature and polaron lifetime were derived. The decoherence was studied trough the Tsallis entropy. Results shows that decreasing (or increasing) the lifetime increases (or decreases) the temperature and delta parameter (electric field strength and hydrogenic impurity). This suggests that to accelerate quantum transition in nanostructure, temperature and delta have to be enhanced. The improvement of electric field and coulomb parameter, increases the lifetime of the delta quantum dot qubit. Energy spectrum of polaron increases with increase in temperature, electric field strength, Coulomb parameter, delta parameter, and polaronic radius. The control of the delta quantum dot energies can be done via the electric field, coulomb impurity, and delta parameter. Results also show that the non-extensive entropy is an oscillatory function of time. With the enhancement of delta parameter, non-extensive parameter, Coulombic parameter, and electric field strength, the entropy has a sinusoidal increase behavior with time. With the study of decoherence through the Tsallis entropy, it may be advised that to have a quantum system with efficient transmission of information, the non-extensive and delta parameters need to be significant. The study of the probability density showed an increase from the boundary to the center of the dot where it has its maximum value and oscillates with period T0 = ℏ / ΔE with the tunneling of the delta parameter, electric field strength, and Coulombic parameter. The results may be very helpful in the transmission of information in nanostructures and control of decoherence

Distribution entropy analysis of epileptic EEG signals.

PubMed

Li, Peng; Yan, Chang; Karmakar, Chandan; Liu, Changchun

2015-01-01

It is an open-ended challenge to accurately detect the epileptic seizures through electroencephalogram (EEG) signals. Recently published studies have made elaborate attempts to distinguish between the normal and epileptic EEG signals by advanced nonlinear entropy methods, such as the approximate entropy, sample entropy, fuzzy entropy, and permutation entropy, etc. Most recently, a novel distribution entropy (DistEn) has been reported to have superior performance compared with the conventional entropy methods for especially short length data. We thus aimed, in the present study, to show the potential of DistEn in the analysis of epileptic EEG signals. The publicly-accessible Bonn database which consisted of normal, interictal, and ictal EEG signals was used in this study. Three different measurement protocols were set for better understanding the performance of DistEn, which are: i) calculate the DistEn of a specific EEG signal using the full recording; ii) calculate the DistEn by averaging the results for all its possible non-overlapped 5 second segments; and iii) calculate it by averaging the DistEn values for all the possible non-overlapped segments of 1 second length, respectively. Results for all three protocols indicated a statistically significantly increased DistEn for the ictal class compared with both the normal and interictal classes. Besides, the results obtained under the third protocol, which only used very short segments (1 s) of EEG recordings showed a significantly (p <; 0.05) increased DistEn for the interictal class in compassion with the normal class, whereas both analyses using relatively long EEG signals failed in tracking this difference between them, which may be due to a nonstationarity effect on entropy algorithm. The capability of discriminating between the normal and interictal EEG signals is of great clinical relevance since it may provide helpful tools for the detection of a seizure onset. Therefore, our study suggests that the DistEn analysis of EEG signals is very promising for clinical and even portable EEG monitoring.

Uncertainties have a meaning: Information entropy as a quality measure for 3-D geological models

NASA Astrophysics Data System (ADS)

Wellmann, J. Florian; Regenauer-Lieb, Klaus

2012-03-01

Analyzing, visualizing and communicating uncertainties are important issues as geological models can never be fully determined. To date, there exists no general approach to quantify uncertainties in geological modeling. We propose here to use information entropy as an objective measure to compare and evaluate model and observational results. Information entropy was introduced in the 50s and defines a scalar value at every location in the model for predictability. We show that this method not only provides a quantitative insight into model uncertainties but, due to the underlying concept of information entropy, can be related to questions of data integration (i.e. how is the model quality interconnected with the used input data) and model evolution (i.e. does new data - or a changed geological hypothesis - optimize the model). In other words information entropy is a powerful measure to be used for data assimilation and inversion. As a first test of feasibility, we present the application of the new method to the visualization of uncertainties in geological models, here understood as structural representations of the subsurface. Applying the concept of information entropy on a suite of simulated models, we can clearly identify (a) uncertain regions within the model, even for complex geometries; (b) the overall uncertainty of a geological unit, which is, for example, of great relevance in any type of resource estimation; (c) a mean entropy for the whole model, important to track model changes with one overall measure. These results cannot easily be obtained with existing standard methods. The results suggest that information entropy is a powerful method to visualize uncertainties in geological models, and to classify the indefiniteness of single units and the mean entropy of a model quantitatively. Due to the relationship of this measure to the missing information, we expect the method to have a great potential in many types of geoscientific data assimilation problems — beyond pure visualization.

Thermodynamics and evolution.

PubMed

Demetrius, L

2000-09-07

The science of thermodynamics is concerned with understanding the properties of inanimate matter in so far as they are determined by changes in temperature. The Second Law asserts that in irreversible processes there is a uni-directional increase in thermodynamic entropy, a measure of the degree of uncertainty in the thermal energy state of a randomly chosen particle in the aggregate. The science of evolution is concerned with understanding the properties of populations of living matter in so far as they are regulated by changes in generation time. Directionality theory, a mathematical model of the evolutionary process, establishes that in populations subject to bounded growth constraints, there is a uni-directional increase in evolutionary entropy, a measure of the degree of uncertainty in the age of the immediate ancestor of a randomly chosen newborn. This article reviews the mathematical basis of directionality theory and analyses the relation between directionality theory and statistical thermodynamics. We exploit an analytic relation between temperature, and generation time, to show that the directionality principle for evolutionary entropy is a non-equilibrium extension of the principle of a uni-directional increase of thermodynamic entropy. The analytic relation between these directionality principles is consistent with the hypothesis of the equivalence of fundamental laws as one moves up the hierarchy, from a molecular ensemble where the thermodynamic laws apply, to a population of replicating entities (molecules, cells, higher organisms), where evolutionary principles prevail. Copyright 2000 Academic Press.

Energy, entropy and mass scaling relations for elliptical galaxies. Towards a physical understanding of their photometric properties

NASA Astrophysics Data System (ADS)

Márquez, I.; Lima Neto, G. B.; Capelato, H.; Durret, F.; Lanzoni, B.; Gerbal, D.

2001-12-01

In the present paper, we show that elliptical galaxies (Es) obey a scaling relation between potential energy and mass. Since they are relaxed systems in a post violent-relaxation stage, they are quasi-equilibrium gravitational systems and therefore they also have a quasi-constant specific entropy. Assuming that light traces mass, these two laws imply that in the space defined by the three Sérsic law parameters (intensity Sigma0 , scale a and shape nu ), elliptical galaxies are distributed on two intersecting 2-manifolds: the Entropic Surface and the Energy-Mass Surface. Using a sample of 132 galaxies belonging to three nearby clusters, we have verified that ellipticals indeed follow these laws. This also implies that they are distributed along the intersection line (the Energy-Entropy line), thus they constitute a one-parameter family. These two physical laws (separately or combined), allow to find the theoretical origin of several observed photometrical relations, such as the correlation between absolute magnitude and effective surface brightness, and the fact that ellipticals are located on a surface in the [log Reff, -2.5 log Sigma0, log nu ] space. The fact that elliptical galaxies are a one-parameter family has important implications for cosmology and galaxy formation and evolution models. Moreover, the Energy-Entropy line could be used as a distance indicator.

Quantum Markov chains, sufficiency of quantum channels, and Rényi information measures

NASA Astrophysics Data System (ADS)

Datta, Nilanjana; Wilde, Mark M.

2015-12-01

A short quantum Markov chain is a tripartite state {ρ }{ABC} such that system A can be recovered perfectly by acting on system C of the reduced state {ρ }{BC}. Such states have conditional mutual information I(A;B| C) equal to zero and are the only states with this property. A quantum channel {N} is sufficient for two states ρ and σ if there exists a recovery channel using which one can perfectly recover ρ from {N}(ρ ) and σ from {N}(σ ). The relative entropy difference D(ρ \\parallel σ )-D({N}(ρ )\\parallel {N}(σ )) is equal to zero if and only if {N} is sufficient for ρ and σ. In this paper, we show that these properties extend to Rényi generalizations of these information measures which were proposed in (Berta et al 2015 J. Math. Phys. 56 022205; Seshadreesan et al 2015 J. Phys. A: Math. Theor. 48 395303), thus providing an alternate characterization of short quantum Markov chains and sufficient quantum channels. These results give further support to these quantities as being legitimate Rényi generalizations of the conditional mutual information and the relative entropy difference. Along the way, we solve some open questions of Ruskai and Zhang, regarding the trace of particular matrices that arise in the study of monotonicity of relative entropy under quantum operations and strong subadditivity of the von Neumann entropy.

Entropy of Masseter Muscle Pain Sensitivity: A New Technique for Pain Assessment.

PubMed

Castrillon, Eduardo E; Exposto, Fernando G; Sato, Hitoshi; Tanosoto, Tomohiro; Arima, Taro; Baad-Hansen, Lene; Svensson, Peter

2017-01-01

To test whether manipulation of mechanical pain sensitivity (MPS) of the masseter muscle is reflected in quantitative measures of entropy. In a randomized, single-blinded, placebo-controlled design, 20 healthy volunteers had glutamate, lidocaine, and isotonic saline injected into the masseter muscle. Self-assessed pain intensity on a numeric rating scale (NRS) was evaluated up to 10 minutes following the injection, and MPS was evaluated after application (at 5 minutes and 30 minutes) of three different forces (0.5 kg, 1 kg, and 2 kg) to 15 different sites of the masseter muscle. Finally, the entropy and center of gravity (COG) of the pain sensitivity scores were calculated. Analysis of variance was used to test differences in means of tested outcomes and Tukey post hoc tests were used to adjust for multiple comparisons. The main findings were: (1) Compared with both lidocaine and isotonic saline, glutamate injections caused an increase in peak, duration, and area under the NRS pain curve (P < .01); (2) A pressure of 2 kg caused the highest NRS pain scores (P < .03) and entropy values (P < .02); (3) Glutamate injections caused increases in entropy values when assessed with 0.5 kg and 1.0 kg but not with 2.0 kg of pressure; and (4) COG coordinates revealed differences between the x coordinates for time (P < .01) and time and force for the y coordinates (P < .01). These results suggest that manipulation of MPS of the masseter muscle with painful glutamate injections can increase the diversity of MPS, which is reflected in entropy measures. Entropy allows quantification of the diversity of MPS, which may be important in clinical assessment of pain states such as myofascial temporomandibular disorders.

Negative Entropy of Life

NASA Astrophysics Data System (ADS)

Goradia, Shantilal

2015-10-01

We modify Newtonian gravity to probabilistic quantum mechanical gravity to derive strong coupling. If this approach is valid, we should be able to extend it to the physical body (life) as follows. Using Boltzmann equation, we get the entropy of the universe (137) as if its reciprocal, the fine structure constant (ALPHA), is the hidden candidate representing the negative entropy of the universe which is indicative of the binary information as its basis (http://www.arXiv.org/pdf/physics0210040v5). Since ALPHA relates to cosmology, it must relate to molecular biology too, with the binary system as the fundamental source of information for the nucleotides of the DNA as implicit in the book by the author: ``Quantum Consciousness - The Road to Reality.'' We debate claims of anthropic principle based on the negligible variation of ALPHA and throw light on thermodynamics. We question constancy of G in multiple ways.

Mass-independent area (or entropy) and thermodynamic volume products in conformal gravity

NASA Astrophysics Data System (ADS)

Pradhan, Parthapratim

2017-06-01

In this work, we investigate the thermodynamic properties of conformal gravity in four dimensions. We compute the area (or entropy) functional relation for this black hole (BH). We consider both de Sitter (dS) and anti-de Sitter (AdS) cases. We derive the Cosmic-Censorship-Inequality which is an important relation in general relativity that relates the total mass of a spacetime to the area of all the BH horizons. Local thermodynamic stability is studied by computing the specific heat. The second-order phase transition occurs at a certain condition. Various types of second-order phase structure have been given for various values of a and the cosmological constant Λ in the Appendix. When a = 0, one obtains the result of Schwarzschild-dS and Schwarzschild-AdS cases. In the limit aM ≪ 1, one obtains the result of Grumiller spacetime, where a is nontrivial Rindler parameter or Rindler acceleration and M is the mass parameter. The thermodynamic volume functional relation is derived in the extended phase space, where the cosmological constant is treated as a thermodynamic pressure and its conjugate variable as a thermodynamic volume. The mass-independent area (or entropy) functional relation and thermodynamic volume functional relation that we have derived could turn out to be a universal quantity.

Multiscale entropy analysis of human gait dynamics

NASA Astrophysics Data System (ADS)

Costa, M.; Peng, C.-K.; L. Goldberger, Ary; Hausdorff, Jeffrey M.

2003-12-01

We compare the complexity of human gait time series from healthy subjects under different conditions. Using the recently developed multiscale entropy algorithm, which provides a way to measure complexity over a range of scales, we observe that normal spontaneous walking has the highest complexity when compared to slow and fast walking and also to walking paced by a metronome. These findings have implications for modeling locomotor control and for quantifying gait dynamics in physiologic and pathologic states.

Saccadic entropy of head impulses in acute unilateral vestibular loss.

PubMed

Hsieh, Li-Chun; Lin, Hung-Ching; Lee, Guo-She

2017-10-01

To evaluate the complexity of vestibular-ocular reflex (VOR) in patients with acute unilateral vestibular loss (AUVL) via entropy analysis of head impulses. Horizontal head impulse test (HIT) with high-velocity alternating directions was used to evaluate 12 participants with AUVL and 16 healthy volunteers. Wireless electro-oculography and electronic gyrometry were used to acquire eye positional signals and head velocity signals. The eye velocity signals were then obtained through differentiation, band-pass filtering. The approximate entropy of eye velocity to head velocity (R ApEn ) was used to evaluate chaos property. VOR gain, gain asymmetry ratio, and R ApEn asymmetry ratio were also used to compare the groups. For the lesion-side HIT of the patient group, the mean VOR gain was significantly lower and the mean R ApEn was significantly greater compared with both nonlesion-side HIT and healthy controls (p < 0.01, one-way analysis of variance). Both the R ApEn asymmetry ratio and gain asymmetry ratio of the AUVL group were significantly greater compared with those of the control group (p < 0.05, independent sample t test). Entropy and gain analysis of HIT using wireless electro-oculography system could be used to detect the VOR dysfunctions of AUVL and may become effective methods for evaluating vestibular disorders. Copyright © 2017. Published by Elsevier B.V.

Secondary structural entropy in RNA switch (Riboswitch) identification.

PubMed

Manzourolajdad, Amirhossein; Arnold, Jonathan

2015-04-28

RNA regulatory elements play a significant role in gene regulation. Riboswitches, a widespread group of regulatory RNAs, are vital components of many bacterial genomes. These regulatory elements generally function by forming a ligand-induced alternative fold that controls access to ribosome binding sites or other regulatory sites in RNA. Riboswitch-mediated mechanisms are ubiquitous across bacterial genomes. A typical class of riboswitch has its own unique structural and biological complexity, making de novo riboswitch identification a formidable task. Traditionally, riboswitches have been identified through comparative genomics based on sequence and structural homology. The limitations of structural-homology-based approaches, coupled with the assumption that there is a great diversity of undiscovered riboswitches, suggests the need for alternative methods for riboswitch identification, possibly based on features intrinsic to their structure. As of yet, no such reliable method has been proposed. We used structural entropy of riboswitch sequences as a measure of their secondary structural dynamics. Entropy values of a diverse set of riboswitches were compared to that of their mutants, their dinucleotide shuffles, and their reverse complement sequences under different stochastic context-free grammar folding models. Significance of our results was evaluated by comparison to other approaches, such as the base-pairing entropy and energy landscapes dynamics. Classifiers based on structural entropy optimized via sequence and structural features were devised as riboswitch identifiers and tested on Bacillus subtilis, Escherichia coli, and Synechococcus elongatus as an exploration of structural entropy based approaches. The unusually long untranslated region of the cotH in Bacillus subtilis, as well as upstream regions of certain genes, such as the sucC genes were associated with significant structural entropy values in genome-wide examinations. Various tests show that there is in fact a relationship between higher structural entropy and the potential for the RNA sequence to have alternative structures, within the limitations of our methodology. This relationship, though modest, is consistent across various tests. Understanding the behavior of structural entropy as a fairly new feature for RNA conformational dynamics, however, may require extensive exploratory investigation both across RNA sequences and folding models.

Nonextensive Entropy Approach to Space Plasma Fluctuations and Turbulence

NASA Astrophysics Data System (ADS)

Leubner, M. P.; Vörös, Z.; Baumjohann, W.

Spatial intermittency in fully developed turbulence is an established feature of astrophysical plasma fluctuations and in particular apparent in the interplanetary medium by in situ observations. In this situation, the classical Boltzmann— Gibbs extensive thermo-statistics, applicable when microscopic interactions and memory are short ranged and the environment is a continuous and differentiable manifold, fails. Upon generalization of the entropy function to nonextensivity, accounting for long-range interactions and thus for correlations in the system, it is demonstrated that the corresponding probability distribution functions (PDFs) are members of a family of specific power-law distributions. In particular, the resulting theoretical bi-κ functional reproduces accurately the observed global leptokurtic, non-Gaussian shape of the increment PDFs of characteristic solar wind variables on all scales, where nonlocality in turbulence is controlled via a multiscale coupling parameter. Gradual decoupling is obtained by enhancing the spatial separation scale corresponding to increasing κ-values in case of slow solar wind conditions where a Gaussian is approached in the limit of large scales. Contrary, the scaling properties in the high speed solar wind are predominantly governed by the mean energy or variance of the distribution, appearing as second parameter in the theory. The PDFs of solar wind scalar field differences are computed from WIND and ACE data for different time-lags and bulk speeds and analyzed within the nonextensive theory, where also a particular nonlinear dependence of the coupling parameter and variance with scale arises for best fitting theoretical PDFs. Consequently, nonlocality in fluctuations, related to both, turbulence and its large scale driving, should be related to long-range interactions in the context of nonextensive entropy generalization, providing fundamentally the physical background of the observed scale dependence of fluctuations in intermittent space plasmas.

Extended statistical entropy analysis as a quantitative management tool for water resource systems

NASA Astrophysics Data System (ADS)

Sobantka, Alicja; Rechberger, Helmut

2010-05-01

The use of entropy in hydrology and water resources has been applied to various applications. As water resource systems are inherently spatial and complex, a stochastic description of these systems is needed, and entropy theory enables development of such a description by providing determination of the least-biased probability distributions with limited knowledge and data. Entropy can also serve as a basis for risk and reliability analysis. The relative entropy has been variously interpreted as a measure freedom of choice, uncertainty and disorder, information content, missing information or information gain or loss. In the analysis of empirical data, entropy is another measure of dispersion, an alternative to the variance. Also, as an evaluation tool, the statistical entropy analysis (SEA) has been developed by previous workers to quantify the power of a process to concentrate chemical elements. Within this research programme the SEA is aimed to be extended for application to chemical compounds and tested for its deficits and potentials in systems where water resources play an important role. The extended SEA (eSEA) will be developed first for the nitrogen balance in waste water treatment plants (WWTP). Later applications on the emission of substances to water bodies such as groundwater (e.g. leachate from landfills) will also be possible. By applying eSEA to the nitrogen balance in a WWTP, all possible nitrogen compounds, which may occur during the water treatment process, are taken into account and are quantified in their impact towards the environment and human health. It has been shown that entropy reducing processes are part of modern waste management. Generally, materials management should be performed in a way that significant entropy rise is avoided. The entropy metric might also be used to perform benchmarking on WWTPs. The result out of this management tool would be the determination of the efficiency of WWTPs. By improving and optimizing the efficiency of WWTPs with respect to the state-of-the-art of technology, waste water treatment could become more resources preserving.

Derivation of the spin-glass order parameter from stochastic thermodynamics

NASA Astrophysics Data System (ADS)

Crisanti, A.; Picco, M.; Ritort, F.

2018-05-01

A fluctuation relation is derived to extract the order parameter function q (x ) in weakly ergodic systems. The relation is based on measuring and classifying entropy production fluctuations according to the value of the overlap q between configurations. For a fixed value of q , entropy production fluctuations are Gaussian distributed allowing us to derive the quasi-FDT so characteristic of aging systems. The theory is validated by extracting the q (x ) in various types of glassy models. It might be generally applicable to other nonequilibrium systems and experimental small systems.

Relative entropy and optimization-driven coarse-graining methods in VOTCA

DOE PAGES

Mashayak, S. Y.; Jochum, Mara N.; Koschke, Konstantin; ...

2015-07-20

We discuss recent advances of the VOTCA package for systematic coarse-graining. Two methods have been implemented, namely the downhill simplex optimization and the relative entropy minimization. We illustrate the new methods by coarse-graining SPC/E bulk water and more complex water-methanol mixture systems. The CG potentials obtained from both methods are then evaluated by comparing the pair distributions from the coarse-grained to the reference atomistic simulations.We have also added a parallel analysis framework to improve the computational efficiency of the coarse-graining process.

Exact conditions on the temperature dependence of density functionals

DOE PAGES

Burke, K.; Smith, J. C.; Grabowski, P. E.; ...

2016-05-15

Universal exact conditions guided the construction of most ground-state density functional approximations in use today. Here, we derive the relation between the entropy and Mermin free energy density functionals for thermal density functional theory. Both the entropy and sum of kinetic and electron-electron repulsion functionals are shown to be monotonically increasing with temperature, while the Mermin functional is concave downwards. Analogous relations are found for both exchange and correlation. The importance of these conditions is illustrated in two extremes: the Hubbard dimer and the uniform gas.

Studies on pressure-gain combustion engines

NASA Astrophysics Data System (ADS)

Matsutomi, Yu

Various aspects of the pressure-gain combustion engine are investigated analytically and experimentally in the current study. A lumped parameter model is developed to characterize the operation of a valveless pulse detonation engine. The model identified the function of flame quenching process through gas dynamic process. By adjusting fuel manifold pressure and geometries, the duration of the air buffer can be effectively varied. The parametric study with the lumped parameter model has shown that engine frequency of up to approximately 15 Hz is attainable. However, requirements for upstream air pressure increases significantly with higher engine frequency. The higher pressure requirement indicates pressure loss in the system and lower overall engine performance. The loss of performance due to the pressure loss is a critical issue for the integrated pressure-gain combustors. Two types of transitional methods are examined using entropy-based models. An accumulator based transition has obvious loss due to sudden area expansion, but it can be minimized by utilizing the gas dynamics in the combustion tube. An ejector type transition has potential to achieve performance beyond the limit specified by a single flow path Humphrey cycle. The performance of an ejector was discussed in terms of apparent entropy and mixed flow entropy. Through an ideal ejector, the apparent part of entropy increases due to the reduction in flow unsteadiness, but entropy of the mixed flow remains constant. The method is applied to a CFD simulation with a simple manifold for qualitative evaluation. The operation of the wave rotor constant volume combustion rig is experimentally examined. The rig has shown versatility of operation for wide range of conditions. Large pressure rise in the rotor channel and in a section of the exhaust duct are observed even with relatively large leakage gaps on the rotor. The simplified analysis indicated that inconsistent combustion is likely due to insufficient fuel near the ignition source. However, it is difficult to conclude its fuel distribution with the current setup. Additional measurement near the rotor interfaces and better fuel control are required for the future test.

Kullback-Leibler information function and the sequential selection of experiments to discriminate among several linear models. Ph.D. Thesis

NASA Technical Reports Server (NTRS)

Sidik, S. M.

1972-01-01

A sequential adaptive experimental design procedure for a related problem is studied. It is assumed that a finite set of potential linear models relating certain controlled variables to an observed variable is postulated, and that exactly one of these models is correct. The problem is to sequentially design most informative experiments so that the correct model equation can be determined with as little experimentation as possible. Discussion includes: structure of the linear models; prerequisite distribution theory; entropy functions and the Kullback-Leibler information function; the sequential decision procedure; and computer simulation results. An example of application is given.

Nonlinear digital signal processing in mental health: characterization of major depression using instantaneous entropy measures of heartbeat dynamics.

PubMed

Valenza, Gaetano; Garcia, Ronald G; Citi, Luca; Scilingo, Enzo P; Tomaz, Carlos A; Barbieri, Riccardo

2015-01-01

Nonlinear digital signal processing methods that address system complexity have provided useful computational tools for helping in the diagnosis and treatment of a wide range of pathologies. More specifically, nonlinear measures have been successful in characterizing patients with mental disorders such as Major Depression (MD). In this study, we propose the use of instantaneous measures of entropy, namely the inhomogeneous point-process approximate entropy (ipApEn) and the inhomogeneous point-process sample entropy (ipSampEn), to describe a novel characterization of MD patients undergoing affective elicitation. Because these measures are built within a nonlinear point-process model, they allow for the assessment of complexity in cardiovascular dynamics at each moment in time. Heartbeat dynamics were characterized from 48 healthy controls and 48 patients with MD while emotionally elicited through either neutral or arousing audiovisual stimuli. Experimental results coming from the arousing tasks show that ipApEn measures are able to instantaneously track heartbeat complexity as well as discern between healthy subjects and MD patients. Conversely, standard heart rate variability (HRV) analysis performed in both time and frequency domains did not show any statistical significance. We conclude that measures of entropy based on nonlinear point-process models might contribute to devising useful computational tools for care in mental health.

From Maximum Entropy Models to Non-Stationarity and Irreversibility

NASA Astrophysics Data System (ADS)

Cofre, Rodrigo; Cessac, Bruno; Maldonado, Cesar

The maximum entropy distribution can be obtained from a variational principle. This is important as a matter of principle and for the purpose of finding approximate solutions. One can exploit this fact to obtain relevant information about the underlying stochastic process. We report here in recent progress in three aspects to this approach.1- Biological systems are expected to show some degree of irreversibility in time. Based on the transfer matrix technique to find the spatio-temporal maximum entropy distribution, we build a framework to quantify the degree of irreversibility of any maximum entropy distribution.2- The maximum entropy solution is characterized by a functional called Gibbs free energy (solution of the variational principle). The Legendre transformation of this functional is the rate function, which controls the speed of convergence of empirical averages to their ergodic mean. We show how the correct description of this functional is determinant for a more rigorous characterization of first and higher order phase transitions.3- We assess the impact of a weak time-dependent external stimulus on the collective statistics of spiking neuronal networks. We show how to evaluate this impact on any higher order spatio-temporal correlation. RC supported by ERC advanced Grant ``Bridges'', BC: KEOPS ANR-CONICYT, Renvision and CM: CONICYT-FONDECYT No. 3140572.

On the role of dealing with quantum coherence in amplitude amplification

NASA Astrophysics Data System (ADS)

Rastegin, Alexey E.

2018-07-01

Amplitude amplification is one of primary tools in building algorithms for quantum computers. This technique generalizes key ideas of the Grover search algorithm. Potentially useful modifications are connected with changing phases in the rotation operations and replacing the intermediate Hadamard transform with arbitrary unitary one. In addition, arbitrary initial distribution of the amplitudes may be prepared. We examine trade-off relations between measures of quantum coherence and the success probability in amplitude amplification processes. As measures of coherence, the geometric coherence and the relative entropy of coherence are considered. In terms of the relative entropy of coherence, complementarity relations with the success probability seem to be the most expository. The general relations presented are illustrated within several model scenarios of amplitude amplification processes.