Estimating Temporal Causal Interaction between Spike Trains with Permutation and Transfer Entropy

PubMed Central

Li, Zhaohui; Li, Xiaoli

2013-01-01

Estimating the causal interaction between neurons is very important for better understanding the functional connectivity in neuronal networks. We propose a method called normalized permutation transfer entropy (NPTE) to evaluate the temporal causal interaction between spike trains, which quantifies the fraction of ordinal information in a neuron that has presented in another one. The performance of this method is evaluated with the spike trains generated by an Izhikevich’s neuronal model. Results show that the NPTE method can effectively estimate the causal interaction between two neurons without influence of data length. Considering both the precision of time delay estimated and the robustness of information flow estimated against neuronal firing rate, the NPTE method is superior to other information theoretic method including normalized transfer entropy, symbolic transfer entropy and permutation conditional mutual information. To test the performance of NPTE on analyzing simulated biophysically realistic synapses, an Izhikevich’s cortical network that based on the neuronal model is employed. It is found that the NPTE method is able to characterize mutual interactions and identify spurious causality in a network of three neurons exactly. We conclude that the proposed method can obtain more reliable comparison of interactions between different pairs of neurons and is a promising tool to uncover more details on the neural coding. PMID:23940662

Heat Transfer and Entropy Generation Analysis of an Intermediate Heat Exchanger in ADS

NASA Astrophysics Data System (ADS)

Wang, Yongwei; Huai, Xiulan

2018-04-01

The intermediate heat exchanger for enhancement heat transfer is the important equipment in the usage of nuclear energy. In the present work, heat transfer and entropy generation of an intermediate heat exchanger (IHX) in the accelerator driven subcritical system (ADS) are investigated experimentally. The variation of entropy generation number with performance parameters of the IHX is analyzed, and effects of inlet conditions of the IHX on entropy generation number and heat transfer are discussed. Compared with the results at two working conditions of the constant mass flow rates of liquid lead-bismuth eutectic (LBE) and helium gas, the total pumping power all tends to reduce with the decreasing entropy generation number, but the variations of the effectiveness, number of transfer units and thermal capacity rate ratio are inconsistent, and need to analyze respectively. With the increasing inlet mass flow rate or LBE inlet temperature, the entropy generation number increases and the heat transfer is enhanced, while the opposite trend occurs with the increasing helium gas inlet temperature. The further study is necessary for obtaining the optimized operation parameters of the IHX to minimize entropy generation and enhance heat transfer.

Reversible and irreversible heat transfer by radiation

NASA Astrophysics Data System (ADS)

del Río, Fernando; de la Selva, Sara María Teresa

2015-05-01

The theme of heat transfer by radiation is absent from most textbooks on thermodynamics, and its treatment in the applied literature presents some basic discrepancies concerning the validity of the Clausius relation between the quantity of heat exchanged, δ Q, and the accompanying entropy change, dS. We review the reversible and irreversible heat transfers by radiation to clarify the validity of the Clausius relation, and we show that in both cases, the Clausius relation is obeyed, as it should be. We also deal with radiation diluted by the presence of matter, introducing a dilution coefficient, ϕ, and an irreversibility factor, χ (φ ). This treatment requires the use of the correct relation between energy and heat fluxes, the spectral fluxes of energy and entropy, and Planck’s equation for the entropy of monochromatic radiation. For the irreversible case of diluted radiation, we recover the ratio between the fluxes of heat and entropy that agree with Clausius’ inequality, including an irreversibility factor, (4/3)χ (φ ). An improved modification for the explicit function χ (φ ) is given. As an illustration, the fluxes of energy and entropy from the Sun to the Earth are obtained. We also calculate the fluxes re-emitted by the Earth, taking into account the greenhouse effect. We find the value of 1.258 W{{m}-2}{{K}-1} for the re-emitted entropy flux after the radiation has been thermalized, which is much larger than the incident flux, in agreement with other authors.

Entropy Transfer between Residue Pairs and Allostery in Proteins: Quantifying Allosteric Communication in Ubiquitin.

PubMed

Hacisuleyman, Aysima; Erman, Burak

2017-01-01

It has recently been proposed by Gunasakaran et al. that allostery may be an intrinsic property of all proteins. Here, we develop a computational method that can determine and quantify allosteric activity in any given protein. Based on Schreiber's transfer entropy formulation, our approach leads to an information transfer landscape for the protein that shows the presence of entropy sinks and sources and explains how pairs of residues communicate with each other using entropy transfer. The model can identify the residues that drive the fluctuations of others. We apply the model to Ubiquitin, whose allosteric activity has not been emphasized until recently, and show that there are indeed systematic pathways of entropy and information transfer between residues that correlate well with the activities of the protein. We use 600 nanosecond molecular dynamics trajectories for Ubiquitin and its complex with human polymerase iota and evaluate entropy transfer between all pairs of residues of Ubiquitin and quantify the binding susceptibility changes upon complex formation. We explain the complex formation propensities of Ubiquitin in terms of entropy transfer. Important residues taking part in allosteric communication in Ubiquitin predicted by our approach are in agreement with results of NMR relaxation dispersion experiments. Finally, we show that time delayed correlation of fluctuations of two interacting residues possesses an intrinsic causality that tells which residue controls the interaction and which one is controlled. Our work shows that time delayed correlations, entropy transfer and causality are the required new concepts for explaining allosteric communication in proteins.

Causality, transfer entropy, and allosteric communication landscapes in proteins with harmonic interactions.

PubMed

Hacisuleyman, Aysima; Erman, Burak

2017-06-01

A fast and approximate method of generating allosteric communication landscapes in proteins is presented by using Schreiber's entropy transfer concept in combination with the Gaussian Network Model of proteins. Predictions of the model and the allosteric communication landscapes generated show that information transfer in proteins does not necessarily take place along a single path, but an ensemble of pathways is possible. The model emphasizes that knowledge of entropy only is not sufficient for determining allosteric communication and additional information based on time delayed correlations should be introduced, which leads to the presence of causality in proteins. The model provides a simple tool for mapping entropy sink-source relations into pairs of residues. By this approach, residues that should be manipulated to control protein activity may be determined. This should be of great importance for allosteric drug design and for understanding the effects of mutations on function. The model is applied to determine allosteric communication in three proteins, Ubiquitin, Pyruvate Kinase, and the PDZ domain. Predictions are in agreement with molecular dynamics simulations and experimental evidence. Proteins 2017; 85:1056-1064. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Entropy Transfer between Residue Pairs and Allostery in Proteins: Quantifying Allosteric Communication in Ubiquitin

PubMed Central

2017-01-01

It has recently been proposed by Gunasakaran et al. that allostery may be an intrinsic property of all proteins. Here, we develop a computational method that can determine and quantify allosteric activity in any given protein. Based on Schreiber's transfer entropy formulation, our approach leads to an information transfer landscape for the protein that shows the presence of entropy sinks and sources and explains how pairs of residues communicate with each other using entropy transfer. The model can identify the residues that drive the fluctuations of others. We apply the model to Ubiquitin, whose allosteric activity has not been emphasized until recently, and show that there are indeed systematic pathways of entropy and information transfer between residues that correlate well with the activities of the protein. We use 600 nanosecond molecular dynamics trajectories for Ubiquitin and its complex with human polymerase iota and evaluate entropy transfer between all pairs of residues of Ubiquitin and quantify the binding susceptibility changes upon complex formation. We explain the complex formation propensities of Ubiquitin in terms of entropy transfer. Important residues taking part in allosteric communication in Ubiquitin predicted by our approach are in agreement with results of NMR relaxation dispersion experiments. Finally, we show that time delayed correlation of fluctuations of two interacting residues possesses an intrinsic causality that tells which residue controls the interaction and which one is controlled. Our work shows that time delayed correlations, entropy transfer and causality are the required new concepts for explaining allosteric communication in proteins. PMID:28095404

Numerical investigation for entropy generation in hydromagnetic flow of fluid with variable properties and slip

NASA Astrophysics Data System (ADS)

Khan, M. Ijaz; Hayat, Tasawar; Alsaedi, Ahmed

2018-02-01

This modeling and computations present the study of viscous fluid flow with variable properties by a rotating stretchable disk. Rotating flow is generated through nonlinear rotating stretching surface. Nonlinear thermal radiation and heat generation/absorption are studied. Flow is conducting for a constant applied magnetic field. No polarization is taken. Induced magnetic field is not taken into account. Attention is focused on the entropy generation rate and Bejan number. The entropy generation rate and Bejan number clearly depend on velocity and thermal fields. The von Kármán approach is utilized to convert the partial differential expressions into ordinary ones. These expressions are non-dimensionalized, and numerical results are obtained for flow variables. The effects of the magnetic parameter, Prandtl number, radiative parameter, heat generation/absorption parameter, and slip parameter on velocity and temperature fields as well as the entropy generation rate and Bejan number are discussed. Drag forces (radial and tangential) and heat transfer rates are calculated and discussed. Furthermore the entropy generation rate is a decreasing function of magnetic variable and Reynolds number. The Bejan number effect on the entropy generation rate is reverse to that of the magnetic variable. Also opposite behavior of heat transfers is observed for varying estimations of radiative and slip variables.

Inference of gene regulatory networks from time series by Tsallis entropy

PubMed Central

2011-01-01

Background The inference of gene regulatory networks (GRNs) from large-scale expression profiles is one of the most challenging problems of Systems Biology nowadays. Many techniques and models have been proposed for this task. However, it is not generally possible to recover the original topology with great accuracy, mainly due to the short time series data in face of the high complexity of the networks and the intrinsic noise of the expression measurements. In order to improve the accuracy of GRNs inference methods based on entropy (mutual information), a new criterion function is here proposed. Results In this paper we introduce the use of generalized entropy proposed by Tsallis, for the inference of GRNs from time series expression profiles. The inference process is based on a feature selection approach and the conditional entropy is applied as criterion function. In order to assess the proposed methodology, the algorithm is applied to recover the network topology from temporal expressions generated by an artificial gene network (AGN) model as well as from the DREAM challenge. The adopted AGN is based on theoretical models of complex networks and its gene transference function is obtained from random drawing on the set of possible Boolean functions, thus creating its dynamics. On the other hand, DREAM time series data presents variation of network size and its topologies are based on real networks. The dynamics are generated by continuous differential equations with noise and perturbation. By adopting both data sources, it is possible to estimate the average quality of the inference with respect to different network topologies, transfer functions and network sizes. Conclusions A remarkable improvement of accuracy was observed in the experimental results by reducing the number of false connections in the inferred topology by the non-Shannon entropy. The obtained best free parameter of the Tsallis entropy was on average in the range 2.5 ≤ q ≤ 3.5 (hence, subextensive entropy), which opens new perspectives for GRNs inference methods based on information theory and for investigation of the nonextensivity of such networks. The inference algorithm and criterion function proposed here were implemented and included in the DimReduction software, which is freely available at http://sourceforge.net/projects/dimreduction and http://code.google.com/p/dimreduction/. PMID:21545720

On the entropy function in sociotechnical systems

PubMed Central

Montroll, Elliott W.

1981-01-01

The entropy function H = -Σpj log pj (pj being the probability of a system being in state j) and its continuum analogue H = ∫p(x) log p(x) dx are fundamental in Shannon's theory of information transfer in communication systems. It is here shown that the discrete form of H also appears naturally in single-lane traffic flow theory. In merchandising, goods flow from a whole-saler through a retailer to a customer. Certain features of the process may be deduced from price distribution functions derived from Sears Roebuck and Company catalogues. It is found that the dispersion in logarithm of catalogue prices of a given year has remained about constant, independently of the year, for over 75 years. From this it may be inferred that the continuum entropy function for the variable logarithm of price had inadvertently, through Sears Roebuck policies, been maximized for that firm subject to the observed dispersion. PMID:16593136

On the entropy function in sociotechnical systems.

PubMed

Montroll, E W

1981-12-01

The entropy function H = -Sigmap(j) log p(j) (p(j) being the probability of a system being in state j) and its continuum analogue H = integralp(x) log p(x) dx are fundamental in Shannon's theory of information transfer in communication systems. It is here shown that the discrete form of H also appears naturally in single-lane traffic flow theory. In merchandising, goods flow from a whole-saler through a retailer to a customer. Certain features of the process may be deduced from price distribution functions derived from Sears Roebuck and Company catalogues. It is found that the dispersion in logarithm of catalogue prices of a given year has remained about constant, independently of the year, for over 75 years. From this it may be inferred that the continuum entropy function for the variable logarithm of price had inadvertently, through Sears Roebuck policies, been maximized for that firm subject to the observed dispersion.

From Maximum Entropy Models to Non-Stationarity and Irreversibility

NASA Astrophysics Data System (ADS)

Cofre, Rodrigo; Cessac, Bruno; Maldonado, Cesar

The maximum entropy distribution can be obtained from a variational principle. This is important as a matter of principle and for the purpose of finding approximate solutions. One can exploit this fact to obtain relevant information about the underlying stochastic process. We report here in recent progress in three aspects to this approach.1- Biological systems are expected to show some degree of irreversibility in time. Based on the transfer matrix technique to find the spatio-temporal maximum entropy distribution, we build a framework to quantify the degree of irreversibility of any maximum entropy distribution.2- The maximum entropy solution is characterized by a functional called Gibbs free energy (solution of the variational principle). The Legendre transformation of this functional is the rate function, which controls the speed of convergence of empirical averages to their ergodic mean. We show how the correct description of this functional is determinant for a more rigorous characterization of first and higher order phase transitions.3- We assess the impact of a weak time-dependent external stimulus on the collective statistics of spiking neuronal networks. We show how to evaluate this impact on any higher order spatio-temporal correlation. RC supported by ERC advanced Grant ``Bridges'', BC: KEOPS ANR-CONICYT, Renvision and CM: CONICYT-FONDECYT No. 3140572.

Multi-scale symbolic transfer entropy analysis of EEG

NASA Astrophysics Data System (ADS)

Yao, Wenpo; Wang, Jun

2017-10-01

From both global and local perspectives, we symbolize two kinds of EEG and analyze their dynamic and asymmetrical information using multi-scale transfer entropy. Multi-scale process with scale factor from 1 to 199 and step size of 2 is applied to EEG of healthy people and epileptic patients, and then the permutation with embedding dimension of 3 and global approach are used to symbolize the sequences. The forward and reverse symbol sequences are taken as the inputs of transfer entropy. Scale factor intervals of permutation and global way are (37, 57) and (65, 85) where the two kinds of EEG have satisfied entropy distinctions. When scale factor is 67, transfer entropy of the healthy and epileptic subjects of permutation, 0.1137 and 0.1028, have biggest difference. And the corresponding values of the global symbolization is 0.0641 and 0.0601 which lies in the scale factor of 165. Research results show that permutation which takes contribution of local information has better distinction and is more effectively applied to our multi-scale transfer entropy analysis of EEG.

SPICODYN: A Toolbox for the Analysis of Neuronal Network Dynamics and Connectivity from Multi-Site Spike Signal Recordings.

PubMed

Pastore, Vito Paolo; Godjoski, Aleksandar; Martinoia, Sergio; Massobrio, Paolo

2018-01-01

We implemented an automated and efficient open-source software for the analysis of multi-site neuronal spike signals. The software package, named SPICODYN, has been developed as a standalone windows GUI application, using C# programming language with Microsoft Visual Studio based on .NET framework 4.5 development environment. Accepted input data formats are HDF5, level 5 MAT and text files, containing recorded or generated time series spike signals data. SPICODYN processes such electrophysiological signals focusing on: spiking and bursting dynamics and functional-effective connectivity analysis. In particular, for inferring network connectivity, a new implementation of the transfer entropy method is presented dealing with multiple time delays (temporal extension) and with multiple binary patterns (high order extension). SPICODYN is specifically tailored to process data coming from different Multi-Electrode Arrays setups, guarantying, in those specific cases, automated processing. The optimized implementation of the Delayed Transfer Entropy and the High-Order Transfer Entropy algorithms, allows performing accurate and rapid analysis on multiple spike trains from thousands of electrodes.

A Graphical Proof of the Positive Entropy Change in Heat Transfer between Two Objects

ERIC Educational Resources Information Center

Kiatgamolchai, Somchai

2015-01-01

It is well known that heat transfer between two objects results in a positive change in the total entropy of the two-object system. The second law of thermodynamics states that the entropy change of a naturally irreversible process is positive. In other words, if the entropy change of any process is positive, it can be inferred that such a process…

Quantifying ‘Causality’ in Complex Systems: Understanding Transfer Entropy

PubMed Central

Abdul Razak, Fatimah; Jensen, Henrik Jeldtoft

2014-01-01

‘Causal’ direction is of great importance when dealing with complex systems. Often big volumes of data in the form of time series are available and it is important to develop methods that can inform about possible causal connections between the different observables. Here we investigate the ability of the Transfer Entropy measure to identify causal relations embedded in emergent coherent correlations. We do this by firstly applying Transfer Entropy to an amended Ising model. In addition we use a simple Random Transition model to test the reliability of Transfer Entropy as a measure of ‘causal’ direction in the presence of stochastic fluctuations. In particular we systematically study the effect of the finite size of data sets. PMID:24955766

Entropy and generalized least square methods in assessment of the regional value of streamgages

USGS Publications Warehouse

Markus, M.; Vernon, Knapp H.; Tasker, Gary D.

2003-01-01

The Illinois State Water Survey performed a study to assess the streamgaging network in the State of Illinois. One of the important aspects of the study was to assess the regional value of each station through an assessment of the information transfer among gaging records for low, average, and high flow conditions. This analysis was performed for the main hydrologic regions in the State, and the stations were initially evaluated using a new approach based on entropy analysis. To determine the regional value of each station within a region, several information parameters, including total net information, were defined based on entropy. Stations were ranked based on the total net information. For comparison, the regional value of the same stations was assessed using the generalized least square regression (GLS) method, developed by the US Geological Survey. Finally, a hybrid combination of GLS and entropy was created by including a function of the negative net information as a penalty function in the GLS. The weights of the combined model were determined to maximize the average correlation with the results of GLS and entropy. The entropy and GLS methods were evaluated using the high-flow data from southern Illinois stations. The combined method was compared with the entropy and GLS approaches using the high-flow data from eastern Illinois stations. ?? 2003 Elsevier B.V. All rights reserved.

Computing algebraic transfer entropy and coupling directions via transcripts

NASA Astrophysics Data System (ADS)

Amigó, José M.; Monetti, Roberto; Graff, Beata; Graff, Grzegorz

2016-11-01

Most random processes studied in nonlinear time series analysis take values on sets endowed with a group structure, e.g., the real and rational numbers, and the integers. This fact allows to associate with each pair of group elements a third element, called their transcript, which is defined as the product of the second element in the pair times the first one. The transfer entropy of two such processes is called algebraic transfer entropy. It measures the information transferred between two coupled processes whose values belong to a group. In this paper, we show that, subject to one constraint, the algebraic transfer entropy matches the (in general, conditional) mutual information of certain transcripts with one variable less. This property has interesting practical applications, especially to the analysis of short time series. We also derive weak conditions for the 3-dimensional algebraic transfer entropy to yield the same coupling direction as the corresponding mutual information of transcripts. A related issue concerns the use of mutual information of transcripts to determine coupling directions in cases where the conditions just mentioned are not fulfilled. We checked the latter possibility in the lowest dimensional case with numerical simulations and cardiovascular data, and obtained positive results.

Thermal modulation voltammetry with laser heating at an aqueous|nitrobenzene solution microinterface: determination of the standard entropy changes of transfer for tetraalkylammonium ions.

PubMed

Hinoue, Teruo; Ikeda, Eiji; Watariguchi, Shigeru; Kibune, Yasuyuki

2007-01-01

Thermal modulation voltammetry (TMV) with laser heating was successfully performed at an aqueous|nitrobenzene (NB) solution microinterface, by taking advantage of the fact that laser light with a wavelength of 325.0 nm is optically transparent to the aqueous solution but opaque to the NB solution. When the laser beam impinges upon the interface from the aqueous solution side, a temperature is raised around the interface through the thermal diffusion subsequent to the light-to-heat conversion following the optical absorption by the NB solution near the interface. Based on such a principle, we achieved a fluctuating temperature perturbation around the interface for TMV by periodically irradiating the interface with the laser beam. On the other hand, the fluctuating temperature perturbation has influence on currents for transfer of an ion across the interface to produce fluctuating currents synchronized with the perturbation through temperature coefficients of several variables concerning the transfer, such as the standard transfer potential and the diffusion coefficient of the ion. Consequently, TMV has the possibility of providing information about the standard entropy change of transfer corresponding to a temperature coefficient of the standard transfer potential and a temperature coefficient of the diffusion coefficient. In this work, the aqueous|NB solution interface of 30 microm in diameter was irradiated with the laser beam at 10 Hz, and the currents synchronized with the periodical irradiation were recorded as a function of the potential difference across the interface in order to construct a TM voltammogram. TM voltammograms were measured for transfer of tetramethylammonium, tetraethylammonium, tetrapropylammonium, and tetra-n-butylammonium ions from the aqueous solution to the NB solution, and the standard entropy change of transfer was determined for each ion, according to an analytical procedure based on a mathematical expression of the TM voltammogram. Comparison of the values obtained in this work with the literature values has proved that TMV with laser heating is available for the determination of the standard entropy change of transfer for an ion.

Effective Techniques for Augmenting Heat Transfer: An Application of Entropy Generation Minimization Principles.

DTIC Science & Technology

1980-12-01

augmentation techniques, entropy generation, irreversibility, exergy . 20. ABSTRACT (Continue on rovers. side If necessary and Identify by block number...35 3.5 Internally finned tubes ...... ................. .. 37 3.6 Internally roughened tubes ..... ............... . 41 3.7 Other heat transfer...irreversibility and entropy generation as fundamental criterion for evaluating and, eventually, minimizing the waste of usable energy ( exergy ) in energy

MHD effects on heat transfer and entropy generation of nanofluid flow in an open cavity

NASA Astrophysics Data System (ADS)

Mehrez, Zouhaier; El Cafsi, Afif; Belghith, Ali; Le Quéré, Patrick

2015-01-01

The present numerical work investigates the effect of an external oriented magnetic field on heat transfer and entropy generation of Cu-water nanofluid flow in an open cavity heated from below. The governing equations are solved numerically by the finite-volume method. The study has been carried out for a wide range of solid volume fraction 0≤φ≤0.06, Hartmann number 0≤Ha≤100, Reynolds number 100≤Re≤500 and Richardson number 0.001≤Ri≤1 at three inclination angles of magnetic field γ: 0°, 45° and 90°. The numerical results are given by streamlines, isotherms, average Nusselt number, average entropy generation and Bejan number. The results show that flow behavior, temperature distribution, heat transfer and entropy generation are strongly affected by the presence of a magnetic field. The average Nusselt number and entropy generation, which increase by increasing volume fraction of nanoparticles, depend mainly on the Hartmann number and inclination angle of the magnetic field. The variation rates of heat transfer and entropy generation while adding nanoparticles or applying a magnetic field depend on the Richardson and Reynolds numbers.

Empirical and Theoretical Aspects of Generation and Transfer of Information in a Neuromagnetic Source Network

PubMed Central

Vakorin, Vasily A.; Mišić, Bratislav; Krakovska, Olga; McIntosh, Anthony Randal

2011-01-01

Variability in source dynamics across the sources in an activated network may be indicative of how the information is processed within a network. Information-theoretic tools allow one not only to characterize local brain dynamics but also to describe interactions between distributed brain activity. This study follows such a framework and explores the relations between signal variability and asymmetry in mutual interdependencies in a data-driven pipeline of non-linear analysis of neuromagnetic sources reconstructed from human magnetoencephalographic (MEG) data collected as a reaction to a face recognition task. Asymmetry in non-linear interdependencies in the network was analyzed using transfer entropy, which quantifies predictive information transfer between the sources. Variability of the source activity was estimated using multi-scale entropy, quantifying the rate of which information is generated. The empirical results are supported by an analysis of synthetic data based on the dynamics of coupled systems with time delay in coupling. We found that the amount of information transferred from one source to another was correlated with the difference in variability between the dynamics of these two sources, with the directionality of net information transfer depending on the time scale at which the sample entropy was computed. The results based on synthetic data suggest that both time delay and strength of coupling can contribute to the relations between variability of brain signals and information transfer between them. Our findings support the previous attempts to characterize functional organization of the activated brain, based on a combination of non-linear dynamics and temporal features of brain connectivity, such as time delay. PMID:22131968

Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables

NASA Astrophysics Data System (ADS)

Barnett, Lionel; Barrett, Adam B.; Seth, Anil K.

2009-12-01

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.

Improved wavelet packet classification algorithm for vibrational intrusions in distributed fiber-optic monitoring systems

NASA Astrophysics Data System (ADS)

Wang, Bingjie; Pi, Shaohua; Sun, Qi; Jia, Bo

2015-05-01

An improved classification algorithm that considers multiscale wavelet packet Shannon entropy is proposed. Decomposition coefficients at all levels are obtained to build the initial Shannon entropy feature vector. After subtracting the Shannon entropy map of the background signal, components of the strongest discriminating power in the initial feature vector are picked out to rebuild the Shannon entropy feature vector, which is transferred to radial basis function (RBF) neural network for classification. Four types of man-made vibrational intrusion signals are recorded based on a modified Sagnac interferometer. The performance of the improved classification algorithm has been evaluated by the classification experiments via RBF neural network under different diffusion coefficients. An 85% classification accuracy rate is achieved, which is higher than the other common algorithms. The classification results show that this improved classification algorithm can be used to classify vibrational intrusion signals in an automatic real-time monitoring system.

Transfer Entropy and Transient Limits of Computation

PubMed Central

Prokopenko, Mikhail; Lizier, Joseph T.

2014-01-01

Transfer entropy is a recently introduced information-theoretic measure quantifying directed statistical coherence between spatiotemporal processes, and is widely used in diverse fields ranging from finance to neuroscience. However, its relationships to fundamental limits of computation, such as Landauer's limit, remain unknown. Here we show that in order to increase transfer entropy (predictability) by one bit, heat flow must match or exceed Landauer's limit. Importantly, we generalise Landauer's limit to bi-directional information dynamics for non-equilibrium processes, revealing that the limit applies to prediction, in addition to retrodiction (information erasure). Furthermore, the results are related to negentropy, and to Bremermann's limit and the Bekenstein bound, producing, perhaps surprisingly, lower bounds on the computational deceleration and information loss incurred during an increase in predictability about the process. The identified relationships set new computational limits in terms of fundamental physical quantities, and establish transfer entropy as a central measure connecting information theory, thermodynamics and theory of computation. PMID:24953547

An Information Transmission Measure for the Analysis of Effective Connectivity among Cortical Neurons

PubMed Central

Law, Andrew J.; Sharma, Gaurav; Schieber, Marc H.

2014-01-01

We present a methodology for detecting effective connections between simultaneously recorded neurons using an information transmission measure to identify the presence and direction of information flow from one neuron to another. Using simulated and experimentally-measured data, we evaluate the performance of our proposed method and compare it to the traditional transfer entropy approach. In simulations, our measure of information transmission outperforms transfer entropy in identifying the effective connectivity structure of a neuron ensemble. For experimentally recorded data, where ground truth is unavailable, the proposed method also yields a more plausible connectivity structure than transfer entropy. PMID:21096617

The limit behavior of the evolution of the Tsallis entropy in self-gravitating systems

NASA Astrophysics Data System (ADS)

Zheng, Yahui; Du, Jiulin; Liang, Faku

2017-06-01

In this letter, we study the limit behavior of the evolution of the Tsallis entropy in self-gravitating systems. The study is carried out under two different situations, drawing the same conclusion. No matter in the energy transfer process or in the mass transfer process inside the system, when the nonextensive parameter q is more than unity, the total entropy is bounded; on the contrary, when this parameter is less than unity, the total entropy is unbounded. There are proofs in both theory and observation that the q is always more than unity. So the Tsallis entropy in self-gravitating systems generally exhibits a bounded property. This indicates the existence of a global maximum of the Tsallis entropy. It is possible for self-gravitating systems to evolve to thermodynamically stable states.

[Determination by thermometric titrimetry of the thermodynamic parameters of water/n-octanol transfer of several non-steroidal anti-inflammatory drugs].

PubMed

Burgot, G; Burgot, J L

1995-01-01

The calorimetric determination by thermometric titrimetry of the water/n-octanol transfer enthalpies of some non steroidic anti-inflammatory compounds is described. By combining the values obtained with that of the free enthalpies of transfer issuing from the values of corresponding log P, it is possible to determinate the transfer entropies of the solutes. The whole results of the show that almost the transfers are both enthalpy and entropy driven. They demonstrate the occurrence of three different mechanisms of transfer.

Seebeck Effects in N-Type and P-Type Polymers Driven Simultaneously by Surface Polarization and Entropy Differences Based on Conductor/Polymer/Conductor Thin-Film Devices

DOE PAGES

Hu, Dehua; Liu, Qing; Tisdale, Jeremy; ...

2015-04-15

This paper reports Seebeck effects driven by both surface polarization difference and entropy difference by using intramolecular charge-transfer states in n-type and p-type conjugated polymers, namely IIDT and IIDDT, based on vertical conductor/polymer/conductor thin-film devices. Large Seebeck coefficients of -898 V/K and 1300 V/K from are observed from n-type IIDT p-type IIDDT, respectively, when the charge-transfer states are generated by a white light illumination of 100 mW/cm2. Simultaneously, electrical conductivities are increased from almost insulating states in dark condition to conducting states under photoexcitation in both n-type IIDT and p-type IIDDT devices. We find that the intramolecular charge-transfer states canmore » largely enhance Seebeck effects in the n-type IIDT and p-type IIDDT devices driven by both surface polarization difference and entropy difference. Furthermore, the Seebeck effects can be shifted between polarization and entropy regimes when electrical conductivities are changed. This reveals a new concept to develop Seebeck effects by controlling polarization and entropy regimes based on charge-transfer states in vertical conductor/polymer/conductor thin-film devices.« less

Diagnosing entropy production and dissipation in fully kinetic plasmas

NASA Astrophysics Data System (ADS)

Juno, James; Tenbarge, Jason; Hakim, Ammar; Dorland, William; Cagas, Petr

2017-10-01

Many plasma systems, from the core of a tokamak to the outer heliosphere, are weakly collisional and thus most accurately described by kinetic theory. The typical approach to solving the kinetic equation has been the particle-in-cell algorithm, which, while a powerful tool, introduces counting noise into the particle distribution function. The counting noise is particularly problematic when attempting to study grand challenge problems such as entropy production from phenomena like shocks and turbulence. In this poster, we present studies of entropy production and dissipation processes present in simple turbulence and shock calculations using the continuum Vlasov-Maxwell solver in the Gkeyll framework. Particular emphasis is placed on a novel diagnostic, the field-particle correlation, which is especially efficient at separating the secular energy transfer into its constituent components, for example, cyclotron damping, Landau damping, or transit-time damping, when applied to a noise-free distribution function. National Science Foundation SHINE award No. AGS-1622306 and the UMD DOE Grant DE-FG02-93ER54197.

Diagnosing entropy production and dissipation in fully kinetic plasmas

NASA Astrophysics Data System (ADS)

Juno, J.; TenBarge, J. M.; Hakim, A.; Dorland, W.

2017-12-01

Many plasma systems, from the core of a tokamak to the outer heliosphere, are weakly collisional and thus most accurately described by kinetic theory. The typical approach to solving the kinetic equation has been the particle-in-cell algorithm, which, while a powerful tool, introduces counting noise into the particle distribution function. The counting noise is particularly problematic when attempting to study grand challenge problems such as entropy production from phenomena like shocks and turbulence. In this poster, we present studies of entropy production and dissipation processes present in simple turbulence and shock calculations using the continuum Vlasov-Maxwell solver in the Gkeyll framework. Particular emphasis is placed on a novel diagnostic, the field-particle correlation, which is especially efficient at separating the secular energy transfer into its constituent components, for example, cyclotron damping, Landau damping, or transit-time damping, when applied to a noise-free distribution function. Using reduced systems such as completely transverse electromagnetic shocks, we also explore the signatures of perpendicular, non-resonant, energization mechanisms.

Instantaneous Transfer Entropy for the Study of Cardiovascular and Cardiorespiratory Nonstationary Dynamics.

PubMed

Valenza, Gaetano; Faes, Luca; Citi, Luca; Orini, Michele; Barbieri, Riccardo

2018-05-01

Measures of transfer entropy (TE) quantify the direction and strength of coupling between two complex systems. Standard approaches assume stationarity of the observations, and therefore are unable to track time-varying changes in nonlinear information transfer with high temporal resolution. In this study, we aim to define and validate novel instantaneous measures of TE to provide an improved assessment of complex nonstationary cardiorespiratory interactions. We here propose a novel instantaneous point-process TE (ipTE) and validate its assessment as applied to cardiovascular and cardiorespiratory dynamics. In particular, heartbeat and respiratory dynamics are characterized through discrete time series, and modeled with probability density functions predicting the time of the next physiological event as a function of the past history. Likewise, nonstationary interactions between heartbeat and blood pressure dynamics are characterized as well. Furthermore, we propose a new measure of information transfer, the instantaneous point-process information transfer (ipInfTr), which is directly derived from point-process-based definitions of the Kolmogorov-Smirnov distance. Analysis on synthetic data, as well as on experimental data gathered from healthy subjects undergoing postural changes confirms that ipTE, as well as ipInfTr measures are able to dynamically track changes in physiological systems coupling. This novel approach opens new avenues in the study of hidden, transient, nonstationary physiological states involving multivariate autonomic dynamics in cardiovascular health and disease. The proposed method can also be tailored for the study of complex multisystem physiology (e.g., brain-heart or, more in general, brain-body interactions).

A new and trustworthy formalism to compute entropy in quantum systems

NASA Astrophysics Data System (ADS)

Ansari, Mohammad

Entropy is nonlinear in density matrix and as such its evaluation in open quantum system has not been fully understood. Recently a quantum formalism was proposed by Ansari and Nazarov that evaluates entropy using parallel time evolutions of multiple worlds. We can use this formalism to evaluate entropy flow in a photovoltaic cells coupled to thermal reservoirs and cavity modes. Recently we studied the full counting statistics of energy transfers in such systems. This rigorously proves a nontrivial correspondence between energy exchanges and entropy changes in quantum systems, which only in systems without entanglement can be simplified to the textbook second law of thermodynamics. We evaluate the flow of entropy using this formalism. In the presence of entanglement, however, interestingly much less information is exchanged than what we expected. This increases the upper limit capacity for information transfer and its conversion to energy for next generation devices in mesoscopic physics.

Thermodynamic studies of aqueous solutions of 2,2,2-cryptand at 298.15 K: enthalpy-entropy compensation, partial entropies, and complexation with K+ ions.

PubMed

Shaikh, Vasim R; Terdale, Santosh S; Ahamad, Abdul; Gupta, Gaurav R; Dagade, Dilip H; Hundiwale, Dilip G; Patil, Kesharsingh J

2013-12-19

The osmotic coefficient measurements for binary aqueous solutions of 2,2,2-cryptand (4,7,13,16,21,24-hexaoxa-1,10-diazabicyclo[8.8.8] hexacosane) in the concentration range of ~0.009 to ~0.24 mol·kg(-1) and in ternary aqueous solutions containing a fixed concentration of 2,2,2-cryptand of ~0.1 mol·kg(-1) with varying concentration of KBr (~0.06 to ~0.16 mol·kg(-1)) have been reported at 298.15 K. The diamine gets hydrolyzed in aqueous solutions and needs proper approach to obtain meaningful thermodynamic properties. The measured osmotic coefficient values are corrected for hydrolysis and are used to determine the solvent activity and mean ionic activity coefficients of solute as a function of concentration. Strong ion-pair formation is observed, and the ion-pair dissociation constant for the species [CrptH](+)[OH(-)] is reported. The excess and mixing thermodynamic properties (Gibbs free energy, enthalpy, and entropy changes) have been obtained using the activity data from this study and the heat data reported in the literature. Further, the data are utilized to compute the partial molal entropies of solvent and solute at finite as well as infinite dilution of 2,2,2-cryptand in water. The concentration dependent non-linear enthalpy-entropy compensation effect has been observed for the studied system, and the compensation temperature along with entropic parameter are reported. Using solute activity coefficient data in ternary solutions, the transfer Gibbs free energies for transfer of the cryptand from water to aqueous KBr as well as transfer of KBr from water to aqueous cryptand were obtained and utilized to obtain the salting constant (ks) and thermodynamic equilibrium constant (log K) values for the complex (2,2,2-cryptand:K(+)) at 298.15 K. The value of log K = 5.8 ± 0.1 obtained in this work is found to be in good agreement with that reported by Lehn and Sauvage. The standard molar entropy for complexation is also estimated for the 2,2,2-cryptand-KBr complex in aqueous medium.

A computational study of entropy generation in magnetohydrodynamic flow and heat transfer over an unsteady stretching permeable sheet

NASA Astrophysics Data System (ADS)

Saeed Butt, Adnan; Ali, Asif

2014-01-01

The present article aims to investigate the entropy effects in magnetohydrodynamic flow and heat transfer over an unsteady permeable stretching surface. The time-dependent partial differential equations are converted into non-linear ordinary differential equations by suitable similarity transformations. The solutions of these equations are computed analytically by the Homotopy Analysis Method (HAM) then solved numerically by the MATLAB built-in routine. Comparison of the obtained results is made with the existing literature under limiting cases to validate our study. The effects of unsteadiness parameter, magnetic field parameter, suction/injection parameter, Prandtl number, group parameter and Reynolds number on flow and heat transfer characteristics are checked and analysed with the aid of graphs and tables. Moreover, the effects of these parameters on entropy generation number and Bejan number are also shown graphically. It is examined that the unsteadiness and presence of magnetic field augments the entropy production.

Model-Free Reconstruction of Excitatory Neuronal Connectivity from Calcium Imaging Signals

PubMed Central

Stetter, Olav; Battaglia, Demian; Soriano, Jordi; Geisel, Theo

2012-01-01

A systematic assessment of global neural network connectivity through direct electrophysiological assays has remained technically infeasible, even in simpler systems like dissociated neuronal cultures. We introduce an improved algorithmic approach based on Transfer Entropy to reconstruct structural connectivity from network activity monitored through calcium imaging. We focus in this study on the inference of excitatory synaptic links. Based on information theory, our method requires no prior assumptions on the statistics of neuronal firing and neuronal connections. The performance of our algorithm is benchmarked on surrogate time series of calcium fluorescence generated by the simulated dynamics of a network with known ground-truth topology. We find that the functional network topology revealed by Transfer Entropy depends qualitatively on the time-dependent dynamic state of the network (bursting or non-bursting). Thus by conditioning with respect to the global mean activity, we improve the performance of our method. This allows us to focus the analysis to specific dynamical regimes of the network in which the inferred functional connectivity is shaped by monosynaptic excitatory connections, rather than by collective synchrony. Our method can discriminate between actual causal influences between neurons and spurious non-causal correlations due to light scattering artifacts, which inherently affect the quality of fluorescence imaging. Compared to other reconstruction strategies such as cross-correlation or Granger Causality methods, our method based on improved Transfer Entropy is remarkably more accurate. In particular, it provides a good estimation of the excitatory network clustering coefficient, allowing for discrimination between weakly and strongly clustered topologies. Finally, we demonstrate the applicability of our method to analyses of real recordings of in vitro disinhibited cortical cultures where we suggest that excitatory connections are characterized by an elevated level of clustering compared to a random graph (although not extreme) and can be markedly non-local. PMID:22927808

Estimating the decomposition of predictive information in multivariate systems

NASA Astrophysics Data System (ADS)

Faes, Luca; Kugiumtzis, Dimitris; Nollo, Giandomenico; Jurysta, Fabrice; Marinazzo, Daniele

2015-03-01

In the study of complex systems from observed multivariate time series, insight into the evolution of one system may be under investigation, which can be explained by the information storage of the system and the information transfer from other interacting systems. We present a framework for the model-free estimation of information storage and information transfer computed as the terms composing the predictive information about the target of a multivariate dynamical process. The approach tackles the curse of dimensionality employing a nonuniform embedding scheme that selects progressively, among the past components of the multivariate process, only those that contribute most, in terms of conditional mutual information, to the present target process. Moreover, it computes all information-theoretic quantities using a nearest-neighbor technique designed to compensate the bias due to the different dimensionality of individual entropy terms. The resulting estimators of prediction entropy, storage entropy, transfer entropy, and partial transfer entropy are tested on simulations of coupled linear stochastic and nonlinear deterministic dynamic processes, demonstrating the superiority of the proposed approach over the traditional estimators based on uniform embedding. The framework is then applied to multivariate physiologic time series, resulting in physiologically well-interpretable information decompositions of cardiovascular and cardiorespiratory interactions during head-up tilt and of joint brain-heart dynamics during sleep.

Heat transfer enhancement and entropy generation analysis of Al2O3-water nanofluid in an alternating oval cross-section tube using two-phase mixture model under turbulent flow

NASA Astrophysics Data System (ADS)

Najafi Khaboshan, Hasan; Nazif, Hamid Reza

2018-04-01

Heat transfer and turbulent flow of Al2O3-water nanofluid within alternating oval cross-section tube are numerically simulated using Eulerian-Eulerian two-phase mixture model. The primary goal of the present study is to investigate the effects of nanoparticles volume fraction, nanoparticles diameter and different inlet velocities on heat transfer, pressure drop and entropy generation characteristics of the alternating oval cross-section tube. For numerical simulation validation, the numerical results were compared with experimental data. Also, constant wall temperature boundary condition was considered on the tube wall. In addition, the comparison of thermal-hydraulic performance and the entropy generation characteristics between alternating oval cross-section tube and circular tube under same fluids were done. The results show that the heat transfer coefficient and pressure drop of alternating oval cross-section tube is more than base tube under same fluids. Also, these two parameters are increased when adding Al2O3 nanoparticle into water fluid, at any inlet velocity for both tubes. Furthermore, compared to the base fluid, the value of the heat transfer enhancement of nanofluid is higher than the increase of friction factor of nanofluid at the same given inlet boundary conditions. The results of entropy generation analysis illustrate that the total entropy generation increase with increasing the nanoparticles volume fraction and decreasing the nanoparticles diameter of nanofluid. The generation of thermal entropy is the main part of irreversibility, and Bejan number with an increase of the nanoparticles diameter slightly increases. Finally, at any given inlet velocity the frictional irreversibility is grown with an increase the nanoparticles volume fraction.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hu, Dehua; Liu, Qing; Tisdale, Jeremy

This paper reports Seebeck effects driven by both surface polarization difference and entropy difference by using intramolecular charge-transfer states in n-type and p-type conjugated polymers, namely IIDT and IIDDT, based on vertical conductor/polymer/conductor thin-film devices. Large Seebeck coefficients of -898 V/K and 1300 V/K from are observed from n-type IIDT p-type IIDDT, respectively, when the charge-transfer states are generated by a white light illumination of 100 mW/cm2. Simultaneously, electrical conductivities are increased from almost insulating states in dark condition to conducting states under photoexcitation in both n-type IIDT and p-type IIDDT devices. We find that the intramolecular charge-transfer states canmore » largely enhance Seebeck effects in the n-type IIDT and p-type IIDDT devices driven by both surface polarization difference and entropy difference. Furthermore, the Seebeck effects can be shifted between polarization and entropy regimes when electrical conductivities are changed. This reveals a new concept to develop Seebeck effects by controlling polarization and entropy regimes based on charge-transfer states in vertical conductor/polymer/conductor thin-film devices.« less

Symbolic phase transfer entropy method and its application

NASA Astrophysics Data System (ADS)

Zhang, Ningning; Lin, Aijing; Shang, Pengjian

2017-10-01

In this paper, we introduce symbolic phase transfer entropy (SPTE) to infer the direction and strength of information flow among systems. The advantages of the proposed method are investigated by simulations on synthetic signals and real-world data. We demonstrate that symbolic phase transfer entropy is a robust and efficient tool to infer the information flow between complex systems. Based on the study of the synthetic data, we find a significant advantage of SPTE is its reduced sensitivity to noise. In addition, SPTE requires less amount of data than symbolic transfer entropy(STE). We analyze the direction and strength of information flow between six stock markets during the period from 2006 to 2016. The results indicate that the information flow among stocks varies over different periods. We also find that the interaction network pattern among stocks undergoes hierarchial reorganization with transition from one period to another. It is shown that the clusters are mainly classified according to period, and then by region. The stocks during the same time period are shown to drop into the same cluster.

Radiative entropy generation in a gray absorbing, emitting, and scattering planar medium at radiative equilibrium

NASA Astrophysics Data System (ADS)

Sadeghi, Pegah; Safavinejad, Ali

2017-11-01

Radiative entropy generation through a gray absorbing, emitting, and scattering planar medium at radiative equilibrium with diffuse-gray walls is investigated. The radiative transfer equation and radiative entropy generation equations are solved using discrete ordinates method. Components of the radiative entropy generation are considered for two different boundary conditions: two walls are at a prescribed temperature and mixed boundary conditions, which one wall is at a prescribed temperature and the other is at a prescribed heat flux. The effect of wall emissivities, optical thickness, single scattering albedo, and anisotropic-scattering factor on the entropy generation is attentively investigated. The results reveal that entropy generation in the system mainly arises from irreversible radiative transfer at wall with lower temperature. Total entropy generation rate for the system with prescribed temperature at walls remarkably increases as wall emissivity increases; conversely, for system with mixed boundary conditions, total entropy generation rate slightly decreases. Furthermore, as the optical thickness increases, total entropy generation rate remarkably decreases for the system with prescribed temperature at walls; nevertheless, for the system with mixed boundary conditions, total entropy generation rate increases. The variation of single scattering albedo does not considerably affect total entropy generation rate. This parametric analysis demonstrates that the optical thickness and wall emissivities have a significant effect on the entropy generation in the system at radiative equilibrium. Considering the parameters affecting radiative entropy generation significantly, provides an opportunity to optimally design or increase overall performance and efficiency by applying entropy minimization techniques for the systems at radiative equilibrium.

Accelerated Recovery of Consciousness after General Anesthesia Is Associated with Increased Functional Brain Connectivity in the High-Gamma Bandwidth.

PubMed

Li, Duan; Hambrecht-Wiedbusch, Viviane S; Mashour, George A

2017-01-01

Recent data from our laboratory demonstrate that high-frequency gamma connectivity across the cortex is present during consciousness and depressed during unconsciousness. However, these data were derived from static and well-defined states of arousal rather than during transitions that would suggest functional relevance. We also recently found that subanesthetic ketamine administered during isoflurane anesthesia accelerates recovery upon discontinuation of the primary anesthetic and increases gamma power during emergence. In the current study we re-analyzed electroencephalogram (EEG) data to test the hypothesis that functional cortical connectivity between anterior and posterior cortical regions would be increased during accelerated recovery induced by ketamine when compared to saline-treated controls. Rodents were instrumented with intracranial EEG electrodes and general anesthesia was induced with isoflurane anesthesia. After 37.5 min of continuous isoflurane anesthesia, a subanesthetic dose of ketamine (25 mg/kg intraperitoneal) was administered, with evidence of a 44% reduction in emergence time. In this study, we analyzed gamma and theta coherence (measure of undirected functional connectivity) and normalized symbolic transfer entropy (measure of directed functional connectivity) between frontal and parietal cortices during various levels of consciousness, with a focus on emergence from isoflurane anesthesia. During accelerated emergence in the ketamine-treated group, there was increased frontal-parietal coherence { p = 0.005, 0.05-0.23 [95% confidence interval (CI)]} and normalized symbolic transfer entropy [frontal to parietal: p < 0.001, 0.010-0.026 (95% CI); parietal to frontal: p < 0.001, 0.009-0.025 (95% CI)] in high-frequency gamma bandwidth as compared with the saline-treated group. Surrogates of cortical information exchange in high-frequency gamma are increased in association with accelerated recovery from anesthesia. This finding adds evidence suggesting a functional significance of high-gamma information transfer in consciousness.

The solvation of the ground and transition states in the reaction of ortho-palladized acetanilide with styrene in organic solvents

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sakodynskaya, I.K.; Neverov, A.A; Ryabov, A.D.

1986-07-01

The rate of the reaction of di-mu-chlorobis(acetanilidato-2C, 0) dipalladium(II) with styrene leading to 2-acetaminostilbene was found in 11 organic solvents. In all media, the reaction has second-order kinetics. The free energy, enthalpy and entropy of activation were determined in each solvent. The data for the solubility of the starting Pd(II) complex were used to determine the free energy for the transfer of the ground state of this reaction from a standard solvent (heptane) to the other solvents. The analogous transfer functions were calculated for the transition state. The correlation of the transfer functions of the starting and transition states ofmore » this reaction with empirical solvent parameters was examined.« less

Numerical study of magnetic field on mixed convection and entropy generation of nanofluid in a trapezoidal enclosure

NASA Astrophysics Data System (ADS)

Aghaei, Alireza; Khorasanizadeh, Hossein; Sheikhzadeh, Ghanbarali; Abbaszadeh, Mahmoud

2016-04-01

The flow under influence of magnetic field is experienced in cooling electronic devices and voltage transformers, nuclear reactors, biochemistry and in physical phenomenon like geology. In this study, the effects of magnetic field on the flow field, heat transfer and entropy generation of Cu-water nanofluid mixed convection in a trapezoidal enclosure have been investigated. The top lid is cold and moving toward right or left, the bottom wall is hot and the side walls are insulated and their angle from the horizon are 15°, 30°, 45° and 60°. Simulations have been carried out for constant Grashof number of 104, Reynolds numbers of 30, 100, 300 and 1000, Hartmann numbers of 25, 50, 75 and 100 and nanoparticles volume fractions of zero up to 0.04. The finite volume method and SIMPLER algorithm have been utilized to solve the governing equations numerically. The results showed that with imposing the magnetic field and enhancing it, the nanofluid convection and the strength of flow decrease and the flow tends toward natural convection and finally toward pure conduction. For this reason, for all of the considered Reynolds numbers and volume fractions, by increasing the Hartmann number the average Nusselt number decreases. Furthermore, for any case with constant Reynolds and Hartmann numbers by increasing the volume fraction of nanoparticles the maximum stream function decreases. For all of the studied cases, entropy generation due to friction is negligible and the total entropy generation is mainly due to irreversibility associated with heat transfer and variation of the total entropy generation with Hartmann number is similar to that of the average Nusselt number. With change in lid movement direction at Reynolds number of 30 the average Nusselt number and total entropy generation are changed, but at Reynolds number of 1000 it has a negligible effect.

Multiscale Symbolic Phase Transfer Entropy in Financial Time Series Classification

NASA Astrophysics Data System (ADS)

Zhang, Ningning; Lin, Aijing; Shang, Pengjian

We address the challenge of classifying financial time series via a newly proposed multiscale symbolic phase transfer entropy (MSPTE). Using MSPTE method, we succeed to quantify the strength and direction of information flow between financial systems and classify financial time series, which are the stock indices from Europe, America and China during the period from 2006 to 2016 and the stocks of banking, aviation industry and pharmacy during the period from 2007 to 2016, simultaneously. The MSPTE analysis shows that the value of symbolic phase transfer entropy (SPTE) among stocks decreases with the increasing scale factor. It is demonstrated that MSPTE method can well divide stocks into groups by areas and industries. In addition, it can be concluded that the MSPTE analysis quantify the similarity among the stock markets. The symbolic phase transfer entropy (SPTE) between the two stocks from the same area is far less than the SPTE between stocks from different areas. The results also indicate that four stocks from America and Europe have relatively high degree of similarity and the stocks of banking and pharmaceutical industry have higher similarity for CA. It is worth mentioning that the pharmaceutical industry has weaker particular market mechanism than banking and aviation industry.

Low-dimensional approximation searching strategy for transfer entropy from non-uniform embedding

PubMed Central

2018-01-01

Transfer entropy from non-uniform embedding is a popular tool for the inference of causal relationships among dynamical subsystems. In this study we present an approach that makes use of low-dimensional conditional mutual information quantities to decompose the original high-dimensional conditional mutual information in the searching procedure of non-uniform embedding for significant variables at different lags. We perform a series of simulation experiments to assess the sensitivity and specificity of our proposed method to demonstrate its advantage compared to previous algorithms. The results provide concrete evidence that low-dimensional approximations can help to improve the statistical accuracy of transfer entropy in multivariate causality analysis and yield a better performance over other methods. The proposed method is especially efficient as the data length grows. PMID:29547669

Study of the cross-market effects of Brexit based on the improved symbolic transfer entropy GARCH model—An empirical analysis of stock–bond correlations

PubMed Central

Chen, Xiurong; Zhao, Rubo

2017-01-01

In this paper, we study the cross-market effects of Brexit on the stock and bond markets of nine major countries in the world. By incorporating information theory, we introduce the time-varying impact weights based on symbolic transfer entropy to improve the traditional GARCH model. The empirical results show that under the influence of Brexit, flight-to-quality not only commonly occurs between the stocks and bonds of each country but also simultaneously occurs among different countries. We also find that the accuracy of the time-varying symbolic transfer entropy GARCH model proposed in this paper has been improved compared to the traditional GARCH model, which indicates that it has a certain practical application value. PMID:28817712

Quantitative Analysis of the Effective Functional Structure in Yeast Glycolysis

PubMed Central

De la Fuente, Ildefonso M.; Cortes, Jesus M.

2012-01-01

The understanding of the effective functionality that governs the enzymatic self-organized processes in cellular conditions is a crucial topic in the post-genomic era. In recent studies, Transfer Entropy has been proposed as a rigorous, robust and self-consistent method for the causal quantification of the functional information flow among nonlinear processes. Here, in order to quantify the functional connectivity for the glycolytic enzymes in dissipative conditions we have analyzed different catalytic patterns using the technique of Transfer Entropy. The data were obtained by means of a yeast glycolytic model formed by three delay differential equations where the enzymatic rate equations of the irreversible stages have been explicitly considered. These enzymatic activity functions were previously modeled and tested experimentally by other different groups. The results show the emergence of a new kind of dynamical functional structure, characterized by changing connectivity flows and a metabolic invariant that constrains the activity of the irreversible enzymes. In addition to the classical topological structure characterized by the specific location of enzymes, substrates, products and feedback-regulatory metabolites, an effective functional structure emerges in the modeled glycolytic system, which is dynamical and characterized by notable variations of the functional interactions. The dynamical structure also exhibits a metabolic invariant which constrains the functional attributes of the enzymes. Finally, in accordance with the classical biochemical studies, our numerical analysis reveals in a quantitative manner that the enzyme phosphofructokinase is the key-core of the metabolic system, behaving for all conditions as the main source of the effective causal flows in yeast glycolysis. PMID:22393350

Respiration and heart rate complexity: Effects of age and gender assessed by band-limited transfer entropy

PubMed Central

Nemati, Shamim; Edwards, Bradley A.; Lee, Joon; Pittman-Polletta, Benjamin; Butler, James P.; Malhotra, Atul

2013-01-01

Aging and disease are accompanied with a reduction of complex variability in the temporal patterns of heart rate. This reduction has been attributed to a break down of the underlying regulatory feedback mechanisms that maintain a homeodynamic state. Previous work has established the utility of entropy as an index of disorder, for quantification of changes in heart rate complexity. However, questions remain regarding the origin of heart rate complexity and the mechanisms involved in its reduction with aging and disease. In this work we use a newly developed technique based on the concept of band-limited transfer entropy to assess the aging-related changes in contribution of respiration and blood pressure to entropy of heart rate at different frequency bands. Noninvasive measurements of heart beat interval, respiration, and systolic blood pressure were recorded from 20 young (21–34 years) and 20 older (68–85 years) healthy adults. Band-limited transfer entropy analysis revealed a reduction in high-frequency contribution of respiration to heart rate complexity (p < 0.001) with normal aging, particularly in men. These results have the potential for dissecting the relative contributions of respiration and blood pressure-related reflexes to heart rate complexity and their degeneration with normal aging. PMID:23811194

Identifying Student Resources in Reasoning about Entropy and the Approach to Thermal Equilibrium

ERIC Educational Resources Information Center

Loverude, Michael

2015-01-01

As part of an ongoing project to examine student learning in upper-division courses in thermal and statistical physics, we have examined student reasoning about entropy and the second law of thermodynamics. We have examined reasoning in terms of heat transfer, entropy maximization, and statistical treatments of multiplicity and probability. In…

Numerical study focusing on the entropy analysis of MHD squeezing flow of a nanofluid model using Cattaneo–Christov theory

NASA Astrophysics Data System (ADS)

Akmal, N.; Sagheer, M.; Hussain, S.

2018-05-01

The present study gives an account of the heat transfer characteristics of the squeezing flow of a nanofluid between two flat plates with upper plate moving vertically and the lower in the horizontal direction. Tiwari and Das nanofluid model has been utilized to give a comparative analysis of the heat transfer in the Cu-water and Al2O3-water nanofluids with entropy generation. The modeling is carried out with the consideration of Lorentz forces to observe the effect of magnetic field on the flow. The Joule heating effect is included to discuss the heat dissipation in the fluid and its effect on the entropy of the system. The nondimensional ordinary differential equations are solved using the Keller box method to assess the numerical results which are presented by the graphs and tables. An interesting observation is that the entropy is generated more near the lower plate as compared with that at the upper plate. Also, the heat transfer rate is found to be higher for the Cu nanoparticles in comparison with the Al2O3 nanoparticles.

Cause-and-effect relationships in tandem swimmer models using transfer entropy

NASA Astrophysics Data System (ADS)

Peterson, Sean; Rosen, Maxwell; Gementzopoulos, Antonios; Zhang, Peng; Porfiri, Maurizio

2017-11-01

Swimming in a group affords a number of advantages to fish, including an enhanced ability to escape from predators, search for food, and mate. To study coordinated movements of fish, principled approaches are needed to unravel cause-and-effect relationships from raw-time series of multiple bodies moving in an encompassing fluid. In this work, we aim at demonstrating the validity of transfer entropy to elucidate cause-and-effect relationships in a fluid-structure interaction problem. Specifically, we consider two tandem airfoils in a uniform flow, wherein the pitching angle of one airfoil is actively controlled while the other is allowed to passively rotate. The active control alternates the pitch angle based upon an underlying two-state ergodic Markov process. We monitor the pitch angle of both the active and passive airfoils in time and demonstrate that transfer entropy can detect causality independent of which airfoil is actuated. The influence estimated by transfer entropy is found to be modulated by the distance between the two airfoils. The proposed data-driven technique offers a model-free perspective on fluid-structure interactions that can help illuminate the mechanisms of swimming in coordination. This work was supported by the National Science Foundation under Grant Numbers CBET-1332204 and CMMI-1433670.

Hydration entropy change from the hard sphere model.

PubMed

Graziano, Giuseppe; Lee, Byungkook

2002-12-10

The gas to liquid transfer entropy change for a pure non-polar liquid can be calculated quite accurately using a hard sphere model that obeys the Carnahan-Starling equation of state. The same procedure fails to produce a reasonable value for hydrogen bonding liquids such as water, methanol and ethanol. However, the size of the molecules increases when the hydrogen bonds are turned off to produce the hard sphere system and the volume packing density rises. We show here that the hard sphere system that has this increased packing density reproduces the experimental transfer entropy values rather well. The gas to water transfer entropy values for small non-polar hydrocarbons is also not reproduced by a hard sphere model, whether one uses the normal (2.8 A diameter) or the increased (3.2 A) size for water. At least part of the reason that the hard sphere model with 2.8 A size water produces too small entropy change is that the size of water is too small for a system without hydrogen bonds. The reason that the 3.2 A model also produces too small entropy values is that this is an overly crowded system and that the free volume introduced in the system by the addition of a solute molecule produces too much of a relief to this crowding. A hard sphere model, in which the free volume increase is limited by requiring that the average surface-to-surface distance between the solute and water molecules is the same as that between the increased-size water molecules, does approximately reproduce the experimental hydration entropy values. Copyright 2002 Elsevier Science B.V.

Three faces of entropy for complex systems: Information, thermodynamics, and the maximum entropy principle

NASA Astrophysics Data System (ADS)

Thurner, Stefan; Corominas-Murtra, Bernat; Hanel, Rudolf

2017-09-01

There are at least three distinct ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a means for statistical inference on multinomial processes (Jaynes maximum entropy principle). Even though these notions represent fundamentally different concepts, the functional form of the entropy for thermodynamic systems in equilibrium, for ergodic sources in information theory, and for independent sampling processes in statistical systems, is degenerate, H (p ) =-∑ipilogpi . For many complex systems, which are typically history-dependent, nonergodic, and nonmultinomial, this is no longer the case. Here we show that for such processes, the three entropy concepts lead to different functional forms of entropy, which we will refer to as SEXT for extensive entropy, SIT for the source information rate in information theory, and SMEP for the entropy functional that appears in the so-called maximum entropy principle, which characterizes the most likely observable distribution functions of a system. We explicitly compute these three entropy functionals for three concrete examples: for Pólya urn processes, which are simple self-reinforcing processes, for sample-space-reducing (SSR) processes, which are simple history dependent processes that are associated with power-law statistics, and finally for multinomial mixture processes.

Numerical study of entropy generation in MHD water-based carbon nanotubes along an inclined permeable surface

NASA Astrophysics Data System (ADS)

Soomro, Feroz Ahmed; Rizwan-ul-Haq; Khan, Z. H.; Zhang, Qiang

2017-10-01

Main theme of the article is to examine the entropy generation analysis for the magneto-hydrodynamic mixed convection flow of water functionalized carbon nanotubes along an inclined stretching surface. Thermophysical properties of both particles and working fluid are incorporated in the system of governing partial differential equations. Rehabilitation of nonlinear system of equations is obtained via similarity transformations. Moreover, solutions of these equations are further utilized to determine the volumetric entropy and characteristic entropy generation. Solutions of governing boundary layer equations are obtained numerically using the finite difference method. Effects of two types of carbon nanotubes, namely, single-wall carbon nanotubes (SWCNTs) and multi-wall carbon nanotubes (MWCNTs) with water as base fluid have been analyzed over the physical quantities of interest, namely, surface skin friction, heat transfer rate and entropy generation coefficients. Influential results of velocities, temperature, entropy generation and isotherms are plotted against the emerging parameter, namely, nanoparticle fraction 0≤φ ≤ 0.2, thermal convective parameter 0≤ λ ≤ 5, Hartmann number 0≤ M≤ 2, suction/injection parameter -1≤ S≤ 1, and Eckert number 0≤ Ec ≤ 2. It is finally concluded that skin friction increases due to the increase in the magnetic parameter, suction/injection and nanoparticle volume fraction, whereas the Nusselt number shows an increasing trend due to the increase in the suction parameter, mixed convection parameter and nanoparticle volume fraction. Similarly, entropy generation shows an opposite behavior for the Hartmann number and mixed convection parameter for both single-wall and multi-wall carbon nanotubes.

Entropy Generation in Regenerative Systems

NASA Technical Reports Server (NTRS)

Kittel, Peter

1995-01-01

Heat exchange to the oscillating flows in regenerative coolers generates entropy. These flows are characterized by oscillating mass flows and oscillating temperatures. Heat is transferred between the flow and heat exchangers and regenerators. In the former case, there is a steady temperature difference between the flow and the heat exchangers. In the latter case, there is no mean temperature difference. In this paper a mathematical model of the entropy generated is developed for both cases. Estimates of the entropy generated by this process are given for oscillating flows in heat exchangers and in regenerators. The practical significance of this entropy is also discussed.

Fluctuation theorem for entropy production during effusion of an ideal gas with momentum transfer.

PubMed

Wood, Kevin; Van den Broeck, C; Kawai, R; Lindenberg, Katja

2007-06-01

We derive an exact expression for entropy production during effusion of an ideal gas driven by momentum transfer in addition to energy and particle flux. Following the treatment in Cleuren [Phys. Rev. E 74, 021117 (2006)], we construct a master equation formulation of the process and explicitly verify the thermodynamic fluctuation theorem, thereby directly exhibiting its extended applicability to particle flows and hence to hydrodynamic systems.

Accelerated Recovery of Consciousness after General Anesthesia Is Associated with Increased Functional Brain Connectivity in the High-Gamma Bandwidth

PubMed Central

Li, Duan; Hambrecht-Wiedbusch, Viviane S.; Mashour, George A.

2017-01-01

Recent data from our laboratory demonstrate that high-frequency gamma connectivity across the cortex is present during consciousness and depressed during unconsciousness. However, these data were derived from static and well-defined states of arousal rather than during transitions that would suggest functional relevance. We also recently found that subanesthetic ketamine administered during isoflurane anesthesia accelerates recovery upon discontinuation of the primary anesthetic and increases gamma power during emergence. In the current study we re-analyzed electroencephalogram (EEG) data to test the hypothesis that functional cortical connectivity between anterior and posterior cortical regions would be increased during accelerated recovery induced by ketamine when compared to saline-treated controls. Rodents were instrumented with intracranial EEG electrodes and general anesthesia was induced with isoflurane anesthesia. After 37.5 min of continuous isoflurane anesthesia, a subanesthetic dose of ketamine (25 mg/kg intraperitoneal) was administered, with evidence of a 44% reduction in emergence time. In this study, we analyzed gamma and theta coherence (measure of undirected functional connectivity) and normalized symbolic transfer entropy (measure of directed functional connectivity) between frontal and parietal cortices during various levels of consciousness, with a focus on emergence from isoflurane anesthesia. During accelerated emergence in the ketamine-treated group, there was increased frontal-parietal coherence {p = 0.005, 0.05–0.23 [95% confidence interval (CI)]} and normalized symbolic transfer entropy [frontal to parietal: p < 0.001, 0.010–0.026 (95% CI); parietal to frontal: p < 0.001, 0.009–0.025 (95% CI)] in high-frequency gamma bandwidth as compared with the saline-treated group. Surrogates of cortical information exchange in high-frequency gamma are increased in association with accelerated recovery from anesthesia. This finding adds evidence suggesting a functional significance of high-gamma information transfer in consciousness. PMID:28392760

Calculation of heat transfer on shuttle type configurations including the effects of variable entropy at boundary layer edge

NASA Technical Reports Server (NTRS)

Dejarnette, F. R.

1972-01-01

A relatively simple method is presented for including the effect of variable entropy at the boundary-layer edge in a heat transfer method developed previously. For each inviscid surface streamline an approximate shockwave shape is calculated using a modified form of Maslen's method for inviscid axisymmetric flows. The entropy for the streamline at the edge of the boundary layer is determined by equating the mass flux through the shock wave to that inside the boundary layer. Approximations used in this technique allow the heating rates along each inviscid surface streamline to be calculated independent of the other streamlines. The shock standoff distances computed by the present method are found to compare well with those computed by Maslen's asymmetric method. Heating rates are presented for blunted circular and elliptical cones and a typical space shuttle orbiter at angles of attack. Variable entropy effects are found to increase heating rates downstream of the nose significantly higher than those computed using normal-shock entropy, and turbulent heating rates increased more than laminar rates. Effects of Reynolds number and angles of attack are also shown.

On Entropy Generation and the Effect of Heat and Mass Transfer Coupling in a Distillation Process

NASA Astrophysics Data System (ADS)

Burgos-Madrigal, Paulina; Mendoza, Diego F.; López de Haro, Mariano

2018-01-01

The entropy production rates as obtained from the exergy analysis, entropy balance and the nonequilibrium thermodynamics approach are compared for two distillation columns. The first case is a depropanizer column involving a mixture of ethane, propane, n-butane and n-pentane. The other is a weighed sample of Mexican crude oil distilled with a pilot scale fractionating column. The composition, temperature and flow profiles, for a given duty and operating conditions in each column, are obtained with the Aspen Plus V8.4 software by using the RateFrac model with a rate-based nonequilibrium column. For the depropanizer column the highest entropy production rate is found in the central trays where most of the mass transfer occurs, while in the second column the highest values correspond to the first three stages (where the vapor mixture is in contact with the cold liquid reflux), and to the last three stages (where the highest temperatures take place). The importance of the explicit inclusion of thermal diffusion in these processes is evaluated. In the depropanizer column, the effect of the coupling between heat and mass transfer is found to be negligible, while for the fractionating column it becomes appreciable.

Laplace transform analysis of a multiplicative asset transfer model

NASA Astrophysics Data System (ADS)

Sokolov, Andrey; Melatos, Andrew; Kieu, Tien

2010-07-01

We analyze a simple asset transfer model in which the transfer amount is a fixed fraction f of the giver’s wealth. The model is analyzed in a new way by Laplace transforming the master equation, solving it analytically and numerically for the steady-state distribution, and exploring the solutions for various values of f∈(0,1). The Laplace transform analysis is superior to agent-based simulations as it does not depend on the number of agents, enabling us to study entropy and inequality in regimes that are costly to address with simulations. We demonstrate that Boltzmann entropy is not a suitable (e.g. non-monotonic) measure of disorder in a multiplicative asset transfer system and suggest an asymmetric stochastic process that is equivalent to the asset transfer model.

Charge Compensation and Electrostatic Transferability in Three Entropy Stabilized Oxides: Results from Density Functional Theory Calculations

DTIC Science & Technology

2016-09-06

displacements from ideal lattice sites, along with reduction of a few Co and Ni cations. Addition of Li to J14 reduces the lattice constant, consistent...associated with the atoms as well as in displacements of atoms from their ideal lattice sites. II. SYNTHESIS OF THE J141Sc COMPOSITION Berardan et al...Plotted in Figure 6 are the average atom displacements for the three large systems as a function of element type. For J14 (open bars), the dis

Analytical approach to entropy generation and heat transfer in CNT-nanofluid dynamics through a ciliated porous medium

NASA Astrophysics Data System (ADS)

Akbar, Noreen Sher; Shoaib, M.; Tripathi, Dharmendra; Bhushan, Shashi; Bég, O. Anwar

2018-04-01

The transportation of biological and industrial nanofluids by natural propulsion like cilia movement and self-generated contraction-relaxation of flexible walls has significant applications in numerous emerging technologies. Inspired by multi-disciplinary progress and innovation in this direction, a thermo-fluid mechanical model is proposed to study the entropy generation and convective heat transfer of nanofluids fabricated by the dispersion of single-wall carbon nanotubes (SWCNT) nanoparticles in water as the base fluid. The regime studied comprises heat transfer and steady, viscous, incompressible flow, induced by metachronal wave propulsion due to beating cilia, through a cylindrical tube containing a sparse (i.e., high permeability) homogenous porous medium. The flow is of the creeping type and is restricted under the low Reynolds number and long wavelength approximations. Slip effects at the wall are incorporated and the generalized Darcy drag-force model is utilized to mimic porous media effects. Cilia boundary conditions for velocity components are employed to determine analytical solutions to the resulting non-dimensionalized boundary value problem. The influence of pertinent physical parameters on temperature, axial velocity, pressure rise and pressure gradient, entropy generation function, Bejan number and stream-line distributions are computed numerically. A comparative study between SWCNT-nanofluids and pure water is also computed. The computations demonstrate that axial flow is accelerated with increasing slip parameter and Darcy number and is greater for SWCNT-nanofluids than for pure water. Furthermore the size of the bolus for SWCNT-nanofluids is larger than that of the pure water. The study is applicable in designing and fabricating nanoscale and microfluidics devices, artificial cilia and biomimetic micro-pumps.

Analytical approach to entropy generation and heat transfer in CNT-nanofluid dynamics through a ciliated porous medium

NASA Astrophysics Data System (ADS)

Akbar, Noreen Sher; Shoaib, M.; Tripathi, Dharmendra; Bhushan, Shashi; Bég, O. Anwar

2018-03-01

The transportation of biological and industrial nanofluids by natural propulsion like cilia movement and self-generated contraction-relaxation of flexible walls has significant applications in numerous emerging technologies. Inspired by multi-disciplinary progress and innovation in this direction, a thermo-fluid mechanical model is proposed to study the entropy generation and convective heat transfer of nanofluids fabricated by the dispersion of single-wall carbon nanotubes (SWCNT) nanoparticles in water as the base fluid. The regime studied comprises heat transfer and steady, viscous, incompressible flow, induced by metachronal wave propulsion due to beating cilia, through a cylindrical tube containing a sparse (i.e., high permeability) homogenous porous medium. The flow is of the creeping type and is restricted under the low Reynolds number and long wavelength approximations. Slip effects at the wall are incorporated and the generalized Darcy drag-force model is utilized to mimic porous media effects. Cilia boundary conditions for velocity components are employed to determine analytical solutions to the resulting non-dimensionalized boundary value problem. The influence of pertinent physical parameters on temperature, axial velocity, pressure rise and pressure gradient, entropy generation function, Bejan number and stream-line distributions are computed numerically. A comparative study between SWCNT-nanofluids and pure water is also computed. The computations demonstrate that axial flow is accelerated with increasing slip parameter and Darcy number and is greater for SWCNT-nanofluids than for pure water. Furthermore the size of the bolus for SWCNT-nanofluids is larger than that of the pure water. The study is applicable in designing and fabricating nanoscale and microfluidics devices, artificial cilia and biomimetic micro-pumps.

Entropy Production of Entirely Diffusional Laplacian Transfer and the Possible Role of Fragmentation of the Boundaries

NASA Astrophysics Data System (ADS)

Karamanos, K.; Mistakidis, S. I.; Massart, T. J.; Mistakidis, I. S.

2015-06-01

The entropy production and the variational functional of a Laplacian diffusional field around the first four fractal iterations of a linear self-similar tree (von Koch curve) is studied analytically and detailed predictions are stated. In a next stage, these predictions are confronted with results from numerical resolution of the Laplace equation by means of Finite Elements computations. After a brief review of the existing results, the range of distances near the geometric irregularity, the so-called "Near Field", a situation never studied in the past, is treated exhaustively. We notice here that in the Near Field, the usual notion of the active zone approximation introduced by Sapoval et al. [M. Filoche and B. Sapoval, Transfer across random versus deterministic fractal interfaces, Phys. Rev. Lett. 84(25) (2000) 5776;1 B. Sapoval, M. Filoche, K. Karamanos and R. Brizzi, Can one hear the shape of an electrode? I. Numerical study of the active zone in Laplacian transfer, Eur. Phys. J. B. Condens. Matter Complex Syst. 9(4) (1999) 739-753.]2 is strictly inapplicable. The basic new result is that the validity of the active-zone approximation based on irreversible thermodynamics is confirmed in this limit, and this implies a new interpretation of this notion for Laplacian diffusional fields.

Revealing Relationships among Relevant Climate Variables with Information Theory

NASA Technical Reports Server (NTRS)

Knuth, Kevin H.; Golera, Anthony; Curry, Charles T.; Huyser, Karen A.; Kevin R. Wheeler; Rossow, William B.

2005-01-01

The primary objective of the NASA Earth-Sun Exploration Technology Office is to understand the observed Earth climate variability, thus enabling the determination and prediction of the climate's response to both natural and human-induced forcing. We are currently developing a suite of computational tools that will allow researchers to calculate, from data, a variety of information-theoretic quantities such as mutual information, which can be used to identify relationships among climate variables, and transfer entropy, which indicates the possibility of causal interactions. Our tools estimate these quantities along with their associated error bars, the latter of which is critical for describing the degree of uncertainty in the estimates. This work is based upon optimal binning techniques that we have developed for piecewise-constant, histogram-style models of the underlying density functions. Two useful side benefits have already been discovered. The first allows a researcher to determine whether there exist sufficient data to estimate the underlying probability density. The second permits one to determine an acceptable degree of round-off when compressing data for efficient transfer and storage. We also demonstrate how mutual information and transfer entropy can be applied so as to allow researchers not only to identify relations among climate variables, but also to characterize and quantify their possible causal interactions.

Hydration of an apolar solute in a two-dimensional waterlike lattice fluid

NASA Astrophysics Data System (ADS)

Buzano, C.; de Stefanis, E.; Pretti, M.

2005-05-01

In a previous work, we investigated a two-dimensional lattice-fluid model, displaying some waterlike thermodynamic anomalies. The model, defined on a triangular lattice, is now extended to aqueous solutions with apolar species. Water molecules are of the “Mercedes Benz” type, i.e., they possess a D3 (equilateral triangle) symmetry, with three equivalent bonding arms. Bond formation depends both on orientation and local density. The insertion of inert molecules displays typical signatures of hydrophobic hydration: large positive transfer free energy, large negative transfer entropy (at low temperature), strong temperature dependence of the transfer enthalpy and entropy, i.e., large (positive) transfer heat capacity. Model properties are derived by a generalized first order approximation on a triangle cluster.

Hydration of an apolar solute in a two-dimensional waterlike lattice fluid.

PubMed

Buzano, C; De Stefanis, E; Pretti, M

2005-05-01

In a previous work, we investigated a two-dimensional lattice-fluid model, displaying some waterlike thermodynamic anomalies. The model, defined on a triangular lattice, is now extended to aqueous solutions with apolar species. Water molecules are of the "Mercedes Benz" type, i.e., they possess a D3 (equilateral triangle) symmetry, with three equivalent bonding arms. Bond formation depends both on orientation and local density. The insertion of inert molecules displays typical signatures of hydrophobic hydration: large positive transfer free energy, large negative transfer entropy (at low temperature), strong temperature dependence of the transfer enthalpy and entropy, i.e., large (positive) transfer heat capacity. Model properties are derived by a generalized first order approximation on a triangle cluster.

Information Transfer Analysis of Spontaneous Low-frequency Fluctuations in Cerebral Hemodynamics and Cardiovascular Dynamics

NASA Astrophysics Data System (ADS)

Katura, Takusige; Tanaka, Naoki; Obata, Akiko; Sato, Hiroki; Maki, Atsushi

2005-08-01

In this study, from the information-theoretic viewpoint, we analyzed the interrelation between the spontaneous low-frequency fluctuations around 0.1Hz in the hemoglobin concentration in the cerebral cortex, mean arterial blood pressure and the heart rate. For this analysis, as measures of information transfer, we used transfer entropy (TE) proposed for two-factor systems by Schreiber and intrinsic transfer entropy (ITE) introduced for further analysis of three-factor systems by extending the original TE. In our analysis, information transfer analysis based on both TE and ITE suggests the systemic cardiovascular fluctuations alone cannot account for the cerebrovascular fluctuations, that is, the regulation of the regional cerebral energetic metabolism is important as a candidate of its generation mechanism Such an information transfer analysis seems useful to reveal the interrelation between the elements regulated each other in a complex manner.

Information Flows? A Critique of Transfer Entropies

NASA Astrophysics Data System (ADS)

James, Ryan G.; Barnett, Nix; Crutchfield, James P.

2016-06-01

A central task in analyzing complex dynamics is to determine the loci of information storage and the communication topology of information flows within a system. Over the last decade and a half, diagnostics for the latter have come to be dominated by the transfer entropy. Via straightforward examples, we show that it and a derivative quantity, the causation entropy, do not, in fact, quantify the flow of information. At one and the same time they can overestimate flow or underestimate influence. We isolate why this is the case and propose several avenues to alternate measures for information flow. We also address an auxiliary consequence: The proliferation of networks as a now-common theoretical model for large-scale systems, in concert with the use of transferlike entropies, has shoehorned dyadic relationships into our structural interpretation of the organization and behavior of complex systems. This interpretation thus fails to include the effects of polyadic dependencies. The net result is that much of the sophisticated organization of complex systems may go undetected.

Cardiorespiratory Information Dynamics during Mental Arithmetic and Sustained Attention

PubMed Central

Widjaja, Devy; Montalto, Alessandro; Vlemincx, Elke; Marinazzo, Daniele; Van Huffel, Sabine; Faes, Luca

2015-01-01

An analysis of cardiorespiratory dynamics during mental arithmetic, which induces stress, and sustained attention was conducted using information theory. The information storage and internal information of heart rate variability (HRV) were determined respectively as the self-entropy of the tachogram, and the self-entropy of the tachogram conditioned to the knowledge of respiration. The information transfer and cross information from respiration to HRV were assessed as the transfer and cross-entropy, both measures of cardiorespiratory coupling. These information-theoretic measures identified significant nonlinearities in the cardiorespiratory time series. Additionally, it was shown that, although mental stress is related to a reduction in vagal activity, no difference in cardiorespiratory coupling was found when several mental states (rest, mental stress, sustained attention) are compared. However, the self-entropy of HRV conditioned to respiration was very informative to study the predictability of RR interval series during mental tasks, and showed higher predictability during mental arithmetic compared to sustained attention or rest. PMID:26042824

Thermodynamics of DL-alanine solvation in water-dimethylsulfoxide mixtures at 298.15 K

NASA Astrophysics Data System (ADS)

Roy, S.; Mahali, K.; Mondal, S.; Dolui, B. K.

2015-04-01

In this study we mainly discuss the transfer Gibbs free energy Δ G {/t 0}( i) and Δ S {/t 0}( i)entropy of DL-alanine at 298.15 K and consequently the involved chemical transfer free energy (Δ G {/t,ch 0}( i)) and entropy ( TΔ S {/t,ch 0}( i)) in aqueous mixtures of dimethylsulfoxide are discussed to clarify the solvation chemistry of DL-alanine. For the evaluation of these energy terms, solubility of this amino acid has been measured by formol titrimetry at five equidistant temperatures i.e., from 288.15 to 308.15 K in different composition of this mixed solvent system. The various solvent parameters as well as thermodynamic parameters like molar volume, density, dipole moment and solvent diameter of this solvent system have also been reported here. The chemical effects of the transfer Gibbs energies (Δ G {/t,ch 0}( i)) and entropies of transfer ( TΔ S {/t,ch 0}( i)) have been obtained after elimination of cavity effect and dipole-dipole interaction effects from the total transfer energies. Here the chemical contribution of transfer energetics of DL-alanine is mainly guided by the composite effects of increased dispersion interaction, basicity effect and decreased acidity, hydrogen bonding effects, hydrophilic hydration and hydrophobic hydration of aqueous DMSO mixtures as compared to that of reference solvent, water.

MHD nanofluid free convection and entropy generation in porous enclosures with different conductivity ratios

NASA Astrophysics Data System (ADS)

Ghasemi, Kasra; Siavashi, Majid

2017-11-01

MHD natural convection of Cu-water nanofluid in a square porous enclosure is investigated using a parallel LBM code, considering temperature dependence of viscosity and viscous dissipation. Effects of nanofluid concentration (φ = 0 - 0.12), Rayleigh (Ra =103 -106), Hartmann (Ha = 0-20) and porous-fluid thermal conductivity ratio (K∗ = 1-70) on heat transfer and entropy generation are investigated. It is shown that K∗ is a very important parameter, and porous media with low K∗ numbers can confine convection effects, but by increasing K∗ both conduction and convection effects can substantially improve. Also, magnetic field always has negative impact on Nu, however this impact can be controlled by φ and K∗. A magnetic instability has also observed in Ra = 104, and Nu exhibits a sinusoidal variation with Ha. It is proved that, depending on K∗, Ra and Ha values, use of nanofluid with porous media to enhance heat transfer can be either beneficial or detrimental. Also, for given K∗, Ra and Ha numbers an optimal φ exists to improve heat transfer. Finally, entropy generation study performed and results state that in low and high Ra values the thermal and frictional entropy generation are respectively dominant, while for moderate Ra they have the same order of magnitude.

Uniqueness and characterization theorems for generalized entropies

NASA Astrophysics Data System (ADS)

Enciso, Alberto; Tempesta, Piergiulio

2017-12-01

The requirement that an entropy function be composable is key: it means that the entropy of a compound system can be calculated in terms of the entropy of its independent components. We prove that, under mild regularity assumptions, the only composable generalized entropy in trace form is the Tsallis one-parameter family (which contains Boltzmann-Gibbs as a particular case). This result leads to the use of generalized entropies that are not of trace form, such as Rényi’s entropy, in the study of complex systems. In this direction, we also present a characterization theorem for a large class of composable non-trace-form entropy functions with features akin to those of Rényi’s entropy.

EEG entropy measures indicate decrease of cortical information processing in Disorders of Consciousness.

PubMed

Thul, Alexander; Lechinger, Julia; Donis, Johann; Michitsch, Gabriele; Pichler, Gerald; Kochs, Eberhard F; Jordan, Denis; Ilg, Rüdiger; Schabus, Manuel

2016-02-01

Clinical assessments that rely on behavioral responses to differentiate Disorders of Consciousness are at times inapt because of some patients' motor disabilities. To objectify patients' conditions of reduced consciousness the present study evaluated the use of electroencephalography to measure residual brain activity. We analyzed entropy values of 18 scalp EEG channels of 15 severely brain-damaged patients with clinically diagnosed Minimally-Conscious-State (MCS) or Unresponsive-Wakefulness-Syndrome (UWS) and compared the results to a sample of 24 control subjects. Permutation entropy (PeEn) and symbolic transfer entropy (STEn), reflecting information processes in the EEG, were calculated for all subjects. Participants were tested on a modified active own-name paradigm to identify correlates of active instruction following. PeEn showed reduced local information content in the EEG in patients, that was most pronounced in UWS. STEn analysis revealed altered directed information flow in the EEG of patients, indicating impaired feed-backward connectivity. Responses to auditory stimulation yielded differences in entropy measures, indicating reduced information processing in MCS and UWS. Local EEG information content and information flow are affected in Disorders of Consciousness. This suggests local cortical information capacity and feedback information transfer as neural correlates of consciousness. The utilized EEG entropy analyses were able to relate to patient groups with different Disorders of Consciousness. Copyright © 2015 International Federation of Clinical Neurophysiology. Published by Elsevier Ireland Ltd. All rights reserved.

Distinguishing anticipation from causality: anticipatory bias in the estimation of information flow.

PubMed

Hahs, Daniel W; Pethel, Shawn D

2011-09-16

We report that transfer entropy estimates obtained from low-resolution and/or small data sets show net information flow away from a purely anticipatory element whereas transfer entropy calculated using exact distributions show the flow towards it. This means that for real-world data sets anticipatory elements can appear to be strongly driving the network dynamics even when there is no possibility of such an influence. Furthermore, we show that in the low-resolution limit there is no statistic that can distinguish anticipatory elements from causal ones.

Explanation to the difference in the ketyl radical formation yields of benzophenone and benzil

NASA Astrophysics Data System (ADS)

Okutsu, Tetsuo; Muramatsu, Hidenori; Horiuchi, Hiroaki; Hiratsuka, Hiroshi

2005-03-01

p Ka values of benzophenone ketyl and benzil ketyl radicals were determined as 9.4 and 12.4, respectively. We can successfully explain the difference in quantum yield of the proton transfer between benzophenone ketyl and benzil ketyl radicals by these values. Reaction enthalpies of the proton transfer are the same (-80 kJ mol -1) for these radicals, and the difference in p Ka value can be explained by that reaction entropies. Reaction entropies between two radicals are discussed by the possible structure of the radicals.

Information transfer across intra/inter-structure of CDS and stock markets

NASA Astrophysics Data System (ADS)

Lim, Kyuseong; Kim, Sehyun; Kim, Soo Yong

2017-11-01

We investigate the information flow between industrial sectors in credit default swap and stock markets in the United States based on transfer entropy. Both markets have been studied with respect to dynamics and relations. Our approach considers the intra-structure of each financial market as well as the inter-structure between two markets through a moving window in order to scan a period from 2005 to 2012. We examine the information transfer with different k, especially k = 3, k = 5 and k = 7. Analysis indicates that the cases with k = 3 and k = 7 show the opposite trends but similar characteristics. Change in transfer entropy for intra-structure of CDS market precedes that of stock market in view of the entire time windows. Abrupt rise and fall in inter-structural information transfer between two markets are detected at the periods related to the financial crises, which can be considered as early warnings.

Kappa and other nonequilibrium distributions from the Fokker-Planck equation and the relationship to Tsallis entropy.

PubMed

Shizgal, Bernie D

2018-05-01

This paper considers two nonequilibrium model systems described by linear Fokker-Planck equations for the time-dependent velocity distribution functions that yield steady state Kappa distributions for specific system parameters. The first system describes the time evolution of a charged test particle in a constant temperature heat bath of a second charged particle. The time dependence of the distribution function of the test particle is given by a Fokker-Planck equation with drift and diffusion coefficients for Coulomb collisions as well as a diffusion coefficient for wave-particle interactions. A second system involves the Fokker-Planck equation for electrons dilutely dispersed in a constant temperature heat bath of atoms or ions and subject to an external time-independent uniform electric field. The momentum transfer cross section for collisions between the two components is assumed to be a power law in reduced speed. The time-dependent Fokker-Planck equations for both model systems are solved with a numerical finite difference method and the approach to equilibrium is rationalized with the Kullback-Leibler relative entropy. For particular choices of the system parameters for both models, the steady distribution is found to be a Kappa distribution. Kappa distributions were introduced as an empirical fitting function that well describe the nonequilibrium features of the distribution functions of electrons and ions in space science as measured by satellite instruments. The calculation of the Kappa distribution from the Fokker-Planck equations provides a direct physically based dynamical approach in contrast to the nonextensive entropy formalism by Tsallis [J. Stat. Phys. 53, 479 (1988)JSTPBS0022-471510.1007/BF01016429].

Kappa and other nonequilibrium distributions from the Fokker-Planck equation and the relationship to Tsallis entropy

NASA Astrophysics Data System (ADS)

Shizgal, Bernie D.

2018-05-01

This paper considers two nonequilibrium model systems described by linear Fokker-Planck equations for the time-dependent velocity distribution functions that yield steady state Kappa distributions for specific system parameters. The first system describes the time evolution of a charged test particle in a constant temperature heat bath of a second charged particle. The time dependence of the distribution function of the test particle is given by a Fokker-Planck equation with drift and diffusion coefficients for Coulomb collisions as well as a diffusion coefficient for wave-particle interactions. A second system involves the Fokker-Planck equation for electrons dilutely dispersed in a constant temperature heat bath of atoms or ions and subject to an external time-independent uniform electric field. The momentum transfer cross section for collisions between the two components is assumed to be a power law in reduced speed. The time-dependent Fokker-Planck equations for both model systems are solved with a numerical finite difference method and the approach to equilibrium is rationalized with the Kullback-Leibler relative entropy. For particular choices of the system parameters for both models, the steady distribution is found to be a Kappa distribution. Kappa distributions were introduced as an empirical fitting function that well describe the nonequilibrium features of the distribution functions of electrons and ions in space science as measured by satellite instruments. The calculation of the Kappa distribution from the Fokker-Planck equations provides a direct physically based dynamical approach in contrast to the nonextensive entropy formalism by Tsallis [J. Stat. Phys. 53, 479 (1988), 10.1007/BF01016429].

Tsallis Entropy and the Transition to Scaling in Fragmentation

NASA Astrophysics Data System (ADS)

Sotolongo-Costa, Oscar; Rodriguez, Arezky H.; Rodgers, G. J.

2000-12-01

By using the maximum entropy principle with Tsallis entropy we obtain a fragment size distribution function which undergoes a transition to scaling. This distribution function reduces to those obtained by other authors using Shannon entropy. The treatment is easily generalisable to any process of fractioning with suitable constraints.

Derivation of Hunt equation for suspension distribution using Shannon entropy theory

NASA Astrophysics Data System (ADS)

Kundu, Snehasis

2017-12-01

In this study, the Hunt equation for computing suspension concentration in sediment-laden flows is derived using Shannon entropy theory. Considering the inverse of the void ratio as a random variable and using principle of maximum entropy, probability density function and cumulative distribution function of suspension concentration is derived. A new and more general cumulative distribution function for the flow domain is proposed which includes several specific other models of CDF reported in literature. This general form of cumulative distribution function also helps to derive the Rouse equation. The entropy based approach helps to estimate model parameters using suspension data of sediment concentration which shows the advantage of using entropy theory. Finally model parameters in the entropy based model are also expressed as functions of the Rouse number to establish a link between the parameters of the deterministic and probabilistic approaches.

Rényi’s information transfer between financial time series

NASA Astrophysics Data System (ADS)

Jizba, Petr; Kleinert, Hagen; Shefaat, Mohammad

2012-05-01

In this paper, we quantify the statistical coherence between financial time series by means of the Rényi entropy. With the help of Campbell’s coding theorem, we show that the Rényi entropy selectively emphasizes only certain sectors of the underlying empirical distribution while strongly suppressing others. This accentuation is controlled with Rényi’s parameter q. To tackle the issue of the information flow between time series, we formulate the concept of Rényi’s transfer entropy as a measure of information that is transferred only between certain parts of underlying distributions. This is particularly pertinent in financial time series, where the knowledge of marginal events such as spikes or sudden jumps is of a crucial importance. We apply the Rényian information flow to stock market time series from 11 world stock indices as sampled at a daily rate in the time period 02.01.1990-31.12.2009. Corresponding heat maps and net information flows are represented graphically. A detailed discussion of the transfer entropy between the DAX and S&P500 indices based on minute tick data gathered in the period 02.04.2008-11.09.2009 is also provided. Our analysis shows that the bivariate information flow between world markets is strongly asymmetric with a distinct information surplus flowing from the Asia-Pacific region to both European and US markets. An important yet less dramatic excess of information also flows from Europe to the US. This is particularly clearly seen from a careful analysis of Rényi information flow between the DAX and S&P500 indices.

Visualizing the Entropy Change of a Thermal Reservoir

ERIC Educational Resources Information Center

Langbeheim, Elon; Safran, Samuel A.; Yerushalmi, Edit

2014-01-01

When a system exchanges energy with a constant-temperature environment, the entropy of the surroundings changes. A lattice model of a fluid thermal reservoir can provide a visualization of the microscopic changes that occur in the surroundings upon energy transfer from the system. This model can be used to clarify the consistency of phenomena such…

Absolute Equilibrium Entropy

NASA Technical Reports Server (NTRS)

Shebalin, John V.

1997-01-01

The entropy associated with absolute equilibrium ensemble theories of ideal, homogeneous, fluid and magneto-fluid turbulence is discussed and the three-dimensional fluid case is examined in detail. A sigma-function is defined, whose minimum value with respect to global parameters is the entropy. A comparison is made between the use of global functions sigma and phase functions H (associated with the development of various H-theorems of ideal turbulence). It is shown that the two approaches are complimentary though conceptually different: H-theorems show that an isolated system tends to equilibrium while sigma-functions allow the demonstration that entropy never decreases when two previously isolated systems are combined. This provides a more complete picture of entropy in the statistical mechanics of ideal fluids.

Ergodicity, configurational entropy and free energy in pigment solutions and plant photosystems: influence of excited state lifetime.

PubMed

Jennings, Robert C; Zucchelli, Giuseppe

2014-01-01

We examine ergodicity and configurational entropy for a dilute pigment solution and for a suspension of plant photosystem particles in which both ground and excited state pigments are present. It is concluded that the pigment solution, due to the extreme brevity of the excited state lifetime, is non-ergodic and the configurational entropy approaches zero. Conversely, due to the rapid energy transfer among pigments, each photosystem is ergodic and the configurational entropy is positive. This decreases the free energy of the single photosystem pigment array by a small amount. On the other hand, the suspension of photosystems is non-ergodic and the configurational entropy approaches zero. The overall configurational entropy which, in principle, includes contributions from both the single excited photosystems and the suspension which contains excited photosystems, also approaches zero. Thus the configurational entropy upon photon absorption by either a pigment solution or a suspension of photosystem particles is approximately zero. Copyright © 2014 Elsevier B.V. All rights reserved.

Joint Entropy for Space and Spatial Frequency Domains Estimated from Psychometric Functions of Achromatic Discrimination

PubMed Central

Silveira, Vladímir de Aquino; Souza, Givago da Silva; Gomes, Bruno Duarte; Rodrigues, Anderson Raiol; Silveira, Luiz Carlos de Lima

2014-01-01

We used psychometric functions to estimate the joint entropy for space discrimination and spatial frequency discrimination. Space discrimination was taken as discrimination of spatial extent. Seven subjects were tested. Gábor functions comprising unidimensionalsinusoidal gratings (0.4, 2, and 10 cpd) and bidimensionalGaussian envelopes (1°) were used as reference stimuli. The experiment comprised the comparison between reference and test stimulithat differed in grating's spatial frequency or envelope's standard deviation. We tested 21 different envelope's standard deviations around the reference standard deviation to study spatial extent discrimination and 19 different grating's spatial frequencies around the reference spatial frequency to study spatial frequency discrimination. Two series of psychometric functions were obtained for 2%, 5%, 10%, and 100% stimulus contrast. The psychometric function data points for spatial extent discrimination or spatial frequency discrimination were fitted with Gaussian functions using the least square method, and the spatial extent and spatial frequency entropies were estimated from the standard deviation of these Gaussian functions. Then, joint entropy was obtained by multiplying the square root of space extent entropy times the spatial frequency entropy. We compared our results to the theoretical minimum for unidimensional Gábor functions, 1/4π or 0.0796. At low and intermediate spatial frequencies and high contrasts, joint entropy reached levels below the theoretical minimum, suggesting non-linear interactions between two or more visual mechanisms. We concluded that non-linear interactions of visual pathways, such as the M and P pathways, could explain joint entropy values below the theoretical minimum at low and intermediate spatial frequencies and high contrasts. These non-linear interactions might be at work at intermediate and high contrasts at all spatial frequencies once there was a substantial decrease in joint entropy for these stimulus conditions when contrast was raised. PMID:24466158

Joint entropy for space and spatial frequency domains estimated from psychometric functions of achromatic discrimination.

PubMed

Silveira, Vladímir de Aquino; Souza, Givago da Silva; Gomes, Bruno Duarte; Rodrigues, Anderson Raiol; Silveira, Luiz Carlos de Lima

2014-01-01

We used psychometric functions to estimate the joint entropy for space discrimination and spatial frequency discrimination. Space discrimination was taken as discrimination of spatial extent. Seven subjects were tested. Gábor functions comprising unidimensionalsinusoidal gratings (0.4, 2, and 10 cpd) and bidimensionalGaussian envelopes (1°) were used as reference stimuli. The experiment comprised the comparison between reference and test stimulithat differed in grating's spatial frequency or envelope's standard deviation. We tested 21 different envelope's standard deviations around the reference standard deviation to study spatial extent discrimination and 19 different grating's spatial frequencies around the reference spatial frequency to study spatial frequency discrimination. Two series of psychometric functions were obtained for 2%, 5%, 10%, and 100% stimulus contrast. The psychometric function data points for spatial extent discrimination or spatial frequency discrimination were fitted with Gaussian functions using the least square method, and the spatial extent and spatial frequency entropies were estimated from the standard deviation of these Gaussian functions. Then, joint entropy was obtained by multiplying the square root of space extent entropy times the spatial frequency entropy. We compared our results to the theoretical minimum for unidimensional Gábor functions, 1/4π or 0.0796. At low and intermediate spatial frequencies and high contrasts, joint entropy reached levels below the theoretical minimum, suggesting non-linear interactions between two or more visual mechanisms. We concluded that non-linear interactions of visual pathways, such as the M and P pathways, could explain joint entropy values below the theoretical minimum at low and intermediate spatial frequencies and high contrasts. These non-linear interactions might be at work at intermediate and high contrasts at all spatial frequencies once there was a substantial decrease in joint entropy for these stimulus conditions when contrast was raised.

A mechanism producing power law etc. distributions

NASA Astrophysics Data System (ADS)

Li, Heling; Shen, Hongjun; Yang, Bin

2017-07-01

Power law distribution is playing an increasingly important role in the complex system study. Based on the insolvability of complex systems, the idea of incomplete statistics is utilized and expanded, three different exponential factors are introduced in equations about the normalization condition, statistical average and Shannon entropy, with probability distribution function deduced about exponential function, power function and the product form between power function and exponential function derived from Shannon entropy and maximal entropy principle. So it is shown that maximum entropy principle can totally replace equal probability hypothesis. Owing to the fact that power and probability distribution in the product form between power function and exponential function, which cannot be derived via equal probability hypothesis, can be derived by the aid of maximal entropy principle, it also can be concluded that maximal entropy principle is a basic principle which embodies concepts more extensively and reveals basic principles on motion laws of objects more fundamentally. At the same time, this principle also reveals the intrinsic link between Nature and different objects in human society and principles complied by all.

Entropy of finite random binary sequences with weak long-range correlations.

PubMed

Melnik, S S; Usatenko, O V

2014-11-01

We study the N-step binary stationary ergodic Markov chain and analyze its differential entropy. Supposing that the correlations are weak we express the conditional probability function of the chain through the pair correlation function and represent the entropy as a functional of the pair correlator. Since the model uses the two-point correlators instead of the block probability, it makes it possible to calculate the entropy of strings at much longer distances than using standard methods. A fluctuation contribution to the entropy due to finiteness of random chains is examined. This contribution can be of the same order as its regular part even at the relatively short lengths of subsequences. A self-similar structure of entropy with respect to the decimation transformations is revealed for some specific forms of the pair correlation function. Application of the theory to the DNA sequence of the R3 chromosome of Drosophila melanogaster is presented.

Entropy of finite random binary sequences with weak long-range correlations

NASA Astrophysics Data System (ADS)

Melnik, S. S.; Usatenko, O. V.

2014-11-01

We study the N -step binary stationary ergodic Markov chain and analyze its differential entropy. Supposing that the correlations are weak we express the conditional probability function of the chain through the pair correlation function and represent the entropy as a functional of the pair correlator. Since the model uses the two-point correlators instead of the block probability, it makes it possible to calculate the entropy of strings at much longer distances than using standard methods. A fluctuation contribution to the entropy due to finiteness of random chains is examined. This contribution can be of the same order as its regular part even at the relatively short lengths of subsequences. A self-similar structure of entropy with respect to the decimation transformations is revealed for some specific forms of the pair correlation function. Application of the theory to the DNA sequence of the R3 chromosome of Drosophila melanogaster is presented.

Chemical and quantum simulation of electron transfer through a polypeptide

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ungar, L.W.; Voth, G.A.; Newton, M.D.

1999-08-26

Quantum rate theory, molecular dynamics simulations, and semiempirical electronic structure calculations are used to fully investigate electron transfer mediated by a solvated polypeptide for the first time. Using a stationary-phase approximation, the nonadiabatic electron-transfer rate constant is calculated from the nuclear free energies and the electronic coupling between the initial and final states. The former are obtained from quantum path integral and classical molecular dynamics simulations; the latter are calculated using semiempirical electronic structure calculations and the generalized Mulliken-Hush method. Importantly, no parameters are fit to kinetic data. The simulated system consists of a solvated four-proline polypeptide with a tris(bipyridine)rutheniummore » donor group and an oxypentamminecobalt acceptor group. From the simulation data entropy and energy contributions to the free energies are distinguished. Quantum suppression of the barrier, including important solvent contributions, is demonstrated. Although free energy profiles along the reaction coordinate are nearly parabolic, pronounced departures from harmonic behavior are found for the separate energy and entropy functions. Harmonic models of the system are compared to simulation results in order to quantify anharmonic effects. Electronic structure calculations show that electronic coupling elements vary considerably with system conformation, even when the effective donor-acceptor separation remains roughly constant. The calculations indicate that electron transfer in a significant range of conformations linking the polypeptide to the acceptor may contribute to the overall rate constant. After correction for limitations of the solvent model, the simulations and calculations agree well with the experimental activation energy and Arrhenius prefactor.« less

Entropy-Based Analysis and Bioinformatics-Inspired Integration of Global Economic Information Transfer

PubMed Central

An, Sungbae; Kwon, Young-Kyun; Yoon, Sungroh

2013-01-01

The assessment of information transfer in the global economic network helps to understand the current environment and the outlook of an economy. Most approaches on global networks extract information transfer based mainly on a single variable. This paper establishes an entirely new bioinformatics-inspired approach to integrating information transfer derived from multiple variables and develops an international economic network accordingly. In the proposed methodology, we first construct the transfer entropies (TEs) between various intra- and inter-country pairs of economic time series variables, test their significances, and then use a weighted sum approach to aggregate information captured in each TE. Through a simulation study, the new method is shown to deliver better information integration compared to existing integration methods in that it can be applied even when intra-country variables are correlated. Empirical investigation with the real world data reveals that Western countries are more influential in the global economic network and that Japan has become less influential following the Asian currency crisis. PMID:23300959

Entropy-based analysis and bioinformatics-inspired integration of global economic information transfer.

PubMed

Kim, Jinkyu; Kim, Gunn; An, Sungbae; Kwon, Young-Kyun; Yoon, Sungroh

2013-01-01

The assessment of information transfer in the global economic network helps to understand the current environment and the outlook of an economy. Most approaches on global networks extract information transfer based mainly on a single variable. This paper establishes an entirely new bioinformatics-inspired approach to integrating information transfer derived from multiple variables and develops an international economic network accordingly. In the proposed methodology, we first construct the transfer entropies (TEs) between various intra- and inter-country pairs of economic time series variables, test their significances, and then use a weighted sum approach to aggregate information captured in each TE. Through a simulation study, the new method is shown to deliver better information integration compared to existing integration methods in that it can be applied even when intra-country variables are correlated. Empirical investigation with the real world data reveals that Western countries are more influential in the global economic network and that Japan has become less influential following the Asian currency crisis.

Group entropies, correlation laws, and zeta functions.

PubMed

Tempesta, Piergiulio

2011-08-01

The notion of group entropy is proposed. It enables the unification and generaliztion of many different definitions of entropy known in the literature, such as those of Boltzmann-Gibbs, Tsallis, Abe, and Kaniadakis. Other entropic functionals are introduced, related to nontrivial correlation laws characterizing universality classes of systems out of equilibrium when the dynamics is weakly chaotic. The associated thermostatistics are discussed. The mathematical structure underlying our construction is that of formal group theory, which provides the general structure of the correlations among particles and dictates the associated entropic functionals. As an example of application, the role of group entropies in information theory is illustrated and generalizations of the Kullback-Leibler divergence are proposed. A new connection between statistical mechanics and zeta functions is established. In particular, Tsallis entropy is related to the classical Riemann zeta function.

TRENTOOL: A Matlab open source toolbox to analyse information flow in time series data with transfer entropy

PubMed Central

2011-01-01

Background Transfer entropy (TE) is a measure for the detection of directed interactions. Transfer entropy is an information theoretic implementation of Wiener's principle of observational causality. It offers an approach to the detection of neuronal interactions that is free of an explicit model of the interactions. Hence, it offers the power to analyze linear and nonlinear interactions alike. This allows for example the comprehensive analysis of directed interactions in neural networks at various levels of description. Here we present the open-source MATLAB toolbox TRENTOOL that allows the user to handle the considerable complexity of this measure and to validate the obtained results using non-parametrical statistical testing. We demonstrate the use of the toolbox and the performance of the algorithm on simulated data with nonlinear (quadratic) coupling and on local field potentials (LFP) recorded from the retina and the optic tectum of the turtle (Pseudemys scripta elegans) where a neuronal one-way connection is likely present. Results In simulated data TE detected information flow in the simulated direction reliably with false positives not exceeding the rates expected under the null hypothesis. In the LFP data we found directed interactions from the retina to the tectum, despite the complicated signal transformations between these stages. No false positive interactions in the reverse directions were detected. Conclusions TRENTOOL is an implementation of transfer entropy and mutual information analysis that aims to support the user in the application of this information theoretic measure. TRENTOOL is implemented as a MATLAB toolbox and available under an open source license (GPL v3). For the use with neural data TRENTOOL seamlessly integrates with the popular FieldTrip toolbox. PMID:22098775

TRENTOOL: a Matlab open source toolbox to analyse information flow in time series data with transfer entropy.

PubMed

Lindner, Michael; Vicente, Raul; Priesemann, Viola; Wibral, Michael

2011-11-18

Transfer entropy (TE) is a measure for the detection of directed interactions. Transfer entropy is an information theoretic implementation of Wiener's principle of observational causality. It offers an approach to the detection of neuronal interactions that is free of an explicit model of the interactions. Hence, it offers the power to analyze linear and nonlinear interactions alike. This allows for example the comprehensive analysis of directed interactions in neural networks at various levels of description. Here we present the open-source MATLAB toolbox TRENTOOL that allows the user to handle the considerable complexity of this measure and to validate the obtained results using non-parametrical statistical testing. We demonstrate the use of the toolbox and the performance of the algorithm on simulated data with nonlinear (quadratic) coupling and on local field potentials (LFP) recorded from the retina and the optic tectum of the turtle (Pseudemys scripta elegans) where a neuronal one-way connection is likely present. In simulated data TE detected information flow in the simulated direction reliably with false positives not exceeding the rates expected under the null hypothesis. In the LFP data we found directed interactions from the retina to the tectum, despite the complicated signal transformations between these stages. No false positive interactions in the reverse directions were detected. TRENTOOL is an implementation of transfer entropy and mutual information analysis that aims to support the user in the application of this information theoretic measure. TRENTOOL is implemented as a MATLAB toolbox and available under an open source license (GPL v3). For the use with neural data TRENTOOL seamlessly integrates with the popular FieldTrip toolbox.

Towards a functional model of mental disorders incorporating the laws of thermodynamics.

PubMed

Murray, George C; McKenzie, Karen

2013-05-01

The current paper presents the hypothesis that the understanding of mental disorders can be advanced by incorporating the laws of thermodynamics, specifically relating to energy conservation and energy transfer. These ideas, along with the introduction of the notion that entropic activities are symptomatic of inefficient energy transfer or disorder, were used to propose a model of understanding mental ill health as resulting from the interaction of entropy, capacity and work (environmental demands). The model was applied to Attention Deficit Hyperactivity Disorder, and was shown to be compatible with current thinking about this condition, as well as emerging models of mental disorders as complex networks. A key implication of the proposed model is that it argues that all mental disorders require a systemic functional approach, with the advantage that it offers a number of routes into the assessment, formulation and treatment for mental health problems. Copyright © 2013 Elsevier Ltd. All rights reserved.

Simulation study of entropy production in the one-dimensional Vlasov system

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dai, Zongliang, E-mail: liangliang1223@gmail.com; Wang, Shaojie

2016-07-15

The coarse-grain averaged distribution function of the one-dimensional Vlasov system is obtained by numerical simulation. The entropy productions in cases of the random field, the linear Landau damping, and the bump-on-tail instability are computed with the coarse-grain averaged distribution function. The computed entropy production is converged with increasing length of coarse-grain average. When the distribution function differs slightly from a Maxwellian distribution, the converged value agrees with the result computed by using the definition of thermodynamic entropy. The length of the coarse-grain average to compute the coarse-grain averaged distribution function is discussed.

The influence of filtering and downsampling on the estimation of transfer entropy

PubMed Central

Florin, Esther; von Papen, Michael; Timmermann, Lars

2017-01-01

Transfer entropy (TE) provides a generalized and model-free framework to study Wiener-Granger causality between brain regions. Because of its nonparametric character, TE can infer directed information flow also from nonlinear systems. Despite its increasing number of applications in neuroscience, not much is known regarding the influence of common electrophysiological preprocessing on its estimation. We test the influence of filtering and downsampling on a recently proposed nearest neighborhood based TE estimator. Different filter settings and downsampling factors were tested in a simulation framework using a model with a linear coupling function and two nonlinear models with sigmoid and logistic coupling functions. For nonlinear coupling and progressively lower low-pass filter cut-off frequencies up to 72% false negative direct connections and up to 26% false positive connections were identified. In contrast, for the linear model, a monotonic increase was only observed for missed indirect connections (up to 86%). High-pass filtering (1 Hz, 2 Hz) had no impact on TE estimation. After low-pass filtering interaction delays were significantly underestimated. Downsampling the data by a factor greater than the assumed interaction delay erased most of the transmitted information and thus led to a very high percentage (67–100%) of false negative direct connections. Low-pass filtering increases the number of missed connections depending on the filters cut-off frequency. Downsampling should only be done if the sampling factor is smaller than the smallest assumed interaction delay of the analyzed network. PMID:29149201

Entanglement entropy from tensor network states for stabilizer codes

NASA Astrophysics Data System (ADS)

He, Huan; Zheng, Yunqin; Bernevig, B. Andrei; Regnault, Nicolas

2018-03-01

In this paper, we present the construction of tensor network states (TNS) for some of the degenerate ground states of three-dimensional (3D) stabilizer codes. We then use the TNS formalism to obtain the entanglement spectrum and entropy of these ground states for some special cuts. In particular, we work out examples of the 3D toric code, the X-cube model, and the Haah code. The latter two models belong to the category of "fracton" models proposed recently, while the first one belongs to the conventional topological phases. We mention the cases for which the entanglement entropy and spectrum can be calculated exactly: For these, the constructed TNS is a singular value decomposition (SVD) of the ground states with respect to particular entanglement cuts. Apart from the area law, the entanglement entropies also have constant and linear corrections for the fracton models, while the entanglement entropies for the toric code models only have constant corrections. For the cuts we consider, the entanglement spectra of these three models are completely flat. We also conjecture that the negative linear correction to the area law is a signature of extensive ground-state degeneracy. Moreover, the transfer matrices of these TNSs can be constructed. We show that the transfer matrices are projectors whose eigenvalues are either 1 or 0. The number of nonzero eigenvalues is tightly related to the ground-state degeneracy.

One-Particle Representation of Heat Conduction Described within the Scope of the Second Law.

PubMed

Jesudason, Christopher Gunaseelan

2016-01-01

The Carnot cycle and its deduction of maximum conversion efficiency of heat inputted and outputted isothermally at different temperatures necessitated the construction of isothermal and adiabatic pathways within the cycle that were mechanically "reversible", leading eventually to the Kelvin-Clausius development of the entropy function S with differential dS = dq/T such that [symbol: see text]C dS = 0 where the heat absorption occurs at the isothermal paths of the elementary Carnot cycle. Another required condition is that the heat transfer processes take place infinitely slowly and "reversibly", implying that rates of transfer are not explicitly featured in the theory. The definition of 'heat' as that form of energy that is transferred as a result of a temperature difference suggests that the local mode of transfer of "heat" in the isothermal segments of the pathway implies a Fourier-like heat conduction mechanism which is apparently irreversible, leading to an increase in entropy of the combined reservoirs at either end of the conducting material, and which is deemed reversible mechanically. These paradoxes are circumvented here by first clarifying the terms used before modeling heat transfer as a thermodynamically reversible but mechanically irreversible process and applied to a one dimensional atomic lattice chain of interacting particles subjected to a temperature difference exemplifying Fourier heat conduction. The basis of a "recoverable trajectory" i.e. that which follows a zero entropy trajectory is identified. The Second Law is strictly maintained in this development. A corollary to this zero entropy trajectory is the generalization of the Zeroth law for steady state non-equilibrium systems with varying temperature, and thus to a statement about "equilibrium" in steady state non-thermostatic conditions. An energy transfer rate term is explicitly identified for each particle and agrees quantitatively (and independently) with the rate of heat absorbed at the reservoirs held at different temperatures and located at the two ends of the lattice chain in MD simulations, where all energy terms in the simulation refer to a single particle interacting with its neighbors. These results validate the theoretical model and provides the necessary boundary conditions (for instance with regard to temperature differentials and force fields) that thermodynamical variables must comply with to satisfy the conditions for a recoverable trajectory, and thus determines the solution of the differential and integral equations that are used to model these processes. These developments and results, if fully pursued would imply that not only can the Carnot cycle be viewed as describing a local process of energy-work conversion by a single interacting particle which feature rates of energy transfer and conversion not possible in the classical Carnot development, but that even irreversible local processes might be brought within the scope of this cycle, implying a unified treatment of thermodynamically (i) irreversible (ii) reversible (iii) isothermal and (iv) adiabatic processes by conflating the classically distinct concept of work and heat energy into a single particle interactional process. A resolution to the fundamental and long-standing conjecture of Benofy and Quay concerning the Fourier principle is one consequence of the analysis.

One-Particle Representation of Heat Conduction Described within the Scope of the Second Law

PubMed Central

Jesudason, Christopher Gunaseelan

2016-01-01

The Carnot cycle and its deduction of maximum conversion efficiency of heat inputted and outputted isothermally at different temperatures necessitated the construction of isothermal and adiabatic pathways within the cycle that were mechanically “reversible”, leading eventually to the Kelvin-Clausius development of the entropy function S with differential dS=dq/T such that ∮CdS=0 where the heat absorption occurs at the isothermal paths of the elementary Carnot cycle. Another required condition is that the heat transfer processes take place infinitely slowly and “reversibly”, implying that rates of transfer are not explicitly featured in the theory. The definition of ‘heat’ as that form of energy that is transferred as a result of a temperature difference suggests that the local mode of transfer of “heat” in the isothermal segments of the pathway implies a Fourier-like heat conduction mechanism which is apparently irreversible, leading to an increase in entropy of the combined reservoirs at either end of the conducting material, and which is deemed reversible mechanically. These paradoxes are circumvented here by first clarifying the terms used before modeling heat transfer as a thermodynamically reversible but mechanically irreversible process and applied to a one dimensional atomic lattice chain of interacting particles subjected to a temperature difference exemplifying Fourier heat conduction. The basis of a “recoverable trajectory” i.e. that which follows a zero entropy trajectory is identified. The Second Law is strictly maintained in this development. A corollary to this zero entropy trajectory is the generalization of the Zeroth law for steady state non-equilibrium systems with varying temperature, and thus to a statement about “equilibrium” in steady state non-thermostatic conditions. An energy transfer rate term is explicitly identified for each particle and agrees quantitatively (and independently) with the rate of heat absorbed at the reservoirs held at different temperatures and located at the two ends of the lattice chain in MD simulations, where all energy terms in the simulation refer to a single particle interacting with its neighbors. These results validate the theoretical model and provides the necessary boundary conditions (for instance with regard to temperature differentials and force fields) that thermodynamical variables must comply with to satisfy the conditions for a recoverable trajectory, and thus determines the solution of the differential and integral equations that are used to model these processes. These developments and results, if fully pursued would imply that not only can the Carnot cycle be viewed as describing a local process of energy-work conversion by a single interacting particle which feature rates of energy transfer and conversion not possible in the classical Carnot development, but that even irreversible local processes might be brought within the scope of this cycle, implying a unified treatment of thermodynamically (i) irreversible (ii) reversible (iii) isothermal and (iv) adiabatic processes by conflating the classically distinct concept of work and heat energy into a single particle interactional process. A resolution to the fundamental and long-standing conjecture of Benofy and Quay concerning the Fourier principle is one consequence of the analysis. PMID:26760507

Entropy Analysis in Mixed Convection MHD flow of Nanofluid over a Non-linear Stretching Sheet

NASA Astrophysics Data System (ADS)

Matin, Meisam Habibi; Nobari, Mohammad Reza Heirani; Jahangiri, Pouyan

This article deals with a numerical study of entropy analysis in mixed convection MHD flow of nanofluid over a non-linear stretching sheet taking into account the effects of viscous dissipation and variable magnetic field. The nanofluid is made of such nano particles as SiO2 with pure water as a base fluid. To analyze the problem, at first the boundary layer equations are transformed into non-linear ordinary equations using a similarity transformation. The resultant equations are then solved numerically using the Keller-Box scheme based on the implicit finite-difference method. The effects of different non-dimensional governing parameters such as magnetic parameter, nanoparticles volume fraction, Nusselt, Richardson, Eckert, Hartman, Brinkman, Reynolds and entropy generation numbers are investigated in details. The results indicate that increasing the nano particles to the base fluids causes the reduction in shear forces and a decrease in stretching sheet heat transfer coefficient. Also, decreasing the magnetic parameter and increasing the Eckert number result in improves heat transfer rate. Furthermore, the surface acts as a strong source of irreversibility due to the higher entropy generation number near the surface.

Entropy and wigner functions

PubMed

Manfredi; Feix

2000-10-01

The properties of an alternative definition of quantum entropy, based on Wigner functions, are discussed. Such a definition emerges naturally from the Wigner representation of quantum mechanics, and can easily quantify the amount of entanglement of a quantum state. It is shown that smoothing of the Wigner function induces an increase in entropy. This fact is used to derive some simple rules to construct positive-definite probability distributions which are also admissible Wigner functions.

Entropy generation and momentum transfer in the superconductor-normal and normal-superconductor phase transformations and the consistency of the conventional theory of superconductivity

NASA Astrophysics Data System (ADS)

Hirsch, J. E.

2018-05-01

Since the discovery of the Meissner effect, the superconductor to normal (S-N) phase transition in the presence of a magnetic field is understood to be a first-order phase transformation that is reversible under ideal conditions and obeys the laws of thermodynamics. The reverse (N-S) transition is the Meissner effect. This implies in particular that the kinetic energy of the supercurrent is not dissipated as Joule heat in the process where the superconductor becomes normal and the supercurrent stops. In this paper, we analyze the entropy generation and the momentum transfer between the supercurrent and the body in the S-N transition and the N-S transition as described by the conventional theory of superconductivity. We find that it is not possible to explain the transition in a way that is consistent with the laws of thermodynamics unless the momentum transfer between the supercurrent and the body occurs with zero entropy generation, for which the conventional theory of superconductivity provides no mechanism. Instead, we point out that the alternative theory of hole superconductivity does not encounter such difficulties.

Cattaneo-Christov based study of {TiO}_2 -CuO/EG Casson hybrid nanofluid flow over a stretching surface with entropy generation

NASA Astrophysics Data System (ADS)

Jamshed, Wasim; Aziz, Asim

2018-06-01

In the present research, a simplified mathematical model is presented to study the heat transfer and entropy generation analysis of thermal system containing hybrid nanofluid. Nanofluid occupies the space over an infinite horizontal surface and the flow is induced by the non-linear stretching of surface. A uniform transverse magnetic field, Cattaneo-Christov heat flux model and thermal radiation effects are also included in the present study. The similarity technique is employed to reduce the governing non-linear partial differential equations to a set of ordinary differential equation. Keller Box numerical scheme is then used to approximate the solutions for the thermal analysis. Results are presented for conventional copper oxide-ethylene glycol (CuO-EG) and hybrid titanium-copper oxide/ethylene glycol ({TiO}_2 -CuO/EG) nanofluids. The spherical, hexahedron, tetrahedron, cylindrical, and lamina-shaped nanoparticles are considered in the present analysis. The significant findings of the study is the enhanced heat transfer capability of hybrid nanofluids over the conventional nanofluids, greatest heat transfer rate for the smallest value of the shape factor parameter and the increase in Reynolds number and Brinkman number increases the overall entropy of the system.

Inquiries into the Nature of Free Energy and Entropy in Respect to Biochemical Thermodynamics

NASA Astrophysics Data System (ADS)

Stoner, Clinton D.

2000-09-01

Free energy and entropy are examined in detail from the standpoint of classical thermodynamics. The approach is logically based on the fact that thermodynamic work is mediated by thermal energy through the tendency for nonthermal energy to convert spontaneously into thermal energy and for thermal energy to distribute spontaneously and uniformly within the accessible space. The fact that free energy is a Second-Law, expendable energy that makes it possible for thermodynamic work to be done at finite rates is emphasized. Entropy, as originally defined, is pointed out to be the capacity factor for thermal energy that is hidden with respect to temperature; it serves to evaluate the practical quality of thermal energy and to account for changes in the amounts of latent thermal energies in systems maintained at constant temperature. With entropy thus operationally defined, it is possible to see that TDS° of the Gibbs standard free energy relation DG°= DH°-TDS° serves to account for differences or changes in nonthermal energies that do not contribute to DG° and that, since DH° serves to account for differences or changes in total energy, complete enthalpy-entropy (DH° - TDS°) compensation must invariably occur in isothermal processes for which TDS° is finite. A major objective was to clarify the means by which free energy is transferred and conserved in sequences of biological reactions coupled by freely diffusible intermediates. In achieving this objective it was found necessary to distinguish between a 'characteristic free energy' possessed by all First-Law energies in amounts equivalent to the amounts of the energies themselves and a 'free energy of concentration' that is intrinsically mechanical and relatively elusive in that it can appear to be free of First-Law energy. The findings in this regard serve to clarify the fact that the transfer of chemical potential energy from one repository to another along sequences of biological reactions of the above sort occurs through transfer of the First-Law energy as thermal energy and transfer of the Second-Law energy as free energy of concentration.

Origin of generalized entropies and generalized statistical mechanics for superstatistical multifractal systems

NASA Astrophysics Data System (ADS)

Gadjiev, Bahruz; Progulova, Tatiana

2015-01-01

We consider a multifractal structure as a mixture of fractal substructures and introduce a distribution function f (α), where α is a fractal dimension. Then we can introduce g(p)˜ ∫- ln p μe-yf(y)dy and show that the distribution functions f (α) in the form of f(α) = δ(α-1), f(α) = δ(α-θ) , f(α) = 1/α-1 , f(y)= y α-1 lead to the Boltzmann - Gibbs, Shafee, Tsallis and Anteneodo - Plastino entropies conformably. Here δ(x) is the Dirac delta function. Therefore the Shafee entropy corresponds to a fractal structure, the Tsallis entropy describes a multifractal structure with a homogeneous distribution of fractal substructures and the Anteneodo - Plastino entropy appears in case of a power law distribution f (y). We consider the Fokker - Planck equation for a fractal substructure and determine its stationary solution. To determine the distribution function of a multifractal structure we solve the two-dimensional Fokker - Planck equation and obtain its stationary solution. Then applying the Bayes theorem we obtain a distribution function for the entire system in the form of q-exponential function. We compare the results of the distribution functions obtained due to the superstatistical approach with the ones obtained according to the maximum entropy principle.

Analysis of neuronal cells of dissociated primary culture on high-density CMOS electrode array

PubMed Central

Matsuda, Eiko; Mita, Takeshi; Hubert, Julien; Bakkum, Douglas; Frey, Urs; Hierlemann, Andreas; Takahashi, Hirokazu; Ikegami, Takashi

2017-01-01

Spontaneous development of neuronal cells was recorded around 4–34 days in vitro (DIV) with high-density CMOS array, which enables detailed study of the spatio-temporal activity of neuronal culture. We used the CMOS array to characterize the evolution of the inter-spike interval (ISI) distribution from putative single neurons, and estimate the network structure based on transfer entropy analysis, where each node corresponds to a single neuron. We observed that the ISI distributions gradually obeyed the power law with maturation of the network. The amount of information transferred between neurons increased at the early stage of development, but decreased as the network matured. These results suggest that both ISI and transfer entropy were very useful for characterizing the dynamic development of cultured neural cells over a few weeks. PMID:24109870

Information Theoretic Approaches to Rapid Discovery of Relationships in Large Climate Data Sets

NASA Technical Reports Server (NTRS)

Knuth, Kevin H.; Rossow, William B.; Clancy, Daniel (Technical Monitor)

2002-01-01

Mutual information as the asymptotic Bayesian measure of independence is an excellent starting point for investigating the existence of possible relationships among climate-relevant variables in large data sets, As mutual information is a nonlinear function of of its arguments, it is not beholden to the assumption of a linear relationship between the variables in question and can reveal features missed in linear correlation analyses. However, as mutual information is symmetric in its arguments, it only has the ability to reveal the probability that two variables are related. it provides no information as to how they are related; specifically, causal interactions or a relation based on a common cause cannot be detected. For this reason we also investigate the utility of a related quantity called the transfer entropy. The transfer entropy can be written as a difference between mutual informations and has the capability to reveal whether and how the variables are causally related. The application of these information theoretic measures is rested on some familiar examples using data from the International Satellite Cloud Climatology Project (ISCCP) to identify relation between global cloud cover and other variables, including equatorial pacific sea surface temperature (SST), over seasonal and El Nino Southern Oscillation (ENSO) cycles.

Analysis of acoustic and entropy disturbances in a hypersonic wind tunnel

NASA Astrophysics Data System (ADS)

Schilden, Thomas; Schröder, Wolfgang; Ali, Syed Raza Christopher; Schreyer, Anne-Marie; Wu, Jie; Radespiel, Rolf

2016-05-01

The tunnel noise in a Mach 5.9 Ludwieg tube is determined by two methods, a newly developed cone-probe-DNS method and a reliable hot-wire-Pitot-probe method. The new method combines pressure and heat flux measurements using a cone probe and direct numerical simulation (DNS). The modal analysis is based on transfer functions obtained by the DNS to link the measured quantities to the tunnel noise. The measurements are performed for several unit-Reynolds numbers in the range of 5 ṡ 106 ≤ Re/m ≤ 16 ṡ 106 and probe positions to identify the sensitivities of tunnel noise. The DNS solutions show similar response mechanisms of the cone probe to incident acoustic and entropy waves which leads to high condition numbers of the transfer matrix such that a unique relationship between response and source mechanism can be only determined by neglecting the contribution of the non-acoustic modes to the pressure and heat flux fluctuations. The results of the cone-probe-DNS method are compared to a modal analysis based on the hot-wire-Pitot-probe method which provides reliable results in the frequency range less than 50 kHz. In this low frequency range the findings of the two different mode analyses agree well. At higher frequencies, the newly developed cone-probe-DNS method is still valid. The tunnel noise is dominated by the acoustic mode, since the entropy mode is lower by one order of magnitude and the vorticity mode can be neglected. The acoustic mode is approximately 0.5% at 30 kHz and the cone-probe-DNS data illustrate the acoustic mode to decrease and to asymptotically approach 0.2%.

Long-Range Reduced Predictive Information Transfers of Autistic Youths in EEG Sensor-Space During Face Processing.

PubMed

Khadem, Ali; Hossein-Zadeh, Gholam-Ali; Khorrami, Anahita

2016-03-01

The majority of previous functional/effective connectivity studies conducted on the autistic patients converged to the underconnectivity theory of ASD: "long-range underconnectivity and sometimes short-rang overconnectivity". However, to the best of our knowledge the total (linear and nonlinear) predictive information transfers (PITs) of autistic patients have not been investigated yet. Also, EEG data have rarely been used for exploring the information processing deficits in autistic subjects. This study is aimed at comparing the total (linear and nonlinear) PITs of autistic and typically developing healthy youths during human face processing by using EEG data. The ERPs of 12 autistic youths and 19 age-matched healthy control (HC) subjects were recorded while they were watching upright and inverted human face images. The PITs among EEG channels were quantified using two measures separately: transfer entropy with self-prediction optimality (TESPO), and modified transfer entropy with self-prediction optimality (MTESPO). Afterwards, the directed differential connectivity graphs (dDCGs) were constructed to characterize the significant changes in the estimated PITs of autistic subjects compared with HC ones. By using both TESPO and MTESPO, long-range reduction of PITs of ASD group during face processing was revealed (particularly from frontal channels to right temporal channels). Also, it seemed the orientation of face images (upright or upside down) did not modulate the binary pattern of PIT-based dDCGs, significantly. Moreover, compared with TESPO, the results of MTESPO were more compatible with the underconnectivity theory of ASD in the sense that MTESPO showed no long-range increase in PIT. It is also noteworthy that to the best of our knowledge it is the first time that a version of MTE is applied for patients (here ASD) and it is also its first use for EEG data analysis.

Time series analysis of the Antarctic Circumpolar Wave via symbolic transfer entropy

NASA Astrophysics Data System (ADS)

Oh, Mingi; Kim, Sehyun; Lim, Kyuseong; Kim, Soo Yong

2018-06-01

An attempt to interpret a large-scale climate phenomenon in the Southern Ocean (SO), the Antarctic Circumpolar Wave (ACW), has been made using an information entropy method, symbolic transfer entropy (STE). Over the areas of 50-60∘S latitude belt, information flow for four climate variables, sea surface temperature (SST), sea-ice edge (SIE), sea level pressure (SLP) and meridional wind speed (MWS) is examined. We found a tendency that eastward flow of information is preferred only for oceanic variables, which is a main characteristic of the ACW, an eastward wave making a circuit around the Antarctica. Since the ACW is the coherent pattern in both ocean and atmosphere it is reasonable to infer that the tendency reflects the Antarctic Circumpolar Current (ACC) encircling the Antarctica, rather than an evidence of the ACW. We observed one common feature for all four variables, a strong information flow over the area of the eastern Pacific Ocean, which suggest a signature of El Nino Southern Oscillation (ENSO).

Entropy and equilibrium via games of complexity

NASA Astrophysics Data System (ADS)

Topsøe, Flemming

2004-09-01

It is suggested that thermodynamical equilibrium equals game theoretical equilibrium. Aspects of this thesis are discussed. The philosophy is consistent with maximum entropy thinking of Jaynes, but goes one step deeper by deriving the maximum entropy principle from an underlying game theoretical principle. The games introduced are based on measures of complexity. Entropy is viewed as minimal complexity. It is demonstrated that Tsallis entropy ( q-entropy) and Kaniadakis entropy ( κ-entropy) can be obtained in this way, based on suitable complexity measures. A certain unifying effect is obtained by embedding these measures in a two-parameter family of entropy functions.

An entropy-assisted musculoskeletal shoulder model.

PubMed

Xu, Xu; Lin, Jia-Hua; McGorry, Raymond W

2017-04-01

Optimization combined with a musculoskeletal shoulder model has been used to estimate mechanical loading of musculoskeletal elements around the shoulder. Traditionally, the objective function is to minimize the summation of the total activities of the muscles with forces, moments, and stability constraints. Such an objective function, however, tends to neglect the antagonist muscle co-contraction. In this study, an objective function including an entropy term is proposed to address muscle co-contractions. A musculoskeletal shoulder model is developed to apply the proposed objective function. To find the optimal weight for the entropy term, an experiment was conducted. In the experiment, participants generated various 3-D shoulder moments in six shoulder postures. The surface EMG of 8 shoulder muscles was measured and compared with the predicted muscle activities based on the proposed objective function using Bhattacharyya distance and concordance ratio under different weight of the entropy term. The results show that a small weight of the entropy term can improve the predictability of the model in terms of muscle activities. Such a result suggests that the concept of entropy could be helpful for further understanding the mechanism of muscle co-contractions as well as developing a shoulder biomechanical model with greater validity. Copyright © 2017 Elsevier Ltd. All rights reserved.

Brain Entropy Mapping Using fMRI

PubMed Central

Wang, Ze; Li, Yin; Childress, Anna Rose; Detre, John A.

2014-01-01

Entropy is an important trait for life as well as the human brain. Characterizing brain entropy (BEN) may provide an informative tool to assess brain states and brain functions. Yet little is known about the distribution and regional organization of BEN in normal brain. The purpose of this study was to examine the whole brain entropy patterns using a large cohort of normal subjects. A series of experiments were first performed to validate an approximate entropy measure regarding its sensitivity, specificity, and reliability using synthetic data and fMRI data. Resting state fMRI data from a large cohort of normal subjects (n = 1049) from multi-sites were then used to derive a 3-dimensional BEN map, showing a sharp low-high entropy contrast between the neocortex and the rest of brain. The spatial heterogeneity of resting BEN was further studied using a data-driven clustering method, and the entire brain was found to be organized into 7 hierarchical regional BEN networks that are consistent with known structural and functional brain parcellations. These findings suggest BEN mapping as a physiologically and functionally meaningful measure for studying brain functions. PMID:24657999

Effects of heat sink and source and entropy generation on MHD mixed convection of a Cu-water nanofluid in a lid-driven square porous enclosure with partial slip

NASA Astrophysics Data System (ADS)

Chamkha, A. J.; Rashad, A. M.; Mansour, M. A.; Armaghani, T.; Ghalambaz, M.

2017-05-01

In this work, the effects of the presence of a heat sink and a heat source and their lengths and locations and the entropy generation on MHD mixed convection flow and heat transfer in a porous enclosure filled with a Cu-water nanofluid in the presence of partial slip effect are investigated numerically. Both the lid driven vertical walls of the cavity are thermally insulated and are moving with constant and equal speeds in their own plane and the effect of partial slip is imposed on these walls. A segment of the bottom wall is considered as a heat source meanwhile a heat sink is placed on the upper wall of cavity. There are heated and cold parts placed on the bottom and upper walls, respectively, while the remaining parts are thermally insulated. Entropy generation and local heat transfer according to different values of the governing parameters are presented in detail. It is found that the addition of nanoparticles decreases the convective heat transfer inside the porous cavity at all ranges of the heat sink and source lengths. The results for the effects of the magnetic field show that the average Nusselt number decreases considerably upon the enhancement of the Hartmann number. Also, adding nanoparticles to a pure fluid leads to increasing the entropy generation for all values of D for λl=-λr = 1 .

Enhancement of heat transfer and entropy generation analysis of nanofluids turbulent convection flow in square section tubes

NASA Astrophysics Data System (ADS)

Bianco, Vincenzo; Nardini, Sergio; Manca, Oronzio

2011-12-01

In this article, developing turbulent forced convection flow of a water-Al2O3 nanofluid in a square tube, subjected to constant and uniform wall heat flux, is numerically investigated. The mixture model is employed to simulate the nanofluid flow and the investigation is accomplished for particles size equal to 38 nm. An entropy generation analysis is also proposed in order to find the optimal working condition for the given geometry under given boundary conditions. A simple analytical procedure is proposed to evaluate the entropy generation and its results are compared with the numerical calculations, showing a very good agreement. A comparison of the resulting Nusselt numbers with experimental correlations available in literature is accomplished. To minimize entropy generation, the optimal Reynolds number is determined.

Magnetic stirling cycles: A new application for magnetic materials

NASA Technical Reports Server (NTRS)

Brown, G. V.

1977-01-01

The elements of the cycle are summarized. The basic advantages include high entropy density in the magnetic material, completely reversible processes, convenient control of the entropy by the applied field, the feature that heat transfer is possible during all processes, and the ability of the ideal cycle to attain Carnot efficiency. The mean field theory is used to predict the entropy of a ferromagnet in an applied field and also the isothermal entropy change and isentropic temperature change caused by applying a field. The results for isentropic temperature change are compared with experimental data on Gd. Coarse mixtures of ferromagnetic materials with different Curie points are proposed to modify the path of the cycle in the T-S diagram in order to improve the efficiency or to increase the specific power.

Entropy Information of Cardiorespiratory Dynamics in Neonates during Sleep.

PubMed

Lucchini, Maristella; Pini, Nicolò; Fifer, William P; Burtchen, Nina; Signorini, Maria G

2017-05-01

Sleep is a central activity in human adults and characterizes most of the newborn infant life. During sleep, autonomic control acts to modulate heart rate variability (HRV) and respiration. Mechanisms underlying cardiorespiratory interactions in different sleep states have been studied but are not yet fully understood. Signal processing approaches have focused on cardiorespiratory analysis to elucidate this co-regulation. This manuscript proposes to analyze heart rate (HR), respiratory variability and their interrelationship in newborn infants to characterize cardiorespiratory interactions in different sleep states (active vs. quiet). We are searching for indices that could detect regulation alteration or malfunction, potentially leading to infant distress. We have analyzed inter-beat (RR) interval series and respiration in a population of 151 newborns, and followed up with 33 at 1 month of age. RR interval series were obtained by recognizing peaks of the QRS complex in the electrocardiogram (ECG), corresponding to the ventricles depolarization. Univariate time domain, frequency domain and entropy measures were applied. In addition, Transfer Entropy was considered as a bivariate approach able to quantify the bidirectional information flow from one signal (respiration) to another (RR series). Results confirm the validity of the proposed approach. Overall, HRV is higher in active sleep, while high frequency (HF) power characterizes more quiet sleep. Entropy analysis provides higher indices for SampEn and Quadratic Sample entropy (QSE) in quiet sleep. Transfer Entropy values were higher in quiet sleep and point to a major influence of respiration on the RR series. At 1 month of age, time domain parameters show an increase in HR and a decrease in variability. No entropy differences were found across ages. The parameters employed in this study help to quantify the potential for infants to adapt their cardiorespiratory responses as they mature. Thus, they could be useful as early markers of risk for infant cardiorespiratory vulnerabilities.

Entanglement entropy flow and the Ward identity.

PubMed

Rosenhaus, Vladimir; Smolkin, Michael

2014-12-31

We derive differential equations for the flow of entanglement entropy as a function of the metric and the couplings of the theory. The variation of the universal part of entanglement entropy under a local Weyl transformation is related to the variation under a local change in the couplings. We show that this relation is, in fact, equivalent to the trace Ward identity. As a concrete application of our formalism, we express the entanglement entropy for massive free fields as a two-point function of the energy-momentum tensor.

Entanglement entropy for 2D gauge theories with matters

NASA Astrophysics Data System (ADS)

Aoki, Sinya; Iizuka, Norihiro; Tamaoka, Kotaro; Yokoya, Tsuyoshi

2017-08-01

We investigate the entanglement entropy in 1 +1 -dimensional S U (N ) gauge theories with various matter fields using the lattice regularization. Here we use extended Hilbert space definition for entanglement entropy, which contains three contributions; (1) classical Shannon entropy associated with superselection sector distribution, where sectors are labeled by irreducible representations of boundary penetrating fluxes, (2) logarithm of the dimensions of their representations, which is associated with "color entanglement," and (3) EPR Bell pairs, which give "genuine" entanglement. We explicitly show that entanglement entropies (1) and (2) above indeed appear for various multiple "meson" states in gauge theories with matter fields. Furthermore, we employ transfer matrix formalism for gauge theory with fundamental matter field and analyze its ground state using hopping parameter expansion (HPE), where the hopping parameter K is roughly the inverse square of the mass for the matter. We evaluate the entanglement entropy for the ground state and show that all (1), (2), (3) above appear in the HPE, though the Bell pair part (3) appears in higher order than (1) and (2) do. With these results, we discuss how the ground state entanglement entropy in the continuum limit can be understood from the lattice ground state obtained in the HPE.

Characterizations of matrix and operator-valued Φ-entropies, and operator Efron-Stein inequalities.

PubMed

Cheng, Hao-Chung; Hsieh, Min-Hsiu

2016-03-01

We derive new characterizations of the matrix Φ-entropy functionals introduced in Chen & Tropp (Chen, Tropp 2014 Electron. J. Prob. 19 , 1-30. (doi:10.1214/ejp.v19-2964)). These characterizations help us to better understand the properties of matrix Φ-entropies, and are a powerful tool for establishing matrix concentration inequalities for random matrices. Then, we propose an operator-valued generalization of matrix Φ-entropy functionals, and prove the subadditivity under Löwner partial ordering. Our results demonstrate that the subadditivity of operator-valued Φ-entropies is equivalent to the convexity. As an application, we derive the operator Efron-Stein inequality.

On q-non-extensive statistics with non-Tsallisian entropy

NASA Astrophysics Data System (ADS)

Jizba, Petr; Korbel, Jan

2016-02-01

We combine an axiomatics of Rényi with the q-deformed version of Khinchin axioms to obtain a measure of information (i.e., entropy) which accounts both for systems with embedded self-similarity and non-extensivity. We show that the entropy thus obtained is uniquely solved in terms of a one-parameter family of information measures. The ensuing maximal-entropy distribution is phrased in terms of a special function known as the Lambert W-function. We analyze the corresponding "high" and "low-temperature" asymptotics and reveal a non-trivial structure of the parameter space. Salient issues such as concavity and Schur concavity of the new entropy are also discussed.

Using the Maximum Entropy Principle as a Unifying Theory Characterization and Sampling of Multi-Scaling Processes in Hydrometeorology

DTIC Science & Technology

2015-08-20

evapotranspiration (ET) over oceans may be significantly lower than previously thought. The MEP model parameterized turbulent transfer coefficients...fluxes, ocean freshwater fluxes, regional crop yield among others. An on-going study suggests that the global annual evapotranspiration (ET) over...Bras, Jingfeng Wang. A model of evapotranspiration based on the theory of maximum entropy production, Water Resources Research, (03 2011): 0. doi

The increase of the functional entropy of the human brain with age.

PubMed

Yao, Y; Lu, W L; Xu, B; Li, C B; Lin, C P; Waxman, D; Feng, J F

2013-10-09

We use entropy to characterize intrinsic ageing properties of the human brain. Analysis of fMRI data from a large dataset of individuals, using resting state BOLD signals, demonstrated that a functional entropy associated with brain activity increases with age. During an average lifespan, the entropy, which was calculated from a population of individuals, increased by approximately 0.1 bits, due to correlations in BOLD activity becoming more widely distributed. We attribute this to the number of excitatory neurons and the excitatory conductance decreasing with age. Incorporating these properties into a computational model leads to quantitatively similar results to the fMRI data. Our dataset involved males and females and we found significant differences between them. The entropy of males at birth was lower than that of females. However, the entropies of the two sexes increase at different rates, and intersect at approximately 50 years; after this age, males have a larger entropy.

The Increase of the Functional Entropy of the Human Brain with Age

PubMed Central

Yao, Y.; Lu, W. L.; Xu, B.; Li, C. B.; Lin, C. P.; Waxman, D.; Feng, J. F.

2013-01-01

We use entropy to characterize intrinsic ageing properties of the human brain. Analysis of fMRI data from a large dataset of individuals, using resting state BOLD signals, demonstrated that a functional entropy associated with brain activity increases with age. During an average lifespan, the entropy, which was calculated from a population of individuals, increased by approximately 0.1 bits, due to correlations in BOLD activity becoming more widely distributed. We attribute this to the number of excitatory neurons and the excitatory conductance decreasing with age. Incorporating these properties into a computational model leads to quantitatively similar results to the fMRI data. Our dataset involved males and females and we found significant differences between them. The entropy of males at birth was lower than that of females. However, the entropies of the two sexes increase at different rates, and intersect at approximately 50 years; after this age, males have a larger entropy. PMID:24103922

Fine structure of the entanglement entropy in the O(2) model.

PubMed

Yang, Li-Ping; Liu, Yuzhi; Zou, Haiyuan; Xie, Z Y; Meurice, Y

2016-01-01

We compare two calculations of the particle density in the superfluid phase of the O(2) model with a chemical potential μ in 1+1 dimensions. The first relies on exact blocking formulas from the Tensor Renormalization Group (TRG) formulation of the transfer matrix. The second is a worm algorithm. We show that the particle number distributions obtained with the two methods agree well. We use the TRG method to calculate the thermal entropy and the entanglement entropy. We describe the particle density, the two entropies and the topology of the world lines as we increase μ to go across the superfluid phase between the first two Mott insulating phases. For a sufficiently large temporal size, this process reveals an interesting fine structure: the average particle number and the winding number of most of the world lines in the Euclidean time direction increase by one unit at a time. At each step, the thermal entropy develops a peak and the entanglement entropy increases until we reach half-filling and then decreases in a way that approximately mirrors the ascent. This suggests an approximate fermionic picture.

Entropy Generation Minimization in Dimethyl Ether Synthesis: A Case Study

NASA Astrophysics Data System (ADS)

Kingston, Diego; Razzitte, Adrián César

2018-04-01

Entropy generation minimization is a method that helps improve the efficiency of real processes and devices. In this article, we study the entropy production (due to chemical reactions, heat exchange and friction) in a conventional reactor that synthesizes dimethyl ether and minimize it by modifying different operating variables of the reactor, such as composition, temperature and pressure, while aiming at a fixed production of dimethyl ether. Our results indicate that it is possible to reduce the entropy production rate by nearly 70 % and that, by changing only the inlet composition, it is possible to cut it by nearly 40 %, though this comes at the expense of greater dissipation due to heat transfer. We also study the alternative of coupling the reactor with another, where dehydrogenation of methylcyclohexane takes place. In that case, entropy generation can be reduced by 54 %, when pressure, temperature and inlet molar flows are varied. These examples show that entropy generation analysis can be a valuable tool in engineering design and applications aiming at process intensification and efficient operation of plant equipment.

A Joint Multitarget Estimator for the Joint Target Detection and Tracking Filter

DTIC Science & Technology

2015-06-27

function is the information theoretic part of the problem and aims for entropy maximization, while the second one arises from the constraint in the...objective functions in conflict. The first objective function is the information theo- retic part of the problem and aims for entropy maximization...theory. For the sake of completeness and clarity, we also summarize how each concept is utilized later. Entropy : A random variable is statistically

On the entropy variation in the scenario of entropic gravity

NASA Astrophysics Data System (ADS)

Xiao, Yong; Bai, Shi-Yang

2018-05-01

In the scenario of entropic gravity, entropy varies as a function of the location of the matter, while the tendency to increase entropy appears as gravity. We concentrate on studying the entropy variation of a typical gravitational system with different relative positions between the mass and the gravitational source. The result is that the entropy of the system doesn't increase when the mass is displaced closer to the gravitational source. In this way it disproves the proposal of entropic gravity from thermodynamic entropy. It doesn't exclude the possibility that gravity originates from non-thermodynamic entropy like entanglement entropy.

Entropy Generation Analysis in Convective Ferromagnetic Nano Blood Flow Through a Composite Stenosed Arteries with Permeable Wall

NASA Astrophysics Data System (ADS)

Sher Akbar, Noreen; Wahid Butt, Adil

2017-05-01

The study of heat transfer is of significant importance in many biological and biomedical industry problems. This investigation comprises of the study of entropy generation analysis of the blood flow in the arteries with permeable walls. The convection through the flow is studied with compliments to the entropy generation. Governing problem is formulized and solved for low Reynold’s number and long wavelength approximations. Exact analytical solutions have been obtained and are analyzed graphically. It is seen that temperature for pure water is lower as compared to the copper water. It gains magnitude with an increase in the slip parameter.

Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach.

PubMed

Ramakrishnan, Raghunathan; Dral, Pavlo O; Rupp, Matthias; von Lilienfeld, O Anatole

2015-05-12

Chemically accurate and comprehensive studies of the virtual space of all possible molecules are severely limited by the computational cost of quantum chemistry. We introduce a composite strategy that adds machine learning corrections to computationally inexpensive approximate legacy quantum methods. After training, highly accurate predictions of enthalpies, free energies, entropies, and electron correlation energies are possible, for significantly larger molecular sets than used for training. For thermochemical properties of up to 16k isomers of C7H10O2 we present numerical evidence that chemical accuracy can be reached. We also predict electron correlation energy in post Hartree-Fock methods, at the computational cost of Hartree-Fock, and we establish a qualitative relationship between molecular entropy and electron correlation. The transferability of our approach is demonstrated, using semiempirical quantum chemistry and machine learning models trained on 1 and 10% of 134k organic molecules, to reproduce enthalpies of all remaining molecules at density functional theory level of accuracy.

Entanglement entropy between real and virtual particles in ϕ4 quantum field theory

NASA Astrophysics Data System (ADS)

Ardenghi, Juan Sebastián

2015-04-01

The aim of this work is to compute the entanglement entropy of real and virtual particles by rewriting the generating functional of ϕ4 theory as a mean value between states and observables defined through the correlation functions. Then the von Neumann definition of entropy can be applied to these quantum states and in particular, for the partial traces taken over the internal or external degrees of freedom. This procedure can be done for each order in the perturbation expansion showing that the entanglement entropy for real and virtual particles behaves as ln (m0). In particular, entanglement entropy is computed at first order for the correlation function of two external points showing that mutual information is identical to the external entropy and that conditional entropies are negative for all the domain of m0. In turn, from the definition of the quantum states, it is possible to obtain general relations between total traces between different quantum states of a ϕr theory. Finally, discussion about the possibility of taking partial traces over external degrees of freedom is considered, which implies the introduction of some observables that measure space-time points where an interaction occurs.

Minimum entropy deconvolution and blind equalisation

NASA Technical Reports Server (NTRS)

Satorius, E. H.; Mulligan, J. J.

1992-01-01

Relationships between minimum entropy deconvolution, developed primarily for geophysics applications, and blind equalization are pointed out. It is seen that a large class of existing blind equalization algorithms are directly related to the scale-invariant cost functions used in minimum entropy deconvolution. Thus the extensive analyses of these cost functions can be directly applied to blind equalization, including the important asymptotic results of Donoho.

Entropy of space-time outcome in a movement speed-accuracy task.

PubMed

Hsieh, Tsung-Yu; Pacheco, Matheus Maia; Newell, Karl M

2015-12-01

The experiment reported was set-up to investigate the space-time entropy of movement outcome as a function of a range of spatial (10, 20 and 30 cm) and temporal (250-2500 ms) criteria in a discrete aiming task. The variability and information entropy of the movement spatial and temporal errors considered separately increased and decreased on the respective dimension as a function of an increment of movement velocity. However, the joint space-time entropy was lowest when the relative contribution of spatial and temporal task criteria was comparable (i.e., mid-range of space-time constraints), and it increased with a greater trade-off between spatial or temporal task demands, revealing a U-shaped function across space-time task criteria. The traditional speed-accuracy functions of spatial error and temporal error considered independently mapped to this joint space-time U-shaped entropy function. The trade-off in movement tasks with joint space-time criteria is between spatial error and timing error, rather than movement speed and accuracy. Copyright © 2015 Elsevier B.V. All rights reserved.

Supersymmetric Renyi entropy in CFT 2 and AdS 3

DOE PAGES

Giveon, Amit; Kutasov, David

2016-01-01

We show that in any two dimensional conformal field theory with (2, 2) super-symmetry one can define a supersymmetric analog of the usual Renyi entropy of a spatial region A. It differs from the Renyi entropy by a universal function (which we compute) of the central charge, Renyi parameter n and the geometric parameters of A. In the limit n → 1 it coincides with the entanglement entropy. Thus, it contains the same information as the Renyi entropy but its computation only involves correlation functions of chiral and anti-chiral operators. We also show that this quantity appears naturally in stringmore » theory on AdS3.« less

Casimir self-entropy of a spherical electromagnetic δ -function shell

NASA Astrophysics Data System (ADS)

Milton, Kimball A.; Kalauni, Pushpa; Parashar, Prachi; Li, Yang

2017-10-01

In this paper we continue our program of computing Casimir self-entropies of idealized electrical bodies. Here we consider an electromagnetic δ -function sphere ("semitransparent sphere") whose electric susceptibility has a transverse polarization with arbitrary strength. Dispersion is incorporated by a plasma-like model. In the strong-coupling limit, a perfectly conducting spherical shell is realized. We compute the entropy for both low and high temperatures. The transverse electric self-entropy is negative as expected, but the transverse magnetic self-entropy requires ultraviolet and infrared renormalization (subtraction), and, surprisingly, is only positive for sufficiently strong coupling. Results are robust under different regularization schemes. These rather surprising findings require further investigation.

Characterizations of matrix and operator-valued Φ-entropies, and operator Efron–Stein inequalities

PubMed Central

Cheng, Hao-Chung; Hsieh, Min-Hsiu

2016-01-01

We derive new characterizations of the matrix Φ-entropy functionals introduced in Chen & Tropp (Chen, Tropp 2014 Electron. J. Prob. 19, 1–30. (doi:10.1214/ejp.v19-2964)). These characterizations help us to better understand the properties of matrix Φ-entropies, and are a powerful tool for establishing matrix concentration inequalities for random matrices. Then, we propose an operator-valued generalization of matrix Φ-entropy functionals, and prove the subadditivity under Löwner partial ordering. Our results demonstrate that the subadditivity of operator-valued Φ-entropies is equivalent to the convexity. As an application, we derive the operator Efron–Stein inequality. PMID:27118909

Entropy Analyses of Four Familiar Processes.

ERIC Educational Resources Information Center

Craig, Norman C.

1988-01-01

Presents entropy analysis of four processes: a chemical reaction, a heat engine, the dissolution of a solid, and osmosis. Discusses entropy, the second law of thermodynamics, and the Gibbs free energy function. (MVL)

Thermodynamics of the Sorption of Benzimidazoles on Octadecyl Silica Gel from Water-Methanol Eluents

NASA Astrophysics Data System (ADS)

Shafigulin, R. V.; Bulanova, A. V.

2018-02-01

The standard enthalpy and entropy component of transferring benzimidazoles from water-methanol solutions to surfaces of octadecyl silica gel are determined using reversed-phase high-performance liquid chromatography (RP HPLC). The dependences between the enthalpy and polarizability of the molecules of the studied benzimidazoles, the enthalpy and the entropy factor are studied, and the influence of the quantitative composition of the water-methanol solution on the enthalpy are studied.

Investigation of Heat and Mass Transfer and Irreversibility Phenomena Within a Three-Dimensional Tilted Enclosure for Different Shapes

NASA Astrophysics Data System (ADS)

Oueslati, F.; Ben-Beya, B.

2018-01-01

Three-dimensional thermosolutal natural convection and entropy generation within an inclined enclosure is investigated in the current study. A numerical method based on the finite volume method and a full multigrid technique is implemented to solve the governing equations. Effects of various parameters, namely, the aspect ratio, buoyancy ratio, and tilt angle on the flow patterns and entropy generation are predicted and discussed.

A kinetic equation with kinetic entropy functions for scalar conservation laws

NASA Technical Reports Server (NTRS)

Perthame, Benoit; Tadmor, Eitan

1990-01-01

A nonlinear kinetic equation is constructed and proved to be well-adapted to describe general multidimensional scalar conservation laws. In particular, it is proved to be well-posed uniformly in epsilon - the microscopic scale. It is also shown that the proposed kinetic equation is equipped with a family of kinetic entropy functions - analogous to Boltzmann's microscopic H-function, such that they recover Krushkov-type entropy inequality on the macroscopic scale. Finally, it is proved by both - BV compactness arguments in the one-dimensional case, that the local density of kinetic particles admits a continuum limit, as it converges strongly with epsilon below 0 to the unique entropy solution of the corresponding conservation law.

Overall heat transfer coefficient and pressure drop in a typical tubular exchanger employing alumina nano-fluid as the tube side hot fluid

NASA Astrophysics Data System (ADS)

Kabeel, A. E.; Abdelgaied, Mohamed

2016-08-01

Nano-fluids are used to improve the heat transfer rates in heat exchangers, especially; the shell-and-tube heat exchanger that is considered one of the most important types of heat exchangers. In the present study, an experimental loop is constructed to study the thermal characteristics of the shell-and-tube heat exchanger; at different concentrations of Al2O3 nonmetallic particles (0.0, 2, 4, and 6 %). This material concentrations is by volume concentrations in pure water as a base fluid. The effects of nano-fluid concentrations on the performance of shell and tube heat exchanger have been conducted based on the overall heat transfer coefficient, the friction factor, the pressure drop in tube side, and the entropy generation rate. The experimental results show that; the highest heat transfer coefficient is obtained at a nano-fluid concentration of 4 % of the shell side. In shell side the maximum percentage increase in the overall heat transfer coefficient has reached 29.8 % for a nano-fluid concentration of 4 %, relative to the case of the base fluid (water) at the same tube side Reynolds number. However; in the tube side the maximum relative increase in pressure drop has recorded the values of 12, 28 and 48 % for a nano-material concentration of 2, 4 and 6 %, respectively, relative to the case without nano-fluid, at an approximate value of 56,000 for Reynolds number. The entropy generation reduces with increasing the nonmetallic particle volume fraction of the same flow rates. For increase the nonmetallic particle volume fraction from 0.0 to 6 % the rate of entropy generation decrease by 10 %.

Renyi Entropies in Multiparticle Production

NASA Astrophysics Data System (ADS)

Bialas, A.; Czyz, W.

2000-12-01

Renyi entropies are calculated for some multiparticle systems. Arguments are presented that measurements of Renyi entropies as functions of the average number of particles produced in high energy collisions carry important information on the produced system.

Entropy generation across Earth's collisionless bow shock.

PubMed

Parks, G K; Lee, E; McCarthy, M; Goldstein, M; Fu, S Y; Cao, J B; Canu, P; Lin, N; Wilber, M; Dandouras, I; Réme, H; Fazakerley, A

2012-02-10

Earth's bow shock is a collisionless shock wave but entropy has never been directly measured across it. The plasma experiments on Cluster and Double Star measure 3D plasma distributions upstream and downstream of the bow shock allowing calculation of Boltzmann's entropy function H and his famous H theorem, dH/dt≤0. The collisionless Boltzmann (Vlasov) equation predicts that the total entropy does not change if the distribution function across the shock becomes nonthermal, but it allows changes in the entropy density. Here, we present the first direct measurements of entropy density changes across Earth's bow shock and show that the results generally support the model of the Vlasov analysis. These observations are a starting point for a more sophisticated analysis that includes 3D computer modeling of collisionless shocks with input from observed particles, waves, and turbulences.

Finding modules and hierarchy in weighted financial network using transfer entropy

NASA Astrophysics Data System (ADS)

Yook, Soon-Hyung; Chae, Huiseung; Kim, Jinho; Kim, Yup

2016-04-01

We study the modular structure of financial network based on the transfer entropy (TE). From the comparison with the obtained modular structure using the cross-correlation (CC), we find that TE and CC both provide well organized modular structure and the hierarchical relationship between each industrial group when the time scale of the measurement is less than one month. However, when the time scale of the measurement becomes larger than one month, we find that the modular structure from CC cannot correctly reflect the known industrial classification and their hierarchy. In addition the measured maximum modularity, Qmax, for TE is always larger than that for CC, which indicates that TE is a better weight measure than CC for the system with asymmetric relationship.

Connectivity in the human brain dissociates entropy and complexity of auditory inputs☆

PubMed Central

Nastase, Samuel A.; Iacovella, Vittorio; Davis, Ben; Hasson, Uri

2015-01-01

Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. PMID:25536493

Large Eddy Simulation of Entropy Generation in a Turbulent Mixing Layer

NASA Astrophysics Data System (ADS)

Sheikhi, Reza H.; Safari, Mehdi; Hadi, Fatemeh

2013-11-01

Entropy transport equation is considered in large eddy simulation (LES) of turbulent flows. The irreversible entropy generation in this equation provides a more general description of subgrid scale (SGS) dissipation due to heat conduction, mass diffusion and viscosity effects. A new methodology is developed, termed the entropy filtered density function (En-FDF), to account for all individual entropy generation effects in turbulent flows. The En-FDF represents the joint probability density function of entropy, frequency, velocity and scalar fields within the SGS. An exact transport equation is developed for the En-FDF, which is modeled by a system of stochastic differential equations, incorporating the second law of thermodynamics. The modeled En-FDF transport equation is solved by a Lagrangian Monte Carlo method. The methodology is employed to simulate a turbulent mixing layer involving transport of passive scalars and entropy. Various modes of entropy generation are obtained from the En-FDF and analyzed. Predictions are assessed against data generated by direct numerical simulation (DNS). The En-FDF predictions are in good agreements with the DNS data.

Entropy Filtered Density Function for Large Eddy Simulation of Turbulent Reacting Flows

NASA Astrophysics Data System (ADS)

Safari, Mehdi

Analysis of local entropy generation is an effective means to optimize the performance of energy and combustion systems by minimizing the irreversibilities in transport processes. Large eddy simulation (LES) is employed to describe entropy transport and generation in turbulent reacting flows. The entropy transport equation in LES contains several unclosed terms. These are the subgrid scale (SGS) entropy flux and entropy generation caused by irreversible processes: heat conduction, mass diffusion, chemical reaction and viscous dissipation. The SGS effects are taken into account using a novel methodology based on the filtered density function (FDF). This methodology, entitled entropy FDF (En-FDF), is developed and utilized in the form of joint entropy-velocity-scalar-turbulent frequency FDF and the marginal scalar-entropy FDF, both of which contain the chemical reaction effects in a closed form. The former constitutes the most comprehensive form of the En-FDF and provides closure for all the unclosed filtered moments. This methodology is applied for LES of a turbulent shear layer involving transport of passive scalars. Predictions show favor- able agreements with the data generated by direct numerical simulation (DNS) of the same layer. The marginal En-FDF accounts for entropy generation effects as well as scalar and entropy statistics. This methodology is applied to a turbulent nonpremixed jet flame (Sandia Flame D) and predictions are validated against experimental data. In both flows, sources of irreversibility are predicted and analyzed.

Use of information entropy measures of sitting postural sway to quantify developmental delay in infants

PubMed Central

Deffeyes, Joan E; Harbourne, Regina T; DeJong, Stacey L; Kyvelidou, Anastasia; Stuberg, Wayne A; Stergiou, Nicholas

2009-01-01

Background By quantifying the information entropy of postural sway data, the complexity of the postural movement of different populations can be assessed, giving insight into pathologic motor control functioning. Methods In this study, developmental delay of motor control function in infants was assessed by analysis of sitting postural sway data acquired from force plate center of pressure measurements. Two types of entropy measures were used: symbolic entropy, including a new asymmetric symbolic entropy measure, and approximate entropy, a more widely used entropy measure. For each method of analysis, parameters were adjusted to optimize the separation of the results from the infants with delayed development from infants with typical development. Results The method that gave the widest separation between the populations was the asymmetric symbolic entropy method, which we developed by modification of the symbolic entropy algorithm. The approximate entropy algorithm also performed well, using parameters optimized for the infant sitting data. The infants with delayed development were found to have less complex patterns of postural sway in the medial-lateral direction, and were found to have different left-right symmetry in their postural sway, as compared to typically developing infants. Conclusion The results of this study indicate that optimization of the entropy algorithm for infant sitting postural sway data can greatly improve the ability to separate the infants with developmental delay from typically developing infants. PMID:19671183

Quantile based Tsallis entropy in residual lifetime

NASA Astrophysics Data System (ADS)

Khammar, A. H.; Jahanshahi, S. M. A.

2018-02-01

Tsallis entropy is a generalization of type α of the Shannon entropy, that is a nonadditive entropy unlike the Shannon entropy. Shannon entropy may be negative for some distributions, but Tsallis entropy can always be made nonnegative by choosing appropriate value of α. In this paper, we derive the quantile form of this nonadditive's entropy function in the residual lifetime, namely the residual quantile Tsallis entropy (RQTE) and get the bounds for it, depending on the Renyi's residual quantile entropy. Also, we obtain relationship between RQTE and concept of proportional hazards model in the quantile setup. Based on the new measure, we propose a stochastic order and aging classes, and study its properties. Finally, we prove characterizations theorems for some well known lifetime distributions. It is shown that RQTE uniquely determines the parent distribution unlike the residual Tsallis entropy.

Entropy is in Flux V3.4

NASA Astrophysics Data System (ADS)

Kadanoff, Leo P.

2017-05-01

The science of thermodynamics was put together in the Nineteenth Century to describe large systems in equilibrium. One part of thermodynamics defines entropy for equilibrium systems and demands an ever-increasing entropy for non-equilibrium ones. Since thermodynamics does not define entropy out of equilibrium, pure thermodynamics cannot follow the details of how this increase occurs. However, starting with the work of Ludwig Boltzmann in 1872, and continuing to the present day, various models of non-equilibrium behavior have been put together with the specific aim of generalizing the concept of entropy to non-equilibrium situations. This kind of entropy has been termed kinetic entropy to distinguish it from the thermodynamic variety. Knowledge of kinetic entropy started from Boltzmann's insight about his equation for the time dependence of gaseous systems. In this paper, his result is stated as a definition of kinetic entropy in terms of a local equation for the entropy density. This definition is then applied to Landau's theory of the Fermi liquid thereby giving the kinetic entropy within that theory. The dynamics of many condensed matter systems including Fermi liquids, low temperature superfluids, and ordinary metals lend themselves to the definition of kinetic entropy. In fact, entropy has been defined and used for a wide variety of situations in which a condensed matter system has been allowed to relax for a sufficient period so that the very most rapid fluctuations have been ironed out. One of the broadest applications of non-equilibrium analysis considers quantum degenerate systems using Martin-Schwinger Green's functions (Phys Rev 115:1342-1373, 1959) as generalized Wigner functions, g^<({p},ω ,{R},T) and g^>({p},ω ,{R},T). This paper describes once again how the quantum kinetic equations for these functions give locally defined conservation laws for mass momentum and energy. In local thermodynamic equilibrium, this kinetic theory enables a reasonable definition of the density of kinetic entropy. However, when the system is outside of local equilibrium, this definition fails. It is speculated that quantum entanglement is the source of this failure.

RELATIONSHIP BETWEEN ENTROPY OF SPIKE TIMING AND FIRING RATE IN ENTOPEDUNCULAR NUCLEUS NEURONS IN ANESTHETIZED RATS: FUNCTION OF THE NIGRO-STRIATAL PATHWAY

PubMed Central

Darbin, Olivier; Jin, Xingxing; von Wrangel, Christof; Schwabe, Kerstin; Nambu, Atsushi; Naritoku, Dean K; Krauss, Joachim K.; Alam, Mesbah

2016-01-01

The function of the nigro-striatal pathway on neuronal entropy in the basal ganglia (BG) output nucleus (entopeduncular nucleus, EPN) was investigated in the unilaterally 6-hyroxydopamine (6-OHDA)-lesioned rat model of Parkinson’s disease (PD). In both control subjects and subjects with 6-OHDA lesion of the nigro-striatal pathway, a histological hallmark for parkinsonism, neuronal entropy in EPN was maximal in neurons with firing rates ranging between 15Hz and 25 Hz. In 6-OHDA lesioned rats, neuronal entropy in the EPN was specifically higher in neurons with firing rates above 25Hz. Our data establishes that nigro-striatal pathway controls neuronal entropy in motor circuitry and that the parkinsonian condition is associated with abnormal relationship between firing rate and neuronal entropy in BG output nuclei. The neuronal firing rates and entropy relationship provide putative relevant electrophysiological information to investigate the sensory-motor processing in normal condition and conditions with movement disorders. PMID:26711712

Maximum-entropy probability distributions under Lp-norm constraints

NASA Technical Reports Server (NTRS)

Dolinar, S.

1991-01-01

Continuous probability density functions and discrete probability mass functions are tabulated which maximize the differential entropy or absolute entropy, respectively, among all probability distributions with a given L sub p norm (i.e., a given pth absolute moment when p is a finite integer) and unconstrained or constrained value set. Expressions for the maximum entropy are evaluated as functions of the L sub p norm. The most interesting results are obtained and plotted for unconstrained (real valued) continuous random variables and for integer valued discrete random variables. The maximum entropy expressions are obtained in closed form for unconstrained continuous random variables, and in this case there is a simple straight line relationship between the maximum differential entropy and the logarithm of the L sub p norm. Corresponding expressions for arbitrary discrete and constrained continuous random variables are given parametrically; closed form expressions are available only for special cases. However, simpler alternative bounds on the maximum entropy of integer valued discrete random variables are obtained by applying the differential entropy results to continuous random variables which approximate the integer valued random variables in a natural manner. All the results are presented in an integrated framework that includes continuous and discrete random variables, constraints on the permissible value set, and all possible values of p. Understanding such as this is useful in evaluating the performance of data compression schemes.

Optimization of a Circular Microchannel With Entropy Generation Minimization Method

NASA Astrophysics Data System (ADS)

Jafari, Arash; Ghazali, Normah Mohd

2010-06-01

New advances in micro and nano scales are being realized and the contributions of micro and nano heat dissipation devices are of high importance in this novel technology development. Past studies showed that microchannel design depends on its thermal resistance and pressure drop. However, entropy generation minimization (EGM) as a new optimization theory stated that the rate of entropy generation should be also optimized. Application of EGM in microchannel heat sink design is reviewed and discussed in this paper. Latest principles for deriving the entropy generation relations are discussed to present how this approach can be achieved. An optimization procedure using EGM method with the entropy generation rate is derived for a circular microchannel heat sink based upon thermal resistance and pressure drop. The equations are solved using MATLAB and the obtained results are compared to similar past studies. The effects of channel diameter, number of channels, heat flux, and pumping power on the entropy generation rate and Reynolds number are investigated. Analytical correlations are utilized for heat transfer and friction coefficients. A minimum entropy generation has been observed for N = 40 and channel diameter of 90μm. It is concluded that for N = 40 and channel hydraulic diameter of 90μm, the circular microchannel heat sink is on its optimum operating point based on second law of thermodynamics.

Transfer entropy in physical systems and the arrow of time

NASA Astrophysics Data System (ADS)

Spinney, Richard E.; Lizier, Joseph T.; Prokopenko, Mikhail

2016-08-01

Recent developments have cemented the realization that many concepts and quantities in thermodynamics and information theory are shared. In this paper, we consider a highly relevant quantity in information theory and complex systems, the transfer entropy, and explore its thermodynamic role by considering the implications of time reversal upon it. By doing so we highlight the role of information dynamics on the nuanced question of observer perspective within thermodynamics by relating the temporal irreversibility in the information dynamics to the configurational (or spatial) resolution of the thermodynamics. We then highlight its role in perhaps the most enduring paradox in modern physics, the manifestation of a (thermodynamic) arrow of time. We find that for systems that process information such as those undergoing feedback, a robust arrow of time can be formulated by considering both the apparent physical behavior which leads to conventional entropy production and the information dynamics which leads to a quantity we call the information theoretic arrow of time. We also offer an interpretation in terms of optimal encoding of observed physical behavior.

The dynamics of information-driven coordination phenomena: A transfer entropy analysis

PubMed Central

Borge-Holthoefer, Javier; Perra, Nicola; Gonçalves, Bruno; González-Bailón, Sandra; Arenas, Alex; Moreno, Yamir; Vespignani, Alessandro

2016-01-01

Data from social media provide unprecedented opportunities to investigate the processes that govern the dynamics of collective social phenomena. We consider an information theoretical approach to define and measure the temporal and structural signatures typical of collective social events as they arise and gain prominence. We use the symbolic transfer entropy analysis of microblogging time series to extract directed networks of influence among geolocalized subunits in social systems. This methodology captures the emergence of system-level dynamics close to the onset of socially relevant collective phenomena. The framework is validated against a detailed empirical analysis of five case studies. In particular, we identify a change in the characteristic time scale of the information transfer that flags the onset of information-driven collective phenomena. Furthermore, our approach identifies an order-disorder transition in the directed network of influence between social subunits. In the absence of clear exogenous driving, social collective phenomena can be represented as endogenously driven structural transitions of the information transfer network. This study provides results that can help define models and predictive algorithms for the analysis of societal events based on open source data. PMID:27051875

The dynamics of information-driven coordination phenomena: A transfer entropy analysis.

PubMed

Borge-Holthoefer, Javier; Perra, Nicola; Gonçalves, Bruno; González-Bailón, Sandra; Arenas, Alex; Moreno, Yamir; Vespignani, Alessandro

2016-04-01

Data from social media provide unprecedented opportunities to investigate the processes that govern the dynamics of collective social phenomena. We consider an information theoretical approach to define and measure the temporal and structural signatures typical of collective social events as they arise and gain prominence. We use the symbolic transfer entropy analysis of microblogging time series to extract directed networks of influence among geolocalized subunits in social systems. This methodology captures the emergence of system-level dynamics close to the onset of socially relevant collective phenomena. The framework is validated against a detailed empirical analysis of five case studies. In particular, we identify a change in the characteristic time scale of the information transfer that flags the onset of information-driven collective phenomena. Furthermore, our approach identifies an order-disorder transition in the directed network of influence between social subunits. In the absence of clear exogenous driving, social collective phenomena can be represented as endogenously driven structural transitions of the information transfer network. This study provides results that can help define models and predictive algorithms for the analysis of societal events based on open source data.

Classic maximum entropy recovery of the average joint distribution of apparent FRET efficiency and fluorescence photons for single-molecule burst measurements.

PubMed

DeVore, Matthew S; Gull, Stephen F; Johnson, Carey K

2012-04-05

We describe a method for analysis of single-molecule Förster resonance energy transfer (FRET) burst measurements using classic maximum entropy. Classic maximum entropy determines the Bayesian inference for the joint probability describing the total fluorescence photons and the apparent FRET efficiency. The method was tested with simulated data and then with DNA labeled with fluorescent dyes. The most probable joint distribution can be marginalized to obtain both the overall distribution of fluorescence photons and the apparent FRET efficiency distribution. This method proves to be ideal for determining the distance distribution of FRET-labeled biomolecules, and it successfully predicts the shape of the recovered distributions.

A minimum entropy principle in the gas dynamics equations

NASA Technical Reports Server (NTRS)

Tadmor, E.

1986-01-01

Let u(x bar,t) be a weak solution of the Euler equations, governing the inviscid polytropic gas dynamics; in addition, u(x bar, t) is assumed to respect the usual entropy conditions connected with the conservative Euler equations. We show that such entropy solutions of the gas dynamics equations satisfy a minimum entropy principle, namely, that the spatial minimum of their specific entropy, (Ess inf s(u(x,t)))/x, is an increasing function of time. This principle equally applies to discrete approximations of the Euler equations such as the Godunov-type and Lax-Friedrichs schemes. Our derivation of this minimum principle makes use of the fact that there is a family of generalized entrophy functions connected with the conservative Euler equations.

Mathematical and information-geometrical entropy for phenomenological Fourier and non-Fourier heat conduction

NASA Astrophysics Data System (ADS)

Li, Shu-Nan; Cao, Bing-Yang

2017-09-01

The second law of thermodynamics governs the direction of heat transport, which provides the foundational definition of thermodynamic Clausius entropy. The definitions of entropy are further generalized for the phenomenological heat transport models in the frameworks of classical irreversible thermodynamics and extended irreversible thermodynamics (EIT). In this work, entropic functions from mathematics are combined with phenomenological heat conduction models and connected to several information-geometrical conceptions. The long-time behaviors of these mathematical entropies exhibit a wide diversity and physical pictures in phenomenological heat conductions, including the tendency to thermal equilibrium, and exponential decay of nonequilibrium and asymptotics, which build a bridge between the macroscopic and microscopic modelings. In contrast with the EIT entropies, the mathematical entropies expressed in terms of the internal energy function can avoid singularity paired with nonpositive local absolute temperature caused by non-Fourier heat conduction models.

Entropy and Self-Organization - An Open System Approach to the Origins of Homeland Security Threats

DTIC Science & Technology

2015-06-01

15  2.  Social Free Energy .............................................................................16  III.  METHODOLOGY FOR THE REST OF THE...and living system theory that money can be used as a maker for entropy transfers in social and economic systems.12 Another is the idea of free energy ...from thermodynamics applied to social systems as social free energy . Social free energy is amount of energy beyond the amount needed to maintain the

The large deviation function for entropy production: the optimal trajectory and the role of fluctuations

NASA Astrophysics Data System (ADS)

Speck, Thomas; Engel, Andreas; Seifert, Udo

2012-12-01

We study the large deviation function for the entropy production rate in two driven one-dimensional systems: the asymmetric random walk on a discrete lattice and Brownian motion in a continuous periodic potential. We compare two approaches: using the Donsker-Varadhan theory and using the Freidlin-Wentzell theory. We show that the wings of the large deviation function are dominated by a single optimal trajectory: either in the forward direction (positive rate) or in the backward direction (negative rate). The joining of the two branches at zero entropy production implies a non-differentiability and thus the appearance of a ‘kink’. However, around zero entropy production, many trajectories contribute and thus the ‘kink’ is smeared out.

Diffusive mixing and Tsallis entropy

DOE PAGES

O'Malley, Daniel; Vesselinov, Velimir V.; Cushman, John H.

2015-04-29

Brownian motion, the classical diffusive process, maximizes the Boltzmann-Gibbs entropy. The Tsallis q-entropy, which is non-additive, was developed as an alternative to the classical entropy for systems which are non-ergodic. A generalization of Brownian motion is provided that maximizes the Tsallis entropy rather than the Boltzmann-Gibbs entropy. This process is driven by a Brownian measure with a random diffusion coefficient. In addition, the distribution of this coefficient is derived as a function of q for 1 < q < 3. Applications to transport in porous media are considered.

Assessing the strength of cardiac and sympathetic baroreflex controls via transfer entropy during orthostatic challenge

NASA Astrophysics Data System (ADS)

Porta, Alberto; Marchi, Andrea; Bari, Vlasta; De Maria, Beatrice; Esler, Murray; Lambert, Elisabeth; Baumert, Mathias

2017-05-01

The study assesses the strength of the causal relation along baroreflex (BR) in humans during an incremental postural challenge soliciting the BR. Both cardiac BR (cBR) and sympathetic BR (sBR) were characterized via BR sequence approaches from spontaneous fluctuations of heart period (HP), systolic arterial pressure (SAP), diastolic arterial pressure (DAP) and muscle sympathetic nerve activity (MSNA). A model-based transfer entropy method was applied to quantify the strength of the coupling from SAP to HP and from DAP to MSNA. The confounding influences of respiration were accounted for. Twelve young healthy subjects (20-36 years, nine females) were sequentially tilted at 0°, 20°, 30° and 40°. We found that (i) the strength of the causal relation along the cBR increases with tilt table inclination, while that along the sBR is unrelated to it; (ii) the strength of the causal coupling is unrelated to the gain of the relation; (iii) transfer entropy indexes are significantly and positively associated with simplified causality indexes derived from BR sequence analysis. The study proves that causality indexes are complementary to traditional characterization of the BR and suggests that simple markers derived from BR sequence analysis might be fruitfully exploited to estimate causality along the BR. This article is part of the themed issue `Mathematical methods in medicine: neuroscience, cardiology and pathology'.

Thermodynamic and Differential Entropy under a Change of Variables

PubMed Central

Hnizdo, Vladimir; Gilson, Michael K.

2013-01-01

The differential Shannon entropy of information theory can change under a change of variables (coordinates), but the thermodynamic entropy of a physical system must be invariant under such a change. This difference is puzzling, because the Shannon and Gibbs entropies have the same functional form. We show that a canonical change of variables can, indeed, alter the spatial component of the thermodynamic entropy just as it alters the differential Shannon entropy. However, there is also a momentum part of the entropy, which turns out to undergo an equal and opposite change when the coordinates are transformed, so that the total thermodynamic entropy remains invariant. We furthermore show how one may correctly write the change in total entropy for an isothermal physical process in any set of spatial coordinates. PMID:24436633

DOE Office of Scientific and Technical Information (OSTI.GOV)

Helinski, Ryan

This Python package provides high-performance implementations of the functions and examples presented in "BiEntropy - The Approximate Entropy of a Finite Binary String" by Grenville J. Croll, presented at ANPA 34 in 2013. https://arxiv.org/abs/1305.0954 According to the paper, BiEntropy is "a simple algorithm which computes the approximate entropy of a finite binary string of arbitrary length" using "a weighted average of the Shannon Entropies of the string and all but the last binary derivative of the string."

DNA entropy reveals a significant difference in complexity between housekeeping and tissue specific gene promoters.

PubMed

Thomas, David; Finan, Chris; Newport, Melanie J; Jones, Susan

2015-10-01

The complexity of DNA can be quantified using estimates of entropy. Variation in DNA complexity is expected between the promoters of genes with different transcriptional mechanisms; namely housekeeping (HK) and tissue specific (TS). The former are transcribed constitutively to maintain general cellular functions, and the latter are transcribed in restricted tissue and cells types for specific molecular events. It is known that promoter features in the human genome are related to tissue specificity, but this has been difficult to quantify on a genomic scale. If entropy effectively quantifies DNA complexity, calculating the entropies of HK and TS gene promoters as profiles may reveal significant differences. Entropy profiles were calculated for a total dataset of 12,003 human gene promoters and for 501 housekeeping (HK) and 587 tissue specific (TS) human gene promoters. The mean profiles show the TS promoters have a significantly lower entropy (p<2.2e-16) than HK gene promoters. The entropy distributions for the 3 datasets show that promoter entropies could be used to identify novel HK genes. Functional features comprise DNA sequence patterns that are non-random and hence they have lower entropies. The lower entropy of TS gene promoters can be explained by a higher density of positive and negative regulatory elements, required for genes with complex spatial and temporary expression. Copyright © 2015 Elsevier Ltd. All rights reserved.

Connectivity in the human brain dissociates entropy and complexity of auditory inputs.

PubMed

Nastase, Samuel A; Iacovella, Vittorio; Davis, Ben; Hasson, Uri

2015-03-01

Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. Copyright © 2014. Published by Elsevier Inc.

Ecosystem functioning and maximum entropy production: a quantitative test of hypotheses.

PubMed

Meysman, Filip J R; Bruers, Stijn

2010-05-12

The idea that entropy production puts a constraint on ecosystem functioning is quite popular in ecological thermodynamics. Yet, until now, such claims have received little quantitative verification. Here, we examine three 'entropy production' hypotheses that have been forwarded in the past. The first states that increased entropy production serves as a fingerprint of living systems. The other two hypotheses invoke stronger constraints. The state selection hypothesis states that when a system can attain multiple steady states, the stable state will show the highest entropy production rate. The gradient response principle requires that when the thermodynamic gradient increases, the system's new stable state should always be accompanied by a higher entropy production rate. We test these three hypotheses by applying them to a set of conventional food web models. Each time, we calculate the entropy production rate associated with the stable state of the ecosystem. This analysis shows that the first hypothesis holds for all the food webs tested: the living state shows always an increased entropy production over the abiotic state. In contrast, the state selection and gradient response hypotheses break down when the food web incorporates more than one trophic level, indicating that they are not generally valid.

Atomic and electronic basis for the serrations of refractory high-entropy alloys

NASA Astrophysics Data System (ADS)

Wang, William Yi; Shang, Shun Li; Wang, Yi; Han, Fengbo; Darling, Kristopher A.; Wu, Yidong; Xie, Xie; Senkov, Oleg N.; Li, Jinshan; Hui, Xi Dong; Dahmen, Karin A.; Liaw, Peter K.; Kecskes, Laszlo J.; Liu, Zi-Kui

2017-06-01

Refractory high-entropy alloys present attractive mechanical properties, i.e., high yield strength and fracture toughness, making them potential candidates for structural applications. Understandings of atomic and electronic interactions are important to reveal the origins for the formation of high-entropy alloys and their structure-dominated mechanical properties, thus enabling the development of a predictive approach for rapidly designing advanced materials. Here, we report the atomic and electronic basis for the valence-electron-concentration-categorized principles and the observed serration behavior in high-entropy alloys and high-entropy metallic glass, including MoNbTaW, MoNbVW, MoTaVW, HfNbTiZr, and Vitreloy-1 MG (Zr41Ti14Cu12.5Ni10Be22.5). We find that the yield strengths of high-entropy alloys and high-entropy metallic glass are a power-law function of the electron-work function, which is dominated by local atomic arrangements. Further, a reliance on the bonding-charge density provides a groundbreaking insight into the nature of loosely bonded spots in materials. The presence of strongly bonded clusters and weakly bonded glue atoms imply a serrated deformation of high-entropy alloys, resulting in intermittent avalanches of defects movement.

Dissipated energy and entropy production for an unconventional heat engine: the stepwise `circular cycle'

NASA Astrophysics Data System (ADS)

di Liberto, Francesco; Pastore, Raffaele; Peruggi, Fulvio

2011-05-01

When some entropy is transferred, by means of a reversible engine, from a hot heat source to a colder one, the maximum efficiency occurs, i.e. the maximum available work is obtained. Similarly, a reversible heat pumps transfer entropy from a cold heat source to a hotter one with the minimum expense of energy. In contrast, if we are faced with non-reversible devices, there is some lost work for heat engines, and some extra work for heat pumps. These quantities are both related to entropy production. The lost work, i.e. ? , is also called 'degraded energy' or 'energy unavailable to do work'. The extra work, i.e. ? , is the excess of work performed on the system in the irreversible process with respect to the reversible one (or the excess of heat given to the hotter source in the irreversible process). Both quantities are analysed in detail and are evaluated for a complex process, i.e. the stepwise circular cycle, which is similar to the stepwise Carnot cycle. The stepwise circular cycle is a cycle performed by means of N small weights, dw, which are first added and then removed from the piston of the vessel containing the gas or vice versa. The work performed by the gas can be found as the increase of the potential energy of the dw's. Each single dw is identified and its increase, i.e. its increase in potential energy, evaluated. In such a way it is found how the energy output of the cycle is distributed among the dw's. The size of the dw's affects entropy production and therefore the lost and extra work. The distribution of increases depends on the chosen removal process.

Optimality and inference in hydrology from entropy production considerations: synthetic hillslope numerical experiments

NASA Astrophysics Data System (ADS)

Kollet, S. J.

2015-05-01

In this study, entropy production optimization and inference principles are applied to a synthetic semi-arid hillslope in high-resolution, physics-based simulations. The results suggest that entropy or power is indeed maximized, because of the strong nonlinearity of variably saturated flow and competing processes related to soil moisture fluxes, the depletion of gradients, and the movement of a free water table. Thus, it appears that the maximum entropy production (MEP) principle may indeed be applicable to hydrologic systems. In the application to hydrologic system, the free water table constitutes an important degree of freedom in the optimization of entropy production and may also relate the theory to actual observations. In an ensuing analysis, an attempt is made to transfer the complex, "microscopic" hillslope model into a macroscopic model of reduced complexity using the MEP principle as an interference tool to obtain effective conductance coefficients and forces/gradients. The results demonstrate a new approach for the application of MEP to hydrologic systems and may form the basis for fruitful discussions and research in future.

Effect of entropy on anomalous transport in ITG-modes of magneto-plasma

NASA Astrophysics Data System (ADS)

Yaqub Khan, M.; Qaiser Manzoor, M.; Haq, A. ul; Iqbal, J.

2017-04-01

The ideal gas equation and S={{c}v}log ≤ft(P/ρ \\right) (where S is entropy, P is pressure and ρ is the mass density) define the interconnection of entropy with the temperature and density of plasma. Therefore, different phenomena relating to plasma and entropy need to be investigated. By employing the Braginskii transport equations for a nonuniform electron-ion magnetoplasma, two new parameters—the entropy distribution function and the entropy gradient drift—are defined, a new dispersion relation is obtained, and the dependence of anomalous transport on entropy is also proved. Some results, like monotonicity, the entropy principle and the second law of thermodynamics, are proved with a new definition of entropy. This work will open new horizons in fusion processes, not only by controlling entropy in tokamak plasmas—particularly in the pedestal regions of the H-mode and space plasmas—but also in engineering sciences.

Entropy Change for the Irreversible Heat Transfer between Two Finite Objects

DTIC Science & Technology

2015-06-10

independent heat capacities. Another interesting aspect of this problem is to compute the entropy change during the process. Textbooks typically only...case where the two objects have unequal heat capacities, both of which are finite. (From a calculus point of view, each time an increment of heat dQ is...Theory, and Statistical Thermodynamics 3rd edn (Reading MA: Addison-Wesley) ch 5 [3] Larson R and Edwards B 2014 Calculus 10th edn (Boston MA: Brooks

Entropy functional and the holographic attractor mechanism

DOE PAGES

Cabo-Bizet, Alejandro; Kol, Uri; Pando Zayas, Leopoldo A.; ...

2018-05-01

We provide a field theory interpretation of the attractor mechanism for asymptotically AdS4 dyonic BPS black holes whose entropy is captured by the supersymmetric index of the twisted ABJM theory at Chern-Simons level one. We holographically compute the renormalized off-shell quantum effective action in the twisted ABJM theory as a function of the supersymmetric fermion masses and the arbitrary vacuum expectation values of the dimension one scalar bilinear operators and show that extremizing the effective action with respect to the vacuum expectation values of the dimension one scalar bilinears is equivalent to the attractor mechanism in the bulk. In fact,more » we show that the holographic quantum effective action coincides with the entropy functional and, therefore, its value at the extremum reproduces the black hole entropy.« less

Controlling the Shannon Entropy of Quantum Systems

PubMed Central

Xing, Yifan; Wu, Jun

2013-01-01

This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking. PMID:23818819

Controlling the shannon entropy of quantum systems.

PubMed

Xing, Yifan; Wu, Jun

2013-01-01

This paper proposes a new quantum control method which controls the Shannon entropy of quantum systems. For both discrete and continuous entropies, controller design methods are proposed based on probability density function control, which can drive the quantum state to any target state. To drive the entropy to any target at any prespecified time, another discretization method is proposed for the discrete entropy case, and the conditions under which the entropy can be increased or decreased are discussed. Simulations are done on both two- and three-dimensional quantum systems, where division and prediction are used to achieve more accurate tracking.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Giveon, Amit; Kutasov, David

We show that in any two dimensional conformal field theory with (2, 2) super-symmetry one can define a supersymmetric analog of the usual Renyi entropy of a spatial region A. It differs from the Renyi entropy by a universal function (which we compute) of the central charge, Renyi parameter n and the geometric parameters of A. In the limit n → 1 it coincides with the entanglement entropy. Thus, it contains the same information as the Renyi entropy but its computation only involves correlation functions of chiral and anti-chiral operators. We also show that this quantity appears naturally in stringmore » theory on AdS3.« less

Exact analytical thermodynamic expressions for a Brownian heat engine

NASA Astrophysics Data System (ADS)

Taye, Mesfin Asfaw

2015-09-01

The nonequilibrium thermodynamics feature of a Brownian motor operating between two different heat baths is explored as a function of time t . Using the Gibbs entropy and Schnakenberg microscopic stochastic approach, we find exact closed form expressions for the free energy, the rate of entropy production, and the rate of entropy flow from the system to the outside. We show that when the system is out of equilibrium, it constantly produces entropy and at the same time extracts entropy out of the system. Its entropy production and extraction rates decrease in time and saturate to a constant value. In the long time limit, the rate of entropy production balances the rate of entropy extraction, and at equilibrium both entropy production and extraction rates become zero. Furthermore, via the present model, many thermodynamic theories can be checked.

Exact analytical thermodynamic expressions for a Brownian heat engine.

PubMed

Taye, Mesfin Asfaw

2015-09-01

The nonequilibrium thermodynamics feature of a Brownian motor operating between two different heat baths is explored as a function of time t. Using the Gibbs entropy and Schnakenberg microscopic stochastic approach, we find exact closed form expressions for the free energy, the rate of entropy production, and the rate of entropy flow from the system to the outside. We show that when the system is out of equilibrium, it constantly produces entropy and at the same time extracts entropy out of the system. Its entropy production and extraction rates decrease in time and saturate to a constant value. In the long time limit, the rate of entropy production balances the rate of entropy extraction, and at equilibrium both entropy production and extraction rates become zero. Furthermore, via the present model, many thermodynamic theories can be checked.

Nonadditive entropies yield probability distributions with biases not warranted by the data.

PubMed

Pressé, Steve; Ghosh, Kingshuk; Lee, Julian; Dill, Ken A

2013-11-01

Different quantities that go by the name of entropy are used in variational principles to infer probability distributions from limited data. Shore and Johnson showed that maximizing the Boltzmann-Gibbs form of the entropy ensures that probability distributions inferred satisfy the multiplication rule of probability for independent events in the absence of data coupling such events. Other types of entropies that violate the Shore and Johnson axioms, including nonadditive entropies such as the Tsallis entropy, violate this basic consistency requirement. Here we use the axiomatic framework of Shore and Johnson to show how such nonadditive entropy functions generate biases in probability distributions that are not warranted by the underlying data.

A two-phase copula entropy-based multiobjective optimization approach to hydrometeorological gauge network design

NASA Astrophysics Data System (ADS)

Xu, Pengcheng; Wang, Dong; Singh, Vijay P.; Wang, Yuankun; Wu, Jichun; Wang, Lachun; Zou, Xinqing; Chen, Yuanfang; Chen, Xi; Liu, Jiufu; Zou, Ying; He, Ruimin

2017-12-01

Hydrometeorological data are needed for obtaining point and areal mean, quantifying the spatial variability of hydrometeorological variables, and calibration and verification of hydrometeorological models. Hydrometeorological networks are utilized to collect such data. Since data collection is expensive, it is essential to design an optimal network based on the minimal number of hydrometeorological stations in order to reduce costs. This study proposes a two-phase copula entropy- based multiobjective optimization approach that includes: (1) copula entropy-based directional information transfer (CDIT) for clustering the potential hydrometeorological gauges into several groups, and (2) multiobjective method for selecting the optimal combination of gauges for regionalized groups. Although entropy theory has been employed for network design before, the joint histogram method used for mutual information estimation has several limitations. The copula entropy-based mutual information (MI) estimation method is shown to be more effective for quantifying the uncertainty of redundant information than the joint histogram (JH) method. The effectiveness of this approach is verified by applying to one type of hydrometeorological gauge network, with the use of three model evaluation measures, including Nash-Sutcliffe Coefficient (NSC), arithmetic mean of the negative copula entropy (MNCE), and MNCE/NSC. Results indicate that the two-phase copula entropy-based multiobjective technique is capable of evaluating the performance of regional hydrometeorological networks and can enable decision makers to develop strategies for water resources management.

A slow atomic diffusion process in high-entropy glass-forming metallic melts

NASA Astrophysics Data System (ADS)

Chen, Changjiu; Wong, Kaikin; Krishnan, Rithin P.; Embs, Jan P.; Chathoth, Suresh M.

2018-04-01

Quasi-elastic neutron scattering has been used to study atomic relaxation processes in high-entropy glass-forming metallic melts with different glass-forming ability (GFA). The momentum transfer dependence of mean relaxation time shows a highly collective atomic transport process in the alloy melts with the highest and lowest GFA. However, a jump diffusion process is the long-range atomic transport process in the intermediate GFA alloy melt. Nevertheless, atomic mobility close to the melting temperature of these alloy melts is quite similar, and the temperature dependence of the diffusion coefficient exhibits a non-Arrhenius behavior. The atomic mobility in these high-entropy melts is much slower than that of the best glass-forming melts at their respective melting temperatures.

Computer program for calculation of real gas turbulent boundary layers with variable edge entropy

NASA Technical Reports Server (NTRS)

Boney, L. R.

1974-01-01

A user's manual for a computer program which calculates real gas turbulent boundary layers with variable edge entropy on a blunt cone or flat plate at zero angle of attack is presented. An integral method is used. The method includes the effect of real gas in thermodynamic equilibrium and variable edge entropy. A modified Crocco enthalpy velocity relationship is used for the enthalpy profiles and an empirical correlation of the N-power law profile is used for the velocity profile. The skin-friction-coefficient expressions of Spalding and Chi and Van Driest are used in the solution of the momentum equation and in the heat-transfer predictions that use several modified forms of Reynolds analogy.

Classic Maximum Entropy Recovery of the Average Joint Distribution of Apparent FRET Efficiency and Fluorescence Photons for Single-molecule Burst Measurements

PubMed Central

DeVore, Matthew S.; Gull, Stephen F.; Johnson, Carey K.

2012-01-01

We describe a method for analysis of single-molecule Förster resonance energy transfer (FRET) burst measurements using classic maximum entropy. Classic maximum entropy determines the Bayesian inference for the joint probability describing the total fluorescence photons and the apparent FRET efficiency. The method was tested with simulated data and then with DNA labeled with fluorescent dyes. The most probable joint distribution can be marginalized to obtain both the overall distribution of fluorescence photons and the apparent FRET efficiency distribution. This method proves to be ideal for determining the distance distribution of FRET-labeled biomolecules, and it successfully predicts the shape of the recovered distributions. PMID:22338694

Entanglement entropy in causal set theory

NASA Astrophysics Data System (ADS)

Sorkin, Rafael D.; Yazdi, Yasaman K.

2018-04-01

Entanglement entropy is now widely accepted as having deep connections with quantum gravity. It is therefore desirable to understand it in the context of causal sets, especially since they provide in a natural manner the UV cutoff needed to render entanglement entropy finite. Formulating a notion of entanglement entropy in a causal set is not straightforward because the type of canonical hypersurface-data on which its definition typically relies is not available. Instead, we appeal to the more global expression given in Sorkin (2012 (arXiv:1205.2953)) which, for a Gaussian scalar field, expresses the entropy of a spacetime region in terms of the field’s correlation function within that region (its ‘Wightman function’ W(x, x') ). Carrying this formula over to the causal set, one obtains an entropy which is both finite and of a Lorentz invariant nature. We evaluate this global entropy-expression numerically for certain regions (primarily order-intervals or ‘causal diamonds’) within causal sets of 1  +  1 dimensions. For the causal-set counterpart of the entanglement entropy, we obtain, in the first instance, a result that follows a (spacetime) volume law instead of the expected (spatial) area law. We find, however, that one obtains an area law if one truncates the commutator function (‘Pauli–Jordan operator’) and the Wightman function by projecting out the eigenmodes of the Pauli–Jordan operator whose eigenvalues are too close to zero according to a geometrical criterion which we describe more fully below. In connection with these results and the questions they raise, we also study the ‘entropy of coarse-graining’ generated by thinning out the causal set, and we compare it with what one obtains by similarly thinning out a chain of harmonic oscillators, finding the same, ‘universal’ behaviour in both cases.

An entropy model to measure heterogeneity of pedestrian crowds using self-propelled agents

NASA Astrophysics Data System (ADS)

Rangel-Huerta, A.; Ballinas-Hernández, A. L.; Muñoz-Meléndez, A.

2017-05-01

An entropy model to characterize the heterogeneity of a pedestrian crowd in a counter-flow corridor is presented. Pedestrians are modeled as self-propelled autonomous agents that are able to perform maneuvers to avoid collisions based on a set of simple rules of perception and action. An observer can determine a probability distribution function of the displayed behavior of pedestrians based only on external information. Three types of pedestrian are modeled, relaxed, standard and hurried pedestrians depending on their preferences of turn and non-turn when walking. Thus, using these types of pedestrians two crowds can be simulated: homogeneous and heterogeneous crowds. Heterogeneity is measured in this research based on the entropy in function of time. For that, the entropy of a homogeneous crowd comprising standard pedestrians is used as reference. A number of simulations to measure entropy of pedestrian crowds were conducted by varying different combinations of types of pedestrians, initial simulation conditions of macroscopic flow, as well as density of the crowd. Results from these simulations show that our entropy model is sensitive enough to capture the effect of both the initial simulation conditions about the spatial distribution of pedestrians in a corridor, and the composition of a crowd. Also, a relevant finding is that entropy in function of density presents a phase transition in the critical region.

Logarithmic black hole entropy corrections and holographic Rényi entropy

NASA Astrophysics Data System (ADS)

Mahapatra, Subhash

2018-01-01

The entanglement and Rényi entropies for spherical entangling surfaces in CFTs with gravity duals can be explicitly calculated by mapping these entropies first to the thermal entropy on hyperbolic space and then, using the AdS/CFT correspondence, to the Wald entropy of topological black holes. Here we extend this idea by taking into account corrections to the Wald entropy. Using the method based on horizon symmetries and the asymptotic Cardy formula, we calculate corrections to the Wald entropy and find that these corrections are proportional to the logarithm of the area of the horizon. With the corrected expression for the entropy of the black hole, we then find corrections to the Rényi entropies. We calculate these corrections for both Einstein and Gauss-Bonnet gravity duals. Corrections with logarithmic dependence on the area of the entangling surface naturally occur at the order GD^0. The entropic c-function and the inequalities of the Rényi entropy are also satisfied even with the correction terms.

Thermodynamic Origins of Monovalent Facilitated RNA Folding

PubMed Central

Holmstrom, Erik D.; Fiore, Julie L.; Nesbitt, David J.

2012-01-01

Cations have long been associated with formation of native RNA structure and are commonly thought to stabilize the formation of tertiary contacts by favorably interacting with the electrostatic potential of the RNA, giving rise to an “ion atmosphere”. A significant amount of information regarding the thermodynamics of structural transitions in the presence of an ion atmosphere has accumulated and suggests stabilization is dominated by entropic terms. This work provides an analysis of how RNA–cation interactions affect the entropy and enthalpy associated with an RNA tertiary transition. Specifically, temperature-dependent single-molecule fluorescence resonance energy transfer studies have been exploited to determine the free energy (ΔG°), enthalpy (ΔH°), and entropy (ΔS°) of folding for an isolated tetraloop–receptor tertiary interaction as a function of Na+ concentration. Somewhat unexpectedly, increasing the Na+ concentration changes the folding enthalpy from a strongly exothermic process [e.g., ΔH° = −26(2) kcal/mol at 180 mM] to a weakly exothermic process [e.g., ΔH° = −4(1) kcal/mol at 630 mM]. As a direct corollary, it is the strong increase in folding entropy [Δ(ΔS°) > 0] that compensates for this loss of exothermicity for the achievement of more favorable folding [Δ(ΔG°) < 0] at higher Na+ concentrations. In conjunction with corresponding measurements of the thermodynamics of the transition state barrier, these data provide a detailed description of the folding pathway associated with the GAAA tetraloop–receptor interaction as a function of Na+ concentration. The results support a potentially universal mechanism for monovalent facilitated RNA folding, whereby an increasing monovalent concentration stabilizes tertiary structure by reducing the entropic penalty for folding. PMID:22448852

Detection of direct and indirect noise generated by synthetic hot spots in a duct

NASA Astrophysics Data System (ADS)

De Domenico, Francesca; Rolland, Erwan O.; Hochgreb, Simone

2017-04-01

Sound waves in a combustor are generated from fluctuations in the heat release rate (direct noise) or the acceleration of entropy, vorticity or compositional perturbations through nozzles or turbine guide vanes (indirect or entropy noise). These sound waves are transmitted downstream as well as reflected upstream of the acceleration point, contributing to the overall noise emissions, or triggering combustion instabilities. Previous experiments attempted to isolate indirect noise by generating thermoacoustic hot spots electrically and measuring the transmitted acoustic waves, yet there are no measurements on the backward propagating entropy and acoustic waves. This work presents the first measurements which clearly separate the direct and indirect noise contributions to pressure fluctuations upstream of the acceleration point. Synthetic entropy spots are produced by unsteady electrical heating of a grid of thin wires located in a tube. Compression waves (direct noise) are generated from this heating process. The hot spots are then advected with the mean flow and finally accelerated through an orifice plate located at the end of the tube, producing a strong acoustic signature which propagates upstream (indirect noise). The convective time is selected to be longer than the heating pulse length, in order to obtain a clear time separation between direct and indirect noise in the overall pressure trace. The contribution of indirect noise to the overall noise is shown to be non-negligible either in subsonic or sonic throat conditions. However, the absolute amplitude of direct noise is larger than the corresponding fraction of indirect noise, explaining the difficulty in clearly identifying the two contributions when they are merged. Further, the work shows the importance of using appropriate pressure transducer instrumentation and correcting for the respective transfer functions in order to account for low frequency effects in the determination of pressure fluctuations.

Entropy method of measuring and evaluating periodicity of quasi-periodic trajectories

NASA Astrophysics Data System (ADS)

Ni, Yanshuo; Turitsyn, Konstantin; Baoyin, Hexi; Junfeng, Li

2018-06-01

This paper presents a method for measuring the periodicity of quasi-periodic trajectories by applying discrete Fourier transform (DFT) to the trajectories and analyzing the frequency domain within the concept of entropy. Having introduced the concept of entropy, analytical derivation and numerical results indicate that entropies increase as a logarithmic function of time. Periodic trajectories typically have higher entropies, and trajectories with higher entropies mean the periodicities of the motions are stronger. Theoretical differences between two trajectories expressed as summations of trigonometric functions are also derived analytically. Trajectories in the Henon-Heiles system and the circular restricted three-body problem (CRTBP) are analyzed with the indicator entropy and compared with orthogonal fast Lyapunov indicator (OFLI). The results show that entropy is a better tool for discriminating periodicity in quasiperiodic trajectories than OFLI and can detect periodicity while excluding the spirals that are judged as periodic cases by OFLI. Finally, trajectories in the vicinity of 243 Ida and 6489 Golevka are considered as examples, and the numerical results verify these conclusions. Some trajectories near asteroids look irregular, but their higher entropy values as analyzed by this method serve as evidence of frequency regularity in three directions. Moreover, these results indicate that applying DFT to the trajectories in the vicinity of irregular small bodies and calculating their entropy in the frequency domain provides a useful quantitative analysis method for evaluating orderliness in the periodicity of quasi-periodic trajectories within a given time interval.

Maximum and minimum entropy states yielding local continuity bounds

NASA Astrophysics Data System (ADS)

Hanson, Eric P.; Datta, Nilanjana

2018-04-01

Given an arbitrary quantum state (σ), we obtain an explicit construction of a state ρɛ * ( σ ) [respectively, ρ * , ɛ ( σ ) ] which has the maximum (respectively, minimum) entropy among all states which lie in a specified neighborhood (ɛ-ball) of σ. Computing the entropy of these states leads to a local strengthening of the continuity bound of the von Neumann entropy, i.e., the Audenaert-Fannes inequality. Our bound is local in the sense that it depends on the spectrum of σ. The states ρɛ * ( σ ) and ρ * , ɛ (σ) depend only on the geometry of the ɛ-ball and are in fact optimizers for a larger class of entropies. These include the Rényi entropy and the minimum- and maximum-entropies, providing explicit formulas for certain smoothed quantities. This allows us to obtain local continuity bounds for these quantities as well. In obtaining this bound, we first derive a more general result which may be of independent interest, namely, a necessary and sufficient condition under which a state maximizes a concave and Gâteaux-differentiable function in an ɛ-ball around a given state σ. Examples of such a function include the von Neumann entropy and the conditional entropy of bipartite states. Our proofs employ tools from the theory of convex optimization under non-differentiable constraints, in particular Fermat's rule, and majorization theory.

Entropy Generation and Human Aging: Lifespan Entropy and Effect of Physical Activity Level

NASA Astrophysics Data System (ADS)

Silva, Carlos; Annamalai, Kalyan

2008-06-01

The first and second laws of thermodynamics were applied to biochemical reactions typical of human metabolism. An open-system model was used for a human body. Energy conservation, availability and entropy balances were performed to obtain the entropy generated for the main food components. Quantitative results for entropy generation were obtained as a function of age using the databases from the U.S. Food and Nutrition Board (FNB) and Centers for Disease Control and Prevention (CDC), which provide energy requirements and food intake composition as a function of age, weight and stature. Numerical integration was performed through human lifespan for different levels of physical activity. Results were presented and analyzed. Entropy generated over the lifespan of average individuals (natural death) was found to be 11,404 kJ/ºK per kg of body mass with a rate of generation three times higher on infants than on the elderly. The entropy generated predicts a life span of 73.78 and 81.61 years for the average U.S. male and female individuals respectively, which are values that closely match the average lifespan from statistics (74.63 and 80.36 years). From the analysis of the effect of different activity levels, it is shown that entropy generated increases with physical activity, suggesting that exercise should be kept to a “healthy minimum” if entropy generation is to be minimized.

Entropy of spatial network ensembles

NASA Astrophysics Data System (ADS)

Coon, Justin P.; Dettmann, Carl P.; Georgiou, Orestis

2018-04-01

We analyze complexity in spatial network ensembles through the lens of graph entropy. Mathematically, we model a spatial network as a soft random geometric graph, i.e., a graph with two sources of randomness, namely nodes located randomly in space and links formed independently between pairs of nodes with probability given by a specified function (the "pair connection function") of their mutual distance. We consider the general case where randomness arises in node positions as well as pairwise connections (i.e., for a given pair distance, the corresponding edge state is a random variable). Classical random geometric graph and exponential graph models can be recovered in certain limits. We derive a simple bound for the entropy of a spatial network ensemble and calculate the conditional entropy of an ensemble given the node location distribution for hard and soft (probabilistic) pair connection functions. Under this formalism, we derive the connection function that yields maximum entropy under general constraints. Finally, we apply our analytical framework to study two practical examples: ad hoc wireless networks and the US flight network. Through the study of these examples, we illustrate that both exhibit properties that are indicative of nearly maximally entropic ensembles.

A Density Functional Theory Evaluation of Hydrophobic Solvation: Ne, Ar and Kr in a 50-Water Cluster. Implications for the Hydrophobic Effect.

PubMed

Kobko, Nadya; Marianski, Mateusz; Asensio, Amparo; Wieczorek, Robert; Dannenberg, J J

2012-06-15

The physical explanation for the hydrophobic effect has been the subject of disagreement. Physical organic chemists tend to use a explanation related to pressure, while many biochemists prefer an explanation that involves decreased entropy of the aqueous solvent. We present DFT calculations at the B3LYP/6-31G(d,p) and X3LYP/6-31G(d,p) levels on the solvation of three noble gases (Ne, Ar, and Kr) in clusters of 50 waters. Vibrational analyses show no substantial decreases in the vibrational entropies of the waters in any of the three clusters. The observed positive free energies of transfer from the gas phase or from nonpolar solvents to water appear to be due to the work needed to make a suitable hole in the aqueous solvent. We distinguish between hydrophobic solvations (explicitly studied here) and the hydrophobic effect that occurs when a solute (or transition state) can decrease its volume through conformational change (which is not possible for the noble gases).

A Density Functional Theory Evaluation of Hydrophobic Solvation: Ne, Ar and Kr in a 50-Water Cluster. Implications for the Hydrophobic Effect

PubMed Central

Kobko, Nadya; Marianski, Mateusz; Asensio, Amparo; Wieczorek, Robert; Dannenberg, J. J.

2011-01-01

The physical explanation for the hydrophobic effect has been the subject of disagreement. Physical organic chemists tend to use a explanation related to pressure, while many biochemists prefer an explanation that involves decreased entropy of the aqueous solvent. We present DFT calculations at the B3LYP/6-31G(d,p) and X3LYP/6-31G(d,p) levels on the solvation of three noble gases (Ne, Ar, and Kr) in clusters of 50 waters. Vibrational analyses show no substantial decreases in the vibrational entropies of the waters in any of the three clusters. The observed positive free energies of transfer from the gas phase or from nonpolar solvents to water appear to be due to the work needed to make a suitable hole in the aqueous solvent. We distinguish between hydrophobic solvations (explicitly studied here) and the hydrophobic effect that occurs when a solute (or transition state) can decrease its volume through conformational change (which is not possible for the noble gases). PMID:22666658

Complexity of genetic sequences modified by horizontal gene transfer and degraded-DNA uptake

NASA Astrophysics Data System (ADS)

Tremberger, George; Dehipawala, S.; Nguyen, A.; Cheung, E.; Sullivan, R.; Holden, T.; Lieberman, D.; Cheung, T.

2015-09-01

Horizontal gene transfer has been a major vehicle for efficient transfer of genetic materials among living species and could be one of the sources for noncoding DNA incorporation into a genome. Our previous study of lnc- RNA sequence complexity in terms of fractal dimension and information entropy shows a tight regulation among the studied genes in numerous diseases. The role of sequence complexity in horizontal transferred genes was investigated with Mealybug in symbiotic relation with a 139K genome microbe and Deinococcus radiodurans as examples. The fractal dimension and entropy showed correlation R-sq of 0.82 (N = 6) for the studied Deinococcus radiodurans sequences. For comparison the Deinococcus radiodurans oxidative stress tolerant catalase and superoxide dismutase genes under extracellular dGMP growth condition showed R-sq ~ 0.42 (N = 6); and the studied arsenate reductase horizontal transferred genes for toxicity survival in several microorganisms showed no correlation. Simulation results showed that R-sq < 0.4 would be improbable at less than one percent chance, suggestive of additional selection pressure when compared to the R-sq ~ 0.29 (N = 21) in the studied transferred genes in Mealybug. The mild correlation of R-sq ~ 0.5 for fractal dimension versus transcription level in the studied Deinococcus radiodurans sequences upon extracellular dGMP growth condition would suggest that lower fractal dimension with less electron density fluctuation favors higher transcription level.

Simple model of hydrophobic hydration.

PubMed

Lukšič, Miha; Urbic, Tomaz; Hribar-Lee, Barbara; Dill, Ken A

2012-05-31

Water is an unusual liquid in its solvation properties. Here, we model the process of transferring a nonpolar solute into water. Our goal was to capture the physical balance between water's hydrogen bonding and van der Waals interactions in a model that is simple enough to be nearly analytical and not heavily computational. We develop a 2-dimensional Mercedes-Benz-like model of water with which we compute the free energy, enthalpy, entropy, and the heat capacity of transfer as a function of temperature, pressure, and solute size. As validation, we find that this model gives the same trends as Monte Carlo simulations of the underlying 2D model and gives qualitative agreement with experiments. The advantages of this model are that it gives simple insights and that computational time is negligible. It may provide a useful starting point for developing more efficient and more realistic 3D models of aqueous solvation.

Entropy of single-file water in (6,6) carbon nanotubes.

PubMed

Waghe, Aparna; Rasaiah, Jayendran C; Hummer, Gerhard

2012-07-28

We used molecular dynamics simulations to investigate the thermodynamics of filling of a (6,6) open carbon nanotube (diameter D = 0.806 nm) solvated in TIP3P water over a temperature range from 280 K to 320 K at atmospheric pressure. In simulations of tubes with slightly weakened carbon-water attractive interactions, we observed multiple filling and emptying events. From the water occupancy statistics, we directly obtained the free energy of filling, and from its temperature dependence the entropy of filling. We found a negative entropy of about -1.3 k(B) per molecule for filling the nanotube with a hydrogen-bonded single-file chain of water molecules. The entropy of filling is nearly independent of the strength of the attractive carbon-water interactions over the range studied. In contrast, the energy of transfer depends strongly on the carbon-water attraction strength. These results are in good agreement with entropies of about -0.5 k(B) per water molecule obtained from grand-canonical Monte Carlo calculations of water in quasi-infinite tubes in vacuum under periodic boundary conditions. Overall, for realistic carbon-water interactions we expect that at ambient conditions filling of a (6,6) carbon nanotube open to a water reservoir is driven by a favorable decrease in energy, and opposed by a small loss of water entropy.

Multi-Scale Low-Entropy Method for Optimizing the Processing Parameters during Automated Fiber Placement.

PubMed

Han, Zhenyu; Sun, Shouzheng; Fu, Hongya; Fu, Yunzhong

2017-09-03

Automated fiber placement (AFP) process includes a variety of energy forms and multi-scale effects. This contribution proposes a novel multi-scale low-entropy method aiming at optimizing processing parameters in an AFP process, where multi-scale effect, energy consumption, energy utilization efficiency and mechanical properties of micro-system could be taken into account synthetically. Taking a carbon fiber/epoxy prepreg as an example, mechanical properties of macro-meso-scale are obtained by Finite Element Method (FEM). A multi-scale energy transfer model is then established to input the macroscopic results into the microscopic system as its boundary condition, which can communicate with different scales. Furthermore, microscopic characteristics, mainly micro-scale adsorption energy, diffusion coefficient entropy-enthalpy values, are calculated under different processing parameters based on molecular dynamics method. Low-entropy region is then obtained in terms of the interrelation among entropy-enthalpy values, microscopic mechanical properties (interface adsorbability and matrix fluidity) and processing parameters to guarantee better fluidity, stronger adsorption, lower energy consumption and higher energy quality collaboratively. Finally, nine groups of experiments are carried out to verify the validity of the simulation results. The results show that the low-entropy optimization method can reduce void content effectively, and further improve the mechanical properties of laminates.

Thermodynamics of energy, charge, and spin currents in a thermoelectric quantum-dot spin valve

NASA Astrophysics Data System (ADS)

Tang, Gaomin; Thingna, Juzar; Wang, Jian

2018-04-01

We provide a thermodynamically consistent description of energy, charge, and spin transfers in a thermoelectric quantum-dot spin valve in the collinear configuration based on nonequilibrium Green's function and full counting statistics. We use the fluctuation theorem symmetry and the concept of entropy production to characterize the efficiency with which thermal gradients can transduce charges or spins against their chemical potentials, arbitrary far from equilibrium. Close to equilibrium, we recover the Onsager reciprocal relations and the connection to linear response notions of performance such as the figure of merit. We also identify regimes where work extraction is more efficient far then close from equilibrium.

Nonequilibrium Thermodynamics in Biological Systems

NASA Astrophysics Data System (ADS)

Aoki, I.

2005-12-01

1. Respiration Oxygen-uptake by respiration in organisms decomposes macromolecules such as carbohydrate, protein and lipid and liberates chemical energy of high quality, which is then used to chemical reactions and motions of matter in organisms to support lively order in structure and function in organisms. Finally, this chemical energy becomes heat energy of low quality and is discarded to the outside (dissipation function). Accompanying this heat energy, entropy production which inevitably occurs by irreversibility also is discarded to the outside. Dissipation function and entropy production are estimated from data of respiration. 2. Human body From the observed data of respiration (oxygen absorption), the entropy production in human body can be estimated. Entropy production from 0 to 75 years old human has been obtained, and extrapolated to fertilized egg (beginning of human life) and to 120 years old (maximum period of human life). Entropy production show characteristic behavior in human life span : early rapid increase in short growing phase and later slow decrease in long aging phase. It is proposed that this tendency is ubiquitous and constitutes a Principle of Organization in complex biotic systems. 3. Ecological communities From the data of respiration of eighteen aquatic communities, specific (i.e. per biomass) entropy productions are obtained. They show two phase character with respect to trophic diversity : early increase and later decrease with the increase of trophic diversity. The trophic diversity in these aquatic ecosystems is shown to be positively correlated with the degree of eutrophication, and the degree of eutrophication is an "arrow of time" in the hierarchy of aquatic ecosystems. Hence specific entropy production has the two phase: early increase and later decrease with time. 4. Entropy principle for living systems The Second Law of Thermodynamics has been expressed as follows. 1) In isolated systems, entropy increases with time and approaches to a maximum value. This is well-known classical Clausius principle. 2) In open systems near equilibrium entropy production always decreases with time approaching a minimum stationary level. This is the minimum entropy production principle by Prigogine. These two principle are established ones. However, living systems are not isolated and not near to equilibrium. Hence, these two principles can not be applied to living systems. What is entropy principle for living systems? Answer: Entropy production in living systems consists of multi-stages with time: early increasing, later decreasing and/or intermediate stages. This tendency is supported by various living systems.

Information Entropy Production of Maximum Entropy Markov Chains from Spike Trains

NASA Astrophysics Data System (ADS)

Cofré, Rodrigo; Maldonado, Cesar

2018-01-01

We consider the maximum entropy Markov chain inference approach to characterize the collective statistics of neuronal spike trains, focusing on the statistical properties of the inferred model. We review large deviations techniques useful in this context to describe properties of accuracy and convergence in terms of sampling size. We use these results to study the statistical fluctuation of correlations, distinguishability and irreversibility of maximum entropy Markov chains. We illustrate these applications using simple examples where the large deviation rate function is explicitly obtained for maximum entropy models of relevance in this field.

A contour for the entanglement entropies in harmonic lattices

NASA Astrophysics Data System (ADS)

Coser, Andrea; De Nobili, Cristiano; Tonni, Erik

2017-08-01

We construct a contour function for the entanglement entropies in generic harmonic lattices. In one spatial dimension, numerical analysis are performed by considering harmonic chains with either periodic or Dirichlet boundary conditions. In the massless regime and for some configurations where the subsystem is a single interval, the numerical results for the contour function are compared to the inverse of the local weight function which multiplies the energy-momentum tensor in the corresponding entanglement hamiltonian, found through conformal field theory methods, and a good agreement is observed. A numerical analysis of the contour function for the entanglement entropy is performed also in a massless harmonic chain for a subsystem made by two disjoint intervals.

Neural Correlates of Wakefulness, Sleep, and General Anesthesia: An Experimental Study in Rat.

PubMed

Pal, Dinesh; Silverstein, Brian H; Lee, Heonsoo; Mashour, George A

2016-11-01

Significant advances have been made in our understanding of subcortical processes related to anesthetic- and sleep-induced unconsciousness, but the associated changes in cortical connectivity and cortical neurochemistry have yet to be fully clarified. Male Sprague-Dawley rats were instrumented for simultaneous measurement of cortical acetylcholine and electroencephalographic indices of corticocortical connectivity-coherence and symbolic transfer entropy-before, during, and after general anesthesia (propofol, n = 11; sevoflurane, n = 13). In another group of rats (n = 7), these electroencephalographic indices were analyzed during wakefulness, slow wave sleep (SWS), and rapid eye movement (REM) sleep. Compared to wakefulness, anesthetic-induced unconsciousness was characterized by a significant decrease in cortical acetylcholine that recovered to preanesthesia levels during recovery wakefulness. Corticocortical coherence and frontal-parietal symbolic transfer entropy in high γ band (85 to 155 Hz) were decreased during anesthetic-induced unconsciousness and returned to preanesthesia levels during recovery wakefulness. Sleep-wake states showed a state-dependent change in coherence and transfer entropy in high γ bandwidth, which correlated with behavioral arousal: high during wakefulness, low during SWS, and lowest during REM sleep. By contrast, frontal-parietal θ connectivity during sleep-wake states was not correlated with behavioral arousal but showed an association with well-established changes in cortical acetylcholine: high during wakefulness and REM sleep and low during SWS. Corticocortical coherence and frontal-parietal connectivity in high γ bandwidth correlates with behavioral arousal and is not mediated by cholinergic mechanisms, while θ connectivity correlates with cortical acetylcholine levels.

Inferring Weighted Directed Association Network from Multivariate Time Series with a Synthetic Method of Partial Symbolic Transfer Entropy Spectrum and Granger Causality

PubMed Central

Hu, Yanzhu; Ai, Xinbo

2016-01-01

Complex network methodology is very useful for complex system explorer. However, the relationships among variables in complex system are usually not clear. Therefore, inferring association networks among variables from their observed data has been a popular research topic. We propose a synthetic method, named small-shuffle partial symbolic transfer entropy spectrum (SSPSTES), for inferring association network from multivariate time series. The method synthesizes surrogate data, partial symbolic transfer entropy (PSTE) and Granger causality. A proper threshold selection is crucial for common correlation identification methods and it is not easy for users. The proposed method can not only identify the strong correlation without selecting a threshold but also has the ability of correlation quantification, direction identification and temporal relation identification. The method can be divided into three layers, i.e. data layer, model layer and network layer. In the model layer, the method identifies all the possible pair-wise correlation. In the network layer, we introduce a filter algorithm to remove the indirect weak correlation and retain strong correlation. Finally, we build a weighted adjacency matrix, the value of each entry representing the correlation level between pair-wise variables, and then get the weighted directed association network. Two numerical simulated data from linear system and nonlinear system are illustrated to show the steps and performance of the proposed approach. The ability of the proposed method is approved by an application finally. PMID:27832153

Information Entropy Analysis of the H1N1 Genetic Code

NASA Astrophysics Data System (ADS)

Martwick, Andy

2010-03-01

During the current H1N1 pandemic, viral samples are being obtained from large numbers of infected people world-wide and are being sequenced on the NCBI Influenza Virus Resource Database. The information entropy of the sequences was computed from the probability of occurrence of each nucleotide base at every position of each set of sequences using Shannon's definition of information entropy, [ H=∑bpb,2( 1pb ) ] where H is the observed information entropy at each nucleotide position and pb is the probability of the base pair of the nucleotides A, C, G, U. Information entropy of the current H1N1 pandemic is compared to reference human and swine H1N1 entropy. As expected, the current H1N1 entropy is in a low entropy state and has a very large mutation potential. Using the entropy method in mature genes we can identify low entropy regions of nucleotides that generally correlate to critical protein function.

Multiwavelet packet entropy and its application in transmission line fault recognition and classification.

PubMed

Liu, Zhigang; Han, Zhiwei; Zhang, Yang; Zhang, Qiaoge

2014-11-01

Multiwavelets possess better properties than traditional wavelets. Multiwavelet packet transformation has more high-frequency information. Spectral entropy can be applied as an analysis index to the complexity or uncertainty of a signal. This paper tries to define four multiwavelet packet entropies to extract the features of different transmission line faults, and uses a radial basis function (RBF) neural network to recognize and classify 10 fault types of power transmission lines. First, the preprocessing and postprocessing problems of multiwavelets are presented. Shannon entropy and Tsallis entropy are introduced, and their difference is discussed. Second, multiwavelet packet energy entropy, time entropy, Shannon singular entropy, and Tsallis singular entropy are defined as the feature extraction methods of transmission line fault signals. Third, the plan of transmission line fault recognition using multiwavelet packet entropies and an RBF neural network is proposed. Finally, the experimental results show that the plan with the four multiwavelet packet energy entropies defined in this paper achieves better performance in fault recognition. The performance with SA4 (symmetric antisymmetric) multiwavelet packet Tsallis singular entropy is the best among the combinations of different multiwavelet packets and the four multiwavelet packet entropies.

Finite entanglement entropy of black holes

NASA Astrophysics Data System (ADS)

Giaccari, Stefano; Modesto, Leonardo; Rachwał, Lesław; Zhu, Yiwei

2018-06-01

We compute the area term contribution to black holes' entanglement entropy (using the conical technique) for a class of local or weakly non-local super-renormalizable gravitational theories coupled to matter. For the first time, we explicitly prove that all the beta functions in the proposed theory, except for the cosmological constant, are identically zero in cut-off regularization scheme and not only in dimensional regularization scheme. In particular, we show that there is no divergence quadratic in cut-off and hence there is no contribution to the beta function of the Newton constant. As a consequence of this result, we argue that in these theories of gravity conical entropy is a sensible definition of physical entropy, in particular, it is positive-definite and gauge independent. On top of this the conical entropy, being expressed only in terms of the classical Newton constant, turns out to be finite and naturally coincides with Bekenstein-Hawking entropy. Finally, we propose a theory in which the renormalization of the Newton constant is entirely due to the Standard Model matter, arguing that such a contribution does not give the usual interpretational problems of conical entropy discussed in the literature.

Electroencephalogram–Electromyography Coupling Analysis in Stroke Based on Symbolic Transfer Entropy

PubMed Central

Gao, Yunyuan; Ren, Leilei; Li, Rihui; Zhang, Yingchun

2018-01-01

The coupling strength between electroencephalogram (EEG) and electromyography (EMG) signals during motion control reflects the interaction between the cerebral motor cortex and muscles. Therefore, neuromuscular coupling characterization is instructive in assessing motor function. In this study, to overcome the limitation of losing the characteristics of signals in conventional time series symbolization methods, a variable scale symbolic transfer entropy (VS-STE) analysis approach was proposed for corticomuscular coupling evaluation. Post-stroke patients (n = 5) and healthy volunteers (n = 7) were recruited and participated in various tasks (left and right hand gripping, elbow bending). The proposed VS-STE was employed to evaluate the corticomuscular coupling strength between the EEG signal measured from the motor cortex and EMG signal measured from the upper limb in both the time-domain and frequency-domain. Results showed a greater strength of the bi-directional (EEG-to-EMG and EMG-to-EEG) VS-STE in post-stroke patients compared to healthy controls. In addition, the strongest EEG–EMG coupling strength was observed in the beta frequency band (15–35 Hz) during the upper limb movement. The predefined coupling strength of EMG-to-EEG in the affected side of the patient was larger than that of EEG-to-EMG. In conclusion, the results suggested that the corticomuscular coupling is bi-directional, and the proposed VS-STE can be used to quantitatively characterize the non-linear synchronization characteristics and information interaction between the primary motor cortex and muscles. PMID:29354091

Functional Connectivity of Precipitation Networks in the Brazilian Rainforest-Savanna Transition Zone

NASA Astrophysics Data System (ADS)

Adera, S.; Larsen, L.; Levy, M. C.; Thompson, S. E.

2016-12-01

In the Brazilian rainforest-savanna transition zone, vegetation change has the potential to significantly affect precipitation patterns. Deforestation, in particular, can affect precipitation patterns by increasing land surface albedo, increasing aerosol loading to the atmosphere, changing land surface roughness, and reducing transpiration. Understanding land surface-precipitation couplings in this region is important not only for sustaining Amazon and Cerrado ecosystems, but also for cattle ranching and agriculture, hydropower generation, and drinking water management. Simulations suggest complex, scale-dependent interactions between precipitation and land cover. For example, the size and distribution of deforested patches has been found to affect precipitation patterns. We take an empirical approach to ask: (1) what are the dominant spatial and temporal length scales of precipitation coupling in the Brazilian rainforest-savanna transition zone? (2) How do these length scales change over time? (3) How does the connectivity of precipitation change over time? The answers to these questions will help address fundamental questions about the impacts of deforestation on precipitation. We use rain gauge data from 1100 rain gauges intermittently covering the period 1980 - 2013, a period of intensive land cover change in the region. The dominant spatial and temporal length scales of precipitation coupling are resolved using transfer entropy, a metric from information theory. Connectivity of the emergent network of couplings is quantified using network statistics. Analyses using transfer entropy and network statistics reveal the spatial and temporal interdependencies of rainfall events occurring in different parts of the study domain.

Mathematical model for thermal and entropy analysis of thermal solar collectors by using Maxwell nanofluids with slip conditions, thermal radiation and variable thermal conductivity

NASA Astrophysics Data System (ADS)

Aziz, Asim; Jamshed, Wasim; Aziz, Taha

2018-04-01

In the present research a simplified mathematical model for the solar thermal collectors is considered in the form of non-uniform unsteady stretching surface. The non-Newtonian Maxwell nanofluid model is utilized for the working fluid along with slip and convective boundary conditions and comprehensive analysis of entropy generation in the system is also observed. The effect of thermal radiation and variable thermal conductivity are also included in the present model. The mathematical formulation is carried out through a boundary layer approach and the numerical computations are carried out for Cu-water and TiO2-water nanofluids. Results are presented for the velocity, temperature and entropy generation profiles, skin friction coefficient and Nusselt number. The discussion is concluded on the effect of various governing parameters on the motion, temperature variation, entropy generation, velocity gradient and the rate of heat transfer at the boundary.

Role of information theoretic uncertainty relations in quantum theory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jizba, Petr, E-mail: p.jizba@fjfi.cvut.cz; ITP, Freie Universität Berlin, Arnimallee 14, D-14195 Berlin; Dunningham, Jacob A., E-mail: J.Dunningham@sussex.ac.uk

2015-04-15

Uncertainty relations based on information theory for both discrete and continuous distribution functions are briefly reviewed. We extend these results to account for (differential) Rényi entropy and its related entropy power. This allows us to find a new class of information-theoretic uncertainty relations (ITURs). The potency of such uncertainty relations in quantum mechanics is illustrated with a simple two-energy-level model where they outperform both the usual Robertson–Schrödinger uncertainty relation and Shannon entropy based uncertainty relation. In the continuous case the ensuing entropy power uncertainty relations are discussed in the context of heavy tailed wave functions and Schrödinger cat states. Again,more » improvement over both the Robertson–Schrödinger uncertainty principle and Shannon ITUR is demonstrated in these cases. Further salient issues such as the proof of a generalized entropy power inequality and a geometric picture of information-theoretic uncertainty relations are also discussed.« less

A pairwise maximum entropy model accurately describes resting-state human brain networks

PubMed Central

Watanabe, Takamitsu; Hirose, Satoshi; Wada, Hiroyuki; Imai, Yoshio; Machida, Toru; Shirouzu, Ichiro; Konishi, Seiki; Miyashita, Yasushi; Masuda, Naoki

2013-01-01

The resting-state human brain networks underlie fundamental cognitive functions and consist of complex interactions among brain regions. However, the level of complexity of the resting-state networks has not been quantified, which has prevented comprehensive descriptions of the brain activity as an integrative system. Here, we address this issue by demonstrating that a pairwise maximum entropy model, which takes into account region-specific activity rates and pairwise interactions, can be robustly and accurately fitted to resting-state human brain activities obtained by functional magnetic resonance imaging. Furthermore, to validate the approximation of the resting-state networks by the pairwise maximum entropy model, we show that the functional interactions estimated by the pairwise maximum entropy model reflect anatomical connexions more accurately than the conventional functional connectivity method. These findings indicate that a relatively simple statistical model not only captures the structure of the resting-state networks but also provides a possible method to derive physiological information about various large-scale brain networks. PMID:23340410

Conditional Self-Entropy and Conditional Joint Transfer Entropy in Heart Period Variability during Graded Postural Challenge.

PubMed

Porta, Alberto; Faes, Luca; Nollo, Giandomenico; Bari, Vlasta; Marchi, Andrea; De Maria, Beatrice; Takahashi, Anielle C M; Catai, Aparecida M

2015-01-01

Self-entropy (SE) and transfer entropy (TE) are widely utilized in biomedical signal processing to assess the information stored into a system and transferred from a source to a destination respectively. The study proposes a more specific definition of the SE, namely the conditional SE (CSE), and a more flexible definition of the TE based on joint TE (JTE), namely the conditional JTE (CJTE), for the analysis of information dynamics in multivariate time series. In a protocol evoking a gradual sympathetic activation and vagal withdrawal proportional to the magnitude of the orthostatic stimulus, such as the graded head-up tilt, we extracted the beat-to-beat spontaneous variability of heart period (HP), systolic arterial pressure (SAP) and respiratory activity (R) in 19 healthy subjects and we computed SE of HP, CSE of HP given SAP and R, JTE from SAP and R to HP, CJTE from SAP and R to HP given SAP and CJTE from SAP and R to HP given R. CSE of HP given SAP and R was significantly smaller than SE of HP and increased progressively with the amplitude of the stimulus, thus suggesting that dynamics internal to HP and unrelated to SAP and R, possibly linked to sympathetic activation evoked by head-up tilt, might play a role during the orthostatic challenge. While JTE from SAP and R to HP was independent of tilt table angle, CJTE from SAP and R to HP given R and from SAP and R to HP given SAP showed opposite trends with tilt table inclination, thus suggesting that the importance of the cardiac baroreflex increases and the relevance of the cardiopulmonary pathway decreases during head-up tilt. The study demonstrates the high specificity of CSE and the high flexibility of CJTE over real data and proves that they are particularly helpful in disentangling physiological mechanisms and in assessing their different contributions to the overall cardiovascular regulation.

From atomic structure to excess entropy: a neutron diffraction and density functional theory study of CaO-Al2O3-SiO2 melts

NASA Astrophysics Data System (ADS)

Liu, Maoyuan; Jacob, Aurélie; Schmetterer, Clemens; Masset, Patrick J.; Hennet, Louis; Fischer, Henry E.; Kozaily, Jad; Jahn, Sandro; Gray-Weale, Angus

2016-04-01

Calcium aluminosilicate \\text{CaO}-\\text{A}{{\\text{l}}2}{{\\text{O}}3}-\\text{Si}{{\\text{O}}2} (CAS) melts with compositions {{≤ft(\\text{CaO}-\\text{Si}{{\\text{O}}2}\\right)}x}{{≤ft(\\text{A}{{\\text{l}}2}{{\\text{O}}3}\\right)}1-x} for x  <  0.5 and {{≤ft(\\text{A}{{\\text{l}}2}{{\\text{O}}3}\\right)}x}{{≤ft(\\text{Si}{{\\text{O}}2}\\right)}1-x} for x≥slant 0.5 are studied using neutron diffraction with aerodynamic levitation and density functional theory molecular dynamics modelling. Simulated structure factors are found to be in good agreement with experimental structure factors. Local atomic structures from simulations reveal the role of calcium cations as a network modifier, and aluminium cations as a non-tetrahedral network former. Distributions of tetrahedral order show that an increasing concentration of the network former Al increases entropy, while an increasing concentration of the network modifier Ca decreases entropy. This trend is opposite to the conventional understanding that increasing amounts of network former should increase order in the network liquid, and so decrease entropy. The two-body correlation entropy S 2 is found to not correlate with the excess entropy values obtained from thermochemical databases, while entropies including higher-order correlations such as tetrahedral order, O-M-O or M-O-M bond angles and Q N environments show a clear linear correlation between computed entropy and database excess entropy. The possible relationship between atomic structures and excess entropy is discussed.

Holographic calculation for large interval Rényi entropy at high temperature

NASA Astrophysics Data System (ADS)

Chen, Bin; Wu, Jie-qiang

2015-11-01

In this paper, we study the holographic Rényi entropy of a large interval on a circle at high temperature for the two-dimensional conformal field theory (CFT) dual to pure AdS3 gravity. In the field theory, the Rényi entropy is encoded in the CFT partition function on n -sheeted torus connected with each other by a large branch cut. As proposed by Chen and Wu [Large interval limit of Rényi entropy at high temperature, arXiv:1412.0763], the effective way to read the entropy in the large interval limit is to insert a complete set of state bases of the twist sector at the branch cut. Then the calculation transforms into an expansion of four-point functions in the twist sector with respect to e-2/π T R n . By using the operator product expansion of the twist operators at the branch points, we read the first few terms of the Rényi entropy, including the leading and next-to-leading contributions in the large central charge limit. Moreover, we show that the leading contribution is actually captured by the twist vacuum module. In this case by the Ward identity the four-point functions can be derived from the correlation function of four twist operators, which is related to double interval entanglement entropy. Holographically, we apply the recipe in [T. Faulkner, The entanglement Rényi entropies of disjoint intervals in AdS/CFT, arXiv:1303.7221] and [T. Barrella et al., Holographic entanglement beyond classical gravity, J. High Energy Phys. 09 (2013) 109] to compute the classical Rényi entropy and its one-loop quantum correction, after imposing a new set of monodromy conditions. The holographic classical result matches exactly with the leading contribution in the field theory up to e-4 π T R and l6, while the holographical one-loop contribution is in exact agreement with next-to-leading results in field theory up to e-6/π T R n and l4 as well.

Entanglement entropy of critical spin liquids.

PubMed

Zhang, Yi; Grover, Tarun; Vishwanath, Ashvin

2011-08-05

Quantum spin liquids are phases of matter whose internal structure is not captured by a local order parameter. Particularly intriguing are critical spin liquids, where strongly interacting excitations control low energy properties. Here we calculate their bipartite entanglement entropy that characterizes their quantum structure. In particular we calculate the Renyi entropy S(2) on model wave functions obtained by Gutzwiller projection of a Fermi sea. Although the wave functions are not sign positive, S(2) can be calculated on relatively large systems (>324 spins) using the variational Monte Carlo technique. On the triangular lattice we find that entanglement entropy of the projected Fermi sea state violates the boundary law, with S(2) enhanced by a logarithmic factor. This is an unusual result for a bosonic wave function reflecting the presence of emergent fermions. These techniques can be extended to study a wide class of other phases.

Symmetry for the duration of entropy-consuming intervals.

PubMed

García-García, Reinaldo; Domínguez, Daniel

2014-05-01

We introduce the violation fraction υ as the cumulative fraction of time that a mesoscopic system spends consuming entropy at a single trajectory in phase space. We show that the fluctuations of this quantity are described in terms of a symmetry relation reminiscent of fluctuation theorems, which involve a function Φ, which can be interpreted as an entropy associated with the fluctuations of the violation fraction. The function Φ, when evaluated for arbitrary stochastic realizations of the violation fraction, is odd upon the symmetry transformations that are relevant for the associated stochastic entropy production. This fact leads to a detailed fluctuation theorem for the probability density function of Φ. We study the steady-state limit of this symmetry in the paradigmatic case of a colloidal particle dragged by optical tweezers through an aqueous solution. Finally, we briefly discuss possible applications of our results for the estimation of free-energy differences from single-molecule experiments.

Analyzing the financial crisis using the entropy density function

NASA Astrophysics Data System (ADS)

Oh, Gabjin; Kim, Ho-yong; Ahn, Seok-Won; Kwak, Wooseop

2015-02-01

The risk that is created by nonlinear interactions among subjects in economic systems is assumed to increase during an abnormal state of a financial market. Nevertheless, investigating the systemic risk in financial markets following the global financial crisis is not sufficient. In this paper, we analyze the entropy density function in the return time series for several financial markets, such as the S&P500, KOSPI, and DAX indices, from October 2002 to December 2011 and analyze the variability in the entropy value over time. We find that the entropy density function of the S&P500 index during the subprime crisis exhibits a significant decrease compared to that in other periods, whereas the other markets, such as those in Germany and Korea, exhibit no significant decrease during the market crisis. These findings demonstrate that the S&P500 index generated a regular pattern in the return time series during the financial crisis.

Metriplectic simulated annealing for quasigeostrophic flow

NASA Astrophysics Data System (ADS)

Morrison, P. J.; Flierl, G. R.

2016-11-01

Metriplectic dynamics is a general form for dynamical systems that embodies the first and second laws of thermodynamics, energy conservation and entropy production. The formalism provides an H-theorem for relaxation to nontrivial equilibrium states. Upon choosing enstrophy as entropy and potential vorticity of the form q =∇2 Ψ + T (x) , recent results of computations, akin to those of, will be described for various topography functions T (x) , including ridge (T = exp (-x2 / 2)) and random functions. Interpretation of the results, in particular their sensitivity to the chosen entropy function will be discussed. PJM supported by U.S. Dept. of Energy Contract # DE-FG05-80ET-53088.

Thermal performance of plate fin heat sink cooled by air slot impinging jet with different cross-sectional area

NASA Astrophysics Data System (ADS)

Mesalhy, O. M.; El-Sayed, Mostafa M.

2015-06-01

Flow and heat transfer characteristics of a plate-fin heat sink cooled by a rectangular impinging jet with different cross-sectional area were studied experimentally and numerically. The study concentrated on investigating the effect of jet width, fin numbers, and fin heights on thermal performance. Entropy generation minimization method was used to define the optimum design and operating conditions. It is found that, the jet width that minimizes entropy generation changes with heat sink height and fin numbers.

Interictal cardiorespiratory variability in temporal lobe and absence epilepsy in childhood.

PubMed

Varon, Carolina; Montalto, Alessandro; Jansen, Katrien; Lagae, Lieven; Marinazzo, Daniele; Faes, Luca; Van Huffel, Sabine

2015-04-01

It is well known that epilepsy has a profound effect on the autonomic nervous system, especially on the autonomic control of heart rate and respiration. This effect has been widely studied during seizure activity, but less attention has been given to interictal (i.e. seizure-free) activity. The studies that have been done on this topic, showed that heart rate and respiration can be affected individually, even without the occurrence of seizures. In this work, the interactions between these two individual physiological variables are analysed during interictal activity in temporal lobe and absence epilepsy in childhood. These interactions are assessed by decomposing the predictive information about heart rate variability, into different components like the transfer entropy, cross-entropy, self- entropy and the conditional self entropy. Each one of these components quantifies different types of shared information. However, when using the cross-entropy and the conditional self entropy, it is possible to split the information carried by the heart rate, into two main components, one related to respiration and one related to different mechanisms, like sympathetic activation. This can be done after assuming a directional link going from respiration to heart rate. After analysing all the entropy components, it is shown that in subjects with absence epilepsy the information shared by respiration and heart rate is significantly lower than for normal subjects. And a more remarkable finding indicates that this type of epilepsy seems to have a long term effect on the cardiac and respiratory control mechanisms of the autonomic nervous system.

The Law of Entropy Increase - A Lab Experiment

NASA Astrophysics Data System (ADS)

Dittrich, William; Drosd, Robert; Minkin, Leonid; Shapovalov, Alexander S.

2016-09-01

The second law of thermodynamics has various formulations. There is the "Clausius formulation," which can be stated in a very intuitive way: "No process is possible whose sole result is the transfer of heat from a cooler to a hotter body." There is also the "Kelvin-Plank principle," which states that "no cyclic process exists whose sole result is the absorption of heat from a reservoir and the conversion of all this heat into work" [emphasis added] (since this would require perfect energy conversion efficiency). Both these statements can be presented to physics students in a conceptual manner, and students' "everyday" experiences will support either statement of the second law of thermodynamics. However, when the second law of thermodynamics is expressed using the concept of entropy (ΔS ≥ 0, for a closed system), most first-year physics students lack any direct experimental experience with this parameter. This paper describes a calculation of the increase in entropy that can be performed while completing three traditional thermodynamics experiments. These simple and quick calculations help students become familiar and comfortable with the concept of entropy. This paper is complementary to prior work where classroom activities were developed to provide insight into the statistical nature of entropy.

Discrete-time entropy formulation of optimal and adaptive control problems

NASA Technical Reports Server (NTRS)

Tsai, Yweting A.; Casiello, Francisco A.; Loparo, Kenneth A.

1992-01-01

The discrete-time version of the entropy formulation of optimal control of problems developed by G. N. Saridis (1988) is discussed. Given a dynamical system, the uncertainty in the selection of the control is characterized by the probability distribution (density) function which maximizes the total entropy. The equivalence between the optimal control problem and the optimal entropy problem is established, and the total entropy is decomposed into a term associated with the certainty equivalent control law, the entropy of estimation, and the so-called equivocation of the active transmission of information from the controller to the estimator. This provides a useful framework for studying the certainty equivalent and adaptive control laws.

Global sensitivity analysis for fuzzy inputs based on the decomposition of fuzzy output entropy

NASA Astrophysics Data System (ADS)

Shi, Yan; Lu, Zhenzhou; Zhou, Yicheng

2018-06-01

To analyse the component of fuzzy output entropy, a decomposition method of fuzzy output entropy is first presented. After the decomposition of fuzzy output entropy, the total fuzzy output entropy can be expressed as the sum of the component fuzzy entropy contributed by fuzzy inputs. Based on the decomposition of fuzzy output entropy, a new global sensitivity analysis model is established for measuring the effects of uncertainties of fuzzy inputs on the output. The global sensitivity analysis model can not only tell the importance of fuzzy inputs but also simultaneously reflect the structural composition of the response function to a certain degree. Several examples illustrate the validity of the proposed global sensitivity analysis, which is a significant reference in engineering design and optimization of structural systems.

Symmetric polynomials in information theory: Entropy and subentropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jozsa, Richard; Mitchison, Graeme

2015-06-15

Entropy and other fundamental quantities of information theory are customarily expressed and manipulated as functions of probabilities. Here we study the entropy H and subentropy Q as functions of the elementary symmetric polynomials in the probabilities and reveal a series of remarkable properties. Derivatives of all orders are shown to satisfy a complete monotonicity property. H and Q themselves become multivariate Bernstein functions and we derive the density functions of their Levy-Khintchine representations. We also show that H and Q are Pick functions in each symmetric polynomial variable separately. Furthermore, we see that H and the intrinsically quantum informational quantitymore » Q become surprisingly closely related in functional form, suggesting a special significance for the symmetric polynomials in quantum information theory. Using the symmetric polynomials, we also derive a series of further properties of H and Q.« less

Entropy-based financial asset pricing.

PubMed

Ormos, Mihály; Zibriczky, Dávid

2014-01-01

We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative measure of risk. Our results show that entropy decreases in the function of the number of securities involved in a portfolio in a similar way to the standard deviation, and that efficient portfolios are situated on a hyperbola in the expected return-entropy system. For empirical investigation we use daily returns of 150 randomly selected securities for a period of 27 years. Our regression results show that entropy has a higher explanatory power for the expected return than the capital asset pricing model beta. Furthermore we show the time varying behavior of the beta along with entropy.

Entropy-Based Financial Asset Pricing

PubMed Central

Ormos, Mihály; Zibriczky, Dávid

2014-01-01

We investigate entropy as a financial risk measure. Entropy explains the equity premium of securities and portfolios in a simpler way and, at the same time, with higher explanatory power than the beta parameter of the capital asset pricing model. For asset pricing we define the continuous entropy as an alternative measure of risk. Our results show that entropy decreases in the function of the number of securities involved in a portfolio in a similar way to the standard deviation, and that efficient portfolios are situated on a hyperbola in the expected return – entropy system. For empirical investigation we use daily returns of 150 randomly selected securities for a period of 27 years. Our regression results show that entropy has a higher explanatory power for the expected return than the capital asset pricing model beta. Furthermore we show the time varying behavior of the beta along with entropy. PMID:25545668

Entropy Generation Across Earth's Bow Shock

NASA Technical Reports Server (NTRS)

Parks, George K.; McCarthy, Michael; Fu, Suiyan; Lee E. s; Cao, Jinbin; Goldstein, Melvyn L.; Canu, Patrick; Dandouras, Iannis S.; Reme, Henri; Fazakerley, Andrew;

Nonparametric entropy estimation using kernel densities.

PubMed

Lake, Douglas E

2009-01-01

The entropy of experimental data from the biological and medical sciences provides additional information over summary statistics. Calculating entropy involves estimates of probability density functions, which can be effectively accomplished using kernel density methods. Kernel density estimation has been widely studied and a univariate implementation is readily available in MATLAB. The traditional definition of Shannon entropy is part of a larger family of statistics, called Renyi entropy, which are useful in applications that require a measure of the Gaussianity of data. Of particular note is the quadratic entropy which is related to the Friedman-Tukey (FT) index, a widely used measure in the statistical community. One application where quadratic entropy is very useful is the detection of abnormal cardiac rhythms, such as atrial fibrillation (AF). Asymptotic and exact small-sample results for optimal bandwidth and kernel selection to estimate the FT index are presented and lead to improved methods for entropy estimation.

Local entanglement entropy of fermions as a marker of quantum phase transition in the one-dimensional Hubbard model

NASA Astrophysics Data System (ADS)

Cha, Min-Chul; Chung, Myung-Hoon

2018-05-01

We study quantum phase transition of interacting fermions by measuring the local entanglement entropy in the one-dimensional Hubbard model. The reduced density matrices for blocks of a few sites are constructed from the ground state wave function in infinite systems by adopting the matrix product state representation where time-evolving block decimations are performed to obtain the lowest energy states. The local entanglement entropy, constructed from the reduced density matrices, as a function of the chemical potential shows clear signatures of the Mott transition. The value of the central charge, numerically determined from the universal properties of the local entanglement entropy, confirms that the transition is caused by the suppression of the charge degrees of freedom.

Logarithmic corrections to entropy of magnetically charged AdS4 black holes

NASA Astrophysics Data System (ADS)

Jeon, Imtak; Lal, Shailesh

2017-11-01

Logarithmic terms are quantum corrections to black hole entropy determined completely from classical data, thus providing a strong check for candidate theories of quantum gravity purely from physics in the infrared. We compute these terms in the entropy associated to the horizon of a magnetically charged extremal black hole in AdS4×S7 using the quantum entropy function and discuss the possibility of matching against recently derived microscopic expressions.

Diffusivity anomaly in modified Stillinger-Weber liquids

NASA Astrophysics Data System (ADS)

Sengupta, Shiladitya; Vasisht, Vishwas V.; Sastry, Srikanth

2014-01-01

By modifying the tetrahedrality (the strength of the three body interactions) in the well-known Stillinger-Weber model for silicon, we study the diffusivity of a series of model liquids as a function of tetrahedrality and temperature at fixed pressure. Previous work has shown that at constant temperature, the diffusivity exhibits a maximum as a function of tetrahedrality, which we refer to as the diffusivity anomaly, in analogy with the well-known anomaly in water upon variation of pressure at constant temperature. We explore to what extent the structural and thermodynamic changes accompanying changes in the interaction potential can help rationalize the diffusivity anomaly, by employing the Rosenfeld relation between diffusivity and the excess entropy (over the ideal gas reference value), and the pair correlation entropy, which provides an approximation to the excess entropy in terms of the pair correlation function. We find that in the modified Stillinger-Weber liquids, the Rosenfeld relation works well above the melting temperatures but exhibits deviations below, with the deviations becoming smaller for smaller tetrahedrality. Further we find that both the excess entropy and the pair correlation entropy at constant temperature go through maxima as a function of the tetrahedrality, thus demonstrating the close relationship between structural, thermodynamic, and dynamical anomalies in the modified Stillinger-Weber liquids.

Establishing non-Abelian topological order in Gutzwiller-projected Chern insulators via entanglement entropy and modular S-matrix

NASA Astrophysics Data System (ADS)

Zhang, Yi; Vishwanath, Ashvin

2013-04-01

We use entanglement entropy signatures to establish non-Abelian topological order in projected Chern-insulator wave functions. The simplest instance is obtained by Gutzwiller projecting a filled band with Chern number C=2, whose wave function may also be viewed as the square of the Slater determinant of a band insulator. We demonstrate that this wave function is captured by the SU(2)2 Chern-Simons theory coupled to fermions. This is established most persuasively by calculating the modular S-matrix from the candidate ground-state wave functions, following a recent entanglement-entropy-based approach. This directly demonstrates the peculiar non-Abelian braiding statistics of Majorana fermion quasiparticles in this state. We also provide microscopic evidence for the field theoretic generalization, that the Nth power of a Chern number C Slater determinant realizes the topological order of the SU(N)C Chern-Simons theory coupled to fermions, by studying the SU(2)3 (Read-Rezayi-type state) and the SU(3)2 wave functions. An advantage of our projected Chern-insulator wave functions is the relative ease with which physical properties, such as entanglement entropy and modular S-matrix, can be numerically calculated using Monte Carlo techniques.

Exploring the Function Space of Deep-Learning Machines

NASA Astrophysics Data System (ADS)

Li, Bo; Saad, David

2018-06-01

The function space of deep-learning machines is investigated by studying growth in the entropy of functions of a given error with respect to a reference function, realized by a deep-learning machine. Using physics-inspired methods we study both sparsely and densely connected architectures to discover a layerwise convergence of candidate functions, marked by a corresponding reduction in entropy when approaching the reference function, gain insight into the importance of having a large number of layers, and observe phase transitions as the error increases.

Deep inelastic scattering as a probe of entanglement

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kharzeev, Dmitri E.; Levin, Eugene M.

Using nonlinear evolution equations of QCD, we compute the von Neumann entropy of the system of partons resolved by deep inelastic scattering at a given Bjorken x and momentum transfer q 2 = - Q 2 . We interpret the result as the entropy of entanglement between the spatial region probed by deep inelastic scattering and the rest of the proton. At small x the relation between the entanglement entropy S ( x ) and the parton distribution x G ( x ) becomes very simple: S ( x ) = ln [ x G ( x ) ] .more » In this small x , large rapidity Y regime, all partonic microstates have equal probabilities—the proton is composed by an exponentially large number exp ( Δ Y ) of microstates that occur with equal and exponentially small probabilities exp ( - Δ Y ) , where Δ is defined by x G ( x ) ~ 1 / x Δ . For this equipartitioned state, the entanglement entropy is maximal—so at small x , deep inelastic scattering probes a maximally entangled state. Here, we propose the entanglement entropy as an observable that can be studied in deep inelastic scattering. This will then require event-by-event measurements of hadronic final states, and would allow to study the transformation of entanglement entropy into the Boltzmann one. We estimate that the proton is represented by the maximally entangled state at x ≤ 10 -3 ; this kinematic region will be amenable to studies at the Electron Ion Collider.« less

Deep inelastic scattering as a probe of entanglement

DOE PAGES

Kharzeev, Dmitri E.; Levin, Eugene M.

2017-06-03

Using nonlinear evolution equations of QCD, we compute the von Neumann entropy of the system of partons resolved by deep inelastic scattering at a given Bjorken x and momentum transfer q 2 = - Q 2 . We interpret the result as the entropy of entanglement between the spatial region probed by deep inelastic scattering and the rest of the proton. At small x the relation between the entanglement entropy S ( x ) and the parton distribution x G ( x ) becomes very simple: S ( x ) = ln [ x G ( x ) ] .more » In this small x , large rapidity Y regime, all partonic microstates have equal probabilities—the proton is composed by an exponentially large number exp ( Δ Y ) of microstates that occur with equal and exponentially small probabilities exp ( - Δ Y ) , where Δ is defined by x G ( x ) ~ 1 / x Δ . For this equipartitioned state, the entanglement entropy is maximal—so at small x , deep inelastic scattering probes a maximally entangled state. Here, we propose the entanglement entropy as an observable that can be studied in deep inelastic scattering. This will then require event-by-event measurements of hadronic final states, and would allow to study the transformation of entanglement entropy into the Boltzmann one. We estimate that the proton is represented by the maximally entangled state at x ≤ 10 -3 ; this kinematic region will be amenable to studies at the Electron Ion Collider.« less

Efficient and Adaptive Methods for Computing Accurate Potential Surfaces for Quantum Nuclear Effects: Applications to Hydrogen-Transfer Reactions.

PubMed

DeGregorio, Nicole; Iyengar, Srinivasan S

2018-01-09

We present two sampling measures to gauge critical regions of potential energy surfaces. These sampling measures employ (a) the instantaneous quantum wavepacket density, an approximation to the (b) potential surface, its (c) gradients, and (d) a Shannon information theory based expression that estimates the local entropy associated with the quantum wavepacket. These four criteria together enable a directed sampling of potential surfaces that appears to correctly describe the local oscillation frequencies, or the local Nyquist frequency, of a potential surface. The sampling functions are then utilized to derive a tessellation scheme that discretizes the multidimensional space to enable efficient sampling of potential surfaces. The sampled potential surface is then combined with four different interpolation procedures, namely, (a) local Hermite curve interpolation, (b) low-pass filtered Lagrange interpolation, (c) the monomial symmetrization approximation (MSA) developed by Bowman and co-workers, and (d) a modified Shepard algorithm. The sampling procedure and the fitting schemes are used to compute (a) potential surfaces in highly anharmonic hydrogen-bonded systems and (b) study hydrogen-transfer reactions in biogenic volatile organic compounds (isoprene) where the transferring hydrogen atom is found to demonstrate critical quantum nuclear effects. In the case of isoprene, the algorithm discussed here is used to derive multidimensional potential surfaces along a hydrogen-transfer reaction path to gauge the effect of quantum-nuclear degrees of freedom on the hydrogen-transfer process. Based on the decreased computational effort, facilitated by the optimal sampling of the potential surfaces through the use of sampling functions discussed here, and the accuracy of the associated potential surfaces, we believe the method will find great utility in the study of quantum nuclear dynamics problems, of which application to hydrogen-transfer reactions and hydrogen-bonded systems is demonstrated here.

An entropy-based statistic for genomewide association studies.

PubMed

Zhao, Jinying; Boerwinkle, Eric; Xiong, Momiao

2005-07-01

Efficient genotyping methods and the availability of a large collection of single-nucleotide polymorphisms provide valuable tools for genetic studies of human disease. The standard chi2 statistic for case-control studies, which uses a linear function of allele frequencies, has limited power when the number of marker loci is large. We introduce a novel test statistic for genetic association studies that uses Shannon entropy and a nonlinear function of allele frequencies to amplify the differences in allele and haplotype frequencies to maintain statistical power with large numbers of marker loci. We investigate the relationship between the entropy-based test statistic and the standard chi2 statistic and show that, in most cases, the power of the entropy-based statistic is greater than that of the standard chi2 statistic. The distribution of the entropy-based statistic and the type I error rates are validated using simulation studies. Finally, we apply the new entropy-based test statistic to two real data sets, one for the COMT gene and schizophrenia and one for the MMP-2 gene and esophageal carcinoma, to evaluate the performance of the new method for genetic association studies. The results show that the entropy-based statistic obtained smaller P values than did the standard chi2 statistic.

Magnetization and isothermal magnetic entropy change of a mixed spin-1 and spin-2 Heisenberg superlattice

NASA Astrophysics Data System (ADS)

Xu, Ping; Du, An

2017-09-01

A superlattice composed of spin-1 and spin-2 with ABAB … structure was described with Heisenberg model. The magnetizations and magnetic entropy changes under different magnetic fields were calculated by the Green's function method. The magnetization compensation phenomenon could be observed by altering the intralayer exchange interactions and the single-ion anisotropies of spins. Along with the temperature increasing, the system in the absence of magnetization compensation shows normal magnetic entropy change and displays a peak near the critical temperature, and yet the system with magnetization compensation shows normal magnetic entropy change near the compensation temperature but inverse magnetic entropy change near the critical temperature. Finally, we illustrated the reasons of different behaviors of magnetic entropy change by analyzing the contributions of two sublattices to the total magnetic entropy change.

Maximum Entropy Production As a Framework for Understanding How Living Systems Evolve, Organize and Function

NASA Astrophysics Data System (ADS)

Vallino, J. J.; Algar, C. K.; Huber, J. A.; Fernandez-Gonzalez, N.

2014-12-01

The maximum entropy production (MEP) principle holds that non equilibrium systems with sufficient degrees of freedom will likely be found in a state that maximizes entropy production or, analogously, maximizes potential energy destruction rate. The theory does not distinguish between abiotic or biotic systems; however, we will show that systems that can coordinate function over time and/or space can potentially dissipate more free energy than purely Markovian processes (such as fire or a rock rolling down a hill) that only maximize instantaneous entropy production. Biological systems have the ability to store useful information acquired via evolution and curated by natural selection in genomic sequences that allow them to execute temporal strategies and coordinate function over space. For example, circadian rhythms allow phototrophs to "predict" that sun light will return and can orchestrate metabolic machinery appropriately before sunrise, which not only gives them a competitive advantage, but also increases the total entropy production rate compared to systems that lack such anticipatory control. Similarly, coordination over space, such a quorum sensing in microbial biofilms, can increase acquisition of spatially distributed resources and free energy and thereby enhance entropy production. In this talk we will develop a modeling framework to describe microbial biogeochemistry based on the MEP conjecture constrained by information and resource availability. Results from model simulations will be compared to laboratory experiments to demonstrate the usefulness of the MEP approach.

Topological entanglement Rényi entropy and reduced density matrix structure.

PubMed

Flammia, Steven T; Hamma, Alioscia; Hughes, Taylor L; Wen, Xiao-Gang

2009-12-31

We generalize the topological entanglement entropy to a family of topological Rényi entropies parametrized by a parameter alpha, in an attempt to find new invariants for distinguishing topologically ordered phases. We show that, surprisingly, all topological Rényi entropies are the same, independent of alpha for all nonchiral topological phases. This independence shows that topologically ordered ground-state wave functions have reduced density matrices with a certain simple structure, and no additional universal information can be extracted from the entanglement spectrum.

Topological Entanglement Rényi Entropy and Reduced Density Matrix Structure

NASA Astrophysics Data System (ADS)

Flammia, Steven T.; Hamma, Alioscia; Hughes, Taylor L.; Wen, Xiao-Gang

2009-12-01

We generalize the topological entanglement entropy to a family of topological Rényi entropies parametrized by a parameter α, in an attempt to find new invariants for distinguishing topologically ordered phases. We show that, surprisingly, all topological Rényi entropies are the same, independent of α for all nonchiral topological phases. This independence shows that topologically ordered ground-state wave functions have reduced density matrices with a certain simple structure, and no additional universal information can be extracted from the entanglement spectrum.

Entropy jump across an inviscid shock wave

NASA Technical Reports Server (NTRS)

Salas, Manuel D.; Iollo, Angelo

1995-01-01

The shock jump conditions for the Euler equations in their primitive form are derived by using generalized functions. The shock profiles for specific volume, speed, and pressure are shown to be the same, however density has a different shock profile. Careful study of the equations that govern the entropy shows that the inviscid entropy profile has a local maximum within the shock layer. We demonstrate that because of this phenomenon, the entropy, propagation equation cannot be used as a conservation law.

The epidemic spreading model and the direction of information flow in brain networks.

PubMed

Meier, J; Zhou, X; Hillebrand, A; Tewarie, P; Stam, C J; Van Mieghem, P

2017-05-15

The interplay between structural connections and emerging information flow in the human brain remains an open research problem. A recent study observed global patterns of directional information flow in empirical data using the measure of transfer entropy. For higher frequency bands, the overall direction of information flow was from posterior to anterior regions whereas an anterior-to-posterior pattern was observed in lower frequency bands. In this study, we applied a simple Susceptible-Infected-Susceptible (SIS) epidemic spreading model on the human connectome with the aim to reveal the topological properties of the structural network that give rise to these global patterns. We found that direct structural connections induced higher transfer entropy between two brain regions and that transfer entropy decreased with increasing distance between nodes (in terms of hops in the structural network). Applying the SIS model, we were able to confirm the empirically observed opposite information flow patterns and posterior hubs in the structural network seem to play a dominant role in the network dynamics. For small time scales, when these hubs acted as strong receivers of information, the global pattern of information flow was in the posterior-to-anterior direction and in the opposite direction when they were strong senders. Our analysis suggests that these global patterns of directional information flow are the result of an unequal spatial distribution of the structural degree between posterior and anterior regions and their directions seem to be linked to different time scales of the spreading process. Copyright © 2017 Elsevier Inc. All rights reserved.

Comment on "Troublesome aspects of the Renyi-MaxEnt treatment"

NASA Astrophysics Data System (ADS)

Oikonomou, Thomas; Bagci, G. Baris

2017-11-01

Plastino et al. [Plastino et al., Phys. Rev. E 94, 012145 (2016), 10.1103/PhysRevE.94.012145] recently stated that the Rényi entropy is not suitable for thermodynamics by using functional calculus, since it leads to anomalous results unlike the Tsallis entropy. We first show that the Tsallis entropy also leads to such anomalous behaviors if one adopts the same functional calculus approach. Second, we note that one of the Lagrange multipliers is set in an ad hoc manner in the functional calculus approach of Plastino et al. Finally, the explanation for these anomalous behaviors is provided by observing that the generalized distributions obtained by Plastino et al. do not yield the ordinary canonical partition function in the appropriate limit and therefore cannot be considered as genuine generalized distributions.

"Mysteries" of the First and Second Laws of Thermodynamics

ERIC Educational Resources Information Center

Battino, Rubin

2007-01-01

The thermodynamic concepts of First and Second Laws with respect to the entropy function are described using atoms and molecules and probability as manifested in statistical mechanics. The First Law is conceptually understood as [Delta]U = Q + W and the Second Law of Thermodynamics and the entropy function have provided the probability and…

Conformational entropic maps of functional coupling domains in GPCR activation: A case study with beta2 adrenergic receptor

NASA Astrophysics Data System (ADS)

Liu, Fan; Abrol, Ravinder; Goddard, William, III; Dougherty, Dennis

2014-03-01

Entropic effect in GPCR activation is poorly understood. Based on the recent solved structures, researchers in the GPCR structural biology field have proposed several ``local activating switches'' that consisted of a few number of conserved residues, but have long ignored the collective dynamical effect (conformational entropy) of a domain comprised of an ensemble of residues. A new paradigm has been proposed recently that a GPCR can be viewed as a composition of several functional coupling domains, each of which undergoes order-to-disorder or disorder-to-order transitions upon activation. Here we identified and studied these functional coupling domains by comparing the local entropy changes of each residue between the inactive and active states of the β2 adrenergic receptor from computational simulation. We found that agonist and G-protein binding increases the heterogeneity of the entropy distribution in the receptor. This new activation paradigm and computational entropy analysis scheme provides novel ways to design functionally modified mutant and identify new allosteric sites for GPCRs. The authors thank NIH and Sanofi for funding this project.

Entropy generation in magnetohydrodynamic radiative flow due to rotating disk in presence of viscous dissipation and Joule heating

NASA Astrophysics Data System (ADS)

Hayat, Tasawar; Qayyum, Sumaira; Khan, Muhammad Ijaz; Alsaedi, Ahmed

2018-01-01

Simultaneous effects of viscous dissipation and Joule heating in flow by rotating disk of variable thickness are examined. Radiative flow saturating porous space is considered. Much attention is given to entropy generation outcome. Developed nonlinear ordinary differential systems are computed for the convergent series solutions. Specifically, the results of velocity, temperature, entropy generation, Bejan number, coefficient of skin friction, and local Nusselt number are discussed. Clearly the entropy generation rate depends on velocity and temperature distributions. Moreover the entropy generation rate is a decreasing function of Hartmann number, Eckert number, and Reynolds number, while they gave opposite behavior for Bejan numbers.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Burke, K.; Smith, J. C.; Grabowski, P. E.

Universal exact conditions guided the construction of most ground-state density functional approximations in use today. Here, we derive the relation between the entropy and Mermin free energy density functionals for thermal density functional theory. Both the entropy and sum of kinetic and electron-electron repulsion functionals are shown to be monotonically increasing with temperature, while the Mermin functional is concave downwards. Analogous relations are found for both exchange and correlation. The importance of these conditions is illustrated in two extremes: the Hubbard dimer and the uniform gas.

Modelling the spreading rate of controlled communicable epidemics through an entropy-based thermodynamic model

NASA Astrophysics Data System (ADS)

Wang, WenBin; Wu, ZiNiu; Wang, ChunFeng; Hu, RuiFeng

2013-11-01

A model based on a thermodynamic approach is proposed for predicting the dynamics of communicable epidemics assumed to be governed by controlling efforts of multiple scales so that an entropy is associated with the system. All the epidemic details are factored into a single and time-dependent coefficient, the functional form of this coefficient is found through four constraints, including notably the existence of an inflexion point and a maximum. The model is solved to give a log-normal distribution for the spread rate, for which a Shannon entropy can be defined. The only parameter, that characterizes the width of the distribution function, is uniquely determined through maximizing the rate of entropy production. This entropy-based thermodynamic (EBT) model predicts the number of hospitalized cases with a reasonable accuracy for SARS in the year 2003. This EBT model can be of use for potential epidemics such as avian influenza and H7N9 in China.

Trends in Ground-State Entropies for Transition Metal Based Hydrogen Atom Transfer Reactions

PubMed Central

Mader, Elizabeth A.; Manner, Virginia W.; Markle, Todd F.; Wu, Adam; Franz, James A.; Mayer, James M.

2009-01-01

Reported herein are thermochemical studies of hydrogen atom transfer (HAT) reactions involving transition metal H-atom donors MIILH and oxyl radicals. [FeII(H2bip)3]2+, [FeII(H2bim)3]2+, [CoII(H2bim)3]2+ and RuII(acac)2(py-imH) [H2bip = 2,2’-bi-1,4,5,6-tetrahydropyrimidine, H2bim = 2,2’-bi-imidazoline, acac = 2,4-pentandionato, py-imH = 2-(2’-pyridyl)-imidazole)] each react with TEMPO (2,2,6,6-tetramethyl-1-piperidinoxyl) or tBu3PhO• (2,4,6-tri-tert-butylphenoxyl) to give the deprotonated, oxidized metal complex MIIIL, and TEMPOH or tBu3PhOH. Solution equilibrium measurements for the reaction of [CoII(H2bim)3]2+ with TEMPO show a large, negative ground-state entropy for hydrogen atom transfer, −41 ± 2 cal mol−1 K−1. This is even more negative than the ΔSoHAT = −30 ± 2 cal mol−1 K−1 for the two iron complexes and the ΔSoHAT for RuII(acac)2(py-imH) + TEMPO, 4.9 ± 1.1 cal mol−1 K−1, as reported earlier. Calorimetric measurements quantitatively confirm the enthalpy of reaction for [FeII(H2bip)3]2+ + TEMPO, thus also confirming ΔSoHAT. Calorimetry on TEMPOH + tBu3PhO• gives ΔHoHAT = −11.2 ± 0.5 kcal mol−1 which matches the enthalpy predicted from the difference in literature solution BDEs. A brief evaluation of the literature thermochemistry of TEMPOH and tBu3PhOH supports the common assumption that ΔSoHAT ≈ 0 for HAT reactions of organic and small gas-phase molecules. However, this assumption does not hold for transition metal based HAT reactions. The trend in magnitude of |ΔSoHAT| for reactions with TEMPO, RuII(acac)2(py-imH) << [FeII(H2bip)3]2+ = [FeII(H2bim)3]2+ < [CoII(H2bim)3]2+, is surprisingly well predicted by the trends for electron transfer half-reaction entropies, ΔSoET, in aprotic solvents. This is because both ΔSoET and ΔSoHAT have substantial contributions from vibrational entropy, which varies significantly with the metal center involved. The close connection between ΔSoHAT and ΔSoET provides an important link between these two fields and provides a starting point from which to predict which HAT systems will have important ground-state entropy effects. PMID:19275235

Increased resting-state brain entropy in Alzheimer's disease.

PubMed

Xue, Shao-Wei; Guo, Yonghu

2018-03-07

Entropy analysis of resting-state functional MRI (R-fMRI) is a novel approach to characterize brain temporal dynamics and facilitates the identification of abnormal brain activity caused by several disease conditions. However, Alzheimer's disease (AD)-related brain entropy mapping based on R-fMRI has not been assessed. Here, we measured the sample entropy and voxel-wise connectivity of the network degree centrality (DC) of the intrinsic brain activity acquired by R-fMRI in 26 patients with AD and 26 healthy controls. Compared with the controls, AD patients showed increased entropy in the middle temporal gyrus and the precentral gyrus and also showed decreased DC in the precuneus. Moreover, the magnitude of the negative correlation between local brain activity (entropy) and network connectivity (DC) was increased in AD patients in comparison with healthy controls. These findings provide new evidence on AD-related brain entropy alterations.

Entanglement entropy of ABJM theory and entropy of topological black hole

NASA Astrophysics Data System (ADS)

Nian, Jun; Zhang, Xinyu

2017-07-01

In this paper we discuss the supersymmetric localization of the 4D N = 2 offshell gauged supergravity on the background of the AdS4 neutral topological black hole, which is the gravity dual of the ABJM theory defined on the boundary {S}^1× H^2 . We compute the large- N expansion of the supergravity partition function. The result gives the black hole entropy with the logarithmic correction, which matches the previous result of the entanglement entropy of the ABJM theory up to some stringy effects. Our result is consistent with the previous on-shell one-loop computation of the logarithmic correction to black hole entropy. It provides an explicit example of the identification of the entanglement entropy of the boundary conformal field theory with the bulk black hole entropy beyond the leading order given by the classical Bekenstein-Hawking formula, which consequently tests the AdS/CFT correspondence at the subleading order.

Nonequilibrium Entropy in a Shock

DOE PAGES

Margolin, Len G.

2017-07-19

In a classic paper, Morduchow and Libby use an analytic solution for the profile of a Navier–Stokes shock to show that the equilibrium thermodynamic entropy has a maximum inside the shock. There is no general nonequilibrium thermodynamic formulation of entropy; the extension of equilibrium theory to nonequililbrium processes is usually made through the assumption of local thermodynamic equilibrium (LTE). However, gas kinetic theory provides a perfectly general formulation of a nonequilibrium entropy in terms of the probability distribution function (PDF) solutions of the Boltzmann equation. In this paper I will evaluate the Boltzmann entropy for the PDF that underlies themore » Navier–Stokes equations and also for the PDF of the Mott–Smith shock solution. I will show that both monotonically increase in the shock. As a result, I will propose a new nonequilibrium thermodynamic entropy and show that it is also monotone and closely approximates the Boltzmann entropy.« less

Microscopic insights into the NMR relaxation based protein conformational entropy meter

PubMed Central

Kasinath, Vignesh; Sharp, Kim A.; Wand, A. Joshua

2013-01-01

Conformational entropy is a potentially important thermodynamic parameter contributing to protein function. Quantitative measures of conformational entropy are necessary for an understanding of its role but have been difficult to obtain. An empirical method that utilizes changes in conformational dynamics as a proxy for changes in conformational entropy has recently been introduced. Here we probe the microscopic origins of the link between conformational dynamics and conformational entropy using molecular dynamics simulations. Simulation of seven pro! teins gave an excellent correlation with measures of side-chain motion derived from NMR relaxation. The simulations show that the motion of methyl-bearing side-chains are sufficiently coupled to that of other side chains to serve as excellent reporters of the overall side-chain conformational entropy. These results tend to validate the use of experimentally accessible measures of methyl motion - the NMR-derived generalized order parameters - as a proxy from which to derive changes in protein conformational entropy. PMID:24007504

Nonequilibrium Entropy in a Shock

DOE Office of Scientific and Technical Information (OSTI.GOV)

Margolin, Len G.

In a classic paper, Morduchow and Libby use an analytic solution for the profile of a Navier–Stokes shock to show that the equilibrium thermodynamic entropy has a maximum inside the shock. There is no general nonequilibrium thermodynamic formulation of entropy; the extension of equilibrium theory to nonequililbrium processes is usually made through the assumption of local thermodynamic equilibrium (LTE). However, gas kinetic theory provides a perfectly general formulation of a nonequilibrium entropy in terms of the probability distribution function (PDF) solutions of the Boltzmann equation. In this paper I will evaluate the Boltzmann entropy for the PDF that underlies themore » Navier–Stokes equations and also for the PDF of the Mott–Smith shock solution. I will show that both monotonically increase in the shock. As a result, I will propose a new nonequilibrium thermodynamic entropy and show that it is also monotone and closely approximates the Boltzmann entropy.« less

Entropy of the Bose-Einstein-condensate ground state: Correlation versus ground-state entropy

NASA Astrophysics Data System (ADS)

Kim, Moochan B.; Svidzinsky, Anatoly; Agarwal, Girish S.; Scully, Marlan O.

2018-01-01

Calculation of the entropy of an ideal Bose-Einstein condensate (BEC) in a three-dimensional trap reveals unusual, previously unrecognized, features of the canonical ensemble. It is found that, for any temperature, the entropy of the Bose gas is equal to the entropy of the excited particles although the entropy of the particles in the ground state is nonzero. We explain this by considering the correlations between the ground-state particles and particles in the excited states. These correlations lead to a correlation entropy which is exactly equal to the contribution from the ground state. The correlations themselves arise from the fact that we have a fixed number of particles obeying quantum statistics. We present results for correlation functions between the ground and excited states in a Bose gas, so as to clarify the role of fluctuations in the system. We also report the sub-Poissonian nature of the ground-state fluctuations.

Computing entropy change in synoptic-scale system

NASA Astrophysics Data System (ADS)

Wu, Y. P.; Hu, Y. Y.; Cao, H. X.; Fu, C. F.; Feng, G. L.

2018-03-01

Thermodynamic entropy is of great importance in the atmospheric physics and chemistry process, because it is a non-conserved state function which making a system's tendency towards spontaneous change. But how the entropy forces a synoptic-scale system is still not well known. In this paper, we analyzed the entropy change in atmosphere system, by calculating several examples of extra tropical cyclones over the Yellow River and its adjacent area in summer. The results show that a strong negative entropy flux appears over the north of a stationary front and the thresholds Fe S ≤ - 280 and ∂s / ∂t ≤ - 50 are satisfied. At the same time, the change of total entropy is smaller than zero. Therefore the cyclone developed quickly and daily precipitation reached 371 mm, which is heaviest rain over the Yellows River area in summer. We suggest the dynamical entropy should be developed to improve the forecasting technique of heavy rainfall event in synoptic-scale.

Is the catalytic activity of triosephosphate isomerase fully optimized? An investigation based on maximization of entropy production.

PubMed

Bonačić Lošić, Željana; Donđivić, Tomislav; Juretić, Davor

2017-03-01

Triosephosphate isomerase (TIM) is often described as a fully evolved housekeeping enzyme with near-maximal possible reaction rate. The assumption that an enzyme is perfectly evolved has not been easy to confirm or refute. In this paper, we use maximization of entropy production within known constraints to examine this assumption by calculating steady-state cyclic flux, corresponding entropy production, and catalytic activity in a reversible four-state scheme of TIM functional states. The maximal entropy production (MaxEP) requirement for any of the first three transitions between TIM functional states leads to decreased total entropy production. Only the MaxEP requirement for the product (R-glyceraldehyde-3-phosphate) release step led to a 30% increase in enzyme activity, specificity constant k cat /K M , and overall entropy production. The product release step, due to the TIM molecular machine working in the physiological direction of glycolysis, has not been identified before as the rate-limiting step by using irreversible thermodynamics. Together with structural studies, our results open the possibility for finding amino acid substitutions leading to an increased frequency of loop six opening and product release.

Spatiotemporal Dependency of Age-Related Changes in Brain Signal Variability

PubMed Central

McIntosh, A. R.; Vakorin, V.; Kovacevic, N.; Wang, H.; Diaconescu, A.; Protzner, A. B.

2014-01-01

Recent theoretical and empirical work has focused on the variability of network dynamics in maturation. Such variability seems to reflect the spontaneous formation and dissolution of different functional networks. We sought to extend these observations into healthy aging. Two different data sets, one EEG (total n = 48, ages 18–72) and one magnetoencephalography (n = 31, ages 20–75) were analyzed for such spatiotemporal dependency using multiscale entropy (MSE) from regional brain sources. In both data sets, the changes in MSE were timescale dependent, with higher entropy at fine scales and lower at more coarse scales with greater age. The signals were parsed further into local entropy, related to information processed within a regional source, and distributed entropy (information shared between two sources, i.e., functional connectivity). Local entropy increased for most regions, whereas the dominant change in distributed entropy was age-related reductions across hemispheres. These data further the understanding of changes in brain signal variability across the lifespan, suggesting an inverted U-shaped curve, but with an important qualifier. Unlike earlier in maturation, where the changes are more widespread, changes in adulthood show strong spatiotemporal dependence. PMID:23395850

Parametric scaling from species relative abundances to absolute abundances in the computation of biological diversity: a first proposal using Shannon's entropy.

PubMed

Ricotta, Carlo

2003-01-01

Traditional diversity measures such as the Shannon entropy are generally computed from the species' relative abundance vector of a given community to the exclusion of species' absolute abundances. In this paper, I first mention some examples where the total information content associated with a given community may be more adequate than Shannon's average information content for a better understanding of ecosystem functioning. Next, I propose a parametric measure of statistical information that contains both Shannon's entropy and total information content as special cases of this more general function.

Thermality and excited state Rényi entropy in two-dimensional CFT

NASA Astrophysics Data System (ADS)

Lin, Feng-Li; Wang, Huajia; Zhang, Jia-ju

2016-11-01

We evaluate one-interval Rényi entropy and entanglement entropy for the excited states of two-dimensional conformal field theory (CFT) on a cylinder, and examine their differences from the ones for the thermal state. We assume the interval to be short so that we can use operator product expansion (OPE) of twist operators to calculate Rényi entropy in terms of sum of one-point functions of OPE blocks. We find that the entanglement entropy for highly excited state and thermal state behave the same way after appropriate identification of the conformal weight of the state with the temperature. However, there exists no such universal identification for the Rényi entropy in the short-interval expansion. Therefore, the highly excited state does not look thermal when comparing its Rényi entropy to the thermal state one. As the Rényi entropy captures the higher moments of the reduced density matrix but the entanglement entropy only the average, our results imply that the emergence of thermality depends on how refined we look into the entanglement structure of the underlying pure excited state.

Exact conditions on the temperature dependence of density functionals

DOE PAGES

Burke, K.; Smith, J. C.; Grabowski, P. E.; ...

2016-05-15

Universal exact conditions guided the construction of most ground-state density functional approximations in use today. Here, we derive the relation between the entropy and Mermin free energy density functionals for thermal density functional theory. Both the entropy and sum of kinetic and electron-electron repulsion functionals are shown to be monotonically increasing with temperature, while the Mermin functional is concave downwards. Analogous relations are found for both exchange and correlation. The importance of these conditions is illustrated in two extremes: the Hubbard dimer and the uniform gas.

An efficient algorithm for automatic phase correction of NMR spectra based on entropy minimization

NASA Astrophysics Data System (ADS)

Chen, Li; Weng, Zhiqiang; Goh, LaiYoong; Garland, Marc

2002-09-01

A new algorithm for automatic phase correction of NMR spectra based on entropy minimization is proposed. The optimal zero-order and first-order phase corrections for a NMR spectrum are determined by minimizing entropy. The objective function is constructed using a Shannon-type information entropy measure. Entropy is defined as the normalized derivative of the NMR spectral data. The algorithm has been successfully applied to experimental 1H NMR spectra. The results of automatic phase correction are found to be comparable to, or perhaps better than, manual phase correction. The advantages of this automatic phase correction algorithm include its simple mathematical basis and the straightforward, reproducible, and efficient optimization procedure. The algorithm is implemented in the Matlab program ACME—Automated phase Correction based on Minimization of Entropy.

Investigation of thermal protection systems effects on viscid and inviscid flow fields for manned entry systems

NASA Technical Reports Server (NTRS)

Bartlett, E. P.; Morse, H. L.; Tong, H.

1971-01-01

Procedures and methods for predicting aerothermodynamic heating to delta orbiter shuttle vehicles were reviewed. A number of approximate methods were found to be adequate for large scale parameter studies, but are considered inadequate for final design calculations. It is recommended that final design calculations be based on a computer code which accounts for nonequilibrium chemistry, streamline spreading, entropy swallowing, and turbulence. It is further recommended that this code be developed with the intent that it can be directly coupled with an exact inviscid flow field calculation when the latter becomes available. A nonsimilar, equilibrium chemistry computer code (BLIMP) was used to evaluate the effects of entropy swallowing, turbulence, and various three dimensional approximations. These solutions were compared with available wind tunnel data. It was found study that, for wind tunnel conditions, the effect of entropy swallowing and three dimensionality are small for laminar boundary layers but entropy swallowing causes a significant increase in turbulent heat transfer. However, it is noted that even small effects (say, 10-20%) may be important for the shuttle reusability concept.

Maximum entropy formalism for the analytic continuation of matrix-valued Green's functions

NASA Astrophysics Data System (ADS)

Kraberger, Gernot J.; Triebl, Robert; Zingl, Manuel; Aichhorn, Markus

2017-10-01

We present a generalization of the maximum entropy method to the analytic continuation of matrix-valued Green's functions. To treat off-diagonal elements correctly based on Bayesian probability theory, the entropy term has to be extended for spectral functions that are possibly negative in some frequency ranges. In that way, all matrix elements of the Green's function matrix can be analytically continued; we introduce a computationally cheap element-wise method for this purpose. However, this method cannot ensure important constraints on the mathematical properties of the resulting spectral functions, namely positive semidefiniteness and Hermiticity. To improve on this, we present a full matrix formalism, where all matrix elements are treated simultaneously. We show the capabilities of these methods using insulating and metallic dynamical mean-field theory (DMFT) Green's functions as test cases. Finally, we apply the methods to realistic material calculations for LaTiO3, where off-diagonal matrix elements in the Green's function appear due to the distorted crystal structure.

Statistical mechanical theory of liquid entropy

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wallace, D.C.

The multiparticle correlation expansion for the entropy of a classical monatomic liquid is presented. This entropy expresses the physical picture in which there is no free particle motion, but rather, each atom moves within a cage formed by its neighbors. The liquid expansion, including only pair correlations, gives an excellent account of the experimental entropy of most liquid metals, of liquid argon, and the hard sphere liquid. The pair correlation entropy is well approximated by a universal function of temperature. Higher order correlation entropy, due to n-particle irreducible correlations for n{ge}3, is significant in only a few liquid metals, andmore » its occurrence suggests the presence of n-body forces. When the liquid theory is applied to the study of melting, the author discovers the important classification of normal and anomalous melting, according to whether there is not or is a significant change in the electronic structure upon melting, and he discovers the universal disordering entropy for melting of a monatomic crystal. Interesting directions for future research are: extension to include orientational correlations of molecules, theoretical calculation of the entropy of water, application to the entropy of the amorphous state, and correlational entropy of compressed argon. The author clarifies the relation among different entropy expansions in the recent literature.« less

Formal groups and Z-entropies

PubMed Central

2016-01-01

We shall prove that the celebrated Rényi entropy is the first example of a new family of infinitely many multi-parametric entropies. We shall call them the Z-entropies. Each of them, under suitable hypotheses, generalizes the celebrated entropies of Boltzmann and Rényi. A crucial aspect is that every Z-entropy is composable (Tempesta 2016 Ann. Phys. 365, 180–197. (doi:10.1016/j.aop.2015.08.013)). This property means that the entropy of a system which is composed of two or more independent systems depends, in all the associated probability space, on the choice of the two systems only. Further properties are also required to describe the composition process in terms of a group law. The composability axiom, introduced as a generalization of the fourth Shannon–Khinchin axiom (postulating additivity), is a highly non-trivial requirement. Indeed, in the trace-form class, the Boltzmann entropy and Tsallis entropy are the only known composable cases. However, in the non-trace form class, the Z-entropies arise as new entropic functions possessing the mathematical properties necessary for information-theoretical applications, in both classical and quantum contexts. From a mathematical point of view, composability is intimately related to formal group theory of algebraic topology. The underlying group-theoretical structure determines crucially the statistical properties of the corresponding entropies. PMID:27956871

Entropy and structure of silicate glasses and melts

USGS Publications Warehouse

Richet, P.; Robie, R.A.; Hemingway, B.S.

1993-01-01

Low-temperature adiabatic Cp measurements have been made on NaAlSi2O6, MgSiO3, Ca3Al2Si3O12 and Ca1.5Mg1.5Al2Si3O12 glasses. Above about 50 K, these and previous data show that the heat capacity is an additive function of composition to within ??1% throughout the investigated glassforming part of the system CaO-MgO-Al2O3-SiO2. In view of the determining role of oxygen coordination polyhedra on the low-temperature entropy, this is interpreted as indicating that Si and Al are tetrahedrally coordinated in all these glasses, in agreement with structural data; whereas Ca and Mg remain octahedrally coordinated. In contrast, heat capacities and entropies are not additive functions of composition for alkali aluminosilicates, indicating increases in the coordination numbers of alkali elements from about six to nine when alumina is introduced. A thermochemical consequence of additivity of vibrational entropies of glasses is that entropies of mixing are essentially configurational for calcium and magnesium aluminosilicate melts. For alkali-bearing liquids, it is probable that vibrational entropies contribute significantly to entropies of mixing. At very low temperatures, the additive nature of the heat capacity with composition is less well followed, likely as a result of specific differences in medium-range order. ?? 1993.

Perceptual suppression revealed by adaptive multi-scale entropy analysis of local field potential in monkey visual cortex.

PubMed

Hu, Meng; Liang, Hualou

2013-04-01

Generalized flash suppression (GFS), in which a salient visual stimulus can be rendered invisible despite continuous retinal input, provides a rare opportunity to directly study the neural mechanism of visual perception. Previous work based on linear methods, such as spectral analysis, on local field potential (LFP) during GFS has shown that the LFP power at distinctive frequency bands are differentially modulated by perceptual suppression. Yet, the linear method alone may be insufficient for the full assessment of neural dynamic due to the fundamentally nonlinear nature of neural signals. In this study, we set forth to analyze the LFP data collected from multiple visual areas in V1, V2 and V4 of macaque monkeys while performing the GFS task using a nonlinear method - adaptive multi-scale entropy (AME) - to reveal the neural dynamic of perceptual suppression. In addition, we propose a new cross-entropy measure at multiple scales, namely adaptive multi-scale cross-entropy (AMCE), to assess the nonlinear functional connectivity between two cortical areas. We show that: (1) multi-scale entropy exhibits percept-related changes in all three areas, with higher entropy observed during perceptual suppression; (2) the magnitude of the perception-related entropy changes increases systematically over successive hierarchical stages (i.e. from lower areas V1 to V2, up to higher area V4); and (3) cross-entropy between any two cortical areas reveals higher degree of asynchrony or dissimilarity during perceptual suppression, indicating a decreased functional connectivity between cortical areas. These results, taken together, suggest that perceptual suppression is related to a reduced functional connectivity and increased uncertainty of neural responses, and the modulation of perceptual suppression is more effective at higher visual cortical areas. AME is demonstrated to be a useful technique in revealing the underlying dynamic of nonlinear/nonstationary neural signal.

Comment on "Troublesome aspects of the Renyi-MaxEnt treatment".

PubMed

Oikonomou, Thomas; Bagci, G Baris

2017-11-01

Plastino et al. [Plastino et al., Phys. Rev. E 94, 012145 (2016)1539-375510.1103/PhysRevE.94.012145] recently stated that the Rényi entropy is not suitable for thermodynamics by using functional calculus, since it leads to anomalous results unlike the Tsallis entropy. We first show that the Tsallis entropy also leads to such anomalous behaviors if one adopts the same functional calculus approach. Second, we note that one of the Lagrange multipliers is set in an ad hoc manner in the functional calculus approach of Plastino et al. Finally, the explanation for these anomalous behaviors is provided by observing that the generalized distributions obtained by Plastino et al. do not yield the ordinary canonical partition function in the appropriate limit and therefore cannot be considered as genuine generalized distributions.

Action and entanglement in gravity and field theory.

PubMed

Neiman, Yasha

2013-12-27

In nongravitational quantum field theory, the entanglement entropy across a surface depends on the short-distance regularization. Quantum gravity should not require such regularization, and it has been conjectured that the entanglement entropy there is always given by the black hole entropy formula evaluated on the entangling surface. We show that these statements have precise classical counterparts at the level of the action. Specifically, we point out that the action can have a nonadditive imaginary part. In gravity, the latter is fixed by the black hole entropy formula, while in nongravitating theories it is arbitrary. From these classical facts, the entanglement entropy conjecture follows by heuristically applying the relation between actions and wave functions.

How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems.

PubMed

Hanel, Rudolf; Thurner, Stefan; Gell-Mann, Murray

2014-05-13

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and Markovian systems in statistical mechanics, information theory, and statistics. For several decades there has been an ongoing controversy over whether the notion of the maximum entropy principle can be extended in a meaningful way to nonextensive, nonergodic, and complex statistical systems and processes. In this paper we start by reviewing how Boltzmann-Gibbs-Shannon entropy is related to multiplicities of independent random processes. We then show how the relaxation of independence naturally leads to the most general entropies that are compatible with the first three Shannon-Khinchin axioms, the (c,d)-entropies. We demonstrate that the MEP is a perfectly consistent concept for nonergodic and complex statistical systems if their relative entropy can be factored into a generalized multiplicity and a constraint term. The problem of finding such a factorization reduces to finding an appropriate representation of relative entropy in a linear basis. In a particular example we show that path-dependent random processes with memory naturally require specific generalized entropies. The example is to our knowledge the first exact derivation of a generalized entropy from the microscopic properties of a path-dependent random process.

Understanding Chemical Equilibrium Using Entropy Analysis: The Relationship between [delta]S[subscript tot](sys[superscript o]) and the Equilibrium Constant

ERIC Educational Resources Information Center

Bindel, Thomas H.

2010-01-01

Entropy analyses as a function of the extent of reaction are presented for a number of physicochemical processes, including vaporization of a liquid, dimerization of nitrogen dioxide, and the autoionization of water. Graphs of the total entropy change versus the extent of reaction give a visual representation of chemical equilibrium and the second…

First-principles calculation of entropy for liquid metals.

PubMed

Desjarlais, Michael P

2013-12-01

We demonstrate the accurate calculation of entropies and free energies for a variety of liquid metals using an extension of the two-phase thermodynamic (2PT) model based on a decomposition of the velocity autocorrelation function into gas-like (hard sphere) and solid-like (harmonic) subsystems. The hard sphere model for the gas-like component is shown to give systematically high entropies for liquid metals as a direct result of the unphysical Lorentzian high-frequency tail. Using a memory function framework we derive a generally applicable velocity autocorrelation and frequency spectrum for the diffusive component which recovers the low-frequency (long-time) behavior of the hard sphere model while providing for realistic short-time coherence and high-frequency tails to the spectrum. This approach provides a significant increase in the accuracy of the calculated entropies for liquid metals and is compared to ambient pressure data for liquid sodium, aluminum, gallium, tin, and iron. The use of this method for the determination of melt boundaries is demonstrated with a calculation of the high-pressure bcc melt boundary for sodium. With the significantly improved accuracy available with the memory function treatment for softer interatomic potentials, the 2PT model for entropy calculations should find broader application in high energy density science, warm dense matter, planetary science, geophysics, and material science.

First-principles calculation of entropy for liquid metals

NASA Astrophysics Data System (ADS)

Desjarlais, Michael P.

2013-12-01

We demonstrate the accurate calculation of entropies and free energies for a variety of liquid metals using an extension of the two-phase thermodynamic (2PT) model based on a decomposition of the velocity autocorrelation function into gas-like (hard sphere) and solid-like (harmonic) subsystems. The hard sphere model for the gas-like component is shown to give systematically high entropies for liquid metals as a direct result of the unphysical Lorentzian high-frequency tail. Using a memory function framework we derive a generally applicable velocity autocorrelation and frequency spectrum for the diffusive component which recovers the low-frequency (long-time) behavior of the hard sphere model while providing for realistic short-time coherence and high-frequency tails to the spectrum. This approach provides a significant increase in the accuracy of the calculated entropies for liquid metals and is compared to ambient pressure data for liquid sodium, aluminum, gallium, tin, and iron. The use of this method for the determination of melt boundaries is demonstrated with a calculation of the high-pressure bcc melt boundary for sodium. With the significantly improved accuracy available with the memory function treatment for softer interatomic potentials, the 2PT model for entropy calculations should find broader application in high energy density science, warm dense matter, planetary science, geophysics, and material science.

Acute Sleep Deprivation Induces a Local Brain Transfer Information Increase in the Frontal Cortex in a Widespread Decrease Context.

PubMed

Alonso, Joan F; Romero, Sergio; Mañanas, Miguel A; Alcalá, Marta; Antonijoan, Rosa M; Giménez, Sandra

2016-04-14

Sleep deprivation (SD) has adverse effects on mental and physical health, affecting the cognitive abilities and emotional states. Specifically, cognitive functions and alertness are known to decrease after SD. The aim of this work was to identify the directional information transfer after SD on scalp EEG signals using transfer entropy (TE). Using a robust methodology based on EEG recordings of 18 volunteers deprived from sleep for 36 h, TE and spectral analysis were performed to characterize EEG data acquired every 2 h. Correlation between connectivity measures and subjective somnolence was assessed. In general, TE showed medium- and long-range significant decreases originated at the occipital areas and directed towards different regions, which could be interpreted as the transfer of predictive information from parieto-occipital activity to the rest of the head. Simultaneously, short-range increases were obtained for the frontal areas, following a consistent and robust time course with significant maps after 20 h of sleep deprivation. Changes during sleep deprivation in brain network were measured effectively by TE, which showed increased local connectivity and diminished global integration. TE is an objective measure that could be used as a potential measure of sleep pressure and somnolence with the additional property of directed relationships.

User Guide for Compressible Flow Toolbox Version 2.1 for Use With MATLAB(Registered Trademark); Version 7

NASA Technical Reports Server (NTRS)

Melcher, Kevin J.

2006-01-01

This report provides a user guide for the Compressible Flow Toolbox, a collection of algorithms that solve almost 300 linear and nonlinear classical compressible flow relations. The algorithms, implemented in the popular MATLAB programming language, are useful for analysis of one-dimensional steady flow with constant entropy, friction, heat transfer, or shock discontinuities. The solutions do not include any gas dissociative effects. The toolbox also contains functions for comparing and validating the equation-solving algorithms against solutions previously published in the open literature. The classical equations solved by the Compressible Flow Toolbox are: isentropic-flow equations, Fanno flow equations (pertaining to flow of an ideal gas in a pipe with friction), Rayleigh flow equations (pertaining to frictionless flow of an ideal gas, with heat transfer, in a pipe of constant cross section.), normal-shock equations, oblique-shock equations, and Prandtl-Meyer expansion equations. At the time this report was published, the Compressible Flow Toolbox was available without cost from the NASA Software Repository.

On the shape of things: From holography to elastica

NASA Astrophysics Data System (ADS)

Fonda, Piermarco; Jejjala, Vishnu; Veliz-Osorio, Alvaro

2017-10-01

We explore the question of which shape a manifold is compelled to take when immersed in another one, provided it must be the extremum of some functional. We consider a family of functionals which depend quadratically on the extrinsic curvatures and on projections of the ambient curvatures. These functionals capture a number of physical setups ranging from holography to the study of membranes and elastica. We present a detailed derivation of the equations of motion, known as the shape equations, placing particular emphasis on the issue of gauge freedom in the choice of normal frame. We apply these equations to the particular case of holographic entanglement entropy for higher curvature three dimensional gravity and find new classes of entangling curves. In particular, we discuss the case of New Massive Gravity where we show that non-geodesic entangling curves have always a smaller on-shell value of the entropy functional. Then we apply this formalism to the computation of the entanglement entropy for dual logarithmic CFTs. Nevertheless, the correct value for the entanglement entropy is provided by geodesics. Then, we discuss the importance of these equations in the context of classical elastica and comment on terms that break gauge invariance.

The acoustic Green's function for swirling flow with variable entropy in a lined duct

NASA Astrophysics Data System (ADS)

Mathews, J. R.; Peake, N.

2018-04-01

This paper extends previous work by the authors (Journal of Sound and Vibration, 395:294-316,2017) on the acoustic field inside an annular duct with acoustic lining carrying mean axial and swirling flow so as to allow for non-uniform mean entropy, as would be found for instance in the turbine stage of an aeroengine. The main aim of this paper is to understand the effect of a non-uniform entropy on both the eigenmodes of the flow and the Green's function, which will allow noise prediction once we have identified acoustic sources. We first derive a new acoustic analogy in isentropic swirling flow, which allows us to derive the equation the tailored Green's function satisfies. The eigenmodes are split into two distinct families, acoustic and hydrodynamic modes, and are computed using different analytical methods; in the limit of high reduced frequency using the WKB method for the acoustic modes; and by considering a Frobenius expansion for the hydrodynamic modes. These are then compared with numerical results, with excellent agreement for all eigenmodes. The Green's function is also calculating analytically using the realistic limit of high reduced frequency, again with excellent agreement compared to numerical calculations. We see that for both the eigenmodes and Green's function the effect of non-uniform mean entropy is significant.

A trade-off between local and distributed information processing associated with remote episodic versus semantic memory.

PubMed

Heisz, Jennifer J; Vakorin, Vasily; Ross, Bernhard; Levine, Brian; McIntosh, Anthony R

2014-01-01

Episodic memory and semantic memory produce very different subjective experiences yet rely on overlapping networks of brain regions for processing. Traditional approaches for characterizing functional brain networks emphasize static states of function and thus are blind to the dynamic information processing within and across brain regions. This study used information theoretic measures of entropy to quantify changes in the complexity of the brain's response as measured by magnetoencephalography while participants listened to audio recordings describing past personal episodic and general semantic events. Personal episodic recordings evoked richer subjective mnemonic experiences and more complex brain responses than general semantic recordings. Critically, we observed a trade-off between the relative contribution of local versus distributed entropy, such that personal episodic recordings produced relatively more local entropy whereas general semantic recordings produced relatively more distributed entropy. Changes in the relative contributions of local and distributed entropy to the total complexity of the system provides a potential mechanism that allows the same network of brain regions to represent cognitive information as either specific episodes or more general semantic knowledge.

Thermodynamic Properties of a Double Ring-Shaped Quantum Dot at Low and High Temperatures

NASA Astrophysics Data System (ADS)

Khordad, R.; Sedehi, H. R. Rastegar

2018-02-01

In this work, we study thermodynamic properties of a GaAs double ring-shaped quantum dot under external magnetic and electric fields. To this end, we first solve the Schrödinger equation and obtain the energy levels and wave functions, analytically. Then, we calculate the entropy, heat capacity, average energy and magnetic susceptibility of the quantum dot in the presence of a magnetic field using the canonical ensemble approach. According to the results, it is found that the entropy is an increasing function of temperature. At low temperatures, the entropy increases monotonically with raising the temperature for all values of the magnetic fields and it is independent of the magnetic field. But, the entropy depends on the magnetic field at high temperatures. The entropy also decreases with increasing the magnetic field. The heat capacity and magnetic susceptibility show a peak structure. The heat capacity reduces with increasing the magnetic field at low temperatures. The magnetic susceptibility shows a transition between diamagnetic and paramagnetic below for T<4 K. The transition temperature depends on the magnetic field.

Single water entropy: hydrophobic crossover and application to drug binding.

PubMed

Sasikala, Wilbee D; Mukherjee, Arnab

2014-09-11

Entropy of water plays an important role in both chemical and biological processes e.g. hydrophobic effect, molecular recognition etc. Here we use a new approach to calculate translational and rotational entropy of the individual water molecules around different hydrophobic and charged solutes. We show that for small hydrophobic solutes, the translational and rotational entropies of each water molecule increase as a function of its distance from the solute reaching finally to a constant bulk value. As the size of the solute increases (0.746 nm), the behavior of the translational entropy is opposite; water molecules closest to the solute have higher entropy that reduces with distance from the solute. This indicates that there is a crossover in translational entropy of water molecules around hydrophobic solutes from negative to positive values as the size of the solute is increased. Rotational entropy of water molecules around hydrophobic solutes for all sizes increases with distance from the solute, indicating the absence of crossover in rotational entropy. This makes the crossover in total entropy (translation + rotation) of water molecule happen at much larger size (>1.5 nm) for hydrophobic solutes. Translational entropy of single water molecule scales logarithmically (Str(QH) = C + kB ln V), with the volume V obtained from the ellipsoid of inertia. We further discuss the origin of higher entropy of water around water and show the possibility of recovering the entropy loss of some hypothetical solutes. The results obtained are helpful to understand water entropy behavior around various hydrophobic and charged environments within biomolecules. Finally, we show how our approach can be used to calculate the entropy of the individual water molecules in a protein cavity that may be replaced during ligand binding.

RNA Thermodynamic Structural Entropy

PubMed Central

Garcia-Martin, Juan Antonio; Clote, Peter

2015-01-01

Conformational entropy for atomic-level, three dimensional biomolecules is known experimentally to play an important role in protein-ligand discrimination, yet reliable computation of entropy remains a difficult problem. Here we describe the first two accurate and efficient algorithms to compute the conformational entropy for RNA secondary structures, with respect to the Turner energy model, where free energy parameters are determined from UV absorption experiments. An algorithm to compute the derivational entropy for RNA secondary structures had previously been introduced, using stochastic context free grammars (SCFGs). However, the numerical value of derivational entropy depends heavily on the chosen context free grammar and on the training set used to estimate rule probabilities. Using data from the Rfam database, we determine that both of our thermodynamic methods, which agree in numerical value, are substantially faster than the SCFG method. Thermodynamic structural entropy is much smaller than derivational entropy, and the correlation between length-normalized thermodynamic entropy and derivational entropy is moderately weak to poor. In applications, we plot the structural entropy as a function of temperature for known thermoswitches, such as the repression of heat shock gene expression (ROSE) element, we determine that the correlation between hammerhead ribozyme cleavage activity and total free energy is improved by including an additional free energy term arising from conformational entropy, and we plot the structural entropy of windows of the HIV-1 genome. Our software RNAentropy can compute structural entropy for any user-specified temperature, and supports both the Turner’99 and Turner’04 energy parameters. It follows that RNAentropy is state-of-the-art software to compute RNA secondary structure conformational entropy. Source code is available at https://github.com/clotelab/RNAentropy/; a full web server is available at http://bioinformatics.bc.edu/clotelab/RNAentropy, including source code and ancillary programs. PMID:26555444

RNA Thermodynamic Structural Entropy.

PubMed

Garcia-Martin, Juan Antonio; Clote, Peter

2015-01-01

Conformational entropy for atomic-level, three dimensional biomolecules is known experimentally to play an important role in protein-ligand discrimination, yet reliable computation of entropy remains a difficult problem. Here we describe the first two accurate and efficient algorithms to compute the conformational entropy for RNA secondary structures, with respect to the Turner energy model, where free energy parameters are determined from UV absorption experiments. An algorithm to compute the derivational entropy for RNA secondary structures had previously been introduced, using stochastic context free grammars (SCFGs). However, the numerical value of derivational entropy depends heavily on the chosen context free grammar and on the training set used to estimate rule probabilities. Using data from the Rfam database, we determine that both of our thermodynamic methods, which agree in numerical value, are substantially faster than the SCFG method. Thermodynamic structural entropy is much smaller than derivational entropy, and the correlation between length-normalized thermodynamic entropy and derivational entropy is moderately weak to poor. In applications, we plot the structural entropy as a function of temperature for known thermoswitches, such as the repression of heat shock gene expression (ROSE) element, we determine that the correlation between hammerhead ribozyme cleavage activity and total free energy is improved by including an additional free energy term arising from conformational entropy, and we plot the structural entropy of windows of the HIV-1 genome. Our software RNAentropy can compute structural entropy for any user-specified temperature, and supports both the Turner'99 and Turner'04 energy parameters. It follows that RNAentropy is state-of-the-art software to compute RNA secondary structure conformational entropy. Source code is available at https://github.com/clotelab/RNAentropy/; a full web server is available at http://bioinformatics.bc.edu/clotelab/RNAentropy, including source code and ancillary programs.

Entropy for quantum pure states and quantum H theorem

NASA Astrophysics Data System (ADS)

Han, Xizhi; Wu, Biao

2015-06-01

We construct a complete set of Wannier functions that are localized at both given positions and momenta. This allows us to introduce the quantum phase space, onto which a quantum pure state can be mapped unitarily. Using its probability distribution in quantum phase space, we define an entropy for a quantum pure state. We prove an inequality regarding the long-time behavior of our entropy's fluctuation. For a typical initial state, this inequality indicates that our entropy can relax dynamically to a maximized value and stay there most of time with small fluctuations. This result echoes the quantum H theorem proved by von Neumann [Zeitschrift für Physik 57, 30 (1929), 10.1007/BF01339852]. Our entropy is different from the standard von Neumann entropy, which is always zero for quantum pure states. According to our definition, a system always has bigger entropy than its subsystem even when the system is described by a pure state. As the construction of the Wannier basis can be implemented numerically, the dynamical evolution of our entropy is illustrated with an example.

Dynamic information routing in complex networks

PubMed Central

Kirst, Christoph; Timme, Marc; Battaglia, Demian

2016-01-01

Flexible information routing fundamentally underlies the function of many biological and artificial networks. Yet, how such systems may specifically communicate and dynamically route information is not well understood. Here we identify a generic mechanism to route information on top of collective dynamical reference states in complex networks. Switching between collective dynamics induces flexible reorganization of information sharing and routing patterns, as quantified by delayed mutual information and transfer entropy measures between activities of a network's units. We demonstrate the power of this mechanism specifically for oscillatory dynamics and analyse how individual unit properties, the network topology and external inputs co-act to systematically organize information routing. For multi-scale, modular architectures, we resolve routing patterns at all levels. Interestingly, local interventions within one sub-network may remotely determine nonlocal network-wide communication. These results help understanding and designing information routing patterns across systems where collective dynamics co-occurs with a communication function. PMID:27067257

Data Decomposition Techniques with Multi-Scale Permutation Entropy Calculations for Bearing Fault Diagnosis

PubMed Central

Yasir, Muhammad Naveed; Koh, Bong-Hwan

2018-01-01

This paper presents the local mean decomposition (LMD) integrated with multi-scale permutation entropy (MPE), also known as LMD-MPE, to investigate the rolling element bearing (REB) fault diagnosis from measured vibration signals. First, the LMD decomposed the vibration data or acceleration measurement into separate product functions that are composed of both amplitude and frequency modulation. MPE then calculated the statistical permutation entropy from the product functions to extract the nonlinear features to assess and classify the condition of the healthy and damaged REB system. The comparative experimental results of the conventional LMD-based multi-scale entropy and MPE were presented to verify the authenticity of the proposed technique. The study found that LMD-MPE’s integrated approach provides reliable, damage-sensitive features when analyzing the bearing condition. The results of REB experimental datasets show that the proposed approach yields more vigorous outcomes than existing methods. PMID:29690526

Data Decomposition Techniques with Multi-Scale Permutation Entropy Calculations for Bearing Fault Diagnosis.

PubMed

Yasir, Muhammad Naveed; Koh, Bong-Hwan

2018-04-21

This paper presents the local mean decomposition (LMD) integrated with multi-scale permutation entropy (MPE), also known as LMD-MPE, to investigate the rolling element bearing (REB) fault diagnosis from measured vibration signals. First, the LMD decomposed the vibration data or acceleration measurement into separate product functions that are composed of both amplitude and frequency modulation. MPE then calculated the statistical permutation entropy from the product functions to extract the nonlinear features to assess and classify the condition of the healthy and damaged REB system. The comparative experimental results of the conventional LMD-based multi-scale entropy and MPE were presented to verify the authenticity of the proposed technique. The study found that LMD-MPE’s integrated approach provides reliable, damage-sensitive features when analyzing the bearing condition. The results of REB experimental datasets show that the proposed approach yields more vigorous outcomes than existing methods.

Linear entropy and collapse–revival phenomenon for a general formalism N-type four-level atom interacting with a single-mode field

NASA Astrophysics Data System (ADS)

Eied, A. A.

2018-05-01

In this paper, the linear entropy and collapse-revival phenomenon through the relation (< {\\hat{a}}+{\\hat{a}} > -{\\bar{n}}) in a system of N-configuration four-level atom interacting with a single-mode field with additional forms of nonlinearities of both the field and the intensity-dependent atom-field coupling functional are investigated. A factorization of the initial density operator is assumed, considering the field to be initially in a squeezed coherent states and the atom initially in its most upper excited state. The dynamical behavior of the linear entropy and the time evolution of (< {\\hat{a}}+ {\\hat{a}} > -{\\bar{n}}) are analyzed. In particular, the effects of the mean photon number, detuning, Kerr-like medium and the intensity-dependent coupling functional on the entropy and the evolution of (< {\\hat{a}}+ {\\hat{a}} > -{\\bar{n}}) are examined.

On entropic uncertainty relations in the presence of a minimal length

NASA Astrophysics Data System (ADS)

Rastegin, Alexey E.

2017-07-01

Entropic uncertainty relations for the position and momentum within the generalized uncertainty principle are examined. Studies of this principle are motivated by the existence of a minimal observable length. Then the position and momentum operators satisfy the modified commutation relation, for which more than one algebraic representation is known. One of them is described by auxiliary momentum so that the momentum and coordinate wave functions are connected by the Fourier transform. However, the probability density functions of the physically true and auxiliary momenta are different. As the corresponding entropies differ, known entropic uncertainty relations are changed. Using differential Shannon entropies, we give a state-dependent formulation with correction term. State-independent uncertainty relations are obtained in terms of the Rényi entropies and the Tsallis entropies with binning. Such relations allow one to take into account a finiteness of measurement resolution.

An Information Theoretic Characterisation of Auditory Encoding

PubMed Central

Overath, Tobias; Cusack, Rhodri; Kumar, Sukhbinder; von Kriegstein, Katharina; Warren, Jason D; Grube, Manon; Carlyon, Robert P; Griffiths, Timothy D

2007-01-01

The entropy metric derived from information theory provides a means to quantify the amount of information transmitted in acoustic streams like speech or music. By systematically varying the entropy of pitch sequences, we sought brain areas where neural activity and energetic demands increase as a function of entropy. Such a relationship is predicted to occur in an efficient encoding mechanism that uses less computational resource when less information is present in the signal: we specifically tested the hypothesis that such a relationship is present in the planum temporale (PT). In two convergent functional MRI studies, we demonstrated this relationship in PT for encoding, while furthermore showing that a distributed fronto-parietal network for retrieval of acoustic information is independent of entropy. The results establish PT as an efficient neural engine that demands less computational resource to encode redundant signals than those with high information content. PMID:17958472

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy.

PubMed

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy

NASA Astrophysics Data System (ADS)

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

Neuronal Entropy-Rate Feature of Entopeduncular Nucleus in Rat Model of Parkinson's Disease.

PubMed

Darbin, Olivier; Jin, Xingxing; Von Wrangel, Christof; Schwabe, Kerstin; Nambu, Atsushi; Naritoku, Dean K; Krauss, Joachim K; Alam, Mesbah

2016-03-01

The function of the nigro-striatal pathway on neuronal entropy in the basal ganglia (BG) output nucleus, i.e. the entopeduncular nucleus (EPN) was investigated in the unilaterally 6-hyroxydopamine (6-OHDA)-lesioned rat model of Parkinson's disease (PD). In both control subjects and subjects with 6-OHDA lesion of dopamine (DA) the nigro-striatal pathway, a histological hallmark for parkinsonism, neuronal entropy in EPN was maximal in neurons with firing rates ranging between 15 and 25 Hz. In 6-OHDA lesioned rats, neuronal entropy in the EPN was specifically higher in neurons with firing rates above 25 Hz. Our data establishes that the nigro-striatal pathway controls neuronal entropy in motor circuitry and that the parkinsonian condition is associated with abnormal relationship between firing rate and neuronal entropy in BG output nuclei. The neuronal firing rates and entropy relationship provide putative relevant electrophysiological information to investigate the sensory-motor processing in normal condition and conditions such as movement disorders.

Prediction of Protein Configurational Entropy (Popcoen).

PubMed

Goethe, Martin; Gleixner, Jan; Fita, Ignacio; Rubi, J Miguel

2018-03-13

A knowledge-based method for configurational entropy prediction of proteins is presented; this methodology is extremely fast, compared to previous approaches, because it does not involve any type of configurational sampling. Instead, the configurational entropy of a query fold is estimated by evaluating an artificial neural network, which was trained on molecular-dynamics simulations of ∼1000 proteins. The predicted entropy can be incorporated into a large class of protein software based on cost-function minimization/evaluation, in which configurational entropy is currently neglected for performance reasons. Software of this type is used for all major protein tasks such as structure predictions, proteins design, NMR and X-ray refinement, docking, and mutation effect predictions. Integrating the predicted entropy can yield a significant accuracy increase as we show exemplarily for native-state identification with the prominent protein software FoldX. The method has been termed Popcoen for Prediction of Protein Configurational Entropy. An implementation is freely available at http://fmc.ub.edu/popcoen/ .

On the Maxwellian distribution, symmetric form, and entropy conservation for the Euler equations

NASA Technical Reports Server (NTRS)

Deshpande, S. M.

1986-01-01

The Euler equations of gas dynamics have some very interesting properties in that the flux vector is a homogeneous function of the unknowns and the equations can be cast in symmetric hyperbolic form and satisfy the entropy conservation. The Euler equations are the moments of the Boltzmann equation of the kinetic theory of gases when the velocity distribution function is a Maxwellian. The present paper shows the relationship between the symmetrizability and the Maxwellian velocity distribution. The entropy conservation is in terms of the H-function, which is a slight modification of the H-function first introduced by Boltzmann in his famous H-theorem. In view of the H-theorem, it is suggested that the development of total H-diminishing (THD) numerical methods may be more profitable than the usual total variation diminishing (TVD) methods for obtaining wiggle-free solutions.

Entanglement, replicas, and Thetas

NASA Astrophysics Data System (ADS)

Mukhi, Sunil; Murthy, Sameer; Wu, Jie-Qiang

2018-01-01

We compute the single-interval Rényi entropy (replica partition function) for free fermions in 1+1d at finite temperature and finite spatial size by two methods: (i) using the higher-genus partition function on the replica Riemann surface, and (ii) using twist operators on the torus. We compare the two answers for a restricted set of spin structures, leading to a non-trivial proposed equivalence between higher-genus Siegel Θ-functions and Jacobi θ-functions. We exhibit this proposal and provide substantial evidence for it. The resulting expressions can be elegantly written in terms of Jacobi forms. Thereafter we argue that the correct Rényi entropy for modular-invariant free-fermion theories, such as the Ising model and the Dirac CFT, is given by the higher-genus computation summed over all spin structures. The result satisfies the physical checks of modular covariance, the thermal entropy relation, and Bose-Fermi equivalence.

Entanglement entropy in integrable field theories with line defects II. Non-topological defect

NASA Astrophysics Data System (ADS)

Jiang, Yunfeng

2017-08-01

This is the second part of two papers where we study the effect of integrable line defects on bipartite entanglement entropy in integrable field theories. In this paper, we consider non-topological line defects in Ising field theory. We derive an infinite series expression for the entanglement entropy and show that both the UV and IR limits of the bulk entanglement entropy are modified by the line defect. In the UV limit, we give an infinite series expression for the coefficient in front of the logarithmic divergence and the exact defect g-function. By tuning the defect to be purely transmissive and reflective, we recover correctly the entanglement entropy of the bulk and with integrable boundary respectively.

Study of water based nanofluid flows in annular tubes using numerical simulation and sensitivity analysis

NASA Astrophysics Data System (ADS)

Siadaty, Moein; Kazazi, Mohsen

2018-04-01

Convective heat transfer, entropy generation and pressure drop of two water based nanofluids (Cu-water and Al2O3-water) in horizontal annular tubes are scrutinized by means of computational fluids dynamics, response surface methodology and sensitivity analysis. First, central composite design is used to perform a series of experiments with diameter ratio, length to diameter ratio, Reynolds number and solid volume fraction. Then, CFD is used to calculate the Nusselt Number, Euler number and entropy generation. After that, RSM is applied to fit second order polynomials on responses. Finally, sensitivity analysis is conducted to manage the above mentioned parameters inside tube. Totally, 62 different cases are examined. CFD results show that Cu-water and Al2O3-water have the highest and lowest heat transfer rate, respectively. In addition, analysis of variances indicates that increase in solid volume fraction increases dimensionless pressure drop for Al2O3-water. Moreover, it has a significant negative and insignificant effects on Cu-water Nusselt and Euler numbers, respectively. Analysis of Bejan number indicates that frictional and thermal entropy generations are the dominant irreversibility in Al2O3-water and Cu-water flows, respectively. Sensitivity analysis indicates dimensionless pressure drop sensitivity to tube length for Cu-water is independent of its diameter ratio at different Reynolds numbers.

Functional determinants, index theorems, and exact quantum black hole entropy

NASA Astrophysics Data System (ADS)

Murthy, Sameer; Reys, Valentin

2015-12-01

The exact quantum entropy of BPS black holes can be evaluated using localization in supergravity. An important ingredient in this program, that has been lacking so far, is the one-loop effect arising from the quadratic fluctuations of the exact deformation (the QV operator). We compute the fluctuation determinant for vector multiplets and hyper multiplets around Q-invariant off-shell configurations in four-dimensional N=2 supergravity with AdS 2 × S 2 boundary conditions, using the Atiyah-Bott fixed-point index theorem and a subsequent zeta function regularization. Our results extend the large-charge on-shell entropy computations in the literature to a regime of finite charges. Based on our results, we present an exact formula for the quantum entropy of BPS black holes in N=2 supergravity. We explain cancellations concerning 1/8 -BPS black holes in N=8 supergravity that were observed in arXiv:1111.1161. We also make comments about the interpretation of a logarithmic term in the topological string partition function in the low energy supergravity theory.

Towards a second law for Lovelock theories

NASA Astrophysics Data System (ADS)

Bhattacharyya, Sayantani; Haehl, Felix M.; Kundu, Nilay; Loganayagam, R.; Rangamani, Mukund

2017-03-01

In classical general relativity described by Einstein-Hilbert gravity, black holes behave as thermodynamic objects. In particular, the laws of black hole mechanics can be interpreted as laws of thermodynamics. The first law of black hole mechanics extends to higher derivative theories via the Noether charge construction of Wald. One also expects the statement of the second law, which in Einstein-Hilbert theory owes to Hawking's area theorem, to extend to higher derivative theories. To argue for this however one needs a notion of entropy for dynamical black holes, which the Noether charge construction does not provide. We propose such an entropy function for the family of Lovelock theories, treating the higher derivative terms as perturbations to the Einstein-Hilbert theory. Working around a dynamical black hole solution, and making no assumptions about the amplitude of departure from equilibrium, we construct a candidate entropy functional valid to all orders in the low energy effective field theory. This entropy functional satisfies a second law, modulo a certain subtle boundary term, which deserves further investigation in non-spherically symmetric situations.

Thermodynamic perspectives on genetic instructions, the laws of biology and diseased states.

PubMed

Trevors, Jack T; Saier, Milton H

2011-01-01

This article examines in a broad perspective entropy and some examples of its relationship to evolution, genetic instructions and how we view diseases. Living organisms are programmed by functional genetic instructions (FGI), through cellular communication pathways, to grow and reproduce by maintaining a variety of hemistable, ordered structures (low entropy). Living organisms are far from equilibrium with their surrounding environmental systems, which tends towards increasing disorder (increasing entropy). Organisms free themselves from high entropy (high disorder) to maintain their cellular structures for a period of time sufficient to allow reproduction and the resultant offspring to reach reproductive ages. This time interval varies for different species. Bacteria, for example need no sexual parents; dividing cells are nearly identical to the previous generation of cells, and can begin a new cell cycle without delay under appropriate conditions. By contrast, human infants require years of care before they can reproduce. Living organisms maintain order in spite of their changing surrounding environment that decreases order according to the second law of thermodynamics. These events actually work together since living organisms create ordered biological structures by increasing local entropy. From a disease perspective, viruses and other disease agents interrupt the normal functioning of cells. The pressure for survival may result in mechanisms that allow organisms to resist attacks by viruses, other pathogens, destructive chemicals and physical agents such as radiation. However, when the attack is successful, the organism can be damaged until the cell, tissue, organ or entire organism is no longer functional and entropy increases. Copyright © 2010 Académie des sciences. Published by Elsevier SAS. All rights reserved.

Fourier heat conduction as a phenomenon described within the scope of the second law

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jesudason, Christopher G.

The historical development of the Carnot cycle necessitated the construction of isothermal and adiabatic pathways within the cycle that were also mechanically 'reversible' which lead eventually to the Kelvin-Clausius development of the entropy function S where for any reversible closed path C, ∮{sub C} dS = 0 based on an infinite number of concatenated Carnot engines that approximated the said path and where for each engine ΔQ{sub 1}/T{sub 1}+ΔQ{sub 2}/T{sub 2} = 0 where the Q's and T's are the heat absorption increments and temperature respectively with the subscripts indicating the isothermal paths (1;2) where for the Carnot engine, the heat absorptionmore » is for the diathermal (isothermal) paths of the cycle only. Since 'heat' has been defined as that form of energy that is transferred as a result of a temperature difference and a corollary of the Clausius statement of the Second law is that it is impossible for heat to be transferred from a cold to a hot reservoir with no other effect on the environment, these statements suggested that the local mode of transfer of 'heat' in the isothermal segments of the pathway does imply a Fourier heat conduction mechanism (to conform to the definition of 'heat') albeit of a 'reversible' kind, but on the other hand, the Fourier mechanism is apparently irreversible, leading to an increase in entropy of the combined reservoirs at either end of the material involved in the conveyance of the heat energy. These and several other considerations lead Benofy and Quay (BQ) to postulate the Fourier heat conduction phenomenon to be an ancillary principle in thermodynamics, with this principle being strictly local in nature, where the global Second law statements could not be applied to this local process. Here we present equations that model heat conduction as a thermodynamically reversible but mechanically irreversible process where due to the belief in mechanical time reversible symmetry, thermodynamical reversibility has been unfortunately linked to mechanical reversibility, that has discouraged such an association. The modeling is based on an application of a 'recoverable transition', defined and developed earlier on ideas derived from thermal desorption of particles from a surface where the Fourier heat conduction process is approximated as a series of such desorption processes. We recall that the original Carnot engine required both adiabatic and isothermal steps to complete the zero entropy cycle, and this construct lead to the consequent deduction that any Second law statement that refers to heat-work conversion processes are only globally relevant. Here, on the other hand, we examine Fourier heat conduction from MD simulation and model this process as a zero-entropy forward scattering process relative to each of the atoms in the lattice chain being treated as a system where the Carnot cycle can be applied individually. The equations developed predicts the 'work' done to be equal to the energy transfer rate. The MD simulations conducted shows excellent agreement with the theory. Such views and results as these, if developed to a successful conclusion could imply that the Carnot cycle be viewed as describing a local process of energy-work conversion and that irreversible local processes might be brought within the scope of this cycle, implying a unified treatment of thermodynamically (i) irreversible, (ii) reversible, (iii) isothermal and (iv) adiabatic processes.« less

Spin-phase-space-entropy production

NASA Astrophysics Data System (ADS)

Santos, Jader P.; Céleri, Lucas C.; Brito, Frederico; Landi, Gabriel T.; Paternostro, Mauro

2018-05-01

Quantifying the degree of irreversibility of an open system dynamics represents a problem of both fundamental and applied relevance. Even though a well-known framework exists for thermal baths, the results give diverging results in the limit of zero temperature and are also not readily extended to nonequilibrium reservoirs, such as dephasing baths. Aimed at filling this gap, in this paper we introduce a phase-space-entropy production framework for quantifying the irreversibility of spin systems undergoing Lindblad dynamics. The theory is based on the spin Husimi-Q function and its corresponding phase-space entropy, known as Wehrl entropy. Unlike the von Neumann entropy production rate, we show that in our framework, the Wehrl entropy production rate remains valid at any temperature and is also readily extended to arbitrary nonequilibrium baths. As an application, we discuss the irreversibility associated with the interaction of a two-level system with a single-photon pulse, a problem which cannot be treated using the conventional approach.

Estimating the melting point, entropy of fusion, and enthalpy of ...

EPA Pesticide Factsheets

The entropies of fusion, enthalies of fusion, and melting points of organic compounds can be estimated through three models developed using the SPARC (SPARC Performs Automated Reasoning in Chemistry) platform. The entropy of fusion is modeled through a combination of interaction terms and physical descriptors. The enthalpy of fusion is modeled as a function of the entropy of fusion, boiling point, and fexibility of the molecule. The melting point model is the enthlapy of fusion divided by the entropy of fusion. These models were developed in part to improve SPARC's vapor pressure and solubility models. These models have been tested on 904 unique compounds. The entropy model has a RMS of 12.5 J mol-1K-1. The enthalpy model has a RMS of 4.87 kJ mol-1. The melting point model has a RMS of 54.4°C. Published in the journal, SAR and QSAR in Environmental Research

Estimating the melting point, entropy of fusion, and enthalpy of fusion of organic compounds via SPARC.

PubMed

Whiteside, T S; Hilal, S H; Brenner, A; Carreira, L A

2016-08-01

The entropy of fusion, enthalpy of fusion, and melting point of organic compounds can be estimated through three models developed using the SPARC (SPARC Performs Automated Reasoning in Chemistry) platform. The entropy of fusion is modelled through a combination of interaction terms and physical descriptors. The enthalpy of fusion is modelled as a function of the entropy of fusion, boiling point, and flexibility of the molecule. The melting point model is the enthalpy of fusion divided by the entropy of fusion. These models were developed in part to improve SPARC's vapour pressure and solubility models. These models have been tested on 904 unique compounds. The entropy model has a RMS of 12.5 J mol(-1) K(-1). The enthalpy model has a RMS of 4.87 kJ mol(-1). The melting point model has a RMS of 54.4°C.

Entropy and long-range memory in random symbolic additive Markov chains

NASA Astrophysics Data System (ADS)

Melnik, S. S.; Usatenko, O. V.

2016-06-01

The goal of this paper is to develop an estimate for the entropy of random symbolic sequences with elements belonging to a finite alphabet. As a plausible model, we use the high-order additive stationary ergodic Markov chain with long-range memory. Supposing that the correlations between random elements of the chain are weak, we express the conditional entropy of the sequence by means of the symbolic pair correlation function. We also examine an algorithm for estimating the conditional entropy of finite symbolic sequences. We show that the entropy contains two contributions, i.e., the correlation and the fluctuation. The obtained analytical results are used for numerical evaluation of the entropy of written English texts and DNA nucleotide sequences. The developed theory opens the way for constructing a more consistent and sophisticated approach to describe the systems with strong short-range and weak long-range memory.

Entropy and long-range memory in random symbolic additive Markov chains.

PubMed

Melnik, S S; Usatenko, O V

2016-06-01

The goal of this paper is to develop an estimate for the entropy of random symbolic sequences with elements belonging to a finite alphabet. As a plausible model, we use the high-order additive stationary ergodic Markov chain with long-range memory. Supposing that the correlations between random elements of the chain are weak, we express the conditional entropy of the sequence by means of the symbolic pair correlation function. We also examine an algorithm for estimating the conditional entropy of finite symbolic sequences. We show that the entropy contains two contributions, i.e., the correlation and the fluctuation. The obtained analytical results are used for numerical evaluation of the entropy of written English texts and DNA nucleotide sequences. The developed theory opens the way for constructing a more consistent and sophisticated approach to describe the systems with strong short-range and weak long-range memory.

Elementary exact calculations of degree growth and entropy for discrete equations.

PubMed

Halburd, R G

2017-05-01

Second-order discrete equations are studied over the field of rational functions [Formula: see text], where z is a variable not appearing in the equation. The exact degree of each iterate as a function of z can be calculated easily using the standard calculations that arise in singularity confinement analysis, even when the singularities are not confined. This produces elementary yet rigorous entropy calculations.

Interatomic potentials in condensed matter via the maximum-entropy principle

NASA Astrophysics Data System (ADS)

Carlsson, A. E.

1987-09-01

A general method is described for the calculation of interatomic potentials in condensed-matter systems by use of a maximum-entropy Ansatz for the interatomic correlation functions. The interatomic potentials are given explicitly in terms of statistical correlation functions involving the potential energy and the structure factor of a ``reference medium.'' Illustrations are given for Al-Cu alloys and a model transition metal.

Radar detection with the Neyman-Pearson criterion using supervised-learning-machines trained with the cross-entropy error

NASA Astrophysics Data System (ADS)

Jarabo-Amores, María-Pilar; la Mata-Moya, David de; Gil-Pita, Roberto; Rosa-Zurera, Manuel

2013-12-01

The application of supervised learning machines trained to minimize the Cross-Entropy error to radar detection is explored in this article. The detector is implemented with a learning machine that implements a discriminant function, which output is compared to a threshold selected to fix a desired probability of false alarm. The study is based on the calculation of the function the learning machine approximates to during training, and the application of a sufficient condition for a discriminant function to be used to approximate the optimum Neyman-Pearson (NP) detector. In this article, the function a supervised learning machine approximates to after being trained to minimize the Cross-Entropy error is obtained. This discriminant function can be used to implement the NP detector, which maximizes the probability of detection, maintaining the probability of false alarm below or equal to a predefined value. Some experiments about signal detection using neural networks are also presented to test the validity of the study.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Flammia, Steven T.; Hamma, Alioscia; Hughes, Taylor L.

We generalize the topological entanglement entropy to a family of topological Renyi entropies parametrized by a parameter alpha, in an attempt to find new invariants for distinguishing topologically ordered phases. We show that, surprisingly, all topological Renyi entropies are the same, independent of alpha for all nonchiral topological phases. This independence shows that topologically ordered ground-state wave functions have reduced density matrices with a certain simple structure, and no additional universal information can be extracted from the entanglement spectrum.

Topological nearly entropy

NASA Astrophysics Data System (ADS)

Gulamsarwar, Syazwani; Salleh, Zabidin

2017-08-01

The purpose of this paper is to generalize the notions of Adler's topological entropy along with their several fundamental properties. A function f : X → Y is said to be R-map if f-1 (V) is regular open in X for every regular open set V in Y. Thus, we initiated a notion of topological nearly entropy for topological R-dynamical systems which is based on nearly compact relative to the space by using R-map.

Application of online measures to monitor and evaluate multiplatform fusion performance

NASA Astrophysics Data System (ADS)

Stubberud, Stephen C.; Kowalski, Charlene; Klamer, Dale M.

1999-07-01

A primary concern of multiplatform data fusion is assessing the quality and utility of data shared among platforms. Constraints such as platform and sensor capability and task load necessitate development of an on-line system that computes a metric to determine which other platform can provide the best data for processing. To determine data quality, we are implementing an approach based on entropy coupled with intelligent agents. To determine data quality, we are implementing an approach based on entropy coupled with intelligent agents. Entropy measures quality of processed information such as localization, classification, and ambiguity in measurement-to-track association. Lower entropy scores imply less uncertainty about a particular target. When new information is provided, we compuete the level of improvement a particular track obtains from one measurement to another. The measure permits us to evaluate the utility of the new information. We couple entropy with intelligent agents that provide two main data gathering functions: estimation of another platform's performance and evaluation of the new measurement data's quality. Both functions result from the entropy metric. The intelligent agent on a platform makes an estimate of another platform's measurement and provides it to its own fusion system, which can then incorporate it, for a particular target. A resulting entropy measure is then calculated and returned to its own agent. From this metric, the agent determines a perceived value of the offboard platform's measurement. If the value is satisfactory, the agent requests the measurement from the other platform, usually by interacting with the other platform's agent. Once the actual measurement is received, again entropy is computed and the agent assesses its estimation process and refines it accordingly.

The Entropy of Non-Ergodic Complex Systems — a Derivation from First Principles

NASA Astrophysics Data System (ADS)

Thurner, Stefan; Hanel, Rudolf

In information theory the 4 Shannon-Khinchin1,2 (SK) axioms determine Boltzmann Gibbs entropy, S -∑i pilog pi, as the unique entropy. Physics is different from information in the sense that physical systems can be non-ergodic or non-Markovian. To characterize such strongly interacting, statistical systems - complex systems in particular - within a thermodynamical framework it might be necessary to introduce generalized entropies. A series of such entropies have been proposed in the past decades. Until now the understanding of their fundamental origin and their deeper relations to complex systems remains unclear. To clarify the situation we note that non-ergodicity explicitly violates the fourth SK axiom. We show that by relaxing this axiom the entropy generalizes to, S ∑i Γ(d + 1, 1 - c log pi), where Γ is the incomplete Gamma function, and c and d are scaling exponents. All recently proposed entropies compatible with the first 3 SK axioms appear to be special cases. We prove that each statistical system is uniquely characterized by the pair of the two scaling exponents (c, d), which defines equivalence classes for all systems. The corresponding distribution functions are special forms of Lambert-W exponentials containing, as special cases, Boltzmann, stretched exponential and Tsallis distributions (power-laws) - all widely abundant in nature. This derivation is the first ab initio justification for generalized entropies. We next show how the phasespace volume of a system is related to its generalized entropy, and provide a concise criterion when it is not of Boltzmann-Gibbs type but assumes a generalized form. We show that generalized entropies only become relevant when the dynamically (statistically) relevant fraction of degrees of freedom in a system vanishes in the thermodynamic limit. These are systems where the bulk of the degrees of freedom is frozen. Systems governed by generalized entropies are therefore systems whose phasespace volume effectively collapses to a lower-dimensional 'surface'. We explicitly illustrate the situation for accelerating random walks, and a spin system on a constant-conectancy network. We argue that generalized entropies should be relevant for self-organized critical systems such as sand piles, for spin systems which form meta-structures such as vortices, domains, instantons, etc., and for problems associated with anomalous diffusion.

Temporal and Spatial Evolution Characteristics of Disturbance Wave in a Hypersonic Boundary Layer due to Single-Frequency Entropy Disturbance

PubMed Central

Lv, Hongqing; Shi, Jianqiang

2014-01-01

By using a high-order accurate finite difference scheme, direct numerical simulation of hypersonic flow over an 8° half-wedge-angle blunt wedge under freestream single-frequency entropy disturbance is conducted; the generation and the temporal and spatial nonlinear evolution of boundary layer disturbance waves are investigated. Results show that, under the freestream single-frequency entropy disturbance, the entropy state of boundary layer is changed sharply and the disturbance waves within a certain frequency range are induced in the boundary layer. Furthermore, the amplitudes of disturbance waves in the period phase are larger than that in the response phase and ablation phase and the frequency range in the boundary layer in the period phase is narrower than that in these two phases. In addition, the mode competition, dominant mode transformation, and disturbance energy transfer exist among different modes both in temporal and in spatial evolution. The mode competition changes the characteristics of nonlinear evolution of the unstable waves in the boundary layer. The development of the most unstable mode along streamwise relies more on the motivation of disturbance waves in the upstream than that of other modes on this motivation. PMID:25143983

Temporal and spatial evolution characteristics of disturbance wave in a hypersonic boundary layer due to single-frequency entropy disturbance.

PubMed

Wang, Zhenqing; Tang, Xiaojun; Lv, Hongqing; Shi, Jianqiang

2014-01-01

By using a high-order accurate finite difference scheme, direct numerical simulation of hypersonic flow over an 8° half-wedge-angle blunt wedge under freestream single-frequency entropy disturbance is conducted; the generation and the temporal and spatial nonlinear evolution of boundary layer disturbance waves are investigated. Results show that, under the freestream single-frequency entropy disturbance, the entropy state of boundary layer is changed sharply and the disturbance waves within a certain frequency range are induced in the boundary layer. Furthermore, the amplitudes of disturbance waves in the period phase are larger than that in the response phase and ablation phase and the frequency range in the boundary layer in the period phase is narrower than that in these two phases. In addition, the mode competition, dominant mode transformation, and disturbance energy transfer exist among different modes both in temporal and in spatial evolution. The mode competition changes the characteristics of nonlinear evolution of the unstable waves in the boundary layer. The development of the most unstable mode along streamwise relies more on the motivation of disturbance waves in the upstream than that of other modes on this motivation.

Magnetic Stirling cycles - A new application for magnetic materials

NASA Technical Reports Server (NTRS)

Brown, G. V.

1977-01-01

There is the prospect of a fundamental new application for magnetic materials as the working substance in thermodynamic cycles. Recuperative cycles which use a rare-earth ferromagnetic material near its Curie point in the field of a superconducting magnet appear feasible for applications from below 20 K to above room temperature. The elements of the cycle, advanced in an earlier paper, are summarized. The basic advantages include high entropy density in the magnetic material, completely reversible processes, convenient control of the entropy by the applied field, the feature that heat transfer is possible during all processes, and the ability of the ideal cycle to attain Carnot efficiency. The mean field theory is used to predict the entropy of a ferromagnet in an applied field and also the isothermal entropy change and isentropic temperature change caused by applying a field. Results are presented for J = 7/2 and g = 2. The results for isentropic temperature change are compared with experimental data on Gd. Coarse mixtures of ferromagnetic materials with different Curie points are proposed to modify the path of the cycle in the T-S diagram in order to improve the efficiency or to increase the specific power.

The viscosity to entropy ratio: From string theory motivated bounds to warm dense matter

DOE PAGES

Faussurier, G.; Libby, S. B.; Silvestrelli, P. L.

2014-07-04

Here, we study the ratio of viscosity to entropy density in Yukawa one-component plasmas as a function of coupling parameter at fixed screening, and in realistic warm dense matter models as a function of temperature at fixed density. In these two situations, the ratio is minimized for values of the coupling parameters that depend on screening, and for temperatures that in turn depend on density and material. In this context, we also examine Rosenfeld arguments relating transport coefficients to excess reduced entropy for Yukawa one-component plasmas. For these cases we show that this ratio is always above the lower-bound conjecturemore » derived from string theory ideas.« less

Chapman Enskog-maximum entropy method on time-dependent neutron transport equation

NASA Astrophysics Data System (ADS)

Abdou, M. A.

2006-09-01

The time-dependent neutron transport equation in semi and infinite medium with linear anisotropic and Rayleigh scattering is proposed. The problem is solved by means of the flux-limited, Chapman Enskog-maximum entropy for obtaining the solution of the time-dependent neutron transport. The solution gives the neutron distribution density function which is used to compute numerically the radiant energy density E(x,t), net flux F(x,t) and reflectivity Rf. The behaviour of the approximate flux-limited maximum entropy neutron density function are compared with those found by other theories. Numerical calculations for the radiant energy, net flux and reflectivity of the proposed medium are calculated at different time and space.

Liquid-Vapor Phase Transition: Thermomechanical Theory, Entropy Stable Numerical Formulation, and Boiling Simulations

DTIC Science & Technology

2015-05-01

will be omitted for notational simplicity. 32 3.3 Functional entropy variables The mathematical entropy function H is defined to be H := −ρs = 8 27 ρ log...ρ 1− ρ ) − 8 27(γ − 1) ρ log (θ) . (104) With this definition and the relation (72), the second law of thermodynamics can be written in terms of H ...as ∂ H ∂t +∇ · (Hu)−∇ · (q θ ) + ρr θ = −1 θ τ : ∇u− 1 θ2 κ|∇θ|2 ≤ 0. In three dimensions, the conservation variables can be written as UT = [U1, U2

Entropy generation in a mixed convection Poiseulle flow of molybdenum disulphide Jeffrey nanofluid

NASA Astrophysics Data System (ADS)

Gul, Aaiza; Khan, Ilyas; Makhanov, Stanislav S.

2018-06-01

Entropy analysis in a mixed convection Poiseulle flow of a Molybdenum Disulphide Jeffrey Nanofluid (MDJN) is presented. Mixed convection is caused due to buoyancy force and external pressure gradient. The problem is formulated in terms of a boundary value problem for a system of partial differential equations. An analytical solution for the velocity and the temperature is obtained using the perturbation technique. Entropy generation has been derived as a function of the velocity and temperature gradients. The solutions are displayed graphically and the relevant importance of the input parameters is discussed. A Jeffrey nanofluid (JN) has been compared with a second grade nanofluid (SGN) and Newtonian nanofluid (NN). It is found that the entropy generation decreases when the temperature increases whereas increasing the Brickman number increases entropy generation.

Applications of quantum entropy to statistics

NASA Astrophysics Data System (ADS)

Silver, R. N.; Martz, H. F.

This paper develops two generalizations of the maximum entropy (ME) principle. First, Shannon classical entropy is replaced by von Neumann quantum entropy to yield a broader class of information divergences (or penalty functions) for statistics applications. Negative relative quantum entropy enforces convexity, positivity, non-local extensivity and prior correlations such as smoothness. This enables the extension of ME methods from their traditional domain of ill-posed in-verse problems to new applications such as non-parametric density estimation. Second, given a choice of information divergence, a combination of ME and Bayes rule is used to assign both prior and posterior probabilities. Hyperparameters are interpreted as Lagrange multipliers enforcing constraints. Conservation principles are proposed to act statistical regularization and other hyperparameters, such as conservation of information and smoothness. ME provides an alternative to hierarchical Bayes methods.

An explorative investigation of functional differences in plantar center of pressure of four foot types using sample entropy method.

PubMed

Mei, Zhanyong; Ivanov, Kamen; Zhao, Guoru; Li, Huihui; Wang, Lei

2017-04-01

In the study of biomechanics of different foot types, temporal or spatial parameters derived from plantar pressure are often used. However, there is no comparative study of complexity and regularity of the center of pressure (CoP) during the stance phase among pes valgus, pes cavus, hallux valgus and normal foot. We aim to analyze whether CoP sample entropy characteristics differ among these four foot types. In our experiment participated 40 subjects with normal feet, 40 with pes cavus, 19 with pes valgus and 36 with hallux valgus. A Footscan ® system was used to collect CoP data. We used sample entropy to quantify several parameters of the investigated four foot types. These are the displacement in medial-lateral (M/L) and anterior-posterior (A/P) directions, as well as the vertical ground reaction force of CoP during the stance phase. To fully examine the potential of the sample entropy method for quantification of CoP components, we provide results for two cases: calculating the sample entropy of normalized CoP components, as well as calculating it using the raw data of CoP components. We also explored what are the optimal values of parameters m (the matching length) and r (the tolerance range) when calculating the sample entropy of CoP data obtained during the stance phases. According to statistical results, some factors significantly influenced the sample entropy of CoP components. The sample entropies of non-normalized A/P values for the left foot, as well as for the right foot, were different between the normal foot and pes valgus, and between the normal foot and hallux valgus. The sample entropy of normalized M/L displacement of the right foot was different between the normal foot and pes cavus. The measured variable for A/P and M/L displacements could serve for the study of foot function.

The maximum entropy method of moments and Bayesian probability theory

NASA Astrophysics Data System (ADS)

Bretthorst, G. Larry

2013-08-01

The problem of density estimation occurs in many disciplines. For example, in MRI it is often necessary to classify the types of tissues in an image. To perform this classification one must first identify the characteristics of the tissues to be classified. These characteristics might be the intensity of a T1 weighted image and in MRI many other types of characteristic weightings (classifiers) may be generated. In a given tissue type there is no single intensity that characterizes the tissue, rather there is a distribution of intensities. Often this distributions can be characterized by a Gaussian, but just as often it is much more complicated. Either way, estimating the distribution of intensities is an inference problem. In the case of a Gaussian distribution, one must estimate the mean and standard deviation. However, in the Non-Gaussian case the shape of the density function itself must be inferred. Three common techniques for estimating density functions are binned histograms [1, 2], kernel density estimation [3, 4], and the maximum entropy method of moments [5, 6]. In the introduction, the maximum entropy method of moments will be reviewed. Some of its problems and conditions under which it fails will be discussed. Then in later sections, the functional form of the maximum entropy method of moments probability distribution will be incorporated into Bayesian probability theory. It will be shown that Bayesian probability theory solves all of the problems with the maximum entropy method of moments. One gets posterior probabilities for the Lagrange multipliers, and, finally, one can put error bars on the resulting estimated density function.

Estimates of the information content and dimensionality of natural scenes from proximity distributions

NASA Astrophysics Data System (ADS)

Chandler, Damon M.; Field, David J.

2007-04-01

Natural scenes, like most all natural data sets, show considerable redundancy. Although many forms of redundancy have been investigated (e.g., pixel distributions, power spectra, contour relationships, etc.), estimates of the true entropy of natural scenes have been largely considered intractable. We describe a technique for estimating the entropy and relative dimensionality of image patches based on a function we call the proximity distribution (a nearest-neighbor technique). The advantage of this function over simple statistics such as the power spectrum is that the proximity distribution is dependent on all forms of redundancy. We demonstrate that this function can be used to estimate the entropy (redundancy) of 3×3 patches of known entropy as well as 8×8 patches of Gaussian white noise, natural scenes, and noise with the same power spectrum as natural scenes. The techniques are based on assumptions regarding the intrinsic dimensionality of the data, and although the estimates depend on an extrapolation model for images larger than 3×3, we argue that this approach provides the best current estimates of the entropy and compressibility of natural-scene patches and that it provides insights into the efficiency of any coding strategy that aims to reduce redundancy. We show that the sample of 8×8 patches of natural scenes used in this study has less than half the entropy of 8×8 white noise and less than 60% of the entropy of noise with the same power spectrum. In addition, given a finite number of samples (<220) drawn randomly from the space of 8×8 patches, the subspace of 8×8 natural-scene patches shows a dimensionality that depends on the sampling density and that for low densities is significantly lower dimensional than the space of 8×8 patches of white noise and noise with the same power spectrum.

Entanglement of two blocks of spins in the critical Ising model

NASA Astrophysics Data System (ADS)

Facchi, P.; Florio, G.; Invernizzi, C.; Pascazio, S.

2008-11-01

We compute the entropy of entanglement of two blocks of L spins at a distance d in the ground state of an Ising chain in an external transverse magnetic field. We numerically study the von Neumann entropy for different values of the transverse field. At the critical point we obtain analytical results for blocks of size L=1 and 2. In the general case, the critical entropy is shown to be additive when d→∞ . Finally, based on simple arguments, we derive an expression for the entropy at the critical point as a function of both L and d . This formula is in excellent agreement with numerical results.

Continuous time wavelet entropy of auditory evoked potentials.

PubMed

Cek, M Emre; Ozgoren, Murat; Savaci, F Acar

2010-01-01

In this paper, the continuous time wavelet entropy (CTWE) of auditory evoked potentials (AEP) has been characterized by evaluating the relative wavelet energies (RWE) in specified EEG frequency bands. Thus, the rapid variations of CTWE due to the auditory stimulation could be detected in post-stimulus time interval. This approach removes the probability of missing the information hidden in short time intervals. The discrete time and continuous time wavelet based wavelet entropy variations were compared on non-target and target AEP data. It was observed that CTWE can also be an alternative method to analyze entropy as a function of time. 2009 Elsevier Ltd. All rights reserved.

Sharp Estimates in Ruelle Theorems for Matrix Transfer Operators

NASA Astrophysics Data System (ADS)

Campbell, J.; Latushkin, Y.

A matrix coefficient transfer operator , on the space of -sections of an m-dimensional vector bundle over n-dimensional compact manifold is considered. The spectral radius of is estimated bya; and the essential spectral radius by Here is the set of ergodic f-invariant measures, and for is the measure-theoretic entropy of f, is the largest Lyapunov exponent of the cocycle over f generated by , and is the smallest Lyapunov exponent of the differential of f.

Towards operational interpretations of generalized entropies

NASA Astrophysics Data System (ADS)

Topsøe, Flemming

2010-12-01

The driving force behind our study has been to overcome the difficulties you encounter when you try to extend the clear and convincing operational interpretations of classical Boltzmann-Gibbs-Shannon entropy to other notions, especially to generalized entropies as proposed by Tsallis. Our approach is philosophical, based on speculations regarding the interplay between truth, belief and knowledge. The main result demonstrates that, accepting philosophically motivated assumptions, the only possible measures of entropy are those suggested by Tsallis - which, as we know, include classical entropy. This result constitutes, so it seems, a more transparent interpretation of entropy than previously available. However, further research to clarify the assumptions is still needed. Our study points to the thesis that one should never consider the notion of entropy in isolation - in order to enable a rich and technically smooth study, further concepts, such as divergence, score functions and descriptors or controls should be included in the discussion. This will clarify the distinction between Nature and Observer and facilitate a game theoretical discussion. The usefulness of this distinction and the subsequent exploitation of game theoretical results - such as those connected with the notion of Nash equilibrium - is demonstrated by a discussion of the Maximum Entropy Principle.

Rényi entropy of the totally asymmetric exclusion process

NASA Astrophysics Data System (ADS)

Wood, Anthony J.; Blythe, Richard A.; Evans, Martin R.

2017-11-01

The Rényi entropy is a generalisation of the Shannon entropy that is sensitive to the fine details of a probability distribution. We present results for the Rényi entropy of the totally asymmetric exclusion process (TASEP). We calculate explicitly an entropy whereby the squares of configuration probabilities are summed, using the matrix product formalism to map the problem to one involving a six direction lattice walk in the upper quarter plane. We derive the generating function across the whole phase diagram, using an obstinate kernel method. This gives the leading behaviour of the Rényi entropy and corrections in all phases of the TASEP. The leading behaviour is given by the result for a Bernoulli measure and we conjecture that this holds for all Rényi entropies. Within the maximal current phase the correction to the leading behaviour is logarithmic in the system size. Finally, we remark upon a special property of equilibrium systems whereby discontinuities in the Rényi entropy arise away from phase transitions, which we refer to as secondary transitions. We find no such secondary transition for this nonequilibrium system, supporting the notion that these are specific to equilibrium cases.

Moments of the Wigner function and Renyi entropies at freeze-out

NASA Astrophysics Data System (ADS)

Bialas, A.; Czyz, W.; Zalewski, K.

2006-03-01

The relation between Renyi entropies and moments of the Wigner function, representing the quantum mechanical description of the M-particle semi-inclusive distribution at freeze-out, is investigated. It is shown that in the limit of infinite volume of the system, the classical and quantum descriptions are equivalent. Finite volume corrections are derived and shown to be small for systems encountered in relativistic heavy ion collisions.

Moisture sorption isotherms and thermodynamic properties of mexican mennonite-style cheese.

PubMed

Martinez-Monteagudo, Sergio I; Salais-Fierro, Fabiola

2014-10-01

Moisture adsorption isotherms of fresh and ripened Mexican Mennonite-style cheese were investigated using the static gravimetric method at 4, 8, and 12 °C in a water activity range (aw) of 0.08-0.96. These isotherms were modeled using GAB, BET, Oswin and Halsey equations through weighed non-linear regression. All isotherms were sigmoid in shape, showing a type II BET isotherm, and the data were best described by GAB model. GAB model coefficients revealed that water adsorption by cheese matrix is a multilayer process characterized by molecules that are strongly bound in the monolayer and molecules that are slightly structured in a multilayer. Using the GAB model, it was possible to estimate thermodynamic functions (net isosteric heat, differential entropy, integral enthalpy and entropy, and enthalpy-entropy compensation) as function of moisture content. For both samples, the isosteric heat and differential entropy decreased with moisture content in exponential fashion. The integral enthalpy gradually decreased with increasing moisture content after reached a maximum value, while the integral entropy decreased with increasing moisture content after reached a minimum value. A linear compensation was found between integral enthalpy and entropy suggesting enthalpy controlled adsorption. Determination of moisture content and aw relationship yields to important information of controlling the ripening, drying and storage operations as well as understanding of the water state within a cheese matrix.

Rescuing the MaxEnt treatment for q-generalized entropies

NASA Astrophysics Data System (ADS)

Plastino, A.; Rocca, M. C.

2018-02-01

It has been recently argued that the MaxEnt variational problem would not adequately work for Renyi's and Tsallis' entropies. We constructively show here that this is not so if one formulates the associated variational problem in a more orthodox functional fashion.

Metabolic networks evolve towards states of maximum entropy production.

PubMed

Unrean, Pornkamol; Srienc, Friedrich

2011-11-01

A metabolic network can be described by a set of elementary modes or pathways representing discrete metabolic states that support cell function. We have recently shown that in the most likely metabolic state the usage probability of individual elementary modes is distributed according to the Boltzmann distribution law while complying with the principle of maximum entropy production. To demonstrate that a metabolic network evolves towards such state we have carried out adaptive evolution experiments with Thermoanaerobacterium saccharolyticum operating with a reduced metabolic functionality based on a reduced set of elementary modes. In such reduced metabolic network metabolic fluxes can be conveniently computed from the measured metabolite secretion pattern. Over a time span of 300 generations the specific growth rate of the strain continuously increased together with a continuous increase in the rate of entropy production. We show that the rate of entropy production asymptotically approaches the maximum entropy production rate predicted from the state when the usage probability of individual elementary modes is distributed according to the Boltzmann distribution. Therefore, the outcome of evolution of a complex biological system can be predicted in highly quantitative terms using basic statistical mechanical principles. Copyright © 2011 Elsevier Inc. All rights reserved.

Information theoretical approach to discovering solar wind drivers of the outer radiation belt

DOE PAGES

Wing, Simon; Johnson, Jay R.; Camporeale, Enrico; ...

2016-07-29

The solar wind-magnetosphere system is nonlinear. The solar wind drivers of geosynchronous electrons with energy range of 1.8–3.5 MeV are investigated using mutual information, conditional mutual information (CMI), and transfer entropy (TE). These information theoretical tools can establish linear and nonlinear relationships as well as information transfer. The information transfer from solar wind velocity ( Vsw) to geosynchronous MeV electron flux ( Je) peaks with a lag time of 2 days. As previously reported, Je is anticorrelated with solar wind density ( nsw) with a lag of 1 day. However, this lag time and anticorrelation can be attributed at leastmore » partly to the Je( t + 2 days) correlation with Vsw( t) and nsw( t + 1 day) anticorrelation with Vsw( t). Analyses of solar wind driving of the magnetosphere need to consider the large lag times, up to 3 days, in the ( Vsw, nsw) anticorrelation. Using CMI to remove the effects of Vsw, the response of Je to nsw is 30% smaller and has a lag time < 24 h, suggesting that the MeV electron loss mechanism due to nsw or solar wind dynamic pressure has to start operating in < 24 h. nsw transfers about 36% as much information as Vsw (the primary driver) to Je. Nonstationarity in the system dynamics is investigated using windowed TE. Here, when the data are ordered according to transfer entropy value, it is possible to understand details of the triangle distribution that has been identified between Je( t + 2 days) versus Vsw( t).« less

Information theoretical approach to discovering solar wind drivers of the outer radiation belt

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wing, Simon; Johnson, Jay R.; Camporeale, Enrico

The solar wind-magnetosphere system is nonlinear. The solar wind drivers of geosynchronous electrons with energy range of 1.8–3.5 MeV are investigated using mutual information, conditional mutual information (CMI), and transfer entropy (TE). These information theoretical tools can establish linear and nonlinear relationships as well as information transfer. The information transfer from solar wind velocity ( Vsw) to geosynchronous MeV electron flux ( Je) peaks with a lag time of 2 days. As previously reported, Je is anticorrelated with solar wind density ( nsw) with a lag of 1 day. However, this lag time and anticorrelation can be attributed at leastmore » partly to the Je( t + 2 days) correlation with Vsw( t) and nsw( t + 1 day) anticorrelation with Vsw( t). Analyses of solar wind driving of the magnetosphere need to consider the large lag times, up to 3 days, in the ( Vsw, nsw) anticorrelation. Using CMI to remove the effects of Vsw, the response of Je to nsw is 30% smaller and has a lag time < 24 h, suggesting that the MeV electron loss mechanism due to nsw or solar wind dynamic pressure has to start operating in < 24 h. nsw transfers about 36% as much information as Vsw (the primary driver) to Je. Nonstationarity in the system dynamics is investigated using windowed TE. Here, when the data are ordered according to transfer entropy value, it is possible to understand details of the triangle distribution that has been identified between Je( t + 2 days) versus Vsw( t).« less

Vacuum drying of apples (cv. Golden Delicious): drying characteristics, thermodynamic properties, and mass transfer parameters

NASA Astrophysics Data System (ADS)

Nadi, Fatemeh; Tzempelikos, Dimitrios

2018-01-01

In this work, apples of cv. Golden Delicious were cut into slices that were 5 and 7 mm thick and then vacuum dried at 50, 60 and 70 °C and pressure of 0.02 bar. The thin layer model drying kinetics was studied, and mass transfer properties, specifically effective moisture diffusivity and convective mass transfer coefficient, were evaluated using the Fick's equation of diffusion. Also, thermodynamic parameters of the process, i.e. enthalpy (ΔH), entropy (ΔS) and Gibbs free energy (ΔG), were determined. Colour properties were evaluated as one of the important indicators of food quality and marketability. Determination of mass transfer parameters and thermodynamic properties of vacuum dried apple slices has not been discussed much in the literature. In conclusion, the Nadi's model fitted best the observed data that represent the drying process. Thermodynamic properties were determined based on the dependence of the drying constant of the Henderson and Pabis model on temperature, and it was concluded that the variation in drying kinetics depends on the energy contribution of the surrounding environment. The enthalpy and entropy diminished, while the Gibbs free energy increased with the increase of the temperature of drying; therefore, it was possible to verify that variation in the diffusion process in the apple during drying depends on energetic contributions of the environment. The obtained results showed that diffusivity increased for 69%, while the mass transfer coefficient increase was even higher, 75%, at the variation of temperature of 20 °C. The increase in the dimensionless Biot number was 20%.

Vacuum drying of apples (cv. Golden Delicious): drying characteristics, thermodynamic properties, and mass transfer parameters

NASA Astrophysics Data System (ADS)

Nadi, Fatemeh; Tzempelikos, Dimitrios

2018-07-01

In this work, apples of cv. Golden Delicious were cut into slices that were 5 and 7 mm thick and then vacuum dried at 50, 60 and 70 °C and pressure of 0.02 bar. The thin layer model drying kinetics was studied, and mass transfer properties, specifically effective moisture diffusivity and convective mass transfer coefficient, were evaluated using the Fick's equation of diffusion. Also, thermodynamic parameters of the process, i.e. enthalpy ( ΔH), entropy ( ΔS) and Gibbs free energy ( ΔG), were determined. Colour properties were evaluated as one of the important indicators of food quality and marketability. Determination of mass transfer parameters and thermodynamic properties of vacuum dried apple slices has not been discussed much in the literature. In conclusion, the Nadi's model fitted best the observed data that represent the drying process. Thermodynamic properties were determined based on the dependence of the drying constant of the Henderson and Pabis model on temperature, and it was concluded that the variation in drying kinetics depends on the energy contribution of the surrounding environment. The enthalpy and entropy diminished, while the Gibbs free energy increased with the increase of the temperature of drying; therefore, it was possible to verify that variation in the diffusion process in the apple during drying depends on energetic contributions of the environment. The obtained results showed that diffusivity increased for 69%, while the mass transfer coefficient increase was even higher, 75%, at the variation of temperature of 20 °C. The increase in the dimensionless Biot number was 20%.

AdS and dS Entropy from String Junctions or The Function of Junction Conjunctions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Silverstein, Eva M

Flux compactifications of string theory exhibiting the possibility of discretely tuning the cosmological constant to small values have been constructed. The highly tuned vacua in this discretuum have curvature radii which scale as large powers of the flux quantum numbers, exponential in the number of cycles in the compactification. By the arguments of Susskind/Witten (in the AdS case) and Gibbons/Hawking (in the dS case), we expect correspondingly large entropies associated with these vacua. If they are to provide a dual description of these vacua on their Coulomb branch, branes traded for the flux need to account for this entropy atmore » the appropriate energy scale. In this note, we argue that simple string junctions and webs ending on the branes can account for this large entropy, obtaining a rough estimate for junction entropy that agrees with the existing rough estimates for the spacing of the discretuum. In particular, the brane entropy can account for the (A)dS entropy far away from string scale correspondence limits.« less

Rényi continuous entropy of DNA sequences.

PubMed

Vinga, Susana; Almeida, Jonas S

2004-12-07

Entropy measures of DNA sequences estimate their randomness or, inversely, their repeatability. L-block Shannon discrete entropy accounts for the empirical distribution of all length-L words and has convergence problems for finite sequences. A new entropy measure that extends Shannon's formalism is proposed. Renyi's quadratic entropy calculated with Parzen window density estimation method applied to CGR/USM continuous maps of DNA sequences constitute a novel technique to evaluate sequence global randomness without some of the former method drawbacks. The asymptotic behaviour of this new measure was analytically deduced and the calculation of entropies for several synthetic and experimental biological sequences was performed. The results obtained were compared with the distributions of the null model of randomness obtained by simulation. The biological sequences have shown a different p-value according to the kernel resolution of Parzen's method, which might indicate an unknown level of organization of their patterns. This new technique can be very useful in the study of DNA sequence complexity and provide additional tools for DNA entropy estimation. The main MATLAB applications developed and additional material are available at the webpage . Specialized functions can be obtained from the authors.

Thermodynamic perspectives on genetic instructions, the laws of biology, diseased states and human population control

PubMed Central

Saier, M. H.

2014-01-01

This article examines in a broad perspective entropy and some examples of its relationship to evolution, genetic instructions and how we view diseases. Many knowledge gaps abound, hence our understanding is still fragmented and incomplete. Living organisms are programmed by functional genetic instructions (FGI), through cellular communication pathways, to grow and reproduce by maintaining a variety of hemistable, ordered structures (low entropy). Living organisms are far from equilibrium with their surrounding environmental systems, which tends towards increasing disorder (increasing entropy). Organisms must free themselves from high entropy (high disorder) to maintain their cellular structures for a period of time sufficient enough to allow reproduction and the resultant offspring to reach reproductive ages. This time interval varies for different species. Bacteria, for example need no sexual parents; dividing cells are nearly identical to the previous generation of cells, and can begin a new cell cycle without delay under appropriate conditions. By contrast, human infants require years of care before they can reproduce. Living organisms maintain order in spite of their changing surrounding environment, that decreases order according to the second law of thermodynamics. These events actually work together since living organisms create ordered biological structures by increasing local entropy. From a disease perspective, viruses and other disease agents interrupt the normal functioning of cells. The pressure for survival may result in mechanisms that allow organisms to resist attacks by viruses, other pathogens, destructive chemicals and physical agents such as radiation. However, when the attack is successful, the organism can be damaged until the cell, tissue, organ or entire organism is no longer functional and entropy increases. PMID:21262480

Making Difficult Things Easy and Easy Things Difficult.

ERIC Educational Resources Information Center

Campbell, J. Arthur; Bent, Henry A.

1982-01-01

Suggestions are offered to illustrate concepts and processes by using simple materials such as paper, paper clip, rubber band (bonding, entropy, endothermic processes). Also suggests using basic terminology: elementary ratios, percent, reaction chemistry for entropy function; equilibrium constants for Gibbs energies; and chemical mechanics for…

A surprising role for conformational entropy in protein function

PubMed Central

Wand, A. Joshua; Moorman, Veronica R.; Harpole, Kyle W.

2014-01-01

Formation of high-affinity complexes is critical for the majority of enzymatic reactions involving proteins. The creation of the family of Michaelis and other intermediate complexes during catalysis clearly involves a complicated manifold of interactions that are diverse and complex. Indeed, computing the energetics of interactions between proteins and small molecule ligands using molecular structure alone remains a grand challenge. One of the most difficult contributions to the free energy of protein-ligand complexes to experimentally access is that due to changes in protein conformational entropy. Fortunately, recent advances in solution nuclear magnetic resonance (NMR) relaxation methods have enabled the use of measures-of-motion between conformational states of a protein as a proxy for conformational entropy. This review briefly summarizes the experimental approaches currently employed to characterize fast internal motion in proteins, how this information is used to gain insight into conformational entropy, what has been learned and what the future may hold for this emerging view of protein function. PMID:23478875

Inhomogeneous point-process entropy: An instantaneous measure of complexity in discrete systems

NASA Astrophysics Data System (ADS)

Valenza, Gaetano; Citi, Luca; Scilingo, Enzo Pasquale; Barbieri, Riccardo

2014-05-01

Measures of entropy have been widely used to characterize complexity, particularly in physiological dynamical systems modeled in discrete time. Current approaches associate these measures to finite single values within an observation window, thus not being able to characterize the system evolution at each moment in time. Here, we propose a new definition of approximate and sample entropy based on the inhomogeneous point-process theory. The discrete time series is modeled through probability density functions, which characterize and predict the time until the next event occurs as a function of the past history. Laguerre expansions of the Wiener-Volterra autoregressive terms account for the long-term nonlinear information. As the proposed measures of entropy are instantaneously defined through probability functions, the novel indices are able to provide instantaneous tracking of the system complexity. The new measures are tested on synthetic data, as well as on real data gathered from heartbeat dynamics of healthy subjects and patients with cardiac heart failure and gait recordings from short walks of young and elderly subjects. Results show that instantaneous complexity is able to effectively track the system dynamics and is not affected by statistical noise properties.

Numerical study of entropy generation and melting heat transfer on MHD generalised non-Newtonian fluid (GNF): Application to optimal energy

NASA Astrophysics Data System (ADS)

Iqbal, Z.; Mehmood, Zaffar; Ahmad, Bilal

2018-05-01

This paper concerns an application to optimal energy by incorporating thermal equilibrium on MHD-generalised non-Newtonian fluid model with melting heat effect. Highly nonlinear system of partial differential equations is simplified to a nonlinear system using boundary layer approach and similarity transformations. Numerical solutions of velocity and temperature profile are obtained by using shooting method. The contribution of entropy generation is appraised on thermal and fluid velocities. Physical features of relevant parameters have been discussed by plotting graphs and tables. Some noteworthy findings are: Prandtl number, power law index and Weissenberg number contribute in lowering mass boundary layer thickness and entropy effect and enlarging thermal boundary layer thickness. However, an increasing mass boundary layer effect is only due to melting heat parameter. Moreover, thermal boundary layers have same trend for all parameters, i.e., temperature enhances with increase in values of significant parameters. Similarly, Hartman and Weissenberg numbers enhance Bejan number.

Entropy from State Probabilities: Hydration Entropy of Cations

PubMed Central

2013-01-01

Entropy is an important energetic quantity determining the progression of chemical processes. We propose a new approach to obtain hydration entropy directly from probability density functions in state space. We demonstrate the validity of our approach for a series of cations in aqueous solution. Extensive validation of simulation results was performed. Our approach does not make prior assumptions about the shape of the potential energy landscape and is capable of calculating accurate hydration entropy values. Sampling times in the low nanosecond range are sufficient for the investigated ionic systems. Although the presented strategy is at the moment limited to systems for which a scalar order parameter can be derived, this is not a principal limitation of the method. The strategy presented is applicable to any chemical system where sufficient sampling of conformational space is accessible, for example, by computer simulations. PMID:23651109

Comparison of connectivity analyses for resting state EEG data

NASA Astrophysics Data System (ADS)

Olejarczyk, Elzbieta; Marzetti, Laura; Pizzella, Vittorio; Zappasodi, Filippo

2017-06-01

Objective. In the present work, a nonlinear measure (transfer entropy, TE) was used in a multivariate approach for the analysis of effective connectivity in high density resting state EEG data in eyes open and eyes closed. Advantages of the multivariate approach in comparison to the bivariate one were tested. Moreover, the multivariate TE was compared to an effective linear measure, i.e. directed transfer function (DTF). Finally, the existence of a relationship between the information transfer and the level of brain synchronization as measured by phase synchronization value (PLV) was investigated. Approach. The comparison between the connectivity measures, i.e. bivariate versus multivariate TE, TE versus DTF, TE versus PLV, was performed by means of statistical analysis of indexes based on graph theory. Main results. The multivariate approach is less sensitive to false indirect connections with respect to the bivariate estimates. The multivariate TE differentiated better between eyes closed and eyes open conditions compared to DTF. Moreover, the multivariate TE evidenced non-linear phenomena in information transfer, which are not evidenced by the use of DTF. We also showed that the target of information flow, in particular the frontal region, is an area of greater brain synchronization. Significance. Comparison of different connectivity analysis methods pointed to the advantages of nonlinear methods, and indicated a relationship existing between the flow of information and the level of synchronization of the brain.

Nonlinear inhomogeneous Fokker-Planck equations: Entropy and free-energy time evolution.

PubMed

Sicuro, Gabriele; Rapčan, Peter; Tsallis, Constantino

2016-12-01

We extend a recently introduced free-energy formalism for homogeneous Fokker-Planck equations to a wide, and physically appealing, class of inhomogeneous nonlinear Fokker-Planck equations. In our approach, the free-energy functional is expressed in terms of an entropic functional and an auxiliary potential, both derived from the coefficients of the equation. With reference to the introduced entropic functional, we discuss the entropy production in a relaxation process towards equilibrium. The properties of the stationary solutions of the considered Fokker-Planck equations are also discussed.

Searching for a C-function on the three-dimensional sphere

NASA Astrophysics Data System (ADS)

Beneventano, C. G.; Cavero-Peláez, I.; D'Ascanio, D.; Santangelo, E. M.

2017-11-01

We present a detailed analytic study on the three-dimensional sphere of the most popular candidates for C-functions, both for Dirac and scalar free massive fields. We discuss to which extent the effective action, the Rényi entanglement entropy and the renormalized entanglement entropy fulfill the conditions expected from C-functions. In view of the absence of a good candidate in the case of the scalar field, we introduce a new candidate, which we call the modified effective action, and analyze its pros and cons.

Brain entropy and human intelligence: A resting-state fMRI study

PubMed Central

Calderone, Daniel; Morales, Leah J.

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns. PMID:29432427

Brain entropy and human intelligence: A resting-state fMRI study.

PubMed

Saxe, Glenn N; Calderone, Daniel; Morales, Leah J

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns.

Connecting complexity with spectral entropy using the Laplace transformed solution to the fractional diffusion equation

NASA Astrophysics Data System (ADS)

Liang, Yingjie; Chen, Wen; Magin, Richard L.

2016-07-01

Analytical solutions to the fractional diffusion equation are often obtained by using Laplace and Fourier transforms, which conveniently encode the order of the time and the space derivatives (α and β) as non-integer powers of the conjugate transform variables (s, and k) for the spectral and the spatial frequencies, respectively. This study presents a new solution to the fractional diffusion equation obtained using the Laplace transform and expressed as a Fox's H-function. This result clearly illustrates the kinetics of the underlying stochastic process in terms of the Laplace spectral frequency and entropy. The spectral entropy is numerically calculated by using the direct integration method and the adaptive Gauss-Kronrod quadrature algorithm. Here, the properties of spectral entropy are investigated for the cases of sub-diffusion and super-diffusion. We find that the overall spectral entropy decreases with the increasing α and β, and that the normal or Gaussian case with α = 1 and β = 2, has the lowest spectral entropy (i.e., less information is needed to describe the state of a Gaussian process). In addition, as the neighborhood over which the entropy is calculated increases, the spectral entropy decreases, which implies a spatial averaging or coarse graining of the material properties. Consequently, the spectral entropy is shown to provide a new way to characterize the temporal correlation of anomalous diffusion. Future studies should be designed to examine changes of spectral entropy in physical, chemical and biological systems undergoing phase changes, chemical reactions and tissue regeneration.

Wavelet entropy of BOLD time series: An application to Rolandic epilepsy.

PubMed

Gupta, Lalit; Jansen, Jacobus F A; Hofman, Paul A M; Besseling, René M H; de Louw, Anton J A; Aldenkamp, Albert P; Backes, Walter H

2017-12-01

To assess the wavelet entropy for the characterization of intrinsic aberrant temporal irregularities in the time series of resting-state blood-oxygen-level-dependent (BOLD) signal fluctuations. Further, to evaluate the temporal irregularities (disorder/order) on a voxel-by-voxel basis in the brains of children with Rolandic epilepsy. The BOLD time series was decomposed using the discrete wavelet transform and the wavelet entropy was calculated. Using a model time series consisting of multiple harmonics and nonstationary components, the wavelet entropy was compared with Shannon and spectral (Fourier-based) entropy. As an application, the wavelet entropy in 22 children with Rolandic epilepsy was compared to 22 age-matched healthy controls. The images were obtained by performing resting-state functional magnetic resonance imaging (fMRI) using a 3T system, an 8-element receive-only head coil, and an echo planar imaging pulse sequence ( T2*-weighted). The wavelet entropy was also compared to spectral entropy, regional homogeneity, and Shannon entropy. Wavelet entropy was found to identify the nonstationary components of the model time series. In Rolandic epilepsy patients, a significantly elevated wavelet entropy was observed relative to controls for the whole cerebrum (P = 0.03). Spectral entropy (P = 0.41), regional homogeneity (P = 0.52), and Shannon entropy (P = 0.32) did not reveal significant differences. The wavelet entropy measure appeared more sensitive to detect abnormalities in cerebral fluctuations represented by nonstationary effects in the BOLD time series than more conventional measures. This effect was observed in the model time series as well as in Rolandic epilepsy. These observations suggest that the brains of children with Rolandic epilepsy exhibit stronger nonstationary temporal signal fluctuations than controls. 2 Technical Efficacy: Stage 3 J. Magn. Reson. Imaging 2017;46:1728-1737. © 2017 International Society for Magnetic Resonance in Medicine.

Strength functions, entropies, and duality in weakly to strongly interacting fermionic systems.

PubMed

Angom, D; Ghosh, S; Kota, V K B

2004-01-01

We revisit statistical wave function properties of finite systems of interacting fermions in the light of strength functions and their participation ratio and information entropy. For weakly interacting fermions in a mean-field with random two-body interactions of increasing strength lambda, the strength functions F(k) (E) are well known to change, in the regime where level fluctuations follow Wigner's surmise, from Breit-Wigner to Gaussian form. We propose an ansatz for the function describing this transition which we use to investigate the participation ratio xi(2) and the information entropy S(info) during this crossover, thereby extending the known behavior valid in the Gaussian domain into much of the Breit-Wigner domain. Our method also allows us to derive the scaling law lambda(d) approximately 1/sqrt[m] ( m is number of fermions) for the duality point lambda= lambda(d), where F(k) (E), xi(2), and S(info) in both the weak ( lambda=0 ) and strong mixing ( lambda= infinity ) basis coincide. As an application, the ansatz function for strength functions is used in describing the Breit-Wigner to Gaussian transition seen in neutral atoms CeI to SmI with valence electrons changing from 4 to 8.

On the Application of Information Theory to Sustainability

EPA Science Inventory

According to the 2nd Law of Thermodynamics, entropy must be an increasing function of time for the whole universe, system plus surroundings. This gives rise to conjectures regarding the lost of work with entropy generation in a general processes. It can be shown that under cond...

An Extension to Deng's Entropy in the Open World Assumption with an Application in Sensor Data Fusion.

PubMed

Tang, Yongchuan; Zhou, Deyun; Chan, Felix T S

2018-06-11

Quantification of uncertain degree in the Dempster-Shafer evidence theory (DST) framework with belief entropy is still an open issue, even a blank field for the open world assumption. Currently, the existed uncertainty measures in the DST framework are limited to the closed world where the frame of discernment (FOD) is assumed to be complete. To address this issue, this paper focuses on extending a belief entropy to the open world by considering the uncertain information represented as the FOD and the nonzero mass function of the empty set simultaneously. An extension to Deng’s entropy in the open world assumption (EDEOW) is proposed as a generalization of the Deng’s entropy and it can be degenerated to the Deng entropy in the closed world wherever necessary. In order to test the reasonability and effectiveness of the extended belief entropy, an EDEOW-based information fusion approach is proposed and applied to sensor data fusion under uncertainty circumstance. The experimental results verify the usefulness and applicability of the extended measure as well as the modified sensor data fusion method. In addition, a few open issues still exist in the current work: the necessary properties for a belief entropy in the open world assumption, whether there exists a belief entropy that satisfies all the existed properties, and what is the most proper fusion frame for sensor data fusion under uncertainty.

Thermodynamics of extremal rotating thin shells in an extremal BTZ spacetime and the extremal black hole entropy

NASA Astrophysics Data System (ADS)

Lemos, José P. S.; Minamitsuji, Masato; Zaslavskii, Oleg B.

2017-02-01

In a (2 +1 )-dimensional spacetime with a negative cosmological constant, the thermodynamics and the entropy of an extremal rotating thin shell, i.e., an extremal rotating ring, are investigated. The outer and inner regions with respect to the shell are taken to be the Bañados-Teitelbom-Zanelli (BTZ) spacetime and the vacuum ground state anti-de Sitter spacetime, respectively. By applying the first law of thermodynamics to the extremal thin shell, one shows that the entropy of the shell is an arbitrary well-behaved function of the gravitational area A+ alone, S =S (A+). When the thin shell approaches its own gravitational radius r+ and turns into an extremal rotating BTZ black hole, it is found that the entropy of the spacetime remains such a function of A+, both when the local temperature of the shell at the gravitational radius is zero and nonzero. It is thus vindicated by this analysis that extremal black holes, here extremal BTZ black holes, have different properties from the corresponding nonextremal black holes, which have a definite entropy, the Bekenstein-Hawking entropy S (A+)=A/+4G , where G is the gravitational constant. It is argued that for extremal black holes, in particular for extremal BTZ black holes, one should set 0 ≤S (A+)≤A/+4G;i.e., the extremal black hole entropy has values in between zero and the maximum Bekenstein-Hawking entropy A/+4 G . Thus, rather than having just two entropies for extremal black holes, as previous results have debated, namely, 0 and A/+4 G , it is shown here that extremal black holes, in particular extremal BTZ black holes, may have a continuous range of entropies, limited by precisely those two entropies. Surely, the entropy that a particular extremal black hole picks must depend on past processes, notably on how it was formed. A remarkable relation between the third law of thermodynamics and the impossibility for a massive body to reach the velocity of light is also found. In addition, in the procedure, it becomes clear that there are two distinct angular velocities for the shell, the mechanical and thermodynamic angular velocities. We comment on the relationship between these two velocities. In passing, we clarify, for a static spacetime with a thermal shell, the meaning of the Tolman temperature formula at a generic radius and at the shell.

The cancer Warburg effect may be a testable example of the minimum entropy production rate principle

NASA Astrophysics Data System (ADS)

Marín, Dolores; Sabater, Bartolomé

2017-04-01

Cancer cells consume more glucose by glycolytic fermentation to lactate than by respiration, a characteristic known as the Warburg effect. In contrast with the 36 moles of ATP produced by respiration, fermentation produces two moles of ATP per mole of glucose consumed, which poses a puzzle with regard to the function of the Warburg effect. The production of free energy (ΔG), enthalpy (ΔH), and entropy (ΔS) per mole linearly varies with the fraction (x) of glucose consumed by fermentation that is frequently estimated around 0.9. Hence, calculation shows that, in respect to pure respiration, the predominant fermentative metabolism decreases around 10% the production of entropy per mole of glucose consumed in cancer cells. We hypothesize that increased fermentation could allow cancer cells to accomplish the Prigogine theorem of the trend to minimize the rate of production of entropy. According to the theorem, open cellular systems near the steady state could evolve to minimize the rates of entropy production that may be reached by modified replicating cells producing entropy at a low rate. Remarkably, at CO2 concentrations above 930 ppm, glucose respiration produces less entropy than fermentation, which suggests experimental tests to validate the hypothesis of minimization of the rate of entropy production through the Warburg effect.

The cancer Warburg effect may be a testable example of the minimum entropy production rate principle.

PubMed

Marín, Dolores; Sabater, Bartolomé

2017-04-28

Cancer cells consume more glucose by glycolytic fermentation to lactate than by respiration, a characteristic known as the Warburg effect. In contrast with the 36 moles of ATP produced by respiration, fermentation produces two moles of ATP per mole of glucose consumed, which poses a puzzle with regard to the function of the Warburg effect. The production of free energy (ΔG), enthalpy (ΔH), and entropy (ΔS) per mole linearly varies with the fraction (x) of glucose consumed by fermentation that is frequently estimated around 0.9. Hence, calculation shows that, in respect to pure respiration, the predominant fermentative metabolism decreases around 10% the production of entropy per mole of glucose consumed in cancer cells. We hypothesize that increased fermentation could allow cancer cells to accomplish the Prigogine theorem of the trend to minimize the rate of production of entropy. According to the theorem, open cellular systems near the steady state could evolve to minimize the rates of entropy production that may be reached by modified replicating cells producing entropy at a low rate. Remarkably, at CO 2 concentrations above 930 ppm, glucose respiration produces less entropy than fermentation, which suggests experimental tests to validate the hypothesis of minimization of the rate of entropy production through the Warburg effect.

Essential equivalence of the general equation for the nonequilibrium reversible-irreversible coupling (GENERIC) and steepest-entropy-ascent models of dissipation for nonequilibrium thermodynamics.

PubMed

Montefusco, Alberto; Consonni, Francesco; Beretta, Gian Paolo

2015-04-01

By reformulating the steepest-entropy-ascent (SEA) dynamical model for nonequilibrium thermodynamics in the mathematical language of differential geometry, we compare it with the primitive formulation of the general equation for the nonequilibrium reversible-irreversible coupling (GENERIC) model and discuss the main technical differences of the two approaches. In both dynamical models the description of dissipation is of the "entropy-gradient" type. SEA focuses only on the dissipative, i.e., entropy generating, component of the time evolution, chooses a sub-Riemannian metric tensor as dissipative structure, and uses the local entropy density field as potential. GENERIC emphasizes the coupling between the dissipative and nondissipative components of the time evolution, chooses two compatible degenerate structures (Poisson and degenerate co-Riemannian), and uses the global energy and entropy functionals as potentials. As an illustration, we rewrite the known GENERIC formulation of the Boltzmann equation in terms of the square root of the distribution function adopted by the SEA formulation. We then provide a formal proof that in more general frameworks, whenever all degeneracies in the GENERIC framework are related to conservation laws, the SEA and GENERIC models of the dissipative component of the dynamics are essentially interchangeable, provided of course they assume the same kinematics. As part of the discussion, we note that equipping the dissipative structure of GENERIC with the Leibniz identity makes it automatically SEA on metric leaves.

Regional entropy of functional imaging signals varies differently in sensory and cognitive systems during propofol-modulated loss and return of behavioral responsiveness.

PubMed

Liu, Xiaolin; Lauer, Kathryn K; Ward, B Douglas; Roberts, Christopher J; Liu, Suyan; Gollapudy, Suneeta; Rohloff, Robert; Gross, William; Xu, Zhan; Chen, Shanshan; Wang, Lubin; Yang, Zheng; Li, Shi-Jiang; Binder, Jeffrey R; Hudetz, Anthony G

2018-05-08

The level and richness of consciousness depend on information integration in the brain. Altered interregional functional interactions may indicate disrupted information integration during anesthetic-induced unconsciousness. How anesthetics modulate the amount of information in various brain regions has received less attention. Here, we propose a novel approach to quantify regional information content in the brain by the entropy of the principal components of regional blood oxygen-dependent imaging signals during graded propofol sedation. Fifteen healthy individuals underwent resting-state scans in wakeful baseline, light sedation (conscious), deep sedation (unconscious), and recovery (conscious). Light sedation characterized by lethargic behavioral responses was associated with global reduction of entropy in the brain. Deep sedation with completely suppressed overt responsiveness was associated with further reductions of entropy in sensory (primary and higher sensory plus orbital prefrontal cortices) but not high-order cognitive (dorsal and medial prefrontal, cingulate, parietotemporal cortices and hippocampal areas) systems. Upon recovery of responsiveness, entropy was restored in the sensory but not in high-order cognitive systems. These findings provide novel evidence for a reduction of information content of the brain as a potential systems-level mechanism of reduced consciousness during propofol anesthesia. The differential changes of entropy in the sensory and high-order cognitive systems associated with losing and regaining overt responsiveness are consistent with the notion of "disconnected consciousness", in which a complete sensory-motor disconnection from the environment occurs with preserved internal mentation.

On the Application of Information Theory to Regime Changes and Sustainability

EPA Science Inventory

According to the 2nd Law of Thermodynamics, entropy must be an increasing function of time for the whole universe, system plus surroundings. This gives rise to conjectures regarding the lost of work with entropy generation in a general processes. It can be shown that under cond...

Time, frequency, and time-varying Granger-causality measures in neuroscience.

PubMed

Cekic, Sezen; Grandjean, Didier; Renaud, Olivier

2018-05-20

This article proposes a systematic methodological review and an objective criticism of existing methods enabling the derivation of time, frequency, and time-varying Granger-causality statistics in neuroscience. The capacity to describe the causal links between signals recorded at different brain locations during a neuroscience experiment is indeed of primary interest for neuroscientists, who often have very precise prior hypotheses about the relationships between recorded brain signals. The increasing interest and the huge number of publications related to this topic calls for this systematic review, which describes the very complex methodological aspects underlying the derivation of these statistics. In this article, we first present a general framework that allows us to review and compare Granger-causality statistics in the time domain, and the link with transfer entropy. Then, the spectral and the time-varying extensions are exposed and discussed together with their estimation and distributional properties. Although not the focus of this article, partial and conditional Granger causality, dynamical causal modelling, directed transfer function, directed coherence, partial directed coherence, and their variant are also mentioned. Copyright © 2018 John Wiley & Sons, Ltd.

Shannon entropy in the research on stationary regimes and the evolution of complexity

NASA Astrophysics Data System (ADS)

Eskov, V. M.; Eskov, V. V.; Vochmina, Yu. V.; Gorbunov, D. V.; Ilyashenko, L. K.

2017-05-01

The questions of the identification of complex biological systems (complexity) as special self-organizing systems or systems of the third type first defined by W. Weaver in 1948 continue to be of interest. No reports on the evaluation of entropy for systems of the third type were found among the publications currently available to the authors. The present study addresses the parameters of muscle biopotentials recorded using surface interference electromyography and presents the results of calculation of the Shannon entropy, autocorrelation functions, and statistical distribution functions for electromyograms of subjects in different physiological states (rest and tension of muscles). The results do not allow for statistically reliable discrimination between the functional states of muscles. However, the data obtained by calculating electromyogram quasiatttractor parameters and matrices of paired comparisons of electromyogram samples (calculation of the number k of "coinciding" pairs among the electromyogram samples) provide an integral characteristic that allows the identification of substantial differences between the state of rest and the different states of functional activity. Modifications and implementation of new methods in combination with the novel methods of the theory of chaos and self-organization are obviously essential. The stochastic approach paradigm is not applicable to systems of the third type due to continuous and chaotic changes of the parameters of the state vector x( t) of an organism or the contrasting constancy of these parameters (in the case of entropy).

The Law of Entropy Increase--A Lab Experiment

ERIC Educational Resources Information Center

Dittrich, William; Drosd, Robert; Minkin, Leonid; Shapovalov, Alexander S.

2016-01-01

The second law of thermodynamics has various formulations. There is the "Clausius formulation," which can be stated in a very intuitive way: "No process is possible whose sole result is the transfer of heat from a cooler to a hotter body." There is also the "Kelvin-Plank principle," which states that "no cyclic…

Detecting causality in policy diffusion processes.

PubMed

Grabow, Carsten; Macinko, James; Silver, Diana; Porfiri, Maurizio

2016-08-01

A universal question in network science entails learning about the topology of interaction from collective dynamics. Here, we address this question by examining diffusion of laws across US states. We propose two complementary techniques to unravel determinants of this diffusion process: information-theoretic union transfer entropy and event synchronization. In order to systematically investigate their performance on law activity data, we establish a new stochastic model to generate synthetic law activity data based on plausible networks of interactions. Through extensive parametric studies, we demonstrate the ability of these methods to reconstruct networks, varying in size, link density, and degree heterogeneity. Our results suggest that union transfer entropy should be preferred for slowly varying processes, which may be associated with policies attending to specific local problems that occur only rarely or with policies facing high levels of opposition. In contrast, event synchronization is effective for faster enactment rates, which may be related to policies involving Federal mandates or incentives. This study puts forward a data-driven toolbox to explain the determinants of legal activity applicable to political science, across dynamical systems, information theory, and complex networks.

Performance optimization of plate heat exchangers with chevron plates

DOE Office of Scientific and Technical Information (OSTI.GOV)

Muley, A.; Manglik, R.M.

1999-07-01

The enhanced heat transfer performance of a chevron plate heat exchanger (PHE) is evaluated employing (1) energy-conservation based performance evaluation criteria (PECs), and (2) the second-law based minimization of entropy generation principle. Single-phase laminar and turbulent flow convection for three different chevron-plate arrangements are considered. The influence of plate surface corrugation characteristics and their stack arrangements on the heat exchanger's thermal-hydraulic performance is delineated. Based on the different figures of merit, the results show that the extent of heat transfer enhancement increases with flow Re and chevron angle {beta} in laminar flow, but it diminishes with increasing Re in turbulentmore » flows. With up to 2.9 times higher Q, 48% lower A, and entropy generation number N{sub s,a} {lt} 1, relative to an equivalent flat-plate pack, chevron plates are found to be especially suitable in the low to medium flow rates range (20 {le} Re {le} 2,000). Also, there appears to be no significant advantage of using a mixed-plate over a symmetric-plate arrangement.« less

Inference of topology and the nature of synapses, and the flow of information in neuronal networks

NASA Astrophysics Data System (ADS)

Borges, F. S.; Lameu, E. L.; Iarosz, K. C.; Protachevicz, P. R.; Caldas, I. L.; Viana, R. L.; Macau, E. E. N.; Batista, A. M.; Baptista, M. S.

2018-02-01

The characterization of neuronal connectivity is one of the most important matters in neuroscience. In this work, we show that a recently proposed informational quantity, the causal mutual information, employed with an appropriate methodology, can be used not only to correctly infer the direction of the underlying physical synapses, but also to identify their excitatory or inhibitory nature, considering easy to handle and measure bivariate time series. The success of our approach relies on a surprising property found in neuronal networks by which nonadjacent neurons do "understand" each other (positive mutual information), however, this exchange of information is not capable of causing effect (zero transfer entropy). Remarkably, inhibitory connections, responsible for enhancing synchronization, transfer more information than excitatory connections, known to enhance entropy in the network. We also demonstrate that our methodology can be used to correctly infer directionality of synapses even in the presence of dynamic and observational Gaussian noise, and is also successful in providing the effective directionality of intermodular connectivity, when only mean fields can be measured.

Detecting causality in policy diffusion processes

NASA Astrophysics Data System (ADS)

Grabow, Carsten; Macinko, James; Silver, Diana; Porfiri, Maurizio

2016-08-01

A universal question in network science entails learning about the topology of interaction from collective dynamics. Here, we address this question by examining diffusion of laws across US states. We propose two complementary techniques to unravel determinants of this diffusion process: information-theoretic union transfer entropy and event synchronization. In order to systematically investigate their performance on law activity data, we establish a new stochastic model to generate synthetic law activity data based on plausible networks of interactions. Through extensive parametric studies, we demonstrate the ability of these methods to reconstruct networks, varying in size, link density, and degree heterogeneity. Our results suggest that union transfer entropy should be preferred for slowly varying processes, which may be associated with policies attending to specific local problems that occur only rarely or with policies facing high levels of opposition. In contrast, event synchronization is effective for faster enactment rates, which may be related to policies involving Federal mandates or incentives. This study puts forward a data-driven toolbox to explain the determinants of legal activity applicable to political science, across dynamical systems, information theory, and complex networks.

Minimal entropy probability paths between genome families.

PubMed

Ahlbrandt, Calvin; Benson, Gary; Casey, William

2004-05-01

We develop a metric for probability distributions with applications to biological sequence analysis. Our distance metric is obtained by minimizing a functional defined on the class of paths over probability measures on N categories. The underlying mathematical theory is connected to a constrained problem in the calculus of variations. The solution presented is a numerical solution, which approximates the true solution in a set of cases called rich paths where none of the components of the path is zero. The functional to be minimized is motivated by entropy considerations, reflecting the idea that nature might efficiently carry out mutations of genome sequences in such a way that the increase in entropy involved in transformation is as small as possible. We characterize sequences by frequency profiles or probability vectors, in the case of DNA where N is 4 and the components of the probability vector are the frequency of occurrence of each of the bases A, C, G and T. Given two probability vectors a and b, we define a distance function based as the infimum of path integrals of the entropy function H( p) over all admissible paths p(t), 0 < or = t< or =1, with p(t) a probability vector such that p(0)=a and p(1)=b. If the probability paths p(t) are parameterized as y(s) in terms of arc length s and the optimal path is smooth with arc length L, then smooth and "rich" optimal probability paths may be numerically estimated by a hybrid method of iterating Newton's method on solutions of a two point boundary value problem, with unknown distance L between the abscissas, for the Euler-Lagrange equations resulting from a multiplier rule for the constrained optimization problem together with linear regression to improve the arc length estimate L. Matlab code for these numerical methods is provided which works only for "rich" optimal probability vectors. These methods motivate a definition of an elementary distance function which is easier and faster to calculate, works on non-rich vectors, does not involve variational theory and does not involve differential equations, but is a better approximation of the minimal entropy path distance than the distance //b-a//(2). We compute minimal entropy distance matrices for examples of DNA myostatin genes and amino-acid sequences across several species. Output tree dendograms for our minimal entropy metric are compared with dendograms based on BLAST and BLAST identity scores.

Optimization and experimental validation of a thermal cycle that maximizes entropy coefficient fisher identifiability for lithium iron phosphate cells

NASA Astrophysics Data System (ADS)

Mendoza, Sergio; Rothenberger, Michael; Hake, Alison; Fathy, Hosam

2016-03-01

This article presents a framework for optimizing the thermal cycle to estimate a battery cell's entropy coefficient at 20% state of charge (SOC). Our goal is to maximize Fisher identifiability: a measure of the accuracy with which a parameter can be estimated. Existing protocols in the literature for estimating entropy coefficients demand excessive laboratory time. Identifiability optimization makes it possible to achieve comparable accuracy levels in a fraction of the time. This article demonstrates this result for a set of lithium iron phosphate (LFP) cells. We conduct a 24-h experiment to obtain benchmark measurements of their entropy coefficients. We optimize a thermal cycle to maximize parameter identifiability for these cells. This optimization proceeds with respect to the coefficients of a Fourier discretization of this thermal cycle. Finally, we compare the estimated parameters using (i) the benchmark test, (ii) the optimized protocol, and (iii) a 15-h test from the literature (by Forgez et al.). The results are encouraging for two reasons. First, they confirm the simulation-based prediction that the optimized experiment can produce accurate parameter estimates in 2 h, compared to 15-24. Second, the optimized experiment also estimates a thermal time constant representing the effects of thermal capacitance and convection heat transfer.

Multi-Scale Low-Entropy Method for Optimizing the Processing Parameters during Automated Fiber Placement

PubMed Central

Han, Zhenyu; Sun, Shouzheng; Fu, Hongya; Fu, Yunzhong

2017-01-01

Automated fiber placement (AFP) process includes a variety of energy forms and multi-scale effects. This contribution proposes a novel multi-scale low-entropy method aiming at optimizing processing parameters in an AFP process, where multi-scale effect, energy consumption, energy utilization efficiency and mechanical properties of micro-system could be taken into account synthetically. Taking a carbon fiber/epoxy prepreg as an example, mechanical properties of macro–meso–scale are obtained by Finite Element Method (FEM). A multi-scale energy transfer model is then established to input the macroscopic results into the microscopic system as its boundary condition, which can communicate with different scales. Furthermore, microscopic characteristics, mainly micro-scale adsorption energy, diffusion coefficient entropy–enthalpy values, are calculated under different processing parameters based on molecular dynamics method. Low-entropy region is then obtained in terms of the interrelation among entropy–enthalpy values, microscopic mechanical properties (interface adsorbability and matrix fluidity) and processing parameters to guarantee better fluidity, stronger adsorption, lower energy consumption and higher energy quality collaboratively. Finally, nine groups of experiments are carried out to verify the validity of the simulation results. The results show that the low-entropy optimization method can reduce void content effectively, and further improve the mechanical properties of laminates. PMID:28869520

Excess entropy and crystallization in Stillinger-Weber and Lennard-Jones fluids

NASA Astrophysics Data System (ADS)

Dhabal, Debdas; Nguyen, Andrew Huy; Singh, Murari; Khatua, Prabir; Molinero, Valeria; Bandyopadhyay, Sanjoy; Chakravarty, Charusita

2015-10-01

Molecular dynamics simulations are used to contrast the supercooling and crystallization behaviour of monatomic liquids that exemplify the transition from simple to anomalous, tetrahedral liquids. As examples of simple fluids, we use the Lennard-Jones (LJ) liquid and a pair-dominated Stillinger-Weber liquid (SW16). As examples of tetrahedral, water-like fluids, we use the Stillinger-Weber model with variable tetrahedrality parameterized for germanium (SW20), silicon (SW21), and water (SW23.15 or mW model). The thermodynamic response functions show clear qualitative differences between simple and water-like liquids. For simple liquids, the compressibility and the heat capacity remain small on isobaric cooling. The tetrahedral liquids in contrast show a very sharp rise in these two response functions as the lower limit of liquid-phase stability is reached. While the thermal expansivity decreases with temperature but never crosses zero in simple liquids, in all three tetrahedral liquids at the studied pressure, there is a temperature of maximum density below which thermal expansivity is negative. In contrast to the thermodynamic response functions, the excess entropy on isobaric cooling does not show qualitatively different features for simple and water-like liquids; however, the slope and curvature of the entropy-temperature plots reflect the heat capacity trends. Two trajectory-based computational estimation methods for the entropy and the heat capacity are compared for possible structural insights into supercooling, with the entropy obtained from thermodynamic integration. The two-phase thermodynamic estimator for the excess entropy proves to be fairly accurate in comparison to the excess entropy values obtained by thermodynamic integration, for all five Lennard-Jones and Stillinger-Weber liquids. The entropy estimator based on the multiparticle correlation expansion that accounts for both pair and triplet correlations, denoted by Strip, is also studied. Strip is a good entropy estimator for liquids where pair and triplet correlations are important such as Ge and Si, but loses accuracy for purely pair-dominated liquids, like LJ fluid, or near the crystallization temperature (Tthr). Since local tetrahedral order is compatible with both liquid and crystalline states, the reorganisation of tetrahedral liquids is accompanied by a clear rise in the pair, triplet, and thermodynamic contributions to the heat capacity, resulting in the heat capacity anomaly. In contrast, the pair-dominated liquids show increasing dominance of triplet correlations on approaching crystallization but no sharp rise in either the pair or thermodynamic heat capacities.

Renormalization of entanglement entropy from topological terms

NASA Astrophysics Data System (ADS)

Anastasiou, Giorgos; Araya, Ignacio J.; Olea, Rodrigo

2018-05-01

We propose a renormalization scheme for entanglement entropy of three-dimensional CFTs with a four-dimensional asymptotically AdS gravity dual in the context of the gauge/gravity correspondence. The procedure consists in adding the Chern form as a boundary term to the area functional of the Ryu-Takayanagi minimal surface. We provide an explicit prescription for the renormalized entanglement entropy, which is derived via the replica trick. This is achieved by considering a Euclidean gravitational action renormalized by the addition of the Chern form at the spacetime boundary, evaluated in the conically-singular replica manifold. We show that the addition of this boundary term cancels the divergent part of the entanglement entropy, recovering the results obtained by Taylor and Woodhead. We comment on how this prescription for renormalizing the entanglement entropy is in line with the general program of topological renormalization in asymptotically AdS gravity.

Entropy of Movement Outcome in Space-Time.

PubMed

Lai, Shih-Chiung; Hsieh, Tsung-Yu; Newell, Karl M

2015-07-01

Information entropy of the joint spatial and temporal (space-time) probability of discrete movement outcome was investigated in two experiments as a function of different movement strategies (space-time, space, and time instructional emphases), task goals (point-aiming and target-aiming) and movement speed-accuracy constraints. The variance of the movement spatial and temporal errors was reduced by instructional emphasis on the respective spatial or temporal dimension, but increased on the other dimension. The space-time entropy was lower in targetaiming task than the point aiming task but did not differ between instructional emphases. However, the joint probabilistic measure of spatial and temporal entropy showed that spatial error is traded for timing error in tasks with space-time criteria and that the pattern of movement error depends on the dimension of the measurement process. The unified entropy measure of movement outcome in space-time reveals a new relation for the speed-accuracy.

Entropy-aware projected Landweber reconstruction for quantized block compressive sensing of aerial imagery

NASA Astrophysics Data System (ADS)

Liu, Hao; Li, Kangda; Wang, Bing; Tang, Hainie; Gong, Xiaohui

2017-01-01

A quantized block compressive sensing (QBCS) framework, which incorporates the universal measurement, quantization/inverse quantization, entropy coder/decoder, and iterative projected Landweber reconstruction, is summarized. Under the QBCS framework, this paper presents an improved reconstruction algorithm for aerial imagery, QBCS, with entropy-aware projected Landweber (QBCS-EPL), which leverages the full-image sparse transform without Wiener filter and an entropy-aware thresholding model for wavelet-domain image denoising. Through analyzing the functional relation between the soft-thresholding factors and entropy-based bitrates for different quantization methods, the proposed model can effectively remove wavelet-domain noise of bivariate shrinkage and achieve better image reconstruction quality. For the overall performance of QBCS reconstruction, experimental results demonstrate that the proposed QBCS-EPL algorithm significantly outperforms several existing algorithms. With the experiment-driven methodology, the QBCS-EPL algorithm can obtain better reconstruction quality at a relatively moderate computational cost, which makes it more desirable for aerial imagery applications.

Topological entanglement entropy of fracton stabilizer codes

NASA Astrophysics Data System (ADS)

Ma, Han; Schmitz, A. T.; Parameswaran, S. A.; Hermele, Michael; Nandkishore, Rahul M.

2018-03-01

Entanglement entropy provides a powerful characterization of two-dimensional gapped topological phases of quantum matter, intimately tied to their description by topological quantum field theories (TQFTs). Fracton topological orders are three-dimensional gapped topologically ordered states of matter that lack a TQFT description. We show that three-dimensional fracton phases are nevertheless characterized, at least partially, by universal structure in the entanglement entropy of their ground-state wave functions. We explicitly compute the entanglement entropy for two archetypal fracton models, the "X-cube model" and "Haah's code," and demonstrate the existence of a nonlocal contribution that scales linearly in subsystem size. We show via Schrieffer-Wolff transformations that this piece of the entanglement entropy of fracton models is robust against arbitrary local perturbations of the Hamiltonian. Finally, we argue that these results may be extended to characterize localization-protected fracton topological order in excited states of disordered fracton models.

Generalized permutation entropy analysis based on the two-index entropic form S q , δ

NASA Astrophysics Data System (ADS)

Xu, Mengjia; Shang, Pengjian

2015-05-01

Permutation entropy (PE) is a novel measure to quantify the complexity of nonlinear time series. In this paper, we propose a generalized permutation entropy ( P E q , δ ) based on the recently postulated entropic form, S q , δ , which was proposed as an unification of the well-known Sq of nonextensive-statistical mechanics and S δ , a possibly appropriate candidate for the black-hole entropy. We find that P E q , δ with appropriate parameters can amplify minor changes and trends of complexities in comparison to PE. Experiments with this generalized permutation entropy method are performed with both synthetic and stock data showing its power. Results show that P E q , δ is an exponential function of q and the power ( k ( δ ) ) is a constant if δ is determined. Some discussions about k ( δ ) are provided. Besides, we also find some interesting results about power law.

Influence of measurement error on Maxwell's demon

NASA Astrophysics Data System (ADS)

Sørdal, Vegard; Bergli, Joakim; Galperin, Y. M.

2017-06-01

In any general cycle of measurement, feedback, and erasure, the measurement will reduce the entropy of the system when information about the state is obtained, while erasure, according to Landauer's principle, is accompanied by a corresponding increase in entropy due to the compression of logical and physical phase space. The total process can in principle be fully reversible. A measurement error reduces the information obtained and the entropy decrease in the system. The erasure still gives the same increase in entropy, and the total process is irreversible. Another consequence of measurement error is that a bad feedback is applied, which further increases the entropy production if the proper protocol adapted to the expected error rate is not applied. We consider the effect of measurement error on a realistic single-electron box Szilard engine, and we find the optimal protocol for the cycle as a function of the desired power P and error ɛ .

Entropy of international trades

NASA Astrophysics Data System (ADS)

Oh, Chang-Young; Lee, D.-S.

2017-05-01

The organization of international trades is highly complex under the collective efforts towards economic profits of participating countries given inhomogeneous resources for production. Considering the trade flux as the probability of exporting a product from a country to another, we evaluate the entropy of the world trades in the period 1950-2000. The trade entropy has increased with time, and we show that it is mainly due to the extension of trade partnership. For a given number of trade partners, the mean trade entropy is about 60% of the maximum possible entropy, independent of time, which can be regarded as a characteristic of the trade fluxes' heterogeneity and is shown to be derived from the scaling and functional behaviors of the universal trade-flux distribution. The correlation and time evolution of the individual countries' gross-domestic products and the number of trade partners show that most countries achieved their economic growth partly by extending their trade relationship.

Generalized sample entropy analysis for traffic signals based on similarity measure

NASA Astrophysics Data System (ADS)

Shang, Du; Xu, Mengjia; Shang, Pengjian

2017-05-01

Sample entropy is a prevailing method used to quantify the complexity of a time series. In this paper a modified method of generalized sample entropy and surrogate data analysis is proposed as a new measure to assess the complexity of a complex dynamical system such as traffic signals. The method based on similarity distance presents a different way of signals patterns match showing distinct behaviors of complexity. Simulations are conducted over synthetic data and traffic signals for providing the comparative study, which is provided to show the power of the new method. Compared with previous sample entropy and surrogate data analysis, the new method has two main advantages. The first one is that it overcomes the limitation about the relationship between the dimension parameter and the length of series. The second one is that the modified sample entropy functions can be used to quantitatively distinguish time series from different complex systems by the similar measure.

Entropy of level-cut random Gaussian structures at different volume fractions

NASA Astrophysics Data System (ADS)

Marčelja, Stjepan

2017-10-01

Cutting random Gaussian fields at a given level can create a variety of morphologically different two- or several-phase structures that have often been used to describe physical systems. The entropy of such structures depends on the covariance function of the generating Gaussian random field, which in turn depends on its spectral density. But the entropy of level-cut structures also depends on the volume fractions of different phases, which is determined by the selection of the cutting level. This dependence has been neglected in earlier work. We evaluate the entropy of several lattice models to show that, even in the cases of strongly coupled systems, the dependence of the entropy of level-cut structures on molar fractions of the constituents scales with the simple ideal noninteracting system formula. In the last section, we discuss the application of the results to binary or ternary fluids and microemulsions.

Inability of the entropy vector method to certify nonclassicality in linelike causal structures

NASA Astrophysics Data System (ADS)

Weilenmann, Mirjam; Colbeck, Roger

2016-10-01

Bell's theorem shows that our intuitive understanding of causation must be overturned in light of quantum correlations. Nevertheless, quantum mechanics does not permit signaling and hence a notion of cause remains. Understanding this notion is not only important at a fundamental level, but also for technological applications such as key distribution and randomness expansion. It has recently been shown that a useful way to decide which classical causal structures could give rise to a given set of correlations is to use entropy vectors. These are vectors whose components are the entropies of all subsets of the observed variables in the causal structure. The entropy vector method employs causal relationships among the variables to restrict the set of possible entropy vectors. Here, we consider whether the same approach can lead to useful certificates of nonclassicality within a given causal structure. Surprisingly, we find that for a family of causal structures that includes the usual bipartite Bell structure they do not. For all members of this family, no function of the entropies of the observed variables gives such a certificate, in spite of the existence of nonclassical correlations. It is therefore necessary to look beyond entropy vectors to understand cause from a quantum perspective.

Thermodynamic contribution of backbone conformational entropy in the binding between SH3 domain and proline-rich motif.

PubMed

Zeng, Danyun; Shen, Qingliang; Cho, Jae-Hyun

2017-02-26

Biological functions of intrinsically disordered proteins (IDPs), and proteins containing intrinsically disordered regions (IDRs) are often mediated by short linear motifs, like proline-rich motifs (PRMs). Upon binding to their target proteins, IDPs undergo a disorder-to-order transition which is accompanied by a large conformational entropy penalty. Hence, the molecular mechanisms underlying control of conformational entropy are critical for understanding the binding affinity and selectivity of IDPs-mediated protein-protein interactions (PPIs). Here, we investigated the backbone conformational entropy change accompanied by binding of the N-terminal SH3 domain (nSH3) of CrkII and PRM derived from guanine nucleotide exchange factor 1 (C3G). In particular, we focused on the estimation of conformational entropy change of disordered PRM upon binding to the nSH3 domain. Quantitative characterization of conformational dynamics of disordered peptides like PRMs is limited. Hence, we combined various methods, including NMR model-free analysis, δ2D, DynaMine, and structure-based calculation of entropy loss. This study demonstrates that the contribution of backbone conformational entropy change is significant in the PPIs mediated by IDPs/IDRs. Copyright © 2017 Elsevier Inc. All rights reserved.

Wigner distribution function and entropy of the damped harmonic oscillator within the theory of the open quantum systems

NASA Technical Reports Server (NTRS)

Isar, Aurelian

1995-01-01

The harmonic oscillator with dissipation is studied within the framework of the Lindblad theory for open quantum systems. By using the Wang-Uhlenbeck method, the Fokker-Planck equation, obtained from the master equation for the density operator, is solved for the Wigner distribution function, subject to either the Gaussian type or the delta-function type of initial conditions. The obtained Wigner functions are two-dimensional Gaussians with different widths. Then a closed expression for the density operator is extracted. The entropy of the system is subsequently calculated and its temporal behavior shows that this quantity relaxes to its equilibrium value.

Dual Function of Phosphoubiquitin in E3 Activation of Parkin*

PubMed Central

Walinda, Erik; Morimoto, Daichi; Sugase, Kenji; Shirakawa, Masahiro

2016-01-01

Mutations in the gene encoding parkin, an auto-inhibited E3 ubiquitin ligase that functions in the clearance of damaged mitochondria, are the most common cause of autosomal recessive juvenile Parkinsonism. The mechanism regulating parkin activation remains poorly understood. Here we show, by using isothermal titration calorimetry, solution NMR, and fluorescence spectroscopy, that parkin can bind ubiquitin and phosphomimetic ubiquitin by recognizing the canonical hydrophobic patch and C terminus of ubiquitin. The affinity of parkin for both phosphomimetic and unmodified ubiquitin is markedly enhanced upon removal of the ubiquitin-like (UBL) domain of parkin. This suggests that the agonistic binding of ubiquitin to parkin in trans is counterbalanced by the antagonistic activity of the parkin UBL domain in cis. Intriguingly, UBL binding is enthalpy-driven, whereas ubiquitin binding is driven by an increase in the total entropy of the system. These thermodynamic differences are explained by different chemistry in the ubiquitin- and UBL-binding pockets of parkin and, as shown by molecular dynamics simulations, are not a consequence of changes in protein conformational entropy. Indeed, comparison of conformational fluctuations reveals that the RING1-IBR element becomes considerably more rigid upon complex formation. A model of parkin activation is proposed in which E2∼Ub binding triggers large scale diffusional motion of the RING2 domain toward the ubiquitin-stabilized RING1-IBR assembly to complete formation of the active parkin-E2∼Ub transfer complex. Thus, ubiquitin plays a dual role in parkin activation by competing with the inhibitory UBL domain and stabilizing the active form of parkin. PMID:27284007

Functional thermo-dynamics: a generalization of dynamic density functional theory to non-isothermal situations.

PubMed

Anero, Jesús G; Español, Pep; Tarazona, Pedro

2013-07-21

We present a generalization of Density Functional Theory (DFT) to non-equilibrium non-isothermal situations. By using the original approach set forth by Gibbs in his consideration of Macroscopic Thermodynamics (MT), we consider a Functional Thermo-Dynamics (FTD) description based on the density field and the energy density field. A crucial ingredient of the theory is an entropy functional, which is a concave functional. Therefore, there is a one to one connection between the density and energy fields with the conjugate thermodynamic fields. The connection between the three levels of description (MT, DFT, FTD) is clarified through a bridge theorem that relates the entropy of different levels of description and that constitutes a generalization of Mermin's theorem to arbitrary levels of description whose relevant variables are connected linearly. Although the FTD level of description does not provide any new information about averages and correlations at equilibrium, it is a crucial ingredient for the dynamics in non-equilibrium states. We obtain with the technique of projection operators the set of dynamic equations that describe the evolution of the density and energy density fields from an initial non-equilibrium state towards equilibrium. These equations generalize time dependent density functional theory to non-isothermal situations. We also present an explicit model for the entropy functional for hard spheres.

Maximum Entropy Methods as the Bridge Between Microscopic and Macroscopic Theory

NASA Astrophysics Data System (ADS)

Taylor, Jamie M.

2016-09-01

This paper is concerned with an investigation into a function of macroscopic variables known as the singular potential, building on previous work by Ball and Majumdar. The singular potential is a function of the admissible statistical averages of probability distributions on a state space, defined so that it corresponds to the maximum possible entropy given known observed statistical averages, although non-classical entropy-like objective functions will also be considered. First the set of admissible moments must be established, and under the conditions presented in this work the set is open, bounded and convex allowing a description in terms of supporting hyperplanes, which provides estimates on the development of singularities for related probability distributions. Under appropriate conditions it is shown that the singular potential is strictly convex, as differentiable as the microscopic entropy, and blows up uniformly as the macroscopic variable tends to the boundary of the set of admissible moments. Applications of the singular potential are then discussed, and particular consideration will be given to certain free-energy functionals typical in mean-field theory, demonstrating an equivalence between certain microscopic and macroscopic free-energy functionals. This allows statements about L^1-local minimisers of Onsager's free energy to be obtained which cannot be given by two-sided variations, and overcomes the need to ensure local minimisers are bounded away from zero and +∞ before taking L^∞ variations. The analysis also permits the definition of a dual order parameter for which Onsager's free energy allows an explicit representation. Also, the difficulties in approximating the singular potential by everywhere defined functions, in particular by polynomial functions, are addressed, with examples demonstrating the failure of the Taylor approximation to preserve relevant shape properties of the singular potential.

Study of charge transfer complexes of menadione (vitamin K 3) with a series of anilines

NASA Astrophysics Data System (ADS)

Pal, Purnendu; Saha, Avijit; Mukherjee, Asok K.; Mukherjee, Dulal C.

2004-01-01

Menadione (vitamin K 3) has been shown to form charge transfer complexes with N, N-dimethyl aniline, N, N-dimethyl p-toluidine and N, N-dimethyl m-toluidine in CCl 4 medium. The CT transition energies are well correlated with the ionisation potentials of the anilines. The formation constants of the complexes have been determined at a number of temperatures from which the enthalpies and entropies of formation have been obtained. The formation constants exhibit a very good linear free energy relationship (Hammett) at all the temperatures studied.

Supersymmetric Rényi entropy and defect operators

NASA Astrophysics Data System (ADS)

Nishioka, Tatsuma; Yaakov, Itamar

2017-11-01

We describe the defect operator interpretation of the supersymmetric Rényi entropies of superconformal field theories in three, four and five dimensions. The operators involved are supersymmetric codimension-two defects in an auxiliary Z_n gauge theory coupled to n copies of the SCFT. We compute the exact expectation values of such operators using localization, and compare the results to the supersymmetric Rényi entropy. The agreement between the two implies a relationship between the partition function on a squashed sphere and the one on a round sphere in the presence of defects.

Breakdown of the equal area law for holographic entanglement entropy

NASA Astrophysics Data System (ADS)

McCarthy, Fiona; Kubizňák, David; Mann, Robert B.

2017-11-01

We investigate a holographic version of Maxwell's equal area law analogous to that for the phase transition in the black hole temperature/black hole entropy plane of a charged AdS black hole. We consider proposed area laws for both the black hole temperature/holographic entanglement entropy plane and the black hole temperature/2- point correlation function plane. Despite recent claims to the contrary, we demonstrate numerically that neither proposal is valid. We argue that there is no physical reason to expect such a construction in these planes.

Quasiparticle entropy in superconductor/normal metal/superconductor proximity junctions in the diffusive limit

NASA Astrophysics Data System (ADS)

Virtanen, P.; Vischi, F.; Strambini, E.; Carrega, M.; Giazotto, F.

2017-12-01

We discuss the quasiparticle entropy and heat capacity of a dirty superconductor/normal metal/superconductor junction. In the case of short junctions, the inverse proximity effect extending in the superconducting banks plays a crucial role in determining the thermodynamic quantities. In this case, commonly used approximations can violate thermodynamic relations between supercurrent and quasiparticle entropy. We provide analytical and numerical results as a function of different geometrical parameters. Quantitative estimates for the heat capacity can be relevant for the design of caloritronic devices or radiation sensor applications.

Selection of entropy-measure parameters for knowledge discovery in heart rate variability data

PubMed Central

2014-01-01

Background Heart rate variability is the variation of the time interval between consecutive heartbeats. Entropy is a commonly used tool to describe the regularity of data sets. Entropy functions are defined using multiple parameters, the selection of which is controversial and depends on the intended purpose. This study describes the results of tests conducted to support parameter selection, towards the goal of enabling further biomarker discovery. Methods This study deals with approximate, sample, fuzzy, and fuzzy measure entropies. All data were obtained from PhysioNet, a free-access, on-line archive of physiological signals, and represent various medical conditions. Five tests were defined and conducted to examine the influence of: varying the threshold value r (as multiples of the sample standard deviation σ, or the entropy-maximizing rChon), the data length N, the weighting factors n for fuzzy and fuzzy measure entropies, and the thresholds rF and rL for fuzzy measure entropy. The results were tested for normality using Lilliefors' composite goodness-of-fit test. Consequently, the p-value was calculated with either a two sample t-test or a Wilcoxon rank sum test. Results The first test shows a cross-over of entropy values with regard to a change of r. Thus, a clear statement that a higher entropy corresponds to a high irregularity is not possible, but is rather an indicator of differences in regularity. N should be at least 200 data points for r = 0.2 σ and should even exceed a length of 1000 for r = rChon. The results for the weighting parameters n for the fuzzy membership function show different behavior when coupled with different r values, therefore the weighting parameters have been chosen independently for the different threshold values. The tests concerning rF and rL showed that there is no optimal choice, but r = rF = rL is reasonable with r = rChon or r = 0.2σ. Conclusions Some of the tests showed a dependency of the test significance on the data at hand. Nevertheless, as the medical conditions are unknown beforehand, compromises had to be made. Optimal parameter combinations are suggested for the methods considered. Yet, due to the high number of potential parameter combinations, further investigations of entropy for heart rate variability data will be necessary. PMID:25078574

Studies of Entanglement Entropy, and Relativistic Fluids for Thermal Field Theories

NASA Astrophysics Data System (ADS)

Spillane, Michael

In this dissertation we consider physical consequences of adding a finite temperature to quantum field theories. At small length scales entanglement is a critically important feature. It is therefore unsurprising that entanglement entropy and Renyi entropy are useful tools in studying quantum phase transition, and quantum information. In this thesis we consider the corrections to entanglement and Renyi entropies due to addition of a finite temperature. More specifically, we investigate the entanglement entropy of a massive scalar field in 1+1 dimensions at nonzero temperature. In the small mass ( m) and temperature (T) limit, we put upper and lower bounds on the two largest eigenvalues of the covariance matrix used to compute the entanglement entropy. We argue that the entanglement entropy has e-m/T scaling in the limit T << m.. Additionally, we calculate thermal corrections to Renyi entropies for free massless fermions on R x S d-1. By expanding the density matrix in a Boltzmann sum, the problem of finding the Renyi entropies can be mapped to the problem of calculating a two point function on an n-sheeted cover of the sphere. We map the problem on the sphere to a conical region in Euclidean space. By using the method of images, we calculate the two point function and recover the Renyi entropies. At large length scales hydrodynamics is a useful way to study quantum field theories. We review recent interest in the Riemann problem as a method for generating a non-equilibrium steady state. The initial conditions consist of a planar interface between two halves of a system held at different temperatures in a hydrodynamic regime. The resulting fluid flow contains a fixed temperature region with a nonzero flux. We briefly discuss the effects of a conserved charge. Next we discuss deforming the relativistic equations with a nonlinear term and how that deformation affects the temperature and velocity in the region connecting the asymptotic fluids. Finally, we study properties of a non-equilibrium steady state generated when two heat baths are initially in contact with one another. The dynamics of the system in question are governed by holographic duality to a blackhole. We discuss the "phase diagram" associated with the steady state of the dual, dynamical black hole and its relation to the fluid/gravity correspondence.

Selection of entropy-measure parameters for knowledge discovery in heart rate variability data.

PubMed

Mayer, Christopher C; Bachler, Martin; Hörtenhuber, Matthias; Stocker, Christof; Holzinger, Andreas; Wassertheurer, Siegfried

2014-01-01

Heart rate variability is the variation of the time interval between consecutive heartbeats. Entropy is a commonly used tool to describe the regularity of data sets. Entropy functions are defined using multiple parameters, the selection of which is controversial and depends on the intended purpose. This study describes the results of tests conducted to support parameter selection, towards the goal of enabling further biomarker discovery. This study deals with approximate, sample, fuzzy, and fuzzy measure entropies. All data were obtained from PhysioNet, a free-access, on-line archive of physiological signals, and represent various medical conditions. Five tests were defined and conducted to examine the influence of: varying the threshold value r (as multiples of the sample standard deviation σ, or the entropy-maximizing rChon), the data length N, the weighting factors n for fuzzy and fuzzy measure entropies, and the thresholds rF and rL for fuzzy measure entropy. The results were tested for normality using Lilliefors' composite goodness-of-fit test. Consequently, the p-value was calculated with either a two sample t-test or a Wilcoxon rank sum test. The first test shows a cross-over of entropy values with regard to a change of r. Thus, a clear statement that a higher entropy corresponds to a high irregularity is not possible, but is rather an indicator of differences in regularity. N should be at least 200 data points for r = 0.2 σ and should even exceed a length of 1000 for r = rChon. The results for the weighting parameters n for the fuzzy membership function show different behavior when coupled with different r values, therefore the weighting parameters have been chosen independently for the different threshold values. The tests concerning rF and rL showed that there is no optimal choice, but r = rF = rL is reasonable with r = rChon or r = 0.2σ. Some of the tests showed a dependency of the test significance on the data at hand. Nevertheless, as the medical conditions are unknown beforehand, compromises had to be made. Optimal parameter combinations are suggested for the methods considered. Yet, due to the high number of potential parameter combinations, further investigations of entropy for heart rate variability data will be necessary.

Conditional quantum entropy power inequality for d-level quantum systems

NASA Astrophysics Data System (ADS)

Jeong, Kabgyun; Lee, Soojoon; Jeong, Hyunseok

2018-04-01

We propose an extension of the quantum entropy power inequality for finite dimensional quantum systems, and prove a conditional quantum entropy power inequality by using the majorization relation as well as the concavity of entropic functions also given by Audenaert et al (2016 J. Math. Phys. 57 052202). Here, we make particular use of the fact that a specific local measurement after a partial swap operation (or partial swap quantum channel) acting only on finite dimensional bipartite subsystems does not affect the majorization relation for the conditional output states when a separable ancillary subsystem is involved. We expect our conditional quantum entropy power inequality to be useful, and applicable in bounding and analyzing several capacity problems for quantum channels.

[Specific features in realization of the principle of minimum energy dissipation during individual development].

PubMed

Zotin, A A

2012-01-01

Realization of the principle of minimum energy dissipation (Prigogine's theorem) during individual development has been analyzed. This analysis has suggested the following reformulation of this principle for living objects: when environmental conditions are constant, the living system evolves to a current steady state in such a way that the difference between entropy production and entropy flow (psi(u) function) is positive and constantly decreases near the steady state, approaching zero. In turn, the current steady state tends to a final steady state in such a way that the difference between the specific entropy productions in an organism and its environment tends to be minimal. In general, individual development completely agrees with the law of entropy increase (second law of thermodynamics).

Minimization of the Renyi entropy production in the stationary states of the Brownian process with matched death and birth rates.

PubMed

Cybulski, Olgierd; Babin, Volodymyr; Hołyst, Robert

2004-01-01

We analyze the Fleming-Viot process. The system is confined in a box, whose boundaries act as a sink of Brownian particles. The death rate at the boundaries is matched by the branching (birth) rate in the system and thus the number of particles is kept constant. We show that such a process is described by the Renyi entropy whose production is minimized in the stationary state. The entropy production in this process is a monotonically decreasing function of time irrespective of the initial conditions. The first Laplacian eigenvalue is shown to be equal to the Renyi entropy production in the stationary state. As an example we simulate the process in a two-dimensional box.

Convex Accelerated Maximum Entropy Reconstruction

PubMed Central

Worley, Bradley

2016-01-01

Maximum entropy (MaxEnt) spectral reconstruction methods provide a powerful framework for spectral estimation of nonuniformly sampled datasets. Many methods exist within this framework, usually defined based on the magnitude of a Lagrange multiplier in the MaxEnt objective function. An algorithm is presented here that utilizes accelerated first-order convex optimization techniques to rapidly and reliably reconstruct nonuniformly sampled NMR datasets using the principle of maximum entropy. This algorithm – called CAMERA for Convex Accelerated Maximum Entropy Reconstruction Algorithm – is a new approach to spectral reconstruction that exhibits fast, tunable convergence in both constant-aim and constant-lambda modes. A high-performance, open source NMR data processing tool is described that implements CAMERA, and brief comparisons to existing reconstruction methods are made on several example spectra. PMID:26894476

Identification of the release history of a groundwater contaminant in non-uniform flow field through the minimum relative entropy method

NASA Astrophysics Data System (ADS)

Cupola, F.; Tanda, M. G.; Zanini, A.

2014-12-01

The interest in approaches that allow the estimation of pollutant source release in groundwater has increased exponentially over the last decades. This is due to the large number of groundwater reclamation procedures that have been carried out: the remediation is expensive and the costs can be easily shared among the different actors if the release history is known. Moreover, a reliable release history can be a useful tool for predicting the plume evolution and for minimizing the harmful effects of the contamination. In this framework, Woodbury and Ulrych (1993, 1996) adopted and improved the minimum relative entropy (MRE) method to solve linear inverse problems for the recovery of the pollutant release history in an aquifer. In this work, the MRE method has been improved to detect the source release history in 2-D aquifer characterized by a non-uniform flow-field. The approach has been tested on two cases: a 2-D homogeneous conductivity field and a strong heterogeneous one (the hydraulic conductivity presents three orders of magnitude in terms of variability). In the latter case the transfer function could not be described with an analytical formulation, thus, the transfer functions were estimated by means of the method developed by Butera et al. (2006). In order to demonstrate its scope, this method was applied with two different datasets: observations collected at the same time at 20 different monitoring points, and observations collected at 2 monitoring points at different times (15-25 monitoring points). The data observed were considered affected by a random error. These study cases have been carried out considering a Boxcar and a Gaussian function as expected value of the prior distribution of the release history. The agreement between the true and the estimated release history has been evaluated through the calculation of the normalized Root Mean Square (nRMSE) error: this has shown the ability of the method of recovering the release history even in the most severe cases. Finally, the forward simulation has been carried out by using the estimated release history in order to compare the true data with the estimated one: the best agreement has been obtained in the homogeneous case, even if also in the heterogenous one the nRMSE is acceptable.

Dual and mixed nonsymmetric stress-based variational formulations for coupled thermoelastodynamics with second sound effect

NASA Astrophysics Data System (ADS)

Tóth, Balázs

2018-03-01

Some new dual and mixed variational formulations based on a priori nonsymmetric stresses will be developed for linearly coupled irreversible thermoelastodynamic problems associated with second sound effect according to the Lord-Shulman theory. Having introduced the entropy flux vector instead of the entropy field and defining the dissipation and the relaxation potential as the function of the entropy flux, a seven-field dual and mixed variational formulation will be derived from the complementary Biot-Hamilton-type variational principle, using the Lagrange multiplier method. The momentum-, the displacement- and the infinitesimal rotation vector, and the a priori nonsymmetric stress tensor, the temperature change, the entropy field and its flux vector are considered as the independent field variables of this formulation. In order to handle appropriately the six different groups of temporal prescriptions in the relaxed- and/or the strong form, two variational integrals will be incorporated into the seven-field functional. Then, eliminating the entropy from this formulation through the strong fulfillment of the constitutive relation for the temperature change with the use of the Legendre transformation between the enthalpy and Gibbs potential, a six-field dual and mixed action functional is obtained. As a further development, the elimination of the momentum- and the velocity vector from the six-field principle through the a priori satisfaction of the kinematic equation and the constitutive relation for the momentum vector leads to a five-field variational formulation. These principles are suitable for the transient analyses of the structures exposed to a thermal shock of short temporal domain or a large heat flux.

Synthesis, spectroscopic (FT-IR, FT-Raman, NMR, UV-Visible), Fukui function, antimicrobial and molecular docking study of (E)-1-(3-bromobenzylidene)semicarbazide by DFT method

NASA Astrophysics Data System (ADS)

Raja, M.; Raj Muhamed, R.; Muthu, S.; Suresh, M.; Muthu, K.

2017-02-01

The title compound, (E)-1-(3-bromobenzylidene)semicarbazide (3BSC) was synthesized and characterized by FT-IR, FT-Raman, UV, 1HNMR and 13CNMR spectral analysis. The optimized molecular geometry, the vibrational wavenumbers, the infrared intensities and the Raman scattering activities were calculated by using density functional theory (DFT) B3LYP method with 6-311++G(d,p) basis set. The calculated HOMO and LUMO energies show that charge transfer within the molecule. Stability of the molecule arising from hyperconjugative interactions, charge delocalization have been analyzed using natural bond orbital analysis (NBO). The hyperpolarizability calculation reveals the present material has a reasonably good propensity for nonlinear optical activity. Molecular electrostatic potential (MEP) and Fukui functions were also performed. The thermodynamic properties (heat capacity, entropy, and enthalpy) of the 3BSC at different temperatures have been calculated. The biological applications of 3BSC have been screened for its antimicrobial activity and found to exhibit antifungal and antibacterial effects. In addition, the Molecular docking was also performed for the different receptors.

Synthesis, spectroscopic (FT-IR, FT-Raman, NMR, UV-Visible), NLO, NBO, HOMO-LUMO, Fukui function and molecular docking study of (E)-1-(5-bromo-2-hydroxybenzylidene)semicarbazide

NASA Astrophysics Data System (ADS)

Raja, M.; Raj Muhamed, R.; Muthu, S.; Suresh, M.

2017-08-01

The title compound, (E)-1-(5-bromo-2-hydroxybenzylidene)semicarbazide (15BHS) was synthesized and characterized by FT-IR, FT-Raman, UV, 1HNMR and 13CNMR spectral analysis. The optimized molecular geometry, the vibrational wavenumbers, the infrared intensities and the Raman scattering activities were calculated by using density functional theory(DFT) B3LYP method with 6-311++G(d,p) basis set. The detailed interpretation of the vibrational spectra has been carried out by VEDA program. The calculated HOMO and LUMO energies show that charge transfer within the molecule. Stability of the molecule arising from hyperconjugative interactions, charge delocalization have been analyzed using natural bond orbital analysis (NBO). The first order hyperpolarizability, Molecular electrostatic potential (MEP) and Fukui functions were also performed. To study the biological activity of the investigation molecule, molecular docking was done to identify the hydrogen bond lengths and binding energy with different antifungal proteins. The thermodynamic properties (heat capacity, entropy, and enthalpy) of the 15BHS at different temperatures have been calculated.

Ising antiferromagnet on a finite triangular lattice with free boundary conditions

NASA Astrophysics Data System (ADS)

Kim, Seung-Yeon

2015-11-01

The exact integer values for the density of states of the Ising model on an equilateral triangular lattice with free boundary conditions are evaluated up to L = 24 spins on a side for the first time by using the microcanonical transfer matrix. The total number of states is 2 N s = 2300 ≈ 2.037 × 1090 for L = 24, where N s = L( L+1)/2 is the number of spins. Classifying all 2300 spin states according to their energy values is an enormous work. From the density of states, the exact partition function zeros in the complex temperature plane of the triangular-lattice Ising model are evaluated. Using the density of states and the partition function zeros, we investigate the properties of the triangularlattice Ising antiferromagnet. The scaling behavior of the ground-state entropy and the form of the correlation length at T = 0 are studied for the triangular-lattice Ising antiferromagnet with free boundary conditions. Also, the scaling behavior of the Fisher edge singularity is investigated.

Restoration of color in a remote sensing image and its quality evaluation

NASA Astrophysics Data System (ADS)

Zhang, Zuxun; Li, Zhijiang; Zhang, Jianqing; Wang, Zhihe

2003-09-01

This paper is focused on the restoration of color remote sensing (including airborne photo). A complete approach is recommended. It propose that two main aspects should be concerned in restoring a remote sensing image, that are restoration of space information, restoration of photometric information. In this proposal, the restoration of space information can be performed by making the modulation transfer function (MTF) as degradation function, in which the MTF is obtained by measuring the edge curve of origin image. The restoration of photometric information can be performed by improved local maximum entropy algorithm. What's more, a valid approach in processing color remote sensing image is recommended. That is splits the color remote sensing image into three monochromatic images which corresponding three visible light bands and synthesizes the three images after being processed separately with psychological color vision restriction. Finally, three novel evaluation variables are obtained based on image restoration to evaluate the image restoration quality in space restoration quality and photometric restoration quality. An evaluation is provided at last.

Entanglement entropy and entanglement spectrum of triplet topological superconductors.

PubMed

Oliveira, T P; Ribeiro, P; Sacramento, P D

2014-10-22

We analyze the entanglement entropy properties of a 2D p-wave superconductor with Rashba spin-orbit coupling, which displays a rich phase-space that supports non-trivial topological phases, as the chemical potential and the Zeeman term are varied. We show that the entanglement entropy and its derivatives clearly signal the topological transitions and we find numerical evidence that for this model the derivative with respect to the magnetization provides a sensible signature of each topological phase. Following the area law for the entanglement entropy, we systematically analyze the contributions that are proportional to or independent of the perimeter of the system, as a function of the Hamiltonian coupling constants and the geometry of the finite subsystem. For this model, we show that even though the topological entanglement entropy vanishes, it signals the topological phase transitions in a finite system. We also observe a relationship between a topological contribution to the entanglement entropy in a half-cylinder geometry and the number of edge states, and that the entanglement spectrum has robust modes associated with each edge state, as in other topological systems.

On the entanglement entropy of quantum fields in causal sets

NASA Astrophysics Data System (ADS)

Belenchia, Alessio; Benincasa, Dionigi M. T.; Letizia, Marco; Liberati, Stefano

2018-04-01

In order to understand the detailed mechanism by which a fundamental discreteness can provide a finite entanglement entropy, we consider the entanglement entropy of two classes of free massless scalar fields on causal sets that are well approximated by causal diamonds in Minkowski spacetime of dimensions 2, 3 and 4. The first class is defined from discretised versions of the continuum retarded Green functions, while the second uses the causal set’s retarded nonlocal d’Alembertians parametrised by a length scale l k . In both cases we provide numerical evidence that the area law is recovered when the double-cutoff prescription proposed in Sorkin and Yazdi (2016 Entanglement entropy in causal set theory (arXiv:1611.10281)) is imposed. We discuss in detail the need for this double cutoff by studying the effect of two cutoffs on the quantum field and, in particular, on the entanglement entropy, in isolation. In so doing, we get a novel interpretation for why these two cutoff are necessary, and the different roles they play in making the entanglement entropy on causal sets finite.

Rényi entropy, abundance distribution, and the equivalence of ensembles.

PubMed

Mora, Thierry; Walczak, Aleksandra M

2016-05-01

Distributions of abundances or frequencies play an important role in many fields of science, from biology to sociology, as does the Rényi entropy, which measures the diversity of a statistical ensemble. We derive a mathematical relation between the abundance distribution and the Rényi entropy, by analogy with the equivalence of ensembles in thermodynamics. The abundance distribution is mapped onto the density of states, and the Rényi entropy to the free energy. The two quantities are related in the thermodynamic limit by a Legendre transform, by virtue of the equivalence between the micro-canonical and canonical ensembles. In this limit, we show how the Rényi entropy can be constructed geometrically from rank-frequency plots. This mapping predicts that non-concave regions of the rank-frequency curve should result in kinks in the Rényi entropy as a function of its order. We illustrate our results on simple examples, and emphasize the limitations of the equivalence of ensembles when a thermodynamic limit is not well defined. Our results help choose reliable diversity measures based on the experimental accuracy of the abundance distributions in particular frequency ranges.

Probing the extensive nature of entropy

NASA Astrophysics Data System (ADS)

Salagaram, T.; Chetty, N.

2013-08-01

We have devised a general numerical scheme applied to a system of independent, distinguishable, non-interacting particles, to demonstrate in a direct manner the extensive nature of statistical entropy. Working within the microcanonical ensemble, our methods enable one to directly monitor the approach to the thermodynamic limit (N → ∞) in a manner that has not been known before. We show that (sN - s∞) → N-α where sN is the entropy per particle for N particles and S∞ is the entropy per particle in the thermodynamic limit. We demonstrate universal behaviour by considering a number of different systems each defined by its unique single-particle spectrum. Various thermodynamic quantities as a function of N may be computed using our methods; in this paper, we focus on the entropy, the chemical potential and the temperature. Our results are applicable to systems of finite size, e.g. nano-particle systems. Furthermore, we demonstrate a new phenomenon, referred to as entropic interference, which manifests as a cancellation of terms in the thermodynamic limit and which results in the additive nature of entropy.

Thermodynamic Entropy and the Accessible States of Some Simple Systems

ERIC Educational Resources Information Center

Sands, David

2008-01-01

Comparison of the thermodynamic entropy with Boltzmann's principle shows that under conditions of constant volume the total number of arrangements in a simple thermodynamic system with temperature-independent constant-volume heat capacity, C, is T[superscript C/k]. A physical interpretation of this function is given for three such systems: an…

Maximum-Entropy Inference with a Programmable Annealer

PubMed Central

Chancellor, Nicholas; Szoke, Szilard; Vinci, Walter; Aeppli, Gabriel; Warburton, Paul A.

2016-01-01

Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be extracted from the excited states of the annealer. Furthermore we introduce a bit-by-bit analytical method which is agnostic to the specific application and use it to show that the annealer samples from a highly Boltzmann-like distribution. Machines of this kind are therefore candidates for use in a variety of machine learning applications which exploit maximum entropy inference, including language processing and image recognition. PMID:26936311

Holographic entanglement entropy of a 1 + 1 dimensional p-wave superconductor

NASA Astrophysics Data System (ADS)

Das, Sumit R.; Fujita, Mitsutoshi; Kim, Bom Soo

2017-09-01

We examine the behavior of entanglement entropy S A EE of a subsystem A in a fully backreacted holographic model of a 1 + 1 dimensional p wave superconductor across the phase transition. For a given temperature, the system goes to a superconducting phase beyond a critical value of the charge density. The entanglement entropy, considered as a function of the charge density at a given temperature, has a cusp at the critical point. In addition, we find that there are three different behaviors in the condensed phase, depending on the subsystem size. For a subsystem size l smaller than a critical size l c1, S A EE continues to increase as a function of the charge density as we cross the phase transition. When l lies between l c1 and another critical size l c2 the entanglement entropy displays a non-monotonic behavior, while for l > l c2 it decreases monotonically. At large charge densities S A EE appears to saturate. The non-monotonic behavior leads to a novel phase diagram for this system.

Information transfer network of global market indices

NASA Astrophysics Data System (ADS)

Kim, Yup; Kim, Jinho; Yook, Soon-Hyung

2015-07-01

We study the topological properties of the information transfer networks (ITN) of the global financial market indices for six different periods. ITN is a directed weighted network, in which the direction and weight are determined by the transfer entropy between market indices. By applying the threshold method, it is found that ITN undergoes a crossover from the complete graph to a small-world (SW) network. SW regime of ITN for a global crisis is found to be much more enhanced than that for ordinary periods. Furthermore, when ITN is in SW regime, the average clustering coefficient is found to be synchronized with average volatility of markets. We also compare the results with the topological properties of correlation networks.

Surface reconstruction of InAs (001) depending on the pressure and temperature examined by density functional thermodynamics.

PubMed

Yeu, In Won; Park, Jaehong; Han, Gyuseung; Hwang, Cheol Seong; Choi, Jung-Hae

2017-09-06

A detailed understanding of the atomic configuration of the compound semiconductor surface, especially after reconstruction, is very important for the device fabrication and performance. While there have been numerous experimental studies using the scanning probe techniques, further theoretical studies on surface reconstruction are necessary to promote the clear understanding of the origins and development of such subtle surface structures. In this work, therefore, a pressure-temperature surface reconstruction diagram was constructed for the model case of the InAs (001) surface considering both the vibrational entropy and configurational entropy based on the density functional theory. Notably, the equilibrium fraction of various reconstructions was determined as a function of the pressure and temperature, not as a function of the chemical potential, which largely facilitated the direct comparison with the experiments. By taking into account the entropy effects, the coexistence of the multiple reconstructions and the fractional change of each reconstruction by the thermodynamic condition were predicted and were in agreement with the previous experimental observations. This work provides the community with a useful framework for such type of theoretical studies.

Thermodynamics of fluid conduction through hydrophobic channel of carbon nanotubes: The exciting force for filling of nanotubes with polar and nonpolar fluids

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sahu, Pooja; Ali, Sk. M., E-mail: musharaf@barc.gov.in; Shenoy, K. T.

2015-02-21

Thermodynamic properties of the fluid in the hydrophobic pores of nanotubes are known to be different not only from the bulk phase but also from other conventional confinements. Here, we use a recently developed theoretical scheme of “two phase thermodynamic (2PT)” model to understand the driving forces inclined to spontaneous filling of carbon nanotubes (CNTs) with polar (water) and nonpolar (methane) fluids. The CNT confinement is found to be energetically favorable for both water and methane, leading to their spontaneous filling inside CNT(6,6). For both the systems, the free energy of transfer from bulk to CNT confinement is favored bymore » the increased entropy (TΔS), i.e., increased translational entropy and increased rotational entropy, which were found to be sufficiently high to conquer the unfavorable increase in enthalpy (ΔE) when they are transferred inside CNT. To the best of our knowledge, this is the first time when it has been established that the increase in translational entropy during confinement in CNT(6,6) is not unique to water-like H bonding fluid but is also observed in case of nonpolar fluids such as methane. The thermodynamic results are explained in terms of density, structural rigidity, and transport of fluid molecules inside CNT. The faster diffusion of methane over water in bulk phase is found to be reversed during the confinement in CNT(6,6). Studies reveal that though hydrogen bonding plays an important role in transport of water through CNT, but it is not the solitary driving factor, as the nonpolar fluids, which do not have any hydrogen bond formation capacity can go inside CNT and also can flow through it. The associated driving force for filling and transport of water and methane is enhanced translational and rotational entropies, which are attributed mainly by the strong correlation between confined fluid molecules and availability of more free space for rotation of molecule, i.e., lower density of fluid inside CNT due to their single file-like arrangement. To the best of our information, this is perhaps the first study of nonpolar fluid within CNT using 2PT method. Furthermore, the fast flow of polar fluid (water) over nonpolar fluid (methane) has been captured for the first time using molecular dynamic simulations.« less

Two aspects of black hole entropy in Lanczos-Lovelock models of gravity

NASA Astrophysics Data System (ADS)

Kolekar, Sanved; Kothawala, Dawood; Padmanabhan, T.

2012-03-01

We consider two specific approaches to evaluate the black hole entropy which are known to produce correct results in the case of Einstein’s theory and generalize them to Lanczos-Lovelock models. In the first approach (which could be called extrinsic), we use a procedure motivated by earlier work by Pretorius, Vollick, and Israel, and by Oppenheim, and evaluate the entropy of a configuration of densely packed gravitating shells on the verge of forming a black hole in Lanczos-Lovelock theories of gravity. We find that this matter entropy is not equal to (it is less than) Wald entropy, except in the case of Einstein theory, where they are equal. The matter entropy is proportional to the Wald entropy if we consider a specific mth-order Lanczos-Lovelock model, with the proportionality constant depending on the spacetime dimensions D and the order m of the Lanczos-Lovelock theory as (D-2m)/(D-2). Since the proportionality constant depends on m, the proportionality between matter entropy and Wald entropy breaks down when we consider a sum of Lanczos-Lovelock actions involving different m. In the second approach (which could be called intrinsic), we generalize a procedure, previously introduced by Padmanabhan in the context of general relativity, to study off-shell entropy of a class of metrics with horizon using a path integral method. We consider the Euclidean action of Lanczos-Lovelock models for a class of metrics off shell and interpret it as a partition function. We show that in the case of spherically symmetric metrics, one can interpret the Euclidean action as the free energy and read off both the entropy and energy of a black hole spacetime. Surprisingly enough, this leads to exactly the Wald entropy and the energy of the spacetime in Lanczos-Lovelock models obtained by other methods. We comment on possible implications of the result.

The entropic brain: a theory of conscious states informed by neuroimaging research with psychedelic drugs

PubMed Central

Carhart-Harris, Robin L.; Leech, Robert; Hellyer, Peter J.; Shanahan, Murray; Feilding, Amanda; Tagliazucchi, Enzo; Chialvo, Dante R.; Nutt, David

2014-01-01

Entropy is a dimensionless quantity that is used for measuring uncertainty about the state of a system but it can also imply physical qualities, where high entropy is synonymous with high disorder. Entropy is applied here in the context of states of consciousness and their associated neurodynamics, with a particular focus on the psychedelic state. The psychedelic state is considered an exemplar of a primitive or primary state of consciousness that preceded the development of modern, adult, human, normal waking consciousness. Based on neuroimaging data with psilocybin, a classic psychedelic drug, it is argued that the defining feature of “primary states” is elevated entropy in certain aspects of brain function, such as the repertoire of functional connectivity motifs that form and fragment across time. Indeed, since there is a greater repertoire of connectivity motifs in the psychedelic state than in normal waking consciousness, this implies that primary states may exhibit “criticality,” i.e., the property of being poised at a “critical” point in a transition zone between order and disorder where certain phenomena such as power-law scaling appear. Moreover, if primary states are critical, then this suggests that entropy is suppressed in normal waking consciousness, meaning that the brain operates just below criticality. It is argued that this entropy suppression furnishes normal waking consciousness with a constrained quality and associated metacognitive functions, including reality-testing and self-awareness. It is also proposed that entry into primary states depends on a collapse of the normally highly organized activity within the default-mode network (DMN) and a decoupling between the DMN and the medial temporal lobes (which are normally significantly coupled). These hypotheses can be tested by examining brain activity and associated cognition in other candidate primary states such as rapid eye movement (REM) sleep and early psychosis and comparing these with non-primary states such as normal waking consciousness and the anaesthetized state. PMID:24550805

The entropic brain: a theory of conscious states informed by neuroimaging research with psychedelic drugs.

PubMed

Carhart-Harris, Robin L; Leech, Robert; Hellyer, Peter J; Shanahan, Murray; Feilding, Amanda; Tagliazucchi, Enzo; Chialvo, Dante R; Nutt, David

2014-01-01

Entropy is a dimensionless quantity that is used for measuring uncertainty about the state of a system but it can also imply physical qualities, where high entropy is synonymous with high disorder. Entropy is applied here in the context of states of consciousness and their associated neurodynamics, with a particular focus on the psychedelic state. The psychedelic state is considered an exemplar of a primitive or primary state of consciousness that preceded the development of modern, adult, human, normal waking consciousness. Based on neuroimaging data with psilocybin, a classic psychedelic drug, it is argued that the defining feature of "primary states" is elevated entropy in certain aspects of brain function, such as the repertoire of functional connectivity motifs that form and fragment across time. Indeed, since there is a greater repertoire of connectivity motifs in the psychedelic state than in normal waking consciousness, this implies that primary states may exhibit "criticality," i.e., the property of being poised at a "critical" point in a transition zone between order and disorder where certain phenomena such as power-law scaling appear. Moreover, if primary states are critical, then this suggests that entropy is suppressed in normal waking consciousness, meaning that the brain operates just below criticality. It is argued that this entropy suppression furnishes normal waking consciousness with a constrained quality and associated metacognitive functions, including reality-testing and self-awareness. It is also proposed that entry into primary states depends on a collapse of the normally highly organized activity within the default-mode network (DMN) and a decoupling between the DMN and the medial temporal lobes (which are normally significantly coupled). These hypotheses can be tested by examining brain activity and associated cognition in other candidate primary states such as rapid eye movement (REM) sleep and early psychosis and comparing these with non-primary states such as normal waking consciousness and the anaesthetized state.

Evaluation of Fuel Cell Operation and Degradation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Williams, Mark; Gemmen, Randall; Richards, George

The concepts of area specific resistance (ASR) and degradation are developed for different fuel cell operating modes. The concepts of exergetic efficiency and entropy production were applied to ASR and degradation. It is shown that exergetic efficiency is a time-dependent function useful describing the thermal efficiency of a fuel cell and the change in thermal efficiency of a degrading fuel cell. Entropy production was evaluated for the cases of constant voltage operation and constant current operation of the fuel cell for a fuel cell undergoing ohmic degradation. It was discovered that the Gaussian hypergeometric function describes the cumulative entropy andmore » electrical work produced by fuel cells operating at constant voltage. The Gaussian hypergeometric function is found in many applications in modern physics. This paper builds from and is an extension of several papers recently published by the authors in the Journal of The Electrochemical Society (ECS), ECS Transactions, Journal of Power Sources, and the Journal of Fuel Cell Science and Technology.« less

Entropy production in photovoltaic-thermoelectric nanodevices from the non-equilibrium Green’s function formalism

NASA Astrophysics Data System (ADS)

Michelini, Fabienne; Crépieux, Adeline; Beltako, Katawoura

2017-05-01

We discuss some thermodynamic aspects of energy conversion in electronic nanosystems able to convert light energy into electrical or/and thermal energy using the non-equilibrium Green’s function formalism. In a first part, we derive the photon energy and particle currents inside a nanosystem interacting with light and in contact with two electron reservoirs at different temperatures. Energy conservation is verified, and radiation laws are discussed from electron non-equilibrium Green’s functions. We further use the photon currents to formulate the rate of entropy production for steady-state nanosystems, and we recast this rate in terms of efficiency for specific photovoltaic-thermoelectric nanodevices. In a second part, a quantum dot based nanojunction is closely examined using a two-level model. We show analytically that the rate of entropy production is always positive, but we find numerically that it can reach negative values when the derived particule and energy currents are empirically modified as it is usually done for modeling realistic photovoltaic systems.

Entropy production in photovoltaic-thermoelectric nanodevices from the non-equilibrium Green's function formalism.

PubMed

Michelini, Fabienne; Crépieux, Adeline; Beltako, Katawoura

2017-05-04

We discuss some thermodynamic aspects of energy conversion in electronic nanosystems able to convert light energy into electrical or/and thermal energy using the non-equilibrium Green's function formalism. In a first part, we derive the photon energy and particle currents inside a nanosystem interacting with light and in contact with two electron reservoirs at different temperatures. Energy conservation is verified, and radiation laws are discussed from electron non-equilibrium Green's functions. We further use the photon currents to formulate the rate of entropy production for steady-state nanosystems, and we recast this rate in terms of efficiency for specific photovoltaic-thermoelectric nanodevices. In a second part, a quantum dot based nanojunction is closely examined using a two-level model. We show analytically that the rate of entropy production is always positive, but we find numerically that it can reach negative values when the derived particule and energy currents are empirically modified as it is usually done for modeling realistic photovoltaic systems.

Thermodynamics of Terrestrial Evolution

PubMed Central

Kirkaldy, J. S.

1965-01-01

The causal element of biological evolution and development can be understood in terms of a potential function which is generalized from the variational principles of irreversible thermodynamics. This potential function is approximated by the rate of entropy production in a configuration space which admits of macroscopic excursions by fluctuation and regression as well as microscopic ones. Analogously to Onsager's dissipation function, the potential takes the form of a saddle surface in this configuration space. The path of evolution following from an initial high dissipation state within the fixed constraint provided by the invariant energy flux from the sun tends toward the stable saddle point by a series of spontaneous regressions which lower the entropy production rate and by an alternating series of spontaneous fluctuations which introduce new internal constraints and lead to a higher entropy production rate. The potential thus rationalizes the system's observed tendency toward “chemical imperialism” (high dissipation) while simultaneously accommodating the development of “dynamic efficiency” and complication (low dissipation). PMID:5884019

A Variational Level Set Approach Based on Local Entropy for Image Segmentation and Bias Field Correction.

PubMed

Tang, Jian; Jiang, Xiaoliang

2017-01-01

Image segmentation has always been a considerable challenge in image analysis and understanding due to the intensity inhomogeneity, which is also commonly known as bias field. In this paper, we present a novel region-based approach based on local entropy for segmenting images and estimating the bias field simultaneously. Firstly, a local Gaussian distribution fitting (LGDF) energy function is defined as a weighted energy integral, where the weight is local entropy derived from a grey level distribution of local image. The means of this objective function have a multiplicative factor that estimates the bias field in the transformed domain. Then, the bias field prior is fully used. Therefore, our model can estimate the bias field more accurately. Finally, minimization of this energy function with a level set regularization term, image segmentation, and bias field estimation can be achieved. Experiments on images of various modalities demonstrated the superior performance of the proposed method when compared with other state-of-the-art approaches.

Principle of maximum entropy for reliability analysis in the design of machine components

NASA Astrophysics Data System (ADS)

Zhang, Yimin

2018-03-01

We studied the reliability of machine components with parameters that follow an arbitrary statistical distribution using the principle of maximum entropy (PME). We used PME to select the statistical distribution that best fits the available information. We also established a probability density function (PDF) and a failure probability model for the parameters of mechanical components using the concept of entropy and the PME. We obtained the first four moments of the state function for reliability analysis and design. Furthermore, we attained an estimate of the PDF with the fewest human bias factors using the PME. This function was used to calculate the reliability of the machine components, including a connecting rod, a vehicle half-shaft, a front axle, a rear axle housing, and a leaf spring, which have parameters that typically follow a non-normal distribution. Simulations were conducted for comparison. This study provides a design methodology for the reliability of mechanical components for practical engineering projects.

Shape dependence of two-cylinder Rényi entropies for free bosons on a lattice

NASA Astrophysics Data System (ADS)

Chojnacki, Leilee; Cook, Caleb Q.; Dalidovich, Denis; Hayward Sierens, Lauren E.; Lantagne-Hurtubise, Étienne; Melko, Roger G.; Vlaar, Tiffany J.

2016-10-01

Universal scaling terms occurring in Rényi entanglement entropies have the potential to bring new understanding to quantum critical points in free and interacting systems. Quantitative comparisons between analytical continuum theories and numerical calculations on lattice models play a crucial role in advancing such studies. In this paper, we exactly calculate the universal two-cylinder shape dependence of entanglement entropies for free bosons on finite-size square lattices, and compare to approximate functions derived in the continuum using several different Ansätze. Although none of these Ansätze are exact in the thermodynamic limit, we find that numerical fits are in good agreement with continuum functions derived using the anti-de Sitter/conformal field theory correspondence, an extensive mutual information model, and a quantum Lifshitz model. We use fits of our lattice data to these functions to calculate universal scalars defined in the thin-cylinder limit, and compare to values previously obtained for the free boson field theory in the continuum.

Two-phase thermodynamic model for efficient and accurate absolute entropy of water from molecular dynamics simulations.

PubMed

Lin, Shiang-Tai; Maiti, Prabal K; Goddard, William A

2010-06-24

Presented here is the two-phase thermodynamic (2PT) model for the calculation of energy and entropy of molecular fluids from the trajectory of molecular dynamics (MD) simulations. In this method, the density of state (DoS) functions (including the normal modes of translation, rotation, and intramolecular vibration motions) are determined from the Fourier transform of the corresponding velocity autocorrelation functions. A fluidicity parameter (f), extracted from the thermodynamic state of the system derived from the same MD, is used to partition the translation and rotation modes into a diffusive, gas-like component (with 3Nf degrees of freedom) and a nondiffusive, solid-like component. The thermodynamic properties, including the absolute value of entropy, are then obtained by applying quantum statistics to the solid component and applying hard sphere/rigid rotor thermodynamics to the gas component. The 2PT method produces exact thermodynamic properties of the system in two limiting states: the nondiffusive solid state (where the fluidicity is zero) and the ideal gas state (where the fluidicity becomes unity). We examine the 2PT entropy for various water models (F3C, SPC, SPC/E, TIP3P, and TIP4P-Ew) at ambient conditions and find good agreement with literature results obtained based on other simulation techniques. We also validate the entropy of water in the liquid and vapor phases along the vapor-liquid equilibrium curve from the triple point to the critical point. We show that this method produces converged liquid phase entropy in tens of picoseconds, making it an efficient means for extracting thermodynamic properties from MD simulations.

Signatures of Solvation Thermodynamics in Spectra of Intermolecular Vibrations

PubMed Central

2017-01-01

This study explores the thermodynamic and vibrational properties of water in the three-dimensional environment of solvated ions and small molecules using molecular simulations. The spectrum of intermolecular vibrations in liquid solvents provides detailed information on the shape of the local potential energy surface, which in turn determines local thermodynamic properties such as the entropy. Here, we extract this information using a spatially resolved extension of the two-phase thermodynamics method to estimate hydration water entropies based on the local vibrational density of states (3D-2PT). Combined with an analysis of solute–water and water–water interaction energies, this allows us to resolve local contributions to the solvation enthalpy, entropy, and free energy. We use this approach to study effects of ions on their surrounding water hydrogen bond network, its spectrum of intermolecular vibrations, and resulting thermodynamic properties. In the three-dimensional environment of polar and nonpolar functional groups of molecular solutes, we identify distinct hydration water species and classify them by their characteristic vibrational density of states and molecular entropies. In each case, we are able to assign variations in local hydration water entropies to specific changes in the spectrum of intermolecular vibrations. This provides an important link for the thermodynamic interpretation of vibrational spectra that are accessible to far-infrared absorption and Raman spectroscopy experiments. Our analysis provides unique microscopic details regarding the hydration of hydrophobic and hydrophilic functional groups, which enable us to identify interactions and molecular degrees of freedom that determine relevant contributions to the solvation entropy and consequently the free energy. PMID:28783431

Integrated design of multivariable hydrometric networks using entropy theory with a multiobjective optimization approach

NASA Astrophysics Data System (ADS)

Kim, Y.; Hwang, T.; Vose, J. M.; Martin, K. L.; Band, L. E.

2016-12-01

Obtaining quality hydrologic observations is the first step towards a successful water resources management. While remote sensing techniques have enabled to convert satellite images of the Earth's surface to hydrologic data, the importance of ground-based observations has never been diminished because in-situ data are often highly accurate and can be used to validate remote measurements. The existence of efficient hydrometric networks is becoming more important to obtain as much as information with minimum redundancy. The World Meteorological Organization (WMO) has recommended a guideline for the minimum hydrometric network density based on physiography; however, this guideline is not for the optimum network design but for avoiding serious deficiency from a network. Moreover, all hydrologic variables are interconnected within the hydrologic cycle, while monitoring networks have been designed individually. This study proposes an integrated network design method using entropy theory with a multiobjective optimization approach. In specific, a precipitation and a streamflow networks in a semi-urban watershed in Ontario, Canada were designed simultaneously by maximizing joint entropy, minimizing total correlation, and maximizing conditional entropy of streamflow network given precipitation network. After comparing with the typical individual network designs, the proposed design method would be able to determine more efficient optimal networks by avoiding the redundant stations, in which hydrologic information is transferable. Additionally, four quantization cases were applied in entropy calculations to assess their implications on the station rankings and the optimal networks. The results showed that the selection of quantization method should be considered carefully because the rankings and optimal networks are subject to change accordingly.

Radiation Entropy and Near-Field Thermophotovoltaics

NASA Astrophysics Data System (ADS)

Zhang, Zhuomin M.

2008-08-01

Radiation entropy was key to the original derivation of Planck's law of blackbody radiation, in 1900. This discovery opened the door to quantum mechanical theory and Planck was awarded the Nobel Prize in Physics in 1918. Thermal radiation plays an important role in incandescent lamps, solar energy utilization, temperature measurements, materials processing, remote sensing for astronomy and space exploration, combustion and furnace design, food processing, cryogenic engineering, as well as numerous agricultural, health, and military applications. While Planck's law has been fruitfully applied to a large number of engineering problems for over 100 years, questions have been raised about its limitation in micro/nano systems, especially at subwavelength distances or in the near field. When two objects are located closer than the characteristic wavelength, wave interference and photon tunneling occurs that can result in significant enhancement of the radiative transfer. Recent studies have shown that the near-field effects can realize emerging technologies, such as superlens, sub-wavelength light source, polariton-assisted nanolithography, thermophotovoltaic (TPV) systems, scanning tunneling thermal microscopy, etc. The concept of entropy has also been applied to explain laser cooling of solids as well as the second law efficiency of devices that utilize thermal radiation to produce electricity. However, little is known as regards the nature of entropy in near-field radiation. Some history and recent advances are reviewed in this presentation with a call for research of radiation entropy in the near field, due to the important applications in the optimization of thermophotovoltaic converters and in the design of practical systems that can harvest photon energies efficiently.

Integrated design of multivariable hydrometric networks using entropy theory with a multiobjective optimization approach

NASA Astrophysics Data System (ADS)

Keum, J.; Coulibaly, P. D.

2017-12-01

Obtaining quality hydrologic observations is the first step towards a successful water resources management. While remote sensing techniques have enabled to convert satellite images of the Earth's surface to hydrologic data, the importance of ground-based observations has never been diminished because in-situ data are often highly accurate and can be used to validate remote measurements. The existence of efficient hydrometric networks is becoming more important to obtain as much as information with minimum redundancy. The World Meteorological Organization (WMO) has recommended a guideline for the minimum hydrometric network density based on physiography; however, this guideline is not for the optimum network design but for avoiding serious deficiency from a network. Moreover, all hydrologic variables are interconnected within the hydrologic cycle, while monitoring networks have been designed individually. This study proposes an integrated network design method using entropy theory with a multiobjective optimization approach. In specific, a precipitation and a streamflow networks in a semi-urban watershed in Ontario, Canada were designed simultaneously by maximizing joint entropy, minimizing total correlation, and maximizing conditional entropy of streamflow network given precipitation network. After comparing with the typical individual network designs, the proposed design method would be able to determine more efficient optimal networks by avoiding the redundant stations, in which hydrologic information is transferable. Additionally, four quantization cases were applied in entropy calculations to assess their implications on the station rankings and the optimal networks. The results showed that the selection of quantization method should be considered carefully because the rankings and optimal networks are subject to change accordingly.

Measuring Information-Transfer Delays

PubMed Central

Wibral, Michael; Pampu, Nicolae; Priesemann, Viola; Siebenhühner, Felix; Seiwert, Hannes; Lindner, Michael; Lizier, Joseph T.; Vicente, Raul

2013-01-01

In complex networks such as gene networks, traffic systems or brain circuits it is important to understand how long it takes for the different parts of the network to effectively influence one another. In the brain, for example, axonal delays between brain areas can amount to several tens of milliseconds, adding an intrinsic component to any timing-based processing of information. Inferring neural interaction delays is thus needed to interpret the information transfer revealed by any analysis of directed interactions across brain structures. However, a robust estimation of interaction delays from neural activity faces several challenges if modeling assumptions on interaction mechanisms are wrong or cannot be made. Here, we propose a robust estimator for neuronal interaction delays rooted in an information-theoretic framework, which allows a model-free exploration of interactions. In particular, we extend transfer entropy to account for delayed source-target interactions, while crucially retaining the conditioning on the embedded target state at the immediately previous time step. We prove that this particular extension is indeed guaranteed to identify interaction delays between two coupled systems and is the only relevant option in keeping with Wiener’s principle of causality. We demonstrate the performance of our approach in detecting interaction delays on finite data by numerical simulations of stochastic and deterministic processes, as well as on local field potential recordings. We also show the ability of the extended transfer entropy to detect the presence of multiple delays, as well as feedback loops. While evaluated on neuroscience data, we expect the estimator to be useful in other fields dealing with network dynamics. PMID:23468850

Functional entropy variables: A new methodology for deriving thermodynamically consistent algorithms for complex fluids, with particular reference to the isothermal Navier–Stokes–Korteweg equations

DOE Office of Scientific and Technical Information (OSTI.GOV)

Liu, Ju, E-mail: jliu@ices.utexas.edu; Gomez, Hector; Evans, John A.

2013-09-01

We propose a new methodology for the numerical solution of the isothermal Navier–Stokes–Korteweg equations. Our methodology is based on a semi-discrete Galerkin method invoking functional entropy variables, a generalization of classical entropy variables, and a new time integration scheme. We show that the resulting fully discrete scheme is unconditionally stable-in-energy, second-order time-accurate, and mass-conservative. We utilize isogeometric analysis for spatial discretization and verify the aforementioned properties by adopting the method of manufactured solutions and comparing coarse mesh solutions with overkill solutions. Various problems are simulated to show the capability of the method. Our methodology provides a means of constructing unconditionallymore » stable numerical schemes for nonlinear non-convex hyperbolic systems of conservation laws.« less

Entropic lattice Boltzmann representations required to recover Navier-Stokes flows.

PubMed

Keating, Brian; Vahala, George; Yepez, Jeffrey; Soe, Min; Vahala, Linda

2007-03-01

There are two disparate formulations of the entropic lattice Boltzmann scheme: one of these theories revolves around the analog of the discrete Boltzmann H function of standard extensive statistical mechanics, while the other revolves around the nonextensive Tsallis entropy. It is shown here that it is the nonenforcement of the pressure tensor moment constraints that lead to extremizations of entropy resulting in Tsallis-like forms. However, with the imposition of the pressure tensor moment constraint, as is fundamentally necessary for the recovery of the Navier-Stokes equations, it is proved that the entropy function must be of the discrete Boltzmann form. Three-dimensional simulations are performed which illustrate some of the differences between standard lattice Boltzmann and entropic lattice Boltzmann schemes, as well as the role played by the number of phase-space velocities used in the discretization.

MaxEnt alternatives to pearson family distributions

NASA Astrophysics Data System (ADS)

Stokes, Barrie J.

2012-05-01

In a previous MaxEnt conference [11] a method of obtaining MaxEnt univariate distributions under a variety of constraints was presented. The Mathematica function Interpolation[], normally used with numerical data, can also process "semi-symbolic" data, and Lagrange Multiplier equations were solved for a set of symbolic ordinates describing the required MaxEnt probability density function. We apply a more developed version of this approach to finding MaxEnt distributions having prescribed β1 and β2 values, and compare the entropy of the MaxEnt distribution to that of the Pearson family distribution having the same β1 and β2. These MaxEnt distributions do have, in general, greater entropy than the related Pearson distribution. In accordance with Jaynes' Maximum Entropy Principle, these MaxEnt distributions are thus to be preferred to the corresponding Pearson distributions as priors in Bayes' Theorem.

Spectral Entropy Can Predict Changes of Working Memory Performance Reduced by Short-Time Training in the Delayed-Match-to-Sample Task

PubMed Central

Tian, Yin; Zhang, Huiling; Xu, Wei; Zhang, Haiyong; Yang, Li; Zheng, Shuxing; Shi, Yupan

2017-01-01

Spectral entropy, which was generated by applying the Shannon entropy concept to the power distribution of the Fourier-transformed electroencephalograph (EEG), was utilized to measure the uniformity of power spectral density underlying EEG when subjects performed the working memory tasks twice, i.e., before and after training. According to Signed Residual Time (SRT) scores based on response speed and accuracy trade-off, 20 subjects were divided into two groups, namely high-performance and low-performance groups, to undertake working memory (WM) tasks. We found that spectral entropy derived from the retention period of WM on channel FC4 exhibited a high correlation with SRT scores. To this end, spectral entropy was used in support vector machine classifier with linear kernel to differentiate these two groups. Receiver operating characteristics analysis and leave-one out cross-validation (LOOCV) demonstrated that the averaged classification accuracy (CA) was 90.0 and 92.5% for intra-session and inter-session, respectively, indicating that spectral entropy could be used to distinguish these two different WM performance groups successfully. Furthermore, the support vector regression prediction model with radial basis function kernel and the root-mean-square error of prediction revealed that spectral entropy could be utilized to predict SRT scores on individual WM performance. After testing the changes in SRT scores and spectral entropy for each subject by short-time training, we found that 16 in 20 subjects’ SRT scores were clearly promoted after training and 15 in 20 subjects’ SRT scores showed consistent changes with spectral entropy before and after training. The findings revealed that spectral entropy could be a promising indicator to predict individual’s WM changes by training and further provide a novel application about WM for brain–computer interfaces. PMID:28912701

[Quantitative assessment of urban ecosystem services flow based on entropy theory: A case study of Beijing, China].

PubMed

Li, Jing Xin; Yang, Li; Yang, Lei; Zhang, Chao; Huo, Zhao Min; Chen, Min Hao; Luan, Xiao Feng

2018-03-01

Quantitative evaluation of ecosystem service is a primary premise for rational resources exploitation and sustainable development. Examining ecosystem services flow provides a scientific method to quantity ecosystem services. We built an assessment indicator system based on land cover/land use under the framework of four types of ecosystem services. The types of ecosystem services flow were reclassified. Using entropy theory, disorder degree and developing trend of indicators and urban ecosystem were quantitatively assessed. Beijing was chosen as the study area, and twenty-four indicators were selected for evaluation. The results showed that the entropy value of Beijing urban ecosystem during 2004 to 2015 was 0.794 and the entropy flow was -0.024, suggesting a large disordered degree and near verge of non-health. The system got maximum values for three times, while the mean annual variation of the system entropy value increased gradually in three periods, indicating that human activities had negative effects on urban ecosystem. Entropy flow reached minimum value in 2007, implying the environmental quality was the best in 2007. The determination coefficient for the fitting function of total permanent population in Beijing and urban ecosystem entropy flow was 0.921, indicating that urban ecosystem health was highly correlated with total permanent population.

Configurational entropy of polar glass formers and the effect of electric field on glass transition

DOE Office of Scientific and Technical Information (OSTI.GOV)

Matyushov, Dmitry V., E-mail: dmitrym@asu.edu

2016-07-21

A model of low-temperature polar liquids is constructed that accounts for the configurational heat capacity, entropy, and the effect of a strong electric field on the glass transition. The model is based on the Padé-truncated perturbation expansions of the liquid state theory. Depending on parameters, it accommodates an ideal glass transition of vanishing configurational entropy and its avoidance, with a square-root divergent enumeration function at the point of its termination. A composite density-temperature parameter ρ{sup γ}/T, often used to represent combined pressure and temperature data, follows from the model. The theory is in good agreement with the experimental data formore » excess (over the crystal state) thermodynamics of molecular glass formers. We suggest that the Kauzmann entropy crisis might be a signature of vanishing configurational entropy of a subset of degrees of freedom, multipolar rotations in our model. This scenario has observable consequences: (i) a dynamical crossover of the relaxation time and (ii) the fragility index defined by the ratio of the excess heat capacity and excess entropy at the glass transition. The Kauzmann temperature of vanishing configurational entropy and the corresponding glass transition temperature shift upward when the electric field is applied. The temperature shift scales quadratically with the field strength.« less

The entropy of the life table: A reappraisal.

PubMed

Fernandez, Oscar E; Beltrán-Sánchez, Hiram

2015-09-01

The life table entropy provides useful information for understanding improvements in mortality and survival in a population. In this paper we take a closer look at the life table entropy and use advanced mathematical methods to provide additional insights for understanding how it relates to changes in mortality and survival. By studying the entropy (H) as a functional, we show that changes in the entropy depend on both the relative change in life expectancy lost due to death (e(†)) and in life expectancy at birth (e0). We also show that changes in the entropy can be further linked to improvements in premature and older deaths. We illustrate our methods with empirical data from Latin American countries, which suggests that at high mortality levels declines in H (which are associated with survival increases) linked with larger improvements in e0, whereas at low mortality levels e(†) made larger contributions to H. We additionally show that among countries with low mortality level, contributions of e(†) to changes in the life table entropy resulted from averting early deaths. These findings indicate that future increases in overall survival in low mortality countries will likely result from improvements in e(†). Copyright © 2015 Elsevier Inc. All rights reserved.

Resting state fMRI entropy probes complexity of brain activity in adults with ADHD.

PubMed

Sokunbi, Moses O; Fung, Wilson; Sawlani, Vijay; Choppin, Sabine; Linden, David E J; Thome, Johannes

2013-12-30

In patients with attention deficit hyperactivity disorder (ADHD), quantitative neuroimaging techniques have revealed abnormalities in various brain regions, including the frontal cortex, striatum, cerebellum, and occipital cortex. Nonlinear signal processing techniques such as sample entropy have been used to probe the regularity of brain magnetoencephalography signals in patients with ADHD. In the present study, we extend this technique to analyse the complex output patterns of the 4 dimensional resting state functional magnetic resonance imaging signals in adult patients with ADHD. After adjusting for the effect of age, we found whole brain entropy differences (P=0.002) between groups and negative correlation (r=-0.45) between symptom scores and mean whole brain entropy values, indicating lower complexity in patients. In the regional analysis, patients showed reduced entropy in frontal and occipital regions bilaterally and a significant negative correlation between the symptom scores and the entropy maps at a family-wise error corrected cluster level of P<0.05 (P=0.001, initial threshold). Our findings support the hypothesis of abnormal frontal-striatal-cerebellar circuits in ADHD and the suggestion that sample entropy is a useful tool in revealing abnormalities in the brain dynamics of patients with psychiatric disorders. © 2013 Elsevier Ireland Ltd. All rights reserved.

Classical many-particle systems with unique disordered ground states

NASA Astrophysics Data System (ADS)

Zhang, G.; Stillinger, F. H.; Torquato, S.

2017-10-01

Classical ground states (global energy-minimizing configurations) of many-particle systems are typically unique crystalline structures, implying zero enumeration entropy of distinct patterns (aside from trivial symmetry operations). By contrast, the few previously known disordered classical ground states of many-particle systems are all high-entropy (highly degenerate) states. Here we show computationally that our recently proposed "perfect-glass" many-particle model [Sci. Rep. 6, 36963 (2016), 10.1038/srep36963] possesses disordered classical ground states with a zero entropy: a highly counterintuitive situation . For all of the system sizes, parameters, and space dimensions that we have numerically investigated, the disordered ground states are unique such that they can always be superposed onto each other or their mirror image. At low energies, the density of states obtained from simulations matches those calculated from the harmonic approximation near a single ground state, further confirming ground-state uniqueness. Our discovery provides singular examples in which entropy and disorder are at odds with one another. The zero-entropy ground states provide a unique perspective on the celebrated Kauzmann-entropy crisis in which the extrapolated entropy of a supercooled liquid drops below that of the crystal. We expect that our disordered unique patterns to be of value in fields beyond glass physics, including applications in cryptography as pseudorandom functions with tunable computational complexity.

General multi-group macroscopic modeling for thermo-chemical non-equilibrium gas mixtures.

PubMed

Liu, Yen; Panesi, Marco; Sahai, Amal; Vinokur, Marcel

2015-04-07

This paper opens a new door to macroscopic modeling for thermal and chemical non-equilibrium. In a game-changing approach, we discard conventional theories and practices stemming from the separation of internal energy modes and the Landau-Teller relaxation equation. Instead, we solve the fundamental microscopic equations in their moment forms but seek only optimum representations for the microscopic state distribution function that provides converged and time accurate solutions for certain macroscopic quantities at all times. The modeling makes no ad hoc assumptions or simplifications at the microscopic level and includes all possible collisional and radiative processes; it therefore retains all non-equilibrium fluid physics. We formulate the thermal and chemical non-equilibrium macroscopic equations and rate coefficients in a coupled and unified fashion for gases undergoing completely general transitions. All collisional partners can have internal structures and can change their internal energy states after transitions. The model is based on the reconstruction of the state distribution function. The internal energy space is subdivided into multiple groups in order to better describe non-equilibrium state distributions. The logarithm of the distribution function in each group is expressed as a power series in internal energy based on the maximum entropy principle. The method of weighted residuals is applied to the microscopic equations to obtain macroscopic moment equations and rate coefficients succinctly to any order. The model's accuracy depends only on the assumed expression of the state distribution function and the number of groups used and can be self-checked for accuracy and convergence. We show that the macroscopic internal energy transfer, similar to mass and momentum transfers, occurs through nonlinear collisional processes and is not a simple relaxation process described by, e.g., the Landau-Teller equation. Unlike the classical vibrational energy relaxation model, which can only be applied to molecules, the new model is applicable to atoms, molecules, ions, and their mixtures. Numerical examples and model validations are carried out with two gas mixtures using the maximum entropy linear model: one mixture consists of nitrogen molecules undergoing internal excitation and dissociation and the other consists of nitrogen atoms undergoing internal excitation and ionization. Results show that the original hundreds to thousands of microscopic equations can be reduced to two macroscopic equations with almost perfect agreement for the total number density and total internal energy using only one or two groups. We also obtain good prediction of the microscopic state populations using 5-10 groups in the macroscopic equations.

Uncertainty estimation of the self-thinning process by Maximum-Entropy Principle

Treesearch

Shoufan Fang; George Z. Gertner

2000-01-01

When available information is scarce, the Maximum-Entropy Principle can estimate the distributions of parameters. In our case study, we estimated the distributions of the parameters of the forest self-thinning process based on literature information, and we derived the conditional distribution functions and estimated the 95 percent confidence interval (CI) of the self-...

An inverse gas chromatographic methodology for studying gas-liquid mass transfer.

PubMed

Paloglou, A; Martakidis, K; Gavril, D

2017-01-13

A novel methodology of reversed flow inverse gas chromatography (RF-IGC) is presented. It permits the simultaneous determination of mass transfer coefficients across the gas liquid interface as well as the respective solubility parameters and thermodynamic functions of dissolution of gases into liquids. The standard deviation of the experimentally determined parameters is estimated for first time, which combined with the successful comparison of the values of the present parameters with other literature ones ascertain the reliability of the methodology. Another novelty of the present work is that the chromatographic sampling of the physicochemical phenomena is done without performing the usual flow reversals procedure. Vinyl chloride monomer's (VCM) interaction with various composition liquid foods: orange juice, milk and olive oil was used as model system. The present transfer rates are controlled by the gas film at lower temperatures, but at higher temperatures the resistances in both films tend to become equal. The found liquid diffusivity values express the total mass transfer from the gas phase into the liquid's bulk and they decrease with rising temperature, as the solubilities of gases in liquids do. Solubility, expressed by Henry's law constant and the mean values of interfacial thickness are of the same order of magnitude to literature ones. From the thermodynamic point of view, VCM dissolution in all liquids is accompanied by significant heat release and it is a slightly non-spontaneous process, near equilibrium, while the entropy change values are negative. Copyright © 2016 Elsevier B.V. All rights reserved.

Predicting solvation free energies and thermodynamics in polar solvents and mixtures using a solvation-layer interface condition

PubMed Central

Goossens, Spencer; Mehdizadeh Rahimi, Ali

2017-01-01

We demonstrate that with two small modifications, the popular dielectric continuum model is capable of predicting, with high accuracy, ion solvation thermodynamics (Gibbs free energies, entropies, and heat capacities) in numerous polar solvents. We are also able to predict ion solvation free energies in water–co-solvent mixtures over available concentration series. The first modification to the classical dielectric Poisson model is a perturbation of the macroscopic dielectric-flux interface condition at the solute–solvent interface: we add a nonlinear function of the local electric field, giving what we have called a solvation-layer interface condition (SLIC). The second modification is including the microscopic interface potential (static potential) in our model. We show that the resulting model exhibits high accuracy without the need for fitting solute atom radii in a state-dependent fashion. Compared to experimental results in nine water–co-solvent mixtures, SLIC predicts transfer free energies to within 2.5 kJ/mol. The co-solvents include both protic and aprotic species, as well as biologically relevant denaturants such as urea and dimethylformamide. Furthermore, our results indicate that the interface potential is essential to reproduce entropies and heat capacities. These and previous tests of the SLIC model indicate that it is a promising dielectric continuum model for accurate predictions in a wide range of conditions.

Multifractals embedded in short time series: An unbiased estimation of probability moment

NASA Astrophysics Data System (ADS)

Qiu, Lu; Yang, Tianguang; Yin, Yanhua; Gu, Changgui; Yang, Huijie

2016-12-01

An exact estimation of probability moments is the base for several essential concepts, such as the multifractals, the Tsallis entropy, and the transfer entropy. By means of approximation theory we propose a new method called factorial-moment-based estimation of probability moments. Theoretical prediction and computational results show that it can provide us an unbiased estimation of the probability moments of continuous order. Calculations on probability redistribution model verify that it can extract exactly multifractal behaviors from several hundred recordings. Its powerfulness in monitoring evolution of scaling behaviors is exemplified by two empirical cases, i.e., the gait time series for fast, normal, and slow trials of a healthy volunteer, and the closing price series for Shanghai stock market. By using short time series with several hundred lengths, a comparison with the well-established tools displays significant advantages of its performance over the other methods. The factorial-moment-based estimation can evaluate correctly the scaling behaviors in a scale range about three generations wider than the multifractal detrended fluctuation analysis and the basic estimation. The estimation of partition function given by the wavelet transform modulus maxima has unacceptable fluctuations. Besides the scaling invariance focused in the present paper, the proposed factorial moment of continuous order can find its various uses, such as finding nonextensive behaviors of a complex system and reconstructing the causality relationship network between elements of a complex system.

Predicting solvation free energies and thermodynamics in polar solvents and mixtures using a solvation-layer interface condition

NASA Astrophysics Data System (ADS)

Molavi Tabrizi, Amirhossein; Goossens, Spencer; Mehdizadeh Rahimi, Ali; Knepley, Matthew; Bardhan, Jaydeep P.

2017-03-01

We demonstrate that with two small modifications, the popular dielectric continuum model is capable of predicting, with high accuracy, ion solvation thermodynamics (Gibbs free energies, entropies, and heat capacities) in numerous polar solvents. We are also able to predict ion solvation free energies in water-co-solvent mixtures over available concentration series. The first modification to the classical dielectric Poisson model is a perturbation of the macroscopic dielectric-flux interface condition at the solute-solvent interface: we add a nonlinear function of the local electric field, giving what we have called a solvation-layer interface condition (SLIC). The second modification is including the microscopic interface potential (static potential) in our model. We show that the resulting model exhibits high accuracy without the need for fitting solute atom radii in a state-dependent fashion. Compared to experimental results in nine water-co-solvent mixtures, SLIC predicts transfer free energies to within 2.5 kJ/mol. The co-solvents include both protic and aprotic species, as well as biologically relevant denaturants such as urea and dimethylformamide. Furthermore, our results indicate that the interface potential is essential to reproduce entropies and heat capacities. These and previous tests of the SLIC model indicate that it is a promising dielectric continuum model for accurate predictions in a wide range of conditions.

Quantum-state reconstruction by maximizing likelihood and entropy.

PubMed

Teo, Yong Siah; Zhu, Huangjun; Englert, Berthold-Georg; Řeháček, Jaroslav; Hradil, Zdeněk

2011-07-08

Quantum-state reconstruction on a finite number of copies of a quantum system with informationally incomplete measurements, as a rule, does not yield a unique result. We derive a reconstruction scheme where both the likelihood and the von Neumann entropy functionals are maximized in order to systematically select the most-likely estimator with the largest entropy, that is, the least-bias estimator, consistent with a given set of measurement data. This is equivalent to the joint consideration of our partial knowledge and ignorance about the ensemble to reconstruct its identity. An interesting structure of such estimators will also be explored.

Entropy-based artificial viscosity stabilization for non-equilibrium Grey Radiation-Hydrodynamics

DOE Office of Scientific and Technical Information (OSTI.GOV)

Delchini, Marc O., E-mail: delchinm@email.tamu.edu; Ragusa, Jean C., E-mail: jean.ragusa@tamu.edu; Morel, Jim, E-mail: jim.morel@tamu.edu

2015-09-01

The entropy viscosity method is extended to the non-equilibrium Grey Radiation-Hydrodynamic equations. The method employs a viscous regularization to stabilize the numerical solution. The artificial viscosity coefficient is modulated by the entropy production and peaks at shock locations. The added dissipative terms are consistent with the entropy minimum principle. A new functional form of the entropy residual, suitable for the Radiation-Hydrodynamic equations, is derived. We demonstrate that the viscous regularization preserves the equilibrium diffusion limit. The equations are discretized with a standard Continuous Galerkin Finite Element Method and a fully implicit temporal integrator within the MOOSE multiphysics framework. The methodmore » of manufactured solutions is employed to demonstrate second-order accuracy in both the equilibrium diffusion and streaming limits. Several typical 1-D radiation-hydrodynamic test cases with shocks (from Mach 1.05 to Mach 50) are presented to establish the ability of the technique to capture and resolve shocks.« less

New Insights into the Fractional Order Diffusion Equation Using Entropy and Kurtosis.

PubMed

Ingo, Carson; Magin, Richard L; Parrish, Todd B

2014-11-01

Fractional order derivative operators offer a concise description to model multi-scale, heterogeneous and non-local systems. Specifically, in magnetic resonance imaging, there has been recent work to apply fractional order derivatives to model the non-Gaussian diffusion signal, which is ubiquitous in the movement of water protons within biological tissue. To provide a new perspective for establishing the utility of fractional order models, we apply entropy for the case of anomalous diffusion governed by a fractional order diffusion equation generalized in space and in time. This fractional order representation, in the form of the Mittag-Leffler function, gives an entropy minimum for the integer case of Gaussian diffusion and greater values of spectral entropy for non-integer values of the space and time derivatives. Furthermore, we consider kurtosis, defined as the normalized fourth moment, as another probabilistic description of the fractional time derivative. Finally, we demonstrate the implementation of anomalous diffusion, entropy and kurtosis measurements in diffusion weighted magnetic resonance imaging in the brain of a chronic ischemic stroke patient.

Entropy and convexity for nonlinear partial differential equations

PubMed Central

Ball, John M.; Chen, Gui-Qiang G.

2013-01-01

Partial differential equations are ubiquitous in almost all applications of mathematics, where they provide a natural mathematical description of many phenomena involving change in physical, chemical, biological and social processes. The concept of entropy originated in thermodynamics and statistical physics during the nineteenth century to describe the heat exchanges that occur in the thermal processes in a thermodynamic system, while the original notion of convexity is for sets and functions in mathematics. Since then, entropy and convexity have become two of the most important concepts in mathematics. In particular, nonlinear methods via entropy and convexity have been playing an increasingly important role in the analysis of nonlinear partial differential equations in recent decades. This opening article of the Theme Issue is intended to provide an introduction to entropy, convexity and related nonlinear methods for the analysis of nonlinear partial differential equations. We also provide a brief discussion about the content and contributions of the papers that make up this Theme Issue. PMID:24249768

Entanglement entropy between virtual and real excitations in quantum electrodynamics

NASA Astrophysics Data System (ADS)

Ardenghi, Juan Sebastián

2018-05-01

The aim of this work is to introduce the entanglement entropy of real and virtual excitations of fermion and photon fields. By rewriting the generating functional of quantum electrodynamics theory as an inner product between quantum operators, it is possible to obtain quantum density operators representing the propagation of real and virtual particles. These operators are partial traces, where the degrees of freedom traced out are unobserved excitations. Then the von Neumann definition of entropy can be applied to these quantum operators and in particular, for the partial traces taken over by the internal or external degrees of freedom. A universal behavior is obtained for the entanglement entropy for different quantum fields at zeroth order in the coupling constant. In order to obtain numerical results at different orders in the perturbation expansion, the Bloch-Nordsieck model is considered, where it is shown that for some particular values of the electric charge, the von Neumann entropy increases or decreases with respect to the noninteracting case.

Generalized Entanglement Entropies of Quantum Designs.

PubMed

Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun

2018-03-30

The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.

Gauge field entanglement in Kitaev's honeycomb model

NASA Astrophysics Data System (ADS)

Dóra, Balázs; Moessner, Roderich

2018-01-01

A spin fractionalizes into matter and gauge fermions in Kitaev's spin liquid on the honeycomb lattice. This follows from a Jordan-Wigner mapping to fermions, allowing for the construction of a minimal entropy ground-state wave function on the cylinder. We use this to calculate the entanglement entropy by choosing several distinct partitionings. First, by partitioning an infinite cylinder into two, the -ln2 topological entanglement entropy is reconfirmed. Second, the reduced density matrix of the gauge sector on the full cylinder is obtained after tracing out the matter degrees of freedom. This allows for evaluating the gauge entanglement Hamiltonian, which contains infinitely long-range correlations along the symmetry axis of the cylinder. The matter-gauge entanglement entropy is (Ny-1 )ln2 , with Ny the circumference of the cylinder. Third, the rules for calculating the gauge sector entanglement of any partition are determined. Rather small correctly chosen gauge partitions can still account for the topological entanglement entropy in spite of long-range correlations in the gauge entanglement Hamiltonian.

A modified belief entropy in Dempster-Shafer framework.

PubMed

Zhou, Deyun; Tang, Yongchuan; Jiang, Wen

2017-01-01

How to quantify the uncertain information in the framework of Dempster-Shafer evidence theory is still an open issue. Quite a few uncertainty measures have been proposed in Dempster-Shafer framework, however, the existing studies mainly focus on the mass function itself, the available information represented by the scale of the frame of discernment (FOD) in the body of evidence is ignored. Without taking full advantage of the information in the body of evidence, the existing methods are somehow not that efficient. In this paper, a modified belief entropy is proposed by considering the scale of FOD and the relative scale of a focal element with respect to FOD. Inspired by Deng entropy, the new belief entropy is consistent with Shannon entropy in the sense of probability consistency. What's more, with less information loss, the new measure can overcome the shortage of some other uncertainty measures. A few numerical examples and a case study are presented to show the efficiency and superiority of the proposed method.

A modified belief entropy in Dempster-Shafer framework

PubMed Central

Zhou, Deyun; Jiang, Wen

2017-01-01

How to quantify the uncertain information in the framework of Dempster-Shafer evidence theory is still an open issue. Quite a few uncertainty measures have been proposed in Dempster-Shafer framework, however, the existing studies mainly focus on the mass function itself, the available information represented by the scale of the frame of discernment (FOD) in the body of evidence is ignored. Without taking full advantage of the information in the body of evidence, the existing methods are somehow not that efficient. In this paper, a modified belief entropy is proposed by considering the scale of FOD and the relative scale of a focal element with respect to FOD. Inspired by Deng entropy, the new belief entropy is consistent with Shannon entropy in the sense of probability consistency. What’s more, with less information loss, the new measure can overcome the shortage of some other uncertainty measures. A few numerical examples and a case study are presented to show the efficiency and superiority of the proposed method. PMID:28481914

Monitoring of Time-Dependent System Profiles by Multiplex Gas Chromatography with Maximum Entropy Demodulation

NASA Technical Reports Server (NTRS)

Becker, Joseph F.; Valentin, Jose

1996-01-01

The maximum entropy technique was successfully applied to the deconvolution of overlapped chromatographic peaks. An algorithm was written in which the chromatogram was represented as a vector of sample concentrations multiplied by a peak shape matrix. Simulation results demonstrated that there is a trade off between the detector noise and peak resolution in the sense that an increase of the noise level reduced the peak separation that could be recovered by the maximum entropy method. Real data originated from a sample storage column was also deconvoluted using maximum entropy. Deconvolution is useful in this type of system because the conservation of time dependent profiles depends on the band spreading processes in the chromatographic column, which might smooth out the finer details in the concentration profile. The method was also applied to the deconvolution of previously interpretted Pioneer Venus chromatograms. It was found in this case that the correct choice of peak shape function was critical to the sensitivity of maximum entropy in the reconstruction of these chromatograms.

Generalized Entanglement Entropies of Quantum Designs

NASA Astrophysics Data System (ADS)

Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun

2018-03-01

The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.

Entropy and convexity for nonlinear partial differential equations.

PubMed

Ball, John M; Chen, Gui-Qiang G

2013-12-28

Partial differential equations are ubiquitous in almost all applications of mathematics, where they provide a natural mathematical description of many phenomena involving change in physical, chemical, biological and social processes. The concept of entropy originated in thermodynamics and statistical physics during the nineteenth century to describe the heat exchanges that occur in the thermal processes in a thermodynamic system, while the original notion of convexity is for sets and functions in mathematics. Since then, entropy and convexity have become two of the most important concepts in mathematics. In particular, nonlinear methods via entropy and convexity have been playing an increasingly important role in the analysis of nonlinear partial differential equations in recent decades. This opening article of the Theme Issue is intended to provide an introduction to entropy, convexity and related nonlinear methods for the analysis of nonlinear partial differential equations. We also provide a brief discussion about the content and contributions of the papers that make up this Theme Issue.

Multiscale Persistent Functions for Biomolecular Structure Characterization

DOE Office of Scientific and Technical Information (OSTI.GOV)

Xia, Kelin; Li, Zhiming; Mu, Lin

Here in this paper, we introduce multiscale persistent functions for biomolecular structure characterization. The essential idea is to combine our multiscale rigidity functions (MRFs) with persistent homology analysis, so as to construct a series of multiscale persistent functions, particularly multiscale persistent entropies, for structure characterization. To clarify the fundamental idea of our method, the multiscale persistent entropy (MPE) model is discussed in great detail. Mathematically, unlike the previous persistent entropy (Chintakunta et al. in Pattern Recognit 48(2):391–401, 2015; Merelli et al. in Entropy 17(10):6872–6892, 2015; Rucco et al. in: Proceedings of ECCS 2014, Springer, pp 117–128, 2016), a special resolutionmore » parameter is incorporated into our model. Various scales can be achieved by tuning its value. Physically, our MPE can be used in conformational entropy evaluation. More specifically, it is found that our method incorporates in it a natural classification scheme. This is achieved through a density filtration of an MRF built from angular distributions. To further validate our model, a systematical comparison with the traditional entropy evaluation model is done. Additionally, it is found that our model is able to preserve the intrinsic topological features of biomolecular data much better than traditional approaches, particularly for resolutions in the intermediate range. Moreover, by comparing with traditional entropies from various grid sizes, bond angle-based methods and a persistent homology-based support vector machine method (Cang et al. in Mol Based Math Biol 3:140–162, 2015), we find that our MPE method gives the best results in terms of average true positive rate in a classic protein structure classification test. More interestingly, all-alpha and all-beta protein classes can be clearly separated from each other with zero error only in our model. Finally, a special protein structure index (PSI) is proposed, for the first time, to describe the “regularity” of protein structures. Basically, a protein structure is deemed as regular if it has a consistent and orderly configuration. Our PSI model is tested on a database of 110 proteins; we find that structures with larger portions of loops and intrinsically disorder regions are always associated with larger PSI, meaning an irregular configuration, while proteins with larger portions of secondary structures, i.e., alpha-helix or beta-sheet, have smaller PSI. Essentially, PSI can be used to describe the “regularity” information in any systems.« less

Free energy calculations along entropic pathways. I. Homogeneous vapor-liquid nucleation for atomic and molecular systems

NASA Astrophysics Data System (ADS)

Desgranges, Caroline; Delhommelle, Jerome

2016-11-01

Using the entropy S as a reaction coordinate, we determine the free energy barrier associated with the formation of a liquid droplet from a supersaturated vapor for atomic and molecular fluids. For this purpose, we develop the μ V T -S simulation method that combines the advantages of the grand-canonical ensemble, that allows for a direct evaluation of the entropy, and of the umbrella sampling method, that is well suited to the study of an activated process like nucleation. Applying this approach to an atomic system such as Ar allows us to test the method. The results show that the μ V T -S method gives the correct dependence on supersaturation of the height of the free energy barrier and of the size of the critical droplet, when compared to predictions from the classical nucleation theory and to previous simulation results. In addition, it provides insight into the relation between the entropy and droplet formation throughout this process. An additional advantage of the μ V T -S approach is its direct transferability to molecular systems, since it uses the entropy of the system as the reaction coordinate. Applications of the μ V T -S simulation method to N2 and CO2 are presented and discussed in this work, showing the versatility of the μ V T -S approach.

Cross-entropy clustering framework for catchment classification

NASA Astrophysics Data System (ADS)

Tongal, Hakan; Sivakumar, Bellie

2017-09-01

There is an increasing interest in catchment classification and regionalization in hydrology, as they are useful for identification of appropriate model complexity and transfer of information from gauged catchments to ungauged ones, among others. This study introduces a nonlinear cross-entropy clustering (CEC) method for classification of catchments. The method specifically considers embedding dimension (m), sample entropy (SampEn), and coefficient of variation (CV) to represent dimensionality, complexity, and variability of the time series, respectively. The method is applied to daily streamflow time series from 217 gauging stations across Australia. The results suggest that a combination of linear and nonlinear parameters (i.e. m, SampEn, and CV), representing different aspects of the underlying dynamics of streamflows, could be useful for determining distinct patterns of flow generation mechanisms within a nonlinear clustering framework. For the 217 streamflow time series, nine hydrologically homogeneous clusters that have distinct patterns of flow regime characteristics and specific dominant hydrological attributes with different climatic features are obtained. Comparison of the results with those obtained using the widely employed k-means clustering method (which results in five clusters, with the loss of some information about the features of the clusters) suggests the superiority of the cross-entropy clustering method. The outcomes from this study provide a useful guideline for employing the nonlinear dynamic approaches based on hydrologic signatures and for gaining an improved understanding of streamflow variability at a large scale.

Atomistic Free Energy Model for Nucleic Acids: Simulations of Single-Stranded DNA and the Entropy Landscape of RNA Stem-Loop Structures.

PubMed

Mak, Chi H

2015-11-25

While single-stranded (ss) segments of DNAs and RNAs are ubiquitous in biology, details about their structures have only recently begun to emerge. To study ssDNA and RNAs, we have developed a new Monte Carlo (MC) simulation using a free energy model for nucleic acids that has the atomisitic accuracy to capture fine molecular details of the sugar-phosphate backbone. Formulated on the basis of a first-principle calculation of the conformational entropy of the nucleic acid chain, this free energy model correctly reproduced both the long and short length-scale structural properties of ssDNA and RNAs in a rigorous comparison against recent data from fluorescence resonance energy transfer, small-angle X-ray scattering, force spectroscopy and fluorescence correlation transport measurements on sequences up to ∼100 nucleotides long. With this new MC algorithm, we conducted a comprehensive investigation of the entropy landscape of small RNA stem-loop structures. From a simulated ensemble of ∼10(6) equilibrium conformations, the entropy for the initiation of different size RNA hairpin loops was computed and compared against thermodynamic measurements. Starting from seeded hairpin loops, constrained MC simulations were then used to estimate the entropic costs associated with propagation of the stem. The numerical results provide new direct molecular insights into thermodynaimc measurement from macroscopic calorimetry and melting experiments.

Functional Entropy Variables: A New Methodology for Deriving Thermodynamically Consistent Algorithms for Complex Fluids, with Particular Reference to the Isothermal Navier-Stokes-Korteweg Equations

DTIC Science & Technology

2012-11-01

multicorrector algorithm . Predictor stage: Set Cρn+1,(0) = C ρ n, (157) Cun+1,(0) = C u n, (158) Cvn+1,(0) = C v n. (159) Multicorrector stage: Repeat the... corrector algorithm given by (157)-(178). Remark 20. We adopt the preconditioned GMRES algorithm [53] from PETSc [2] to solve the linear system given by (175...ICES REPORT 12-43 November 2012 Functional Entropy Variables: A New Methodology for Deriving Thermodynamically Consistent Algorithms for Complex

DOE Office of Scientific and Technical Information (OSTI.GOV)

Xu Cenke

In this paper, we calculate the entanglement Renyi entropy of two coupled gapless systems in general spatial dimension d. The gapless systems can be either conformal field theories or Fermi liquids. We assume the two systems are coupled uniformly in an h-dimensional submanifold of the space, with 0{<=}h{<=}d. We will focus on the scaling of the Renyi entropy with the size of the system, and its scaling with the intersystem coupling constant g. Three approaches will be used for our calculation: (1) exact calculation with ground-state wave functional, (2) perturbative calculation with functional path integral, and (3) scaling argument.

Third law of thermodynamics in the presence of a heat flux

DOE Office of Scientific and Technical Information (OSTI.GOV)

Camacho, J.

1995-01-01

Following a maximum entropy formalism, we study a one-dimensional crystal under a heat flux. We obtain the phonon distribution function and evaluate the nonequilibrium temperature, the specific heat, and the entropy as functions of the internal energy and the heat flux, in both the quantum and the classical limits. Some analogies between the behavior of equilibrium systems at low absolute temperature and nonequilibrium steady states under high values of the heat flux are shown, which point to a possible generalization of the third law in nonequilibrium situations.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dhabal, Debdas; Chakravarty, Charusita, E-mail: charus@chemistry.iitd.ac.in; Nguyen, Andrew Huy

Molecular dynamics simulations are used to contrast the supercooling and crystallization behaviour of monatomic liquids that exemplify the transition from simple to anomalous, tetrahedral liquids. As examples of simple fluids, we use the Lennard-Jones (LJ) liquid and a pair-dominated Stillinger-Weber liquid (SW{sub 16}). As examples of tetrahedral, water-like fluids, we use the Stillinger-Weber model with variable tetrahedrality parameterized for germanium (SW{sub 20}), silicon (SW{sub 21}), and water (SW{sub 23.15} or mW model). The thermodynamic response functions show clear qualitative differences between simple and water-like liquids. For simple liquids, the compressibility and the heat capacity remain small on isobaric cooling. Themore » tetrahedral liquids in contrast show a very sharp rise in these two response functions as the lower limit of liquid-phase stability is reached. While the thermal expansivity decreases with temperature but never crosses zero in simple liquids, in all three tetrahedral liquids at the studied pressure, there is a temperature of maximum density below which thermal expansivity is negative. In contrast to the thermodynamic response functions, the excess entropy on isobaric cooling does not show qualitatively different features for simple and water-like liquids; however, the slope and curvature of the entropy-temperature plots reflect the heat capacity trends. Two trajectory-based computational estimation methods for the entropy and the heat capacity are compared for possible structural insights into supercooling, with the entropy obtained from thermodynamic integration. The two-phase thermodynamic estimator for the excess entropy proves to be fairly accurate in comparison to the excess entropy values obtained by thermodynamic integration, for all five Lennard-Jones and Stillinger-Weber liquids. The entropy estimator based on the multiparticle correlation expansion that accounts for both pair and triplet correlations, denoted by S{sub trip}, is also studied. S{sub trip} is a good entropy estimator for liquids where pair and triplet correlations are important such as Ge and Si, but loses accuracy for purely pair-dominated liquids, like LJ fluid, or near the crystallization temperature (T{sub thr}). Since local tetrahedral order is compatible with both liquid and crystalline states, the reorganisation of tetrahedral liquids is accompanied by a clear rise in the pair, triplet, and thermodynamic contributions to the heat capacity, resulting in the heat capacity anomaly. In contrast, the pair-dominated liquids show increasing dominance of triplet correlations on approaching crystallization but no sharp rise in either the pair or thermodynamic heat capacities.« less

Reaction cycle and thermodynamics in bacteriorhodopsin

NASA Technical Reports Server (NTRS)

Lanyi, J. K.

1992-01-01

Light causes the all-trans to 13-cis isomerization of the retinal in bacteriorhodopsin; the thermal relaxation leading back to the initial state drives proton transport first via proton transfer between the retinal Schiff base and D85 and then between the Schiff base and D96. The reaction sequence and thermodynamics of this photocycle are described by measuring time-resolved absorption changes with a gated multichannel analyzer between 100 ns and 100 ms, at six temperatures between 5 degrees C and 30 degrees C. Analysis of the energetics of the chromophore reaction sequence is on the basis of a recently proposed model (Varo & Lanyi, Biochemistry 30, 5016-5022, 1991) which consists of a single cycle and many reversible reactions: BR -hv-->K<==>L<==>M1-->M2<==>N<==>O-->BR. The existence of the M1-->M2 reaction, which functions as the switch in the proton transfer, is confirmed by spectroscopic evidence. The calculated thermodynamic parameters indicate that the exchange of free energy between the protein and the protons is at the switch step. Further, a large entropy decrease at this reaction suggests a protein conformation change which will conserve delta G for driving the completion of the reaction cycle. The results provide insights to mechanism and energy coupling in this system, with possible relevance to the general question of how ion pumps function.

Absorption spectrometric study of charge transfer complex formation between 4-acetamidophenol (paracetamol) and a series of quinones including Vitamin K 3

NASA Astrophysics Data System (ADS)

Saha, Avijit; Mukherjee, Asok K.

2004-07-01

The formation of charge transfer (CT) complexes of 4-acetamidophenol (commonly called 'paracetamol') and a series of quinones (including Vitamin K 3) has been studied spectrophotometrically in ethanol medium. The vertical ionisation potential of paracetamol and the degrees of charge transfer of the complexes in their ground state has been estimated from the trends in the charge transfer bands. The oscillator and transition dipole strengths of the complexes have been determined from the CT absorption spectra at 298 K. The complexes have been found by Job's method of continuous variation to have the uncommon 2:1 (paracetamol:quinone) stoichiometry in each case. The enthalpies and entropies of formation of the complexes have been obtained by determining their formation constants at five different temperatures.

Power-law scaling for macroscopic entropy and microscopic complexity: Evidence from human movement and posture

NASA Astrophysics Data System (ADS)

Hong, S. Lee; Bodfish, James W.; Newell, Karl M.

2006-03-01

We investigated the relationship between macroscopic entropy and microscopic complexity of the dynamics of body rocking and sitting still across adults with stereotyped movement disorder and mental retardation (profound and severe) against controls matched for age, height, and weight. This analysis was performed through the examination of center of pressure (COP) motion on the mediolateral (side-to-side) and anteroposterior (fore-aft) dimensions and the entropy of the relative phase between the two dimensions of motion. Intentional body rocking and stereotypical body rocking possessed similar slopes for their respective frequency spectra, but differences were revealed during maintenance of sitting postures. The dynamics of sitting in the control group produced lower spectral slopes and higher complexity (approximate entropy). In the controls, the higher complexity found on each dimension of motion was related to a weaker coupling between dimensions. Information entropy of the relative phase between the two dimensions of COP motion and irregularity (complexity) of their respective motions fitted a power-law function, revealing a relationship between macroscopic entropy and microscopic complexity across both groups and behaviors. This power-law relation affords the postulation that the organization of movement and posture dynamics occurs as a fractal process.

Information measures for a local quantum phase transition: Lattice fermions in a one-dimensional harmonic trap

NASA Astrophysics Data System (ADS)

Zhang, Yicheng; Vidmar, Lev; Rigol, Marcos

2018-02-01

We use quantum information measures to study the local quantum phase transition that occurs for trapped spinless fermions in one-dimensional lattices. We focus on the case of a harmonic confinement. The transition occurs upon increasing the characteristic density and results in the formation of a band-insulating domain in the center of the trap. We show that the ground-state bipartite entanglement entropy can be used as an order parameter to characterize this local quantum phase transition. We also study excited eigenstates by calculating the average von Neumann and second Renyi eigenstate entanglement entropies, and compare the results with the thermodynamic entropy and the mutual information of thermal states at the same energy density. While at low temperatures we observe a linear increase of the thermodynamic entropy with temperature at all characteristic densities, the average eigenstate entanglement entropies exhibit a strikingly different behavior as functions of temperature below and above the transition. They are linear in temperature below the transition but exhibit activated behavior above it. Hence, at nonvanishing energy densities above the ground state, the average eigenstate entanglement entropies carry fingerprints of the local quantum phase transition.

Information-Theoretical Quantifier of Brain Rhythm Based on Data-Driven Multiscale Representation

PubMed Central

2015-01-01

This paper presents a data-driven multiscale entropy measure to reveal the scale dependent information quantity of electroencephalogram (EEG) recordings. This work is motivated by the previous observations on the nonlinear and nonstationary nature of EEG over multiple time scales. Here, a new framework of entropy measures considering changing dynamics over multiple oscillatory scales is presented. First, to deal with nonstationarity over multiple scales, EEG recording is decomposed by applying the empirical mode decomposition (EMD) which is known to be effective for extracting the constituent narrowband components without a predetermined basis. Following calculation of Renyi entropy of the probability distributions of the intrinsic mode functions extracted by EMD leads to a data-driven multiscale Renyi entropy. To validate the performance of the proposed entropy measure, actual EEG recordings from rats (n = 9) experiencing 7 min cardiac arrest followed by resuscitation were analyzed. Simulation and experimental results demonstrate that the use of the multiscale Renyi entropy leads to better discriminative capability of the injury levels and improved correlations with the neurological deficit evaluation after 72 hours after cardiac arrest, thus suggesting an effective diagnostic and prognostic tool. PMID:26380297

Entropy production of a Brownian ellipsoid in the overdamped limit.

PubMed

Marino, Raffaele; Eichhorn, Ralf; Aurell, Erik

2016-01-01

We analyze the translational and rotational motion of an ellipsoidal Brownian particle from the viewpoint of stochastic thermodynamics. The particle's Brownian motion is driven by external forces and torques and takes place in an heterogeneous thermal environment where friction coefficients and (local) temperature depend on space and time. Our analysis of the particle's stochastic thermodynamics is based on the entropy production associated with single particle trajectories. It is motivated by the recent discovery that the overdamped limit of vanishing inertia effects (as compared to viscous fricion) produces a so-called "anomalous" contribution to the entropy production, which has no counterpart in the overdamped approximation, when inertia effects are simply discarded. Here we show that rotational Brownian motion in the overdamped limit generates an additional contribution to the "anomalous" entropy. We calculate its specific form by performing a systematic singular perturbation analysis for the generating function of the entropy production. As a side result, we also obtain the (well-known) equations of motion in the overdamped limit. We furthermore investigate the effects of particle shape and give explicit expressions of the "anomalous entropy" for prolate and oblate spheroids and for near-spherical Brownian particles.

Dissipation and entropy production in open quantum systems

NASA Astrophysics Data System (ADS)

Majima, H.; Suzuki, A.

2010-11-01

A microscopic description of an open system is generally expressed by the Hamiltonian of the form: Htot = Hsys + Henviron + Hsys-environ. We developed a microscopic theory of entropy and derived a general formula, so-called "entropy-Hamiltonian relation" (EHR), that connects the entropy of the system to the interaction Hamiltonian represented by Hsys-environ for a nonequilibrium open quantum system. To derive the EHR formula, we mapped the open quantum system to the representation space of the Liouville-space formulation or thermo field dynamics (TFD), and thus worked on the representation space Script L := Script H otimes , where Script H denotes the ordinary Hilbert space while the tilde Hilbert space conjugates to Script H. We show that the natural transformation (mapping) of nonequilibrium open quantum systems is accomplished within the theoretical structure of TFD. By using the obtained EHR formula, we also derived the equation of motion for the distribution function of the system. We demonstrated that by knowing the microscopic description of the interaction, namely, the specific form of Hsys-environ on the representation space Script L, the EHR formulas enable us to evaluate the entropy of the system and to gain some information about entropy for nonequilibrium open quantum systems.

Entanglement entropy with a time-dependent Hamiltonian

NASA Astrophysics Data System (ADS)

Sivaramakrishnan, Allic

2018-03-01

The time evolution of entanglement tracks how information propagates in interacting quantum systems. We study entanglement entropy in CFT2 with a time-dependent Hamiltonian. We perturb by operators with time-dependent source functions and use the replica trick to calculate higher-order corrections to entanglement entropy. At first order, we compute the correction due to a metric perturbation in AdS3/CFT2 and find agreement on both sides of the duality. Past first order, we find evidence of a universal structure of entanglement propagation to all orders. The central feature is that interactions entangle unentangled excitations. Entanglement propagates according to "entanglement diagrams," proposed structures that are motivated by accessory spacetime diagrams for real-time perturbation theory. To illustrate the mechanisms involved, we compute higher-order corrections to free fermion entanglement entropy. We identify an unentangled operator, one which does not change the entanglement entropy to any order. Then, we introduce an interaction and find it changes entanglement entropy by entangling the unentangled excitations. The entanglement propagates in line with our conjecture. We compute several entanglement diagrams. We provide tools to simplify the computation of loop entanglement diagrams, which probe UV effects in entanglement propagation in CFT and holography.