Inability of the entropy vector method to certify nonclassicality in linelike causal structures

NASA Astrophysics Data System (ADS)

Weilenmann, Mirjam; Colbeck, Roger

2016-10-01

Bell's theorem shows that our intuitive understanding of causation must be overturned in light of quantum correlations. Nevertheless, quantum mechanics does not permit signaling and hence a notion of cause remains. Understanding this notion is not only important at a fundamental level, but also for technological applications such as key distribution and randomness expansion. It has recently been shown that a useful way to decide which classical causal structures could give rise to a given set of correlations is to use entropy vectors. These are vectors whose components are the entropies of all subsets of the observed variables in the causal structure. The entropy vector method employs causal relationships among the variables to restrict the set of possible entropy vectors. Here, we consider whether the same approach can lead to useful certificates of nonclassicality within a given causal structure. Surprisingly, we find that for a family of causal structures that includes the usual bipartite Bell structure they do not. For all members of this family, no function of the entropies of the observed variables gives such a certificate, in spite of the existence of nonclassical correlations. It is therefore necessary to look beyond entropy vectors to understand cause from a quantum perspective.

On the entanglement entropy of quantum fields in causal sets

NASA Astrophysics Data System (ADS)

Belenchia, Alessio; Benincasa, Dionigi M. T.; Letizia, Marco; Liberati, Stefano

2018-04-01

In order to understand the detailed mechanism by which a fundamental discreteness can provide a finite entanglement entropy, we consider the entanglement entropy of two classes of free massless scalar fields on causal sets that are well approximated by causal diamonds in Minkowski spacetime of dimensions 2, 3 and 4. The first class is defined from discretised versions of the continuum retarded Green functions, while the second uses the causal set’s retarded nonlocal d’Alembertians parametrised by a length scale l k . In both cases we provide numerical evidence that the area law is recovered when the double-cutoff prescription proposed in Sorkin and Yazdi (2016 Entanglement entropy in causal set theory (arXiv:1611.10281)) is imposed. We discuss in detail the need for this double cutoff by studying the effect of two cutoffs on the quantum field and, in particular, on the entanglement entropy, in isolation. In so doing, we get a novel interpretation for why these two cutoff are necessary, and the different roles they play in making the entanglement entropy on causal sets finite.

Tools for Detecting Causality in Space Systems

NASA Astrophysics Data System (ADS)

Johnson, J.; Wing, S.

2017-12-01

Complex systems such as the solar and magnetospheric envivonment often exhibit patterns of behavior that suggest underlying organizing principles. Causality is a key organizing principle that is particularly difficult to establish in strongly coupled nonlinear systems, but essential for understanding and modeling the behavior of systems. While traditional methods of time-series analysis can identify linear correlations, they do not adequately quantify the distinction between causal and coincidental dependence. We discuss tools for detecting causality including: granger causality, transfer entropy, conditional redundancy, and convergent cross maps. The tools are illustrated by applications to magnetospheric and solar physics including radiation belt, Dst (a magnetospheric state variable), substorm, and solar cycle dynamics.

On the maximum-entropy/autoregressive modeling of time series

NASA Technical Reports Server (NTRS)

Chao, B. F.

1984-01-01

The autoregressive (AR) model of a random process is interpreted in the light of the Prony's relation which relates a complex conjugate pair of poles of the AR process in the z-plane (or the z domain) on the one hand, to the complex frequency of one complex harmonic function in the time domain on the other. Thus the AR model of a time series is one that models the time series as a linear combination of complex harmonic functions, which include pure sinusoids and real exponentials as special cases. An AR model is completely determined by its z-domain pole configuration. The maximum-entropy/autogressive (ME/AR) spectrum, defined on the unit circle of the z-plane (or the frequency domain), is nothing but a convenient, but ambiguous visual representation. It is asserted that the position and shape of a spectral peak is determined by the corresponding complex frequency, and the height of the spectral peak contains little information about the complex amplitude of the complex harmonic functions.

Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables

NASA Astrophysics Data System (ADS)

Barnett, Lionel; Barrett, Adam B.; Seth, Anil K.

2009-12-01

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.

­Understanding Information Flow Interaction along Separable Causal Paths in Environmental Signals

NASA Astrophysics Data System (ADS)

Jiang, P.; Kumar, P.

2017-12-01

Multivariate environmental signals reflect the outcome of complex inter-dependencies, such as those in ecohydrologic systems. Transfer entropy and information partitioning approaches have been used to characterize such dependencies. However, these approaches capture net information flow occurring through a multitude of pathways involved in the interaction and as a result mask our ability to discern the causal interaction within an interested subsystem through specific pathways. We build on recent developments of momentary information transfer along causal paths proposed by Runge [2015] to develop a framework for quantifying information decomposition along separable causal paths. Momentary information transfer along causal paths captures the amount of information flow between any two variables lagged at two specific points in time. Our approach expands this concept to characterize the causal interaction in terms of synergistic, unique and redundant information flow through separable causal paths. Multivariate analysis using this novel approach reveals precise understanding of causality and feedback. We illustrate our approach with synthetic and observed time series data. We believe the proposed framework helps better delineate the internal structure of complex systems in geoscience where huge amounts of observational datasets exist, and it will also help the modeling community by providing a new way to look at the complexity of real and modeled systems. Runge, Jakob. "Quantifying information transfer and mediation along causal pathways in complex systems." Physical Review E 92.6 (2015): 062829.

Measuring the uncertainty of coupling

NASA Astrophysics Data System (ADS)

Zhao, Xiaojun; Shang, Pengjian

2015-06-01

A new information-theoretic measure, called coupling entropy, is proposed here to detect the causal links in complex systems by taking into account the inner composition alignment of temporal structure. It is a permutation-based asymmetric association measure to infer the uncertainty of coupling between two time series. The coupling entropy is found to be effective in the analysis of Hénon maps, where different noises are added to test its accuracy and sensitivity. The coupling entropy is also applied to analyze the relationship between unemployment rate and CPI change in the U.S., where the CPI change turns out to be the driving variable while the unemployment rate is the responding one.

Optimal quantum networks and one-shot entropies

NASA Astrophysics Data System (ADS)

Chiribella, Giulio; Ebler, Daniel

2016-09-01

We develop a semidefinite programming method for the optimization of quantum networks, including both causal networks and networks with indefinite causal structure. Our method applies to a broad class of performance measures, defined operationally in terms of interative tests set up by a verifier. We show that the optimal performance is equal to a max relative entropy, which quantifies the informativeness of the test. Building on this result, we extend the notion of conditional min-entropy from quantum states to quantum causal networks. The optimization method is illustrated in a number of applications, including the inversion, charge conjugation, and controlization of an unknown unitary dynamics. In the non-causal setting, we show a proof-of-principle application to the maximization of the winning probability in a non-causal quantum game.

Efficiency and credit ratings: a permutation-information-theory analysis

NASA Astrophysics Data System (ADS)

Fernandez Bariviera, Aurelio; Zunino, Luciano; Belén Guercio, M.; Martinez, Lisana B.; Rosso, Osvaldo A.

2013-08-01

The role of credit rating agencies has been under severe scrutiny after the subprime crisis. In this paper we explore the relationship between credit ratings and informational efficiency of a sample of thirty nine corporate bonds of US oil and energy companies from April 2008 to November 2012. For this purpose we use a powerful statistical tool, relatively new in the financial literature: the complexity-entropy causality plane. This representation space allows us to graphically classify the different bonds according to their degree of informational efficiency. We find that this classification agrees with the credit ratings assigned by Moody’s. In particular, we detect the formation of two clusters, which correspond to the global categories of investment and speculative grades. Regarding the latter cluster, two subgroups reflect distinct levels of efficiency. Additionally, we also find an intriguing absence of correlation between informational efficiency and firm characteristics. This allows us to conclude that the proposed permutation-information-theory approach provides an alternative practical way to justify bond classification.

Inferring Weighted Directed Association Network from Multivariate Time Series with a Synthetic Method of Partial Symbolic Transfer Entropy Spectrum and Granger Causality

PubMed Central

Hu, Yanzhu; Ai, Xinbo

2016-01-01

Complex network methodology is very useful for complex system explorer. However, the relationships among variables in complex system are usually not clear. Therefore, inferring association networks among variables from their observed data has been a popular research topic. We propose a synthetic method, named small-shuffle partial symbolic transfer entropy spectrum (SSPSTES), for inferring association network from multivariate time series. The method synthesizes surrogate data, partial symbolic transfer entropy (PSTE) and Granger causality. A proper threshold selection is crucial for common correlation identification methods and it is not easy for users. The proposed method can not only identify the strong correlation without selecting a threshold but also has the ability of correlation quantification, direction identification and temporal relation identification. The method can be divided into three layers, i.e. data layer, model layer and network layer. In the model layer, the method identifies all the possible pair-wise correlation. In the network layer, we introduce a filter algorithm to remove the indirect weak correlation and retain strong correlation. Finally, we build a weighted adjacency matrix, the value of each entry representing the correlation level between pair-wise variables, and then get the weighted directed association network. Two numerical simulated data from linear system and nonlinear system are illustrated to show the steps and performance of the proposed approach. The ability of the proposed method is approved by an application finally. PMID:27832153

Traveling Wave Modes of a Plane Layered Anelastic Earth

DTIC Science & Technology

2016-05-20

dependent anelastic moduli. The anelastic moduli must be frequency dependent and satisfy the Kramers- Kronig relations to preserve causality. The...the complex, frequency dependent moduli satisfy the Kramers- Kronig relations. Stable, well-behaved numerical algorithms exist for solving the complex

Causal Entropies – a measure for determining changes in the temporal organization of neural systems

PubMed Central

Waddell, Jack; Dzakpasu, Rhonda; Booth, Victoria; Riley, Brett; Reasor, Jonathan; Poe, Gina; Zochowski, Michal

2009-01-01

We propose a novel measure to detect temporal ordering in the activity of individual neurons in a local network, which is thought to be a hallmark of activity-dependent synaptic modifications during learning. The measure, called Causal Entropy, is based on the time-adaptive detection of asymmetries in the relative temporal patterning between neuronal pairs. We characterize properties of the measure on both simulated data and experimental multiunit recordings of hippocampal neurons from the awake, behaving rat, and show that the metric can more readily detect those asymmetries than standard cross correlation-based techniques, especially since the temporal sensitivity of causal entropy can detect such changes rapidly and dynamically. PMID:17275095

Estimating Temporal Causal Interaction between Spike Trains with Permutation and Transfer Entropy

PubMed Central

Li, Zhaohui; Li, Xiaoli

2013-01-01

Estimating the causal interaction between neurons is very important for better understanding the functional connectivity in neuronal networks. We propose a method called normalized permutation transfer entropy (NPTE) to evaluate the temporal causal interaction between spike trains, which quantifies the fraction of ordinal information in a neuron that has presented in another one. The performance of this method is evaluated with the spike trains generated by an Izhikevich’s neuronal model. Results show that the NPTE method can effectively estimate the causal interaction between two neurons without influence of data length. Considering both the precision of time delay estimated and the robustness of information flow estimated against neuronal firing rate, the NPTE method is superior to other information theoretic method including normalized transfer entropy, symbolic transfer entropy and permutation conditional mutual information. To test the performance of NPTE on analyzing simulated biophysically realistic synapses, an Izhikevich’s cortical network that based on the neuronal model is employed. It is found that the NPTE method is able to characterize mutual interactions and identify spurious causality in a network of three neurons exactly. We conclude that the proposed method can obtain more reliable comparison of interactions between different pairs of neurons and is a promising tool to uncover more details on the neural coding. PMID:23940662

Cosmological Entropy Bounds

NASA Astrophysics Data System (ADS)

Brustein, R.

I review some basic facts about entropy bounds in general and about cosmological entropy bounds. Then I review the causal entropy bound, the conditions for its validity and its application to the study of cosmological singularities. This article is based on joint work with Gabriele Veneziano and subsequent related research.

Chaotic density fluctuations in L-mode plasmas of the DIII-D tokamak

DOE PAGES

Maggs, J. E.; Rhodes, Terry L.; Morales, G. J.

2015-03-05

Analysis of the time series obtained with the Doppler backscattering system (DBS) in the DIII-D tokamak shows that intermediate wave number plasma density fluctuations in low confinement (L-mode) tokamak plasmas are chaotic. Here, the supporting evidence is based on the shape of the power spectrum; the location of the signal in the complexity-entropy plane (C-H plane); and the population of the corresponding Bandt-Pompe probability distributions.

Statistical properties of bidimensional patterns generated from delayed and extended maps

NASA Astrophysics Data System (ADS)

Giacomelli, Giovanni; Lepri, Stefano; Politi, Antonio

1995-05-01

The space-time chaotic patterns associated with a class of dynamical systems ranging from delayed to extended maps are investigated. All the systems are constructed in such a way that the corresponding two-dimensional (2D) representation is characterized by the same updating rule in the bulk. The main difference among them is the direction of the ``time'' axis in the plane. Despite the different causality relations among the various models, the resulting patterns are shown to be statistically equivalent. In particular, the Kolmogorov-Sinai entropy density assumes always the same value. Therefore, it can be considered as an absolute indicator, measuring the amount of disorder of a 2D pattern. The Kaplan-Yorke dimension density is instead rule dependent: this indicator alone cannot be used to quantify the degrees of freedom of a given pattern; one must further specify the direction of propagation in the plane.

Emergent Geometry from Entropy and Causality

NASA Astrophysics Data System (ADS)

Engelhardt, Netta

In this thesis, we investigate the connections between the geometry of spacetime and aspects of quantum field theory such as entanglement entropy and causality. This work is motivated by the idea that spacetime geometry is an emergent phenomenon in quantum gravity, and that the physics responsible for this emergence is fundamental to quantum field theory. Part I of this thesis is focused on the interplay between spacetime and entropy, with a special emphasis on entropy due to entanglement. In general spacetimes, there exist locally-defined surfaces sensitive to the geometry that may act as local black hole boundaries or cosmological horizons; these surfaces, known as holographic screens, are argued to have a connection with the second law of thermodynamics. Holographic screens obey an area law, suggestive of an association with entropy; they are also distinguished surfaces from the perspective of the covariant entropy bound, a bound on the total entropy of a slice of the spacetime. This construction is shown to be quite general, and is formulated in both classical and perturbatively quantum theories of gravity. The remainder of Part I uses the Anti-de Sitter/ Conformal Field Theory (AdS/CFT) correspondence to both expand and constrain the connection between entanglement entropy and geometry. The AdS/CFT correspondence posits an equivalence between string theory in the "bulk" with AdS boundary conditions and certain quantum field theories. In the limit where the string theory is simply classical General Relativity, the Ryu-Takayanagi and more generally, the Hubeny-Rangamani-Takayanagi (HRT) formulae provide a way of relating the geometry of surfaces to entanglement entropy. A first-order bulk quantum correction to HRT was derived by Faulkner, Lewkowycz and Maldacena. This formula is generalized to include perturbative quantum corrections in the bulk at any (finite) order. Hurdles to spacetime emergence from entanglement entropy as described by HRT and its quantum generalizations are discussed, both at the classical and perturbatively quantum limits. In particular, several No Go Theorems are proven, indicative of a conclusion that supplementary approaches or information may be necessary to recover the full spacetime geometry. Part II of this thesis involves the relation between geometry and causality, the property that information cannot travel faster than light. Requiring this of any quantum field theory results in constraints on string theory setups that are dual to quantum field theories via the AdS/CFT correspondence. At the level of perturbative quantum gravity, it is shown that causality in the field theory constraints the causal structure in the bulk. At the level of nonperturbative quantum string theory, we find that constraints on causal signals restrict the possible ways in which curvature singularities can be resolved in string theory. Finally, a new program of research is proposed for the construction of bulk geometry from the divergences of correlation functions in the dual field theory. This divergence structure is linked to the causal structure of the bulk and of the field theory.

Breakdown of the equal area law for holographic entanglement entropy

NASA Astrophysics Data System (ADS)

McCarthy, Fiona; Kubizňák, David; Mann, Robert B.

2017-11-01

We investigate a holographic version of Maxwell's equal area law analogous to that for the phase transition in the black hole temperature/black hole entropy plane of a charged AdS black hole. We consider proposed area laws for both the black hole temperature/holographic entanglement entropy plane and the black hole temperature/2- point correlation function plane. Despite recent claims to the contrary, we demonstrate numerically that neither proposal is valid. We argue that there is no physical reason to expect such a construction in these planes.

Time, frequency, and time-varying Granger-causality measures in neuroscience.

PubMed

Cekic, Sezen; Grandjean, Didier; Renaud, Olivier

2018-05-20

This article proposes a systematic methodological review and an objective criticism of existing methods enabling the derivation of time, frequency, and time-varying Granger-causality statistics in neuroscience. The capacity to describe the causal links between signals recorded at different brain locations during a neuroscience experiment is indeed of primary interest for neuroscientists, who often have very precise prior hypotheses about the relationships between recorded brain signals. The increasing interest and the huge number of publications related to this topic calls for this systematic review, which describes the very complex methodological aspects underlying the derivation of these statistics. In this article, we first present a general framework that allows us to review and compare Granger-causality statistics in the time domain, and the link with transfer entropy. Then, the spectral and the time-varying extensions are exposed and discussed together with their estimation and distributional properties. Although not the focus of this article, partial and conditional Granger causality, dynamical causal modelling, directed transfer function, directed coherence, partial directed coherence, and their variant are also mentioned. Copyright © 2018 John Wiley & Sons, Ltd.

Mapping and discrimination of networks in the complexity-entropy plane

NASA Astrophysics Data System (ADS)

Wiedermann, Marc; Donges, Jonathan F.; Kurths, Jürgen; Donner, Reik V.

2017-10-01

Complex networks are usually characterized in terms of their topological, spatial, or information-theoretic properties and combinations of the associated metrics are used to discriminate networks into different classes or categories. However, even with the present variety of characteristics at hand it still remains a subject of current research to appropriately quantify a network's complexity and correspondingly discriminate between different types of complex networks, like infrastructure or social networks, on such a basis. Here we explore the possibility to classify complex networks by means of a statistical complexity measure that has formerly been successfully applied to distinguish different types of chaotic and stochastic time series. It is composed of a network's averaged per-node entropic measure characterizing the network's information content and the associated Jenson-Shannon divergence as a measure of disequilibrium. We study 29 real-world networks and show that networks of the same category tend to cluster in distinct areas of the resulting complexity-entropy plane. We demonstrate that within our framework, connectome networks exhibit among the highest complexity while, e.g., transportation and infrastructure networks display significantly lower values. Furthermore, we demonstrate the utility of our framework by applying it to families of random scale-free and Watts-Strogatz model networks. We then show in a second application that the proposed framework is useful to objectively construct threshold-based networks, such as functional climate networks or recurrence networks, by choosing the threshold such that the statistical network complexity is maximized.

Interactions of information transfer along separable causal paths

NASA Astrophysics Data System (ADS)

Jiang, Peishi; Kumar, Praveen

2018-04-01

Complex systems arise as a result of interdependences between multiple variables, whose causal interactions can be visualized in a time-series graph. Transfer entropy and information partitioning approaches have been used to characterize such dependences. However, these approaches capture net information transfer occurring through a multitude of pathways involved in the interaction and as a result mask our ability to discern the causal interaction within a subgraph of interest through specific pathways. We build on recent developments of momentary information transfer along causal paths proposed by Runge [Phys. Rev. E 92, 062829 (2015), 10.1103/PhysRevE.92.062829] to develop a framework for quantifying information partitioning along separable causal paths. Momentary information transfer along causal paths captures the amount of information transfer between any two variables lagged at two specific points in time. Our approach expands this concept to characterize the causal interaction in terms of synergistic, unique, and redundant information transfer through separable causal paths. Through a graphical model, we analyze the impact of the separable and nonseparable causal paths and the causality structure embedded in the graph as well as the noise effect on information partitioning by using synthetic data generated from two coupled logistic equation models. Our approach can provide a valuable reference for an autonomous information partitioning along separable causal paths which form a causal subgraph influencing a target.

Complexity of Multi-Dimensional Spontaneous EEG Decreases during Propofol Induced General Anaesthesia

PubMed Central

Schartner, Michael; Seth, Anil; Noirhomme, Quentin; Boly, Melanie; Bruno, Marie-Aurelie; Laureys, Steven; Barrett, Adam

2015-01-01

Emerging neural theories of consciousness suggest a correlation between a specific type of neural dynamical complexity and the level of consciousness: When awake and aware, causal interactions between brain regions are both integrated (all regions are to a certain extent connected) and differentiated (there is inhomogeneity and variety in the interactions). In support of this, recent work by Casali et al (2013) has shown that Lempel-Ziv complexity correlates strongly with conscious level, when computed on the EEG response to transcranial magnetic stimulation. Here we investigated complexity of spontaneous high-density EEG data during propofol-induced general anaesthesia. We consider three distinct measures: (i) Lempel-Ziv complexity, which is derived from how compressible the data are; (ii) amplitude coalition entropy, which measures the variability in the constitution of the set of active channels; and (iii) the novel synchrony coalition entropy (SCE), which measures the variability in the constitution of the set of synchronous channels. After some simulations on Kuramoto oscillator models which demonstrate that these measures capture distinct ‘flavours’ of complexity, we show that there is a robustly measurable decrease in the complexity of spontaneous EEG during general anaesthesia. PMID:26252378

Predictions of the causal entropic principle for environmental conditions of the universe

NASA Astrophysics Data System (ADS)

Cline, James M.; Frey, Andrew R.; Holder, Gilbert

2008-03-01

The causal entropic principle has been proposed as an alternative to the anthropic principle for understanding the magnitude of the cosmological constant. In this approach, the probability to create observers is assumed to be proportional to the entropy production ΔS in a maximal causally connected region—the causal diamond. We improve on the original treatment by better quantifying the entropy production due to stars, using an analytic model for the star formation history which accurately accounts for changes in cosmological parameters. We calculate the dependence of ΔS on the density contrast Q=δρ/ρ, and find that our universe is much closer to the most probable value of Q than in the usual anthropic approach and that probabilities are relatively weakly dependent on this amplitude. In addition, we make first estimates of the dependence of ΔS on the baryon fraction and overall matter abundance. Finally, we also explore the possibility that decays of dark matter, suggested by various observed gamma ray excesses, might produce a comparable amount of entropy to stars.

Assessing the strength of cardiac and sympathetic baroreflex controls via transfer entropy during orthostatic challenge

NASA Astrophysics Data System (ADS)

Porta, Alberto; Marchi, Andrea; Bari, Vlasta; De Maria, Beatrice; Esler, Murray; Lambert, Elisabeth; Baumert, Mathias

2017-05-01

The study assesses the strength of the causal relation along baroreflex (BR) in humans during an incremental postural challenge soliciting the BR. Both cardiac BR (cBR) and sympathetic BR (sBR) were characterized via BR sequence approaches from spontaneous fluctuations of heart period (HP), systolic arterial pressure (SAP), diastolic arterial pressure (DAP) and muscle sympathetic nerve activity (MSNA). A model-based transfer entropy method was applied to quantify the strength of the coupling from SAP to HP and from DAP to MSNA. The confounding influences of respiration were accounted for. Twelve young healthy subjects (20-36 years, nine females) were sequentially tilted at 0°, 20°, 30° and 40°. We found that (i) the strength of the causal relation along the cBR increases with tilt table inclination, while that along the sBR is unrelated to it; (ii) the strength of the causal coupling is unrelated to the gain of the relation; (iii) transfer entropy indexes are significantly and positively associated with simplified causality indexes derived from BR sequence analysis. The study proves that causality indexes are complementary to traditional characterization of the BR and suggests that simple markers derived from BR sequence analysis might be fruitfully exploited to estimate causality along the BR. This article is part of the themed issue `Mathematical methods in medicine: neuroscience, cardiology and pathology'.

An exploratory statistical approach to depression pattern identification

NASA Astrophysics Data System (ADS)

Feng, Qing Yi; Griffiths, Frances; Parsons, Nick; Gunn, Jane

2013-02-01

Depression is a complex phenomenon thought to be due to the interaction of biological, psychological and social factors. Currently depression assessment uses self-reported depressive symptoms but this is limited in the degree to which it can characterise the different expressions of depression emerging from the complex causal pathways that are thought to underlie depression. In this study, we aimed to represent the different patterns of depression with pattern values unique to each individual, where each value combines all the available information about an individual’s depression. We considered the depressed individual as a subsystem of an open complex system, proposed Generalized Information Entropy (GIE) to represent the general characteristics of information entropy of the system, and then implemented Maximum Entropy Estimates to derive equations for depression patterns. We also introduced a numerical simulation method to process the depression related data obtained by the Diamond Cohort Study which has been underway in Australia since 2005 involving 789 people. Unlike traditional assessment, we obtained a unique value for each depressed individual which gives an overall assessment of the depression pattern. Our work provides a novel way to visualise and quantitatively measure the depression pattern of the depressed individual which could be used for pattern categorisation. This may have potential for tailoring health interventions to depressed individuals to maximize health benefit.

Unified framework for information integration based on information geometry

PubMed Central

Oizumi, Masafumi; Amari, Shun-ichi

2016-01-01

Assessment of causal influences is a ubiquitous and important subject across diverse research fields. Drawn from consciousness studies, integrated information is a measure that defines integration as the degree of causal influences among elements. Whereas pairwise causal influences between elements can be quantified with existing methods, quantifying multiple influences among many elements poses two major mathematical difficulties. First, overestimation occurs due to interdependence among influences if each influence is separately quantified in a part-based manner and then simply summed over. Second, it is difficult to isolate causal influences while avoiding noncausal confounding influences. To resolve these difficulties, we propose a theoretical framework based on information geometry for the quantification of multiple causal influences with a holistic approach. We derive a measure of integrated information, which is geometrically interpreted as the divergence between the actual probability distribution of a system and an approximated probability distribution where causal influences among elements are statistically disconnected. This framework provides intuitive geometric interpretations harmonizing various information theoretic measures in a unified manner, including mutual information, transfer entropy, stochastic interaction, and integrated information, each of which is characterized by how causal influences are disconnected. In addition to the mathematical assessment of consciousness, our framework should help to analyze causal relationships in complex systems in a complete and hierarchical manner. PMID:27930289

Constructing entanglement wedges for Lifshitz spacetimes with Lifshitz gravity

NASA Astrophysics Data System (ADS)

Cheyne, Jonathan; Mattingly, David

2018-03-01

Holographic relationships between entanglement entropy on the boundary of a spacetime and the area of minimal surfaces in the bulk provide an important entry in the bulk/boundary dictionary. While constructing the necessary causal and entanglement wedges is well understood in asymptotically AdS spacetimes, less is known about the equivalent constructions in spacetimes with different asymptotics. In particular, recent attempts to construct entanglement and causal wedges for asymptotically Lifshitz solutions in relativistic gravitational theories have proven problematic. We note a simple observation, that a Lifshitz bulk theory, specifically a covariant formulation of Hořava-Lifshitz gravity coupled to matter, has causal propagation defined by Lifshitz modes. We use these modes to construct causal and entanglement wedges and compute the geometric entanglement entropy, which in such a construction matches the field theory prescription.

Predicting the Cosmological Constant from the CausalEntropic Principle

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bousso, Raphael; Harnik, Roni; Kribs, Graham D.

2007-02-20

We compute the expected value of the cosmological constant in our universe from the Causal Entropic Principle. Since observers must obey the laws of thermodynamics and causality, it asserts that physical parameters are most likely to be found in the range of values for which the total entropy production within a causally connected region is maximized. Despite the absence of more explicit anthropic criteria, the resulting probability distribution turns out to be in excellent agreement with observation. In particular, we find that dust heated by stars dominates the entropy production, demonstrating the remarkable power of this thermodynamic selection criterion. Themore » alternative approach--weighting by the number of ''observers per baryon''--is less well-defined, requires problematic assumptions about the nature of observers, and yet prefers values larger than present experimental bounds.« less

Classification and Verification of Handwritten Signatures with Time Causal Information Theory Quantifiers.

PubMed

Rosso, Osvaldo A; Ospina, Raydonal; Frery, Alejandro C

2016-01-01

We present a new approach for handwritten signature classification and verification based on descriptors stemming from time causal information theory. The proposal uses the Shannon entropy, the statistical complexity, and the Fisher information evaluated over the Bandt and Pompe symbolization of the horizontal and vertical coordinates of signatures. These six features are easy and fast to compute, and they are the input to an One-Class Support Vector Machine classifier. The results are better than state-of-the-art online techniques that employ higher-dimensional feature spaces which often require specialized software and hardware. We assess the consistency of our proposal with respect to the size of the training sample, and we also use it to classify the signatures into meaningful groups.

Black-box Brain Experiments, Causal Mathematical Logic, and the Thermodynamics of Intelligence

NASA Astrophysics Data System (ADS)

Pissanetzky, Sergio; Lanzalaco, Felix

2013-12-01

Awareness of the possible existence of a yet-unknown principle of Physics that explains cognition and intelligence does exist in several projects of emulation, simulation, and replication of the human brain currently under way. Brain simulation projects define their success partly in terms of the emergence of non-explicitly programmed biophysical signals such as self-oscillation and spreading cortical waves. We propose that a recently discovered theory of Physics known as Causal Mathematical Logic (CML) that links intelligence with causality and entropy and explains intelligent behavior from first principles, is the missing link. We further propose the theory as a roadway to understanding more complex biophysical signals, and to explain the set of intelligence principles. The new theory applies to information considered as an entity by itself. The theory proposes that any device that processes information and exhibits intelligence must satisfy certain theoretical conditions irrespective of the substrate where it is being processed. The substrate can be the human brain, a part of it, a worm's brain, a motor protein that self-locomotes in response to its environment, a computer. Here, we propose to extend the causal theory to systems in Neuroscience, because of its ability to model complex systems without heuristic approximations, and to predict emerging signals of intelligence directly from the models. The theory predicts the existence of a large number of observables (or "signals"), all of which emerge and can be directly and mathematically calculated from non-explicitly programmed detailed causal models. This approach is aiming for a universal and predictive language for Neuroscience and AGI based on causality and entropy, detailed enough to describe the finest structures and signals of the brain, yet general enough to accommodate the versatility and wholeness of intelligence. Experiments are focused on a black-box as one of the devices described above of which both the input and the output are precisely known, but not the internal implementation. The same input is separately supplied to a causal virtual machine, and the calculated output is compared with the measured output. The virtual machine, described in a previous paper, is a computer implementation of CML, fixed for all experiments and unrelated to the device in the black box. If the two outputs are equivalent, then the experiment has quantitatively succeeded and conclusions can be drawn regarding details of the internal implementation of the device. Several small black-box experiments were successfully performed and demonstrated the emergence of non-explicitly programmed cognitive function in each case

Recurrence measure of conditional dependence and applications.

PubMed

Ramos, Antônio M T; Builes-Jaramillo, Alejandro; Poveda, Germán; Goswami, Bedartha; Macau, Elbert E N; Kurths, Jürgen; Marwan, Norbert

2017-05-01

Identifying causal relations from observational data sets has posed great challenges in data-driven causality inference studies. One of the successful approaches to detect direct coupling in the information theory framework is transfer entropy. However, the core of entropy-based tools lies on the probability estimation of the underlying variables. Here we propose a data-driven approach for causality inference that incorporates recurrence plot features into the framework of information theory. We define it as the recurrence measure of conditional dependence (RMCD), and we present some applications. The RMCD quantifies the causal dependence between two processes based on joint recurrence patterns between the past of the possible driver and present of the potentially driven, excepting the contribution of the contemporaneous past of the driven variable. Finally, it can unveil the time scale of the influence of the sea-surface temperature of the Pacific Ocean on the precipitation in the Amazonia during recent major droughts.

Recurrence measure of conditional dependence and applications

NASA Astrophysics Data System (ADS)

Ramos, Antônio M. T.; Builes-Jaramillo, Alejandro; Poveda, Germán; Goswami, Bedartha; Macau, Elbert E. N.; Kurths, Jürgen; Marwan, Norbert

2017-05-01

Identifying causal relations from observational data sets has posed great challenges in data-driven causality inference studies. One of the successful approaches to detect direct coupling in the information theory framework is transfer entropy. However, the core of entropy-based tools lies on the probability estimation of the underlying variables. Here we propose a data-driven approach for causality inference that incorporates recurrence plot features into the framework of information theory. We define it as the recurrence measure of conditional dependence (RMCD), and we present some applications. The RMCD quantifies the causal dependence between two processes based on joint recurrence patterns between the past of the possible driver and present of the potentially driven, excepting the contribution of the contemporaneous past of the driven variable. Finally, it can unveil the time scale of the influence of the sea-surface temperature of the Pacific Ocean on the precipitation in the Amazonia during recent major droughts.

Distinguishing anticipation from causality: anticipatory bias in the estimation of information flow.

PubMed

Hahs, Daniel W; Pethel, Shawn D

2011-09-16

We report that transfer entropy estimates obtained from low-resolution and/or small data sets show net information flow away from a purely anticipatory element whereas transfer entropy calculated using exact distributions show the flow towards it. This means that for real-world data sets anticipatory elements can appear to be strongly driving the network dynamics even when there is no possibility of such an influence. Furthermore, we show that in the low-resolution limit there is no statistic that can distinguish anticipatory elements from causal ones.

Stochastic Laplacian growth

NASA Astrophysics Data System (ADS)

Alekseev, Oleg; Mineev-Weinstein, Mark

2016-12-01

A point source on a plane constantly emits particles which rapidly diffuse and then stick to a growing cluster. The growth probability of a cluster is presented as a sum over all possible scenarios leading to the same final shape. The classical point for the action, defined as a minus logarithm of the growth probability, describes the most probable scenario and reproduces the Laplacian growth equation, which embraces numerous fundamental free boundary dynamics in nonequilibrium physics. For nonclassical scenarios we introduce virtual point sources, in which presence the action becomes the Kullback-Leibler entropy. Strikingly, this entropy is shown to be the sum of electrostatic energies of layers grown per elementary time unit. Hence the growth probability of the presented nonequilibrium process obeys the Gibbs-Boltzmann statistics, which, as a rule, is not applied out from equilibrium. Each layer's probability is expressed as a product of simple factors in an auxiliary complex plane after a properly chosen conformal map. The action at this plane is a sum of Robin functions, which solve the Liouville equation. At the end we establish connections of our theory with the τ function of the integrable Toda hierarchy and with the Liouville theory for noncritical quantum strings.

How hidden are hidden processes? A primer on crypticity and entropy convergence

NASA Astrophysics Data System (ADS)

Mahoney, John R.; Ellison, Christopher J.; James, Ryan G.; Crutchfield, James P.

2011-09-01

We investigate a stationary process's crypticity—a measure of the difference between its hidden state information and its observed information—using the causal states of computational mechanics. Here, we motivate crypticity and cryptic order as physically meaningful quantities that monitor how hidden a hidden process is. This is done by recasting previous results on the convergence of block entropy and block-state entropy in a geometric setting, one that is more intuitive and that leads to a number of new results. For example, we connect crypticity to how an observer synchronizes to a process. We show that the block-causal-state entropy is a convex function of block length. We give a complete analysis of spin chains. We present a classification scheme that surveys stationary processes in terms of their possible cryptic and Markov orders. We illustrate related entropy convergence behaviors using a new form of foliated information diagram. Finally, along the way, we provide a variety of interpretations of crypticity and cryptic order to establish their naturalness and pervasiveness. This is also a first step in developing applications in spatially extended and network dynamical systems.

Holographic entanglement entropy conjecture for general spacetimes

NASA Astrophysics Data System (ADS)

Sanches, Fabio; Weinberg, Sean J.

2016-10-01

We present a natural generalization of holographic entanglement entropy proposals beyond the scope of AdS /CFT by anchoring extremal surfaces to holographic screens. Holographic screens are a natural extension of the AdS boundary to arbitrary spacetimes and are preferred codimension-1 surfaces from the viewpoint of the covariant entropy bound. A broad class of screens have a unique preferred foliation into codimension-2 surfaces called leaves. Our proposal is to find the areas of extremal surfaces anchored to the boundaries of regions in leaves. We show that the properties of holographic screens are sufficient to prove, under generic conditions, that extremal surfaces anchored in this way always lie within a causal region associated with a given leaf. Within this causal region, a maximin construction similar to that of Wall proves that our proposed quantity satisfies standard properties of entanglement entropy like strong subadditivity. We conjecture that our prescription computes entanglement entropies in quantum states that holographically define arbitrary spacetimes, including those in a cosmological setting with no obvious boundary on which to anchor extremal surfaces.

Comparison of six methods for the detection of causality in a bivariate time series

NASA Astrophysics Data System (ADS)

Krakovská, Anna; Jakubík, Jozef; Chvosteková, Martina; Coufal, David; Jajcay, Nikola; Paluš, Milan

2018-04-01

In this comparative study, six causality detection methods were compared, namely, the Granger vector autoregressive test, the extended Granger test, the kernel version of the Granger test, the conditional mutual information (transfer entropy), the evaluation of cross mappings between state spaces, and an assessment of predictability improvement due to the use of mixed predictions. Seven test data sets were analyzed: linear coupling of autoregressive models, a unidirectional connection of two Hénon systems, a unidirectional connection of chaotic systems of Rössler and Lorenz type and of two different Rössler systems, an example of bidirectionally connected two-species systems, a fishery model as an example of two correlated observables without a causal relationship, and an example of mediated causality. We tested not only 20 000 points long clean time series but also noisy and short variants of the data. The standard and the extended Granger tests worked only for the autoregressive models. The remaining methods were more successful with the more complex test examples, although they differed considerably in their capability to reveal the presence and the direction of coupling and to distinguish causality from mere correlation.

A CMOS Imager with Focal Plane Compression using Predictive Coding

NASA Technical Reports Server (NTRS)

Leon-Salas, Walter D.; Balkir, Sina; Sayood, Khalid; Schemm, Nathan; Hoffman, Michael W.

2007-01-01

This paper presents a CMOS image sensor with focal-plane compression. The design has a column-level architecture and it is based on predictive coding techniques for image decorrelation. The prediction operations are performed in the analog domain to avoid quantization noise and to decrease the area complexity of the circuit, The prediction residuals are quantized and encoded by a joint quantizer/coder circuit. To save area resources, the joint quantizerlcoder circuit exploits common circuitry between a single-slope analog-to-digital converter (ADC) and a Golomb-Rice entropy coder. This combination of ADC and encoder allows the integration of the entropy coder at the column level. A prototype chip was fabricated in a 0.35 pm CMOS process. The output of the chip is a compressed bit stream. The test chip occupies a silicon area of 2.60 mm x 5.96 mm which includes an 80 X 44 APS array. Tests of the fabricated chip demonstrate the validity of the design.

Information flow and causality as rigorous notions ab initio

NASA Astrophysics Data System (ADS)

Liang, X. San

2016-11-01

Information flow or information transfer the widely applicable general physics notion can be rigorously derived from first principles, rather than axiomatically proposed as an ansatz. Its logical association with causality is firmly rooted in the dynamical system that lies beneath. The principle of nil causality that reads, an event is not causal to another if the evolution of the latter is independent of the former, which transfer entropy analysis and Granger causality test fail to verify in many situations, turns out to be a proven theorem here. Established in this study are the information flows among the components of time-discrete mappings and time-continuous dynamical systems, both deterministic and stochastic. They have been obtained explicitly in closed form, and put to applications with the benchmark systems such as the Kaplan-Yorke map, Rössler system, baker transformation, Hénon map, and stochastic potential flow. Besides unraveling the causal relations as expected from the respective systems, some of the applications show that the information flow structure underlying a complex trajectory pattern could be tractable. For linear systems, the resulting remarkably concise formula asserts analytically that causation implies correlation, while correlation does not imply causation, providing a mathematical basis for the long-standing philosophical debate over causation versus correlation.

Low-dimensional approximation searching strategy for transfer entropy from non-uniform embedding

PubMed Central

2018-01-01

Transfer entropy from non-uniform embedding is a popular tool for the inference of causal relationships among dynamical subsystems. In this study we present an approach that makes use of low-dimensional conditional mutual information quantities to decompose the original high-dimensional conditional mutual information in the searching procedure of non-uniform embedding for significant variables at different lags. We perform a series of simulation experiments to assess the sensitivity and specificity of our proposed method to demonstrate its advantage compared to previous algorithms. The results provide concrete evidence that low-dimensional approximations can help to improve the statistical accuracy of transfer entropy in multivariate causality analysis and yield a better performance over other methods. The proposed method is especially efficient as the data length grows. PMID:29547669

Information-Theoretical Complexity Analysis of Selected Elementary Chemical Reactions

NASA Astrophysics Data System (ADS)

Molina-Espíritu, M.; Esquivel, R. O.; Dehesa, J. S.

We investigate the complexity of selected elementary chemical reactions (namely, the hydrogenic-abstraction reaction and the identity SN2 exchange reaction) by means of the following single and composite information-theoretic measures: disequilibrium (D), exponential entropy(L), Fisher information (I), power entropy (J), I-D, D-L and I-J planes and Fisher-Shannon (FS) and Lopez-Mancini-Calbet (LMC) shape complexities. These quantities, which are functionals of the one-particle density, are computed in both position (r) and momentum (p) spaces. The analysis revealed that the chemically significant regions of these reactions can be identified through most of the single information-theoretic measures and the two-component planes, not only the ones which are commonly revealed by the energy, such as the reactant/product (R/P) and the transition state (TS), but also those that are not present in the energy profile such as the bond cleavage energy region (BCER), the bond breaking/forming regions (B-B/F) and the charge transfer process (CT). The analysis of the complexities shows that the energy profile of the abstraction reaction bears the same information-theoretical features of the LMC and FS measures, however for the identity SN2 exchange reaction does not hold a simple behavior with respect to the LMC and FS measures. Most of the chemical features of interest (BCER, B-B/F and CT) are only revealed when particular information-theoretic aspects of localizability (L or J), uniformity (D) and disorder (I) are considered.

Classification and Verification of Handwritten Signatures with Time Causal Information Theory Quantifiers

PubMed Central

Ospina, Raydonal; Frery, Alejandro C.

2016-01-01

We present a new approach for handwritten signature classification and verification based on descriptors stemming from time causal information theory. The proposal uses the Shannon entropy, the statistical complexity, and the Fisher information evaluated over the Bandt and Pompe symbolization of the horizontal and vertical coordinates of signatures. These six features are easy and fast to compute, and they are the input to an One-Class Support Vector Machine classifier. The results are better than state-of-the-art online techniques that employ higher-dimensional feature spaces which often require specialized software and hardware. We assess the consistency of our proposal with respect to the size of the training sample, and we also use it to classify the signatures into meaningful groups. PMID:27907014

Identification of a Threshold Value for the DEMATEL Method: Using the Maximum Mean De-Entropy Algorithm

NASA Astrophysics Data System (ADS)

Chung-Wei, Li; Gwo-Hshiung, Tzeng

To deal with complex problems, structuring them through graphical representations and analyzing causal influences can aid in illuminating complex issues, systems, or concepts. The DEMATEL method is a methodology which can be used for researching and solving complicated and intertwined problem groups. The end product of the DEMATEL process is a visual representation—the impact-relations map—by which respondents organize their own actions in the world. The applicability of the DEMATEL method is widespread, ranging from analyzing world problematique decision making to industrial planning. The most important property of the DEMATEL method used in the multi-criteria decision making (MCDM) field is to construct interrelations between criteria. In order to obtain a suitable impact-relations map, an appropriate threshold value is needed to obtain adequate information for further analysis and decision-making. In this paper, we propose a method based on the entropy approach, the maximum mean de-entropy algorithm, to achieve this purpose. Using real cases to find the interrelationships between the criteria for evaluating effects in E-learning programs as an examples, we will compare the results obtained from the respondents and from our method, and discuss that the different impact-relations maps from these two methods.

Analysing causal structures with entropy

PubMed Central

Weilenmann, Mirjam

2017-01-01

A central question for causal inference is to decide whether a set of correlations fits a given causal structure. In general, this decision problem is computationally infeasible and hence several approaches have emerged that look for certificates of compatibility. Here, we review several such approaches based on entropy. We bring together the key aspects of these entropic techniques with unified terminology, filling several gaps and establishing new connections, all illustrated with examples. We consider cases where unobserved causes are classical, quantum and post-quantum, and discuss what entropic analyses tell us about the difference. This difference has applications to quantum cryptography, where it can be crucial to eliminate the possibility of classical causes. We discuss the achievements and limitations of the entropic approach in comparison to other techniques and point out the main open problems. PMID:29225499

Analysing causal structures with entropy

NASA Astrophysics Data System (ADS)

Weilenmann, Mirjam; Colbeck, Roger

2017-11-01

A central question for causal inference is to decide whether a set of correlations fits a given causal structure. In general, this decision problem is computationally infeasible and hence several approaches have emerged that look for certificates of compatibility. Here, we review several such approaches based on entropy. We bring together the key aspects of these entropic techniques with unified terminology, filling several gaps and establishing new connections, all illustrated with examples. We consider cases where unobserved causes are classical, quantum and post-quantum, and discuss what entropic analyses tell us about the difference. This difference has applications to quantum cryptography, where it can be crucial to eliminate the possibility of classical causes. We discuss the achievements and limitations of the entropic approach in comparison to other techniques and point out the main open problems.

Control entropy identifies differential changes in complexity of walking and running gait patterns with increasing speed in highly trained runners

NASA Astrophysics Data System (ADS)

McGregor, Stephen J.; Busa, Michael A.; Skufca, Joseph; Yaggie, James A.; Bollt, Erik M.

2009-06-01

Regularity statistics have been previously applied to walking gait measures in the hope of gaining insight into the complexity of gait under different conditions and in different populations. Traditional regularity statistics are subject to the requirement of stationarity, a limitation for examining changes in complexity under dynamic conditions such as exhaustive exercise. Using a novel measure, control entropy (CE), applied to triaxial continuous accelerometry, we report changes in complexity of walking and running during increasing speeds up to exhaustion in highly trained runners. We further apply Karhunen-Loeve analysis in a new and novel way to the patterns of CE responses in each of the three axes to identify dominant modes of CE responses in the vertical, mediolateral, and anterior/posterior planes. The differential CE responses observed between the different axes in this select population provide insight into the constraints of walking and running in those who may have optimized locomotion. Future comparisons between athletes, healthy untrained, and clinical populations using this approach may help elucidate differences between optimized and diseased locomotor control.

The predictive power of singular value decomposition entropy for stock market dynamics

NASA Astrophysics Data System (ADS)

Caraiani, Petre

2014-01-01

We use a correlation-based approach to analyze financial data from the US stock market, both daily and monthly observations from the Dow Jones. We compute the entropy based on the singular value decomposition of the correlation matrix for the components of the Dow Jones Industrial Index. Based on a moving window, we derive time varying measures of entropy for both daily and monthly data. We find that the entropy has a predictive ability with respect to stock market dynamics as indicated by the Granger causality tests.

All the entropies on the light-cone

NASA Astrophysics Data System (ADS)

Casini, Horacio; Testé, Eduardo; Torroba, Gonzalo

2018-05-01

We determine the explicit universal form of the entanglement and Renyi entropies, for regions with arbitrary boundary on a null plane or the light-cone. All the entropies are shown to saturate the strong subadditive inequality. This Renyi Markov property implies that the vacuum behaves like a product state. For the null plane, our analysis applies to general quantum field theories, and we show that the entropies do not depend on the region. For the light-cone, our approach is restricted to conformal field theories. In this case, the construction of the entropies is related to dilaton effective actions in two less dimensions. In particular, the universal logarithmic term in the entanglement entropy arises from a Wess-Zumino anomaly action. We also consider these properties in theories with holographic duals, for which we construct the minimal area surfaces for arbitrary shapes on the light-cone. We recover the Markov property and the universal form of the entropy, and argue that these properties continue to hold upon including stringy and quantum corrections. We end with some remarks on the recently proved entropic a-theorem in four spacetime dimensions.

Non-linear Interactions between Niño region 3 and the Southern Amazon

NASA Astrophysics Data System (ADS)

Ramos, A. M. D. T.; Builes-Jaramillo, L. A.; Poveda, G.; Goswami, B.; Macau, E. E. N.; Kurths, J.; Marwan, N.

2016-12-01

Identifying causal relations from the observational dataset has posed great challenges in data-driven inference study. However, complex system framework offers promising approaches to tackle such problems. Here we propose a new data-driven causality inference method using the framework of recurrence plots. We present the Recurrence Measure of Conditional Dependence (RMCD) and its applications. The RMCD incorporates the recurrence behavior into the transfer entropy theory. Therefore, it quantifies the causal dependence between two processes based on joint recurrence patterns between the past of the potential driver and present on the potential driven, except for any contribution that has already been in the past of the driven. We apply this methodology to some paradigmatic models and to investigate the possible influence of the Pacific Ocean temperatures on the South West Amazon for the 2010 and 2005 droughts. The results reveal that for the 2005 drought there is not a significant signal of dependence from the Pacific Ocean and that for 2010 there is a signal of dependence of around 200 days. These outcomes are confirmed by the traditional climatological analysis of these episodes available in the literature and show the accuracy of RMCD inferring causal relations in climate systems.

Causal nexus between energy consumption and carbon dioxide emission for Malaysia using maximum entropy bootstrap approach.

PubMed

Gul, Sehrish; Zou, Xiang; Hassan, Che Hashim; Azam, Muhammad; Zaman, Khalid

2015-12-01

This study investigates the relationship between energy consumption and carbon dioxide emission in the causal framework, as the direction of causality remains has a significant policy implication for developed and developing countries. The study employed maximum entropy bootstrap (Meboot) approach to examine the causal nexus between energy consumption and carbon dioxide emission using bivariate as well as multivariate framework for Malaysia, over a period of 1975-2013. This is a unified approach without requiring the use of conventional techniques based on asymptotical theory such as testing for possible unit root and cointegration. In addition, it can be applied in the presence of non-stationary of any type including structural breaks without any type of data transformation to achieve stationary. Thus, it provides more reliable and robust inferences which are insensitive to time span as well as lag length used. The empirical results show that there is a unidirectional causality running from energy consumption to carbon emission both in the bivariate model and multivariate framework, while controlling for broad money supply and population density. The results indicate that Malaysia is an energy-dependent country and hence energy is stimulus to carbon emissions.

Proposed principles of maximum local entropy production.

PubMed

Ross, John; Corlan, Alexandru D; Müller, Stefan C

2012-07-12

Articles have appeared that rely on the application of some form of "maximum local entropy production principle" (MEPP). This is usually an optimization principle that is supposed to compensate for the lack of structural information and measurements about complex systems, even systems as complex and as little characterized as the whole biosphere or the atmosphere of the Earth or even of less known bodies in the solar system. We select a number of claims from a few well-known papers that advocate this principle and we show that they are in error with the help of simple examples of well-known chemical and physical systems. These erroneous interpretations can be attributed to ignoring well-established and verified theoretical results such as (1) entropy does not necessarily increase in nonisolated systems, such as "local" subsystems; (2) macroscopic systems, as described by classical physics, are in general intrinsically deterministic-there are no "choices" in their evolution to be selected by using supplementary principles; (3) macroscopic deterministic systems are predictable to the extent to which their state and structure is sufficiently well-known; usually they are not sufficiently known, and probabilistic methods need to be employed for their prediction; and (4) there is no causal relationship between the thermodynamic constraints and the kinetics of reaction systems. In conclusion, any predictions based on MEPP-like principles should not be considered scientifically founded.

Device-Independent Tests of Entropy

NASA Astrophysics Data System (ADS)

Chaves, Rafael; Brask, Jonatan Bohr; Brunner, Nicolas

2015-09-01

We show that the entropy of a message can be tested in a device-independent way. Specifically, we consider a prepare-and-measure scenario with classical or quantum communication, and develop two different methods for placing lower bounds on the communication entropy, given observable data. The first method is based on the framework of causal inference networks. The second technique, based on convex optimization, shows that quantum communication provides an advantage over classical communication, in the sense of requiring a lower entropy to reproduce given data. These ideas may serve as a basis for novel applications in device-independent quantum information processing.

Finite entanglement entropy and spectral dimension in quantum gravity

NASA Astrophysics Data System (ADS)

Arzano, Michele; Calcagni, Gianluca

2017-12-01

What are the conditions on a field theoretic model leading to a finite entanglement entropy density? We prove two very general results: (1) Ultraviolet finiteness of a theory does not guarantee finiteness of the entropy density; (2) If the spectral dimension of the spatial boundary across which the entropy is calculated is non-negative at all scales, then the entanglement entropy cannot be finite. These conclusions, which we verify in several examples, negatively affect all quantum-gravity models, since their spectral dimension is always positive. Possible ways out are considered, including abandoning the definition of the entanglement entropy in terms of the boundary return probability or admitting an analytic continuation (not a regularization) of the usual definition. In the second case, one can get a finite entanglement entropy density in multi-fractional theories and causal dynamical triangulations.

Fall risk factors analysis based on sample entropy of plantar kinematic signal during stance phase.

PubMed

Shengyun Liang; Huiyu Jia; Zilong Li; Huiqi Li; Xing Gao; Zuchang Ma; Yingnan Ma; Guoru Zhao

2016-08-01

Falls are a multi-causal phenomenon with a complex interaction. The aim of our research is to study the effect of multiple variables for potential risk of falls and construct an elderly fall risk assessment model based on demographics data and gait characteristics. A total of 101 subjects, whom belong to Malianwa Street, aged above 50 years old and participated in questionnaire survey. Participants were classified into three groups (high, medium and low risk group) according to the score of elderly fall risk assessment scale. In addition, the data of ground reaction force (GRF) and ground reaction moment (GRM) was record when they performed walking at comfortable state. The demographic variables, sample entropy of GRF and GRM, and impulse difference of bilateral foot were considered as potential explanatory variables of risk assessment model. Firstly, we investigated whether different groups could present difference in every variable. Statistical differences were found for the following variables: age (p=2.28e-05); impulse difference (p=0.02036); sample entropy of GRF in vertical direction (p=0.0144); sample entropy of GRM in anterior-posterior direction (p=0.0387). Finally, the multiple regression analysis results indicated that age, impulse difference and sample entropy of resultant GRM could identify individuals who had different levels of fall risk. Therefore, those results could potentially be useful in the fall risk assessment and monitor the state of physical function in elderly population.

Digital focusing of OCT images based on scalar diffraction theory and information entropy.

PubMed

Liu, Guozhong; Zhi, Zhongwei; Wang, Ruikang K

2012-11-01

This paper describes a digital method that is capable of automatically focusing optical coherence tomography (OCT) en face images without prior knowledge of the point spread function of the imaging system. The method utilizes a scalar diffraction model to simulate wave propagation from out-of-focus scatter to the focal plane, from which the propagation distance between the out-of-focus plane and the focal plane is determined automatically via an image-definition-evaluation criterion based on information entropy theory. By use of the proposed approach, we demonstrate that the lateral resolution close to that at the focal plane can be recovered from the imaging planes outside the depth of field region with minimal loss of resolution. Fresh onion tissues and mouse fat tissues are used in the experiments to show the performance of the proposed method.

Refined two-index entropy and multiscale analysis for complex system

NASA Astrophysics Data System (ADS)

Bian, Songhan; Shang, Pengjian

2016-10-01

As a fundamental concept in describing complex system, entropy measure has been proposed to various forms, like Boltzmann-Gibbs (BG) entropy, one-index entropy, two-index entropy, sample entropy, permutation entropy etc. This paper proposes a new two-index entropy Sq,δ and we find the new two-index entropy is applicable to measure the complexity of wide range of systems in the terms of randomness and fluctuation range. For more complex system, the value of two-index entropy is smaller and the correlation between parameter δ and entropy Sq,δ is weaker. By combining the refined two-index entropy Sq,δ with scaling exponent h(δ), this paper analyzes the complexities of simulation series and classifies several financial markets in various regions of the world effectively.

Backward transfer entropy: Informational measure for detecting hidden Markov models and its interpretations in thermodynamics, gambling and causality

PubMed Central

Ito, Sosuke

2016-01-01

The transfer entropy is a well-established measure of information flow, which quantifies directed influence between two stochastic time series and has been shown to be useful in a variety fields of science. Here we introduce the transfer entropy of the backward time series called the backward transfer entropy, and show that the backward transfer entropy quantifies how far it is from dynamics to a hidden Markov model. Furthermore, we discuss physical interpretations of the backward transfer entropy in completely different settings of thermodynamics for information processing and the gambling with side information. In both settings of thermodynamics and the gambling, the backward transfer entropy characterizes a possible loss of some benefit, where the conventional transfer entropy characterizes a possible benefit. Our result implies the deep connection between thermodynamics and the gambling in the presence of information flow, and that the backward transfer entropy would be useful as a novel measure of information flow in nonequilibrium thermodynamics, biochemical sciences, economics and statistics. PMID:27833120

Backward transfer entropy: Informational measure for detecting hidden Markov models and its interpretations in thermodynamics, gambling and causality

NASA Astrophysics Data System (ADS)

Ito, Sosuke

2016-11-01

The transfer entropy is a well-established measure of information flow, which quantifies directed influence between two stochastic time series and has been shown to be useful in a variety fields of science. Here we introduce the transfer entropy of the backward time series called the backward transfer entropy, and show that the backward transfer entropy quantifies how far it is from dynamics to a hidden Markov model. Furthermore, we discuss physical interpretations of the backward transfer entropy in completely different settings of thermodynamics for information processing and the gambling with side information. In both settings of thermodynamics and the gambling, the backward transfer entropy characterizes a possible loss of some benefit, where the conventional transfer entropy characterizes a possible benefit. Our result implies the deep connection between thermodynamics and the gambling in the presence of information flow, and that the backward transfer entropy would be useful as a novel measure of information flow in nonequilibrium thermodynamics, biochemical sciences, economics and statistics.

Charged Rényi entropies in CFTs with Einstein-Gauss-Bonnet holographic duals

NASA Astrophysics Data System (ADS)

Pastras, Georgios; Manolopoulos, Dimitrios

2014-11-01

We calculate the Rényi entropy S q ( μ, λ), for spherical entangling surfaces in CFT's with Einstein-Gauss-Bonnet-Maxwell holographic duals. Rényi entropies must obey some interesting inequalities by definition. However, for Gauss-Bonnet couplings λ, larger than specific value, but still allowed by causality, we observe a violation of the inequality , which is related to the existence of negative entropy black holes, providing interesting restrictions in the bulk theory. Moreover, we find an interesting distinction of the behaviour of the analytic continuation of S q ( μ, λ) for imaginary chemical potential, between negative and non-negative λ.

[Medicine at the "edge of chaos". Life, entropy and complexity].

PubMed

De Vito, Eduardo L

2016-01-01

The aim of this paper is to help physicians and health professionals, who constantly seek to improve their knowledge for the benefit of the ill, to incorporate new conceptual and methodological tools to understand the complexity inherent to the field of medicine. This article contains notions that are unfamiliar to these professionals and are intended to foster reflection and learning. It poses the need to define life from a thermodynamic point of view, linking it closely to complex systems, nonlinear dynamics and chaotic behavior, as well as to redefine conventional physiological control mechanisms based on the concept of homeostasis, and to travel the path that starts with the search for extraterrestrial life up to exposing medicine "near the edge of chaos". Complexity transcends the biological aspects; it includes a subjective and symbolic/social dimension. Viewing disease as a heterogeneous and multi-causal phenomenon can give rise to new approaches for the sick.

Causality, transfer entropy, and allosteric communication landscapes in proteins with harmonic interactions.

PubMed

Hacisuleyman, Aysima; Erman, Burak

2017-06-01

A fast and approximate method of generating allosteric communication landscapes in proteins is presented by using Schreiber's entropy transfer concept in combination with the Gaussian Network Model of proteins. Predictions of the model and the allosteric communication landscapes generated show that information transfer in proteins does not necessarily take place along a single path, but an ensemble of pathways is possible. The model emphasizes that knowledge of entropy only is not sufficient for determining allosteric communication and additional information based on time delayed correlations should be introduced, which leads to the presence of causality in proteins. The model provides a simple tool for mapping entropy sink-source relations into pairs of residues. By this approach, residues that should be manipulated to control protein activity may be determined. This should be of great importance for allosteric drug design and for understanding the effects of mutations on function. The model is applied to determine allosteric communication in three proteins, Ubiquitin, Pyruvate Kinase, and the PDZ domain. Predictions are in agreement with molecular dynamics simulations and experimental evidence. Proteins 2017; 85:1056-1064. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

Implications of the causality principle for ultra chiral metamaterials

PubMed Central

Gorkunov, Maxim V.; Dmitrienko, Vladimir E.; Ezhov, Alexander A.; Artemov, Vladimir V.; Rogov, Oleg Y.

2015-01-01

Chiral metamaterials – artificial subwavelength structures with broken mirror symmetry – demonstrate outstanding degree of optical chirality that exhibits sophisticated spectral behavior and can eventually reach extreme values. Based on the fundamental causality principle we show how one can unambiguously relate the metamaterial circular dichroism and optical activity by the generalized Kramers-Kronig relations. Contrary to the conventional relations, the generalized ones provide a unique opportunity of extracting information on material-dependent zeroes of transmission coefficient in the upper half plane of complex frequency. We illustrate the merit of the formulated relations by applying them to the observed ultra chiral optical transmission spectra of subwavelength arrays of chiral holes in silver films. Apart from the possibility of precise verification of experimental data, the relations enable resolving complex eigenfrequencies of metamaterial intrinsic modes and resonances. PMID:25787007

Causal holographic information does not satisfy the linearized quantum focusing condition

NASA Astrophysics Data System (ADS)

Fu, Zicao; Marolf, Donald; Qi, Marvin

2018-04-01

The Hubeny-Rangamani causal holographic information (CHI) defined by a region R of a holographic quantum field theory (QFT) is a modern version of the idea that the area of event horizons might be related to an entropy. Here the event horizon lives in a dual gravitational bulk theory with Newton's constant G bulk, and the relation involves a factor of 4 G bulk. The fact that CHI is bounded below by the von Neumann entropy S suggests that CHI is coarse-grained. Its properties could thus differ markedly from those of S. In particular, recent results imply that when d ≤ 4 holographic QFTs are perturbatively coupled to d-dimensional gravity, the combined system satisfies the so-called quantum focusing condition (QFC) at leading order in the new gravitational coupling G d when the QFT entropy is taken to be that of von Neumann. However, by studying states dual to spherical bulk (anti-de Sitter) Schwarschild black holes in the conformal frame for which the boundary is a (2 + 1)-dimensional de Sitter space, we find the QFC defined by CHI is violated even when perturbing about a Killing horizon and using a single null congruence. Since it is known that a generalized second law (GSL) holds in this context, our work demonstrates that the QFC is not required in order for an entropy, or an entropy-like quantity, to satisfy such a GSL.

Information theory and robotics meet to study predator-prey interactions

NASA Astrophysics Data System (ADS)

Neri, Daniele; Ruberto, Tommaso; Cord-Cruz, Gabrielle; Porfiri, Maurizio

2017-07-01

Transfer entropy holds promise to advance our understanding of animal behavior, by affording the identification of causal relationships that underlie animal interactions. A critical step toward the reliable implementation of this powerful information-theoretic concept entails the design of experiments in which causal relationships could be systematically controlled. Here, we put forward a robotics-based experimental approach to test the validity of transfer entropy in the study of predator-prey interactions. We investigate the behavioral response of zebrafish to a fear-evoking robotic stimulus, designed after the morpho-physiology of the red tiger oscar and actuated along preprogrammed trajectories. From the time series of the positions of the zebrafish and the robotic stimulus, we demonstrate that transfer entropy correctly identifies the influence of the stimulus on the focal subject. Building on this evidence, we apply transfer entropy to study the interactions between zebrafish and a live red tiger oscar. The analysis of transfer entropy reveals a change in the direction of the information flow, suggesting a mutual influence between the predator and the prey, where the predator adapts its strategy as a function of the movement of the prey, which, in turn, adjusts its escape as a function of the predator motion. Through the integration of information theory and robotics, this study posits a new approach to study predator-prey interactions in freshwater fish.

Entropy and equilibrium via games of complexity

NASA Astrophysics Data System (ADS)

Topsøe, Flemming

2004-09-01

It is suggested that thermodynamical equilibrium equals game theoretical equilibrium. Aspects of this thesis are discussed. The philosophy is consistent with maximum entropy thinking of Jaynes, but goes one step deeper by deriving the maximum entropy principle from an underlying game theoretical principle. The games introduced are based on measures of complexity. Entropy is viewed as minimal complexity. It is demonstrated that Tsallis entropy ( q-entropy) and Kaniadakis entropy ( κ-entropy) can be obtained in this way, based on suitable complexity measures. A certain unifying effect is obtained by embedding these measures in a two-parameter family of entropy functions.

Evaluating data-driven causal inference techniques in noisy physical and ecological systems

NASA Astrophysics Data System (ADS)

Tennant, C.; Larsen, L.

2016-12-01

Causal inference from observational time series challenges traditional approaches for understanding processes and offers exciting opportunities to gain new understanding of complex systems where nonlinearity, delayed forcing, and emergent behavior are common. We present a formal evaluation of the performance of convergent cross-mapping (CCM) and transfer entropy (TE) for data-driven causal inference under real-world conditions. CCM is based on nonlinear state-space reconstruction, and causality is determined by the convergence of prediction skill with an increasing number of observations of the system. TE is the uncertainty reduction based on transition probabilities of a pair of time-lagged variables. With TE, causal inference is based on asymmetry in information flow between the variables. Observational data and numerical simulations from a number of classical physical and ecological systems: atmospheric convection (the Lorenz system), species competition (patch-tournaments), and long-term climate change (Vostok ice core) were used to evaluate the ability of CCM and TE to infer causal-relationships as data series become increasingly corrupted by observational (instrument-driven) or process (model-or -stochastic-driven) noise. While both techniques show promise for causal inference, TE appears to be applicable to a wider range of systems, especially when the data series are of sufficient length to reliably estimate transition probabilities of system components. Both techniques also show a clear effect of observational noise on causal inference. For example, CCM exhibits a negative logarithmic decline in prediction skill as the noise level of the system increases. Changes in TE strongly depend on noise type and which variable the noise was added to. The ability of CCM and TE to detect driving influences suggest that their application to physical and ecological systems could be transformative for understanding driving mechanisms as Earth systems undergo change.

Digital focusing of OCT images based on scalar diffraction theory and information entropy

PubMed Central

Liu, Guozhong; Zhi, Zhongwei; Wang, Ruikang K.

2012-01-01

This paper describes a digital method that is capable of automatically focusing optical coherence tomography (OCT) en face images without prior knowledge of the point spread function of the imaging system. The method utilizes a scalar diffraction model to simulate wave propagation from out-of-focus scatter to the focal plane, from which the propagation distance between the out-of-focus plane and the focal plane is determined automatically via an image-definition-evaluation criterion based on information entropy theory. By use of the proposed approach, we demonstrate that the lateral resolution close to that at the focal plane can be recovered from the imaging planes outside the depth of field region with minimal loss of resolution. Fresh onion tissues and mouse fat tissues are used in the experiments to show the performance of the proposed method. PMID:23162717

Double symbolic joint entropy in nonlinear dynamic complexity analysis

NASA Astrophysics Data System (ADS)

Yao, Wenpo; Wang, Jun

2017-07-01

Symbolizations, the base of symbolic dynamic analysis, are classified as global static and local dynamic approaches which are combined by joint entropy in our works for nonlinear dynamic complexity analysis. Two global static methods, symbolic transformations of Wessel N. symbolic entropy and base-scale entropy, and two local ones, namely symbolizations of permutation and differential entropy, constitute four double symbolic joint entropies that have accurate complexity detections in chaotic models, logistic and Henon map series. In nonlinear dynamical analysis of different kinds of heart rate variability, heartbeats of healthy young have higher complexity than those of the healthy elderly, and congestive heart failure (CHF) patients are lowest in heartbeats' joint entropy values. Each individual symbolic entropy is improved by double symbolic joint entropy among which the combination of base-scale and differential symbolizations have best complexity analysis. Test results prove that double symbolic joint entropy is feasible in nonlinear dynamic complexity analysis.

Study on localization of epileptic focus based on causality analysis

NASA Astrophysics Data System (ADS)

Shan, Shaojie; Li, Hanjun; Tang, Xiaoying

2018-05-01

In this paper, we considered that the ECoG signal contain abundant pathological information, which can be used for the localization of epileptic focus before epileptic seizures in 1-2 mins. In order to validate this hypothesis, cutting the ECoG into three stages: before seizure, seizure and after seizure, then through using Granger causality algorithm, PSI causality algorithm, Transfer Entropy causality algorithm at different stages of epilepsy ECoG, we were able to do the causality analysis of ECoG data. The results have shown that there is significant difference with the causality value of the epileptic focus area in before seizure, seizure and after seizure. An increase is in the causality value of each channel during epileptic seizure. After epileptic seizure, the causality between the channels showed a downward trend, but the difference was not obvious. The difference of the causality provides a reliable technical method to assist the clinical diagnosis of epileptic focus.

Connectivity in the human brain dissociates entropy and complexity of auditory inputs☆

PubMed Central

Nastase, Samuel A.; Iacovella, Vittorio; Davis, Ben; Hasson, Uri

2015-01-01

Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. PMID:25536493

Investigations on entropy layer along hypersonic hyperboloids using a defect boundary layer

NASA Technical Reports Server (NTRS)

Brazier, J. P.; Aupoix, B.; Cousteix, J.

1992-01-01

A defect approach coupled with matched asymptotic expansions is used to derive a new set of boundary layer equations. This method ensures a smooth matching of the boundary layer with the inviscid solution. These equations are solved to calculate boundary layers over hypersonic blunt bodies involving the entropy gradient effect. Systematic comparisons are made for both axisymmetric and plane flows in several cases with different Mach and Reynolds numbers. After a brief survey of the entropy layer characteristics, the defect boundary layer results are compared with standard boundary layer and full Navier-Stokes solutions. The entropy gradient effects are found to be more important in the axisymmetric case than in the plane one. The wall temperature has a great influence on the results through the displacement effect. Good predictions can be obtained with the defect approach over a cold wall in the nose region, with a first order solution. However, the defect approach gives less accurate results far from the nose on axisymmetric bodies because of the thinning of the entropy layer.

Clauser-Horne-Shimony-Holt violation and the entropy-concurrence plane

DOE Office of Scientific and Technical Information (OSTI.GOV)

Derkacz, Lukasz; Jakobczyk, Lech

2005-10-15

We characterize violation of Clauser-Horne-Shimony-Holt (CHSH) inequalities for mixed two-qubit states by their mixedness and entanglement. The class of states that have maximum degree of CHSH violation for a given linear entropy is also constructed.

Entropic Nonsignaling Correlations.

PubMed

Chaves, Rafael; Budroni, Costantino

2016-06-17

We introduce the concept of entropic nonsignaling correlations, i.e., entropies arising from probabilistic theories that are compatible with the fact that we cannot transmit information instantaneously. We characterize and show the relevance of these entropic correlations in a variety of different scenarios, ranging from typical Bell experiments to more refined descriptions such as bilocality and information causality. In particular, we apply the framework to derive the first entropic inequality testing genuine tripartite nonlocality in quantum systems of arbitrary dimension and also prove the first known monogamy relation for entropic Bell inequalities. Further, within the context of complex Bell networks, we show that entropic nonlocal correlations can be activated.

Entropic Nonsignaling Correlations

NASA Astrophysics Data System (ADS)

Chaves, Rafael; Budroni, Costantino

2016-06-01

We introduce the concept of entropic nonsignaling correlations, i.e., entropies arising from probabilistic theories that are compatible with the fact that we cannot transmit information instantaneously. We characterize and show the relevance of these entropic correlations in a variety of different scenarios, ranging from typical Bell experiments to more refined descriptions such as bilocality and information causality. In particular, we apply the framework to derive the first entropic inequality testing genuine tripartite nonlocality in quantum systems of arbitrary dimension and also prove the first known monogamy relation for entropic Bell inequalities. Further, within the context of complex Bell networks, we show that entropic nonlocal correlations can be activated.

Connectivity in the human brain dissociates entropy and complexity of auditory inputs.

PubMed

Nastase, Samuel A; Iacovella, Vittorio; Davis, Ben; Hasson, Uri

2015-03-01

Complex systems are described according to two central dimensions: (a) the randomness of their output, quantified via entropy; and (b) their complexity, which reflects the organization of a system's generators. Whereas some approaches hold that complexity can be reduced to uncertainty or entropy, an axiom of complexity science is that signals with very high or very low entropy are generated by relatively non-complex systems, while complex systems typically generate outputs with entropy peaking between these two extremes. In understanding their environment, individuals would benefit from coding for both input entropy and complexity; entropy indexes uncertainty and can inform probabilistic coding strategies, whereas complexity reflects a concise and abstract representation of the underlying environmental configuration, which can serve independent purposes, e.g., as a template for generalization and rapid comparisons between environments. Using functional neuroimaging, we demonstrate that, in response to passively processed auditory inputs, functional integration patterns in the human brain track both the entropy and complexity of the auditory signal. Connectivity between several brain regions scaled monotonically with input entropy, suggesting sensitivity to uncertainty, whereas connectivity between other regions tracked entropy in a convex manner consistent with sensitivity to input complexity. These findings suggest that the human brain simultaneously tracks the uncertainty of sensory data and effectively models their environmental generators. Copyright © 2014. Published by Elsevier Inc.

Using Rényi parameter to improve the predictive power of singular value decomposition entropy on stock market

NASA Astrophysics Data System (ADS)

Jiang, Jiaqi; Gu, Rongbao

2016-04-01

This paper generalizes the method of traditional singular value decomposition entropy by incorporating orders q of Rényi entropy. We analyze the predictive power of the entropy based on trajectory matrix using Shanghai Composite Index and Dow Jones Index data in both static test and dynamic test. In the static test on SCI, results of global granger causality tests all turn out to be significant regardless of orders selected. But this entropy fails to show much predictability in American stock market. In the dynamic test, we find that the predictive power can be significantly improved in SCI by our generalized method but not in DJI. This suggests that noises and errors affect SCI more frequently than DJI. In the end, results obtained using different length of sliding window also corroborate this finding.

Entropy corrected holographic dark energy models in modified gravity

NASA Astrophysics Data System (ADS)

Jawad, Abdul; Azhar, Nadeem; Rani, Shamaila

We consider the power law and the entropy corrected holographic dark energy (HDE) models with Hubble horizon in the dynamical Chern-Simons modified gravity. We explore various cosmological parameters and planes in this framework. The Hubble parameter lies within the consistent range at the present and later epoch for both entropy corrected models. The deceleration parameter explains the accelerated expansion of the universe. The equation of state (EoS) parameter corresponds to quintessence and cold dark matter (ΛCDM) limit. The ωΛ-ωΛ‧ approaches to ΛCDM limit and freezing region in both entropy corrected models. The statefinder parameters are consistent with ΛCDM limit and dark energy (DE) models. The generalized second law of thermodynamics remain valid in all cases of interacting parameter. It is interesting to mention here that our results of Hubble, EoS parameter and ωΛ-ωΛ‧ plane show consistency with the present observations like Planck, WP, BAO, H0, SNLS and nine-year WMAP.

Numerical estimation of the relative entropy of entanglement

NASA Astrophysics Data System (ADS)

Zinchenko, Yuriy; Friedland, Shmuel; Gour, Gilad

2010-11-01

We propose a practical algorithm for the calculation of the relative entropy of entanglement (REE), defined as the minimum relative entropy between a state and the set of states with positive partial transpose. Our algorithm is based on a practical semidefinite cutting plane approach. In low dimensions the implementation of the algorithm in matlab provides an estimation for the REE with an absolute error smaller than 10-3.

How long the singular value decomposed entropy predicts the stock market? - Evidence from the Dow Jones Industrial Average Index

NASA Astrophysics Data System (ADS)

Gu, Rongbao; Shao, Yanmin

2016-07-01

In this paper, a new concept of multi-scales singular value decomposition entropy based on DCCA cross correlation analysis is proposed and its predictive power for the Dow Jones Industrial Average Index is studied. Using Granger causality analysis with different time scales, it is found that, the singular value decomposition entropy has predictive power for the Dow Jones Industrial Average Index for period less than one month, but not for more than one month. This shows how long the singular value decomposition entropy predicts the stock market that extends Caraiani's result obtained in Caraiani (2014). On the other hand, the result also shows an essential characteristic of stock market as a chaotic dynamic system.

Information entropy to measure the spatial and temporal complexity of solute transport in heterogeneous porous media

NASA Astrophysics Data System (ADS)

Li, Weiyao; Huang, Guanhua; Xiong, Yunwu

2016-04-01

The complexity of the spatial structure of porous media, randomness of groundwater recharge and discharge (rainfall, runoff, etc.) has led to groundwater movement complexity, physical and chemical interaction between groundwater and porous media cause solute transport in the medium more complicated. An appropriate method to describe the complexity of features is essential when study on solute transport and conversion in porous media. Information entropy could measure uncertainty and disorder, therefore we attempted to investigate complexity, explore the contact between the information entropy and complexity of solute transport in heterogeneous porous media using information entropy theory. Based on Markov theory, two-dimensional stochastic field of hydraulic conductivity (K) was generated by transition probability. Flow and solute transport model were established under four conditions (instantaneous point source, continuous point source, instantaneous line source and continuous line source). The spatial and temporal complexity of solute transport process was characterized and evaluated using spatial moment and information entropy. Results indicated that the entropy increased as the increase of complexity of solute transport process. For the point source, the one-dimensional entropy of solute concentration increased at first and then decreased along X and Y directions. As time increased, entropy peak value basically unchanged, peak position migrated along the flow direction (X direction) and approximately coincided with the centroid position. With the increase of time, spatial variability and complexity of solute concentration increase, which result in the increases of the second-order spatial moment and the two-dimensional entropy. Information entropy of line source was higher than point source. Solute entropy obtained from continuous input was higher than instantaneous input. Due to the increase of average length of lithoface, media continuity increased, flow and solute transport complexity weakened, and the corresponding information entropy also decreased. Longitudinal macro dispersivity declined slightly at early time then rose. Solute spatial and temporal distribution had significant impacts on the information entropy. Information entropy could reflect the change of solute distribution. Information entropy appears a tool to characterize the spatial and temporal complexity of solute migration and provides a reference for future research.

Effect of Age on Complexity and Causality of the Cardiovascular Control: Comparison between Model-Based and Model-Free Approaches

PubMed Central

Porta, Alberto; Faes, Luca; Bari, Vlasta; Marchi, Andrea; Bassani, Tito; Nollo, Giandomenico; Perseguini, Natália Maria; Milan, Juliana; Minatel, Vinícius; Borghi-Silva, Audrey; Takahashi, Anielle C. M.; Catai, Aparecida M.

2014-01-01

The proposed approach evaluates complexity of the cardiovascular control and causality among cardiovascular regulatory mechanisms from spontaneous variability of heart period (HP), systolic arterial pressure (SAP) and respiration (RESP). It relies on construction of a multivariate embedding space, optimization of the embedding dimension and a procedure allowing the selection of the components most suitable to form the multivariate embedding space. Moreover, it allows the comparison between linear model-based (MB) and nonlinear model-free (MF) techniques and between MF approaches exploiting local predictability (LP) and conditional entropy (CE). The framework was applied to study age-related modifications of complexity and causality in healthy humans in supine resting (REST) and during standing (STAND). We found that: 1) MF approaches are more efficient than the MB method when nonlinear components are present, while the reverse situation holds in presence of high dimensional embedding spaces; 2) the CE method is the least powerful in detecting age-related trends; 3) the association of HP complexity on age suggests an impairment of cardiac regulation and response to STAND; 4) the relation of SAP complexity on age indicates a gradual increase of sympathetic activity and a reduced responsiveness of vasomotor control to STAND; 5) the association from SAP to HP on age during STAND reveals a progressive inefficiency of baroreflex; 6) the reduced connection from HP to SAP with age might be linked to the progressive exploitation of Frank-Starling mechanism at REST and to the progressive increase of peripheral resistances during STAND; 7) at REST the diminished association from RESP to HP with age suggests a vagal withdrawal and a gradual uncoupling between respiratory activity and heart; 8) the weakened connection from RESP to SAP with age might be related to the progressive increase of left ventricular thickness and vascular stiffness and to the gradual decrease of respiratory sinus arrhythmia. PMID:24586796

Amputation effects on the underlying complexity within transtibial amputee ankle motion

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wurdeman, Shane R., E-mail: shanewurdeman@gmail.com; Advanced Prosthetics Center, Omaha, Nebraska 68134; Myers, Sara A.

2014-03-15

The presence of chaos in walking is considered to provide a stable, yet adaptable means for locomotion. This study examined whether lower limb amputation and subsequent prosthetic rehabilitation resulted in a loss of complexity in amputee gait. Twenty-eight individuals with transtibial amputation participated in a 6 week, randomized cross-over design study in which they underwent a 3 week adaptation period to two separate prostheses. One prosthesis was deemed “more appropriate” and the other “less appropriate” based on matching/mismatching activity levels of the person and the prosthesis. Subjects performed a treadmill walking trial at self-selected walking speed at multiple points ofmore » the adaptation period, while kinematics of the ankle were recorded. Bilateral sagittal plane ankle motion was analyzed for underlying complexity through the pseudoperiodic surrogation analysis technique. Results revealed the presence of underlying deterministic structure in both prostheses and both the prosthetic and sound leg ankle (discriminant measure largest Lyapunov exponent). Results also revealed that the prosthetic ankle may be more likely to suffer loss of complexity than the sound ankle, and a “more appropriate” prosthesis may be better suited to help restore a healthy complexity of movement within the prosthetic ankle motion compared to a “less appropriate” prosthesis (discriminant measure sample entropy). Results from sample entropy results are less likely to be affected by the intracycle periodic dynamics as compared to the largest Lyapunov exponent. Adaptation does not seem to influence complexity in the system for experienced prosthesis users.« less

Entropy for the Complexity of Physiological Signal Dynamics.

PubMed

Zhang, Xiaohua Douglas

2017-01-01

Recently, the rapid development of large data storage technologies, mobile network technology, and portable medical devices makes it possible to measure, record, store, and track analysis of biological dynamics. Portable noninvasive medical devices are crucial to capture individual characteristics of biological dynamics. The wearable noninvasive medical devices and the analysis/management of related digital medical data will revolutionize the management and treatment of diseases, subsequently resulting in the establishment of a new healthcare system. One of the key features that can be extracted from the data obtained by wearable noninvasive medical device is the complexity of physiological signals, which can be represented by entropy of biological dynamics contained in the physiological signals measured by these continuous monitoring medical devices. Thus, in this chapter I present the major concepts of entropy that are commonly used to measure the complexity of biological dynamics. The concepts include Shannon entropy, Kolmogorov entropy, Renyi entropy, approximate entropy, sample entropy, and multiscale entropy. I also demonstrate an example of using entropy for the complexity of glucose dynamics.

Detecting causality in policy diffusion processes.

PubMed

Grabow, Carsten; Macinko, James; Silver, Diana; Porfiri, Maurizio

2016-08-01

A universal question in network science entails learning about the topology of interaction from collective dynamics. Here, we address this question by examining diffusion of laws across US states. We propose two complementary techniques to unravel determinants of this diffusion process: information-theoretic union transfer entropy and event synchronization. In order to systematically investigate their performance on law activity data, we establish a new stochastic model to generate synthetic law activity data based on plausible networks of interactions. Through extensive parametric studies, we demonstrate the ability of these methods to reconstruct networks, varying in size, link density, and degree heterogeneity. Our results suggest that union transfer entropy should be preferred for slowly varying processes, which may be associated with policies attending to specific local problems that occur only rarely or with policies facing high levels of opposition. In contrast, event synchronization is effective for faster enactment rates, which may be related to policies involving Federal mandates or incentives. This study puts forward a data-driven toolbox to explain the determinants of legal activity applicable to political science, across dynamical systems, information theory, and complex networks.

Detecting causality in policy diffusion processes

NASA Astrophysics Data System (ADS)

Grabow, Carsten; Macinko, James; Silver, Diana; Porfiri, Maurizio

2016-08-01

A universal question in network science entails learning about the topology of interaction from collective dynamics. Here, we address this question by examining diffusion of laws across US states. We propose two complementary techniques to unravel determinants of this diffusion process: information-theoretic union transfer entropy and event synchronization. In order to systematically investigate their performance on law activity data, we establish a new stochastic model to generate synthetic law activity data based on plausible networks of interactions. Through extensive parametric studies, we demonstrate the ability of these methods to reconstruct networks, varying in size, link density, and degree heterogeneity. Our results suggest that union transfer entropy should be preferred for slowly varying processes, which may be associated with policies attending to specific local problems that occur only rarely or with policies facing high levels of opposition. In contrast, event synchronization is effective for faster enactment rates, which may be related to policies involving Federal mandates or incentives. This study puts forward a data-driven toolbox to explain the determinants of legal activity applicable to political science, across dynamical systems, information theory, and complex networks.

The specific entropy of elliptical galaxies: an explanation for profile-shape distance indicators?

NASA Astrophysics Data System (ADS)

Lima Neto, G. B.; Gerbal, D.; Márquez, I.

1999-10-01

Dynamical systems in equilibrium have a stationary entropy; we suggest that elliptical galaxies, as stellar systems in a stage of quasi-equilibrium, may have in principle a unique specific entropy. This uniqueness, a priori unknown, should be reflected in correlations between the fundamental parameters describing the mass (light) distribution in galaxies. Following recent photometrical work on elliptical galaxies by Caon et al., Graham & Colless and Prugniel & Simien, we use the Sérsic law to describe the light profile and an analytical approximation to its three-dimensional deprojection. The specific entropy is then calculated, supposing that the galaxy behaves as a spherical, isotropic, one-component system in hydrostatic equilibrium, obeying the ideal-gas equations of state. We predict a relation between the three parameters of the Sérsic law linked to the specific entropy, defining a surface in the parameter space, an `Entropic Plane', by analogy with the well-known Fundamental Plane. We have analysed elliptical galaxies in two rich clusters of galaxies (Coma and ABCG 85) and a group of galaxies (associated with NGC 4839, near Coma). We show that, for a given cluster, the galaxies follow closely a relation predicted by the constant specific entropy hypothesis with a typical dispersion (one standard deviation) of 9.5per cent around the mean value of the specific entropy. Moreover, assuming that the specific entropy is also the same for galaxies of different clusters, we are able to derive relative distances between Coma, ABGC 85, and the group of NGC 4839. If the errors are due only to the determination of the specific entropy (about 10per cent), then the error in the relative distance determination should be less than 20per cent for rich clusters. We suggest that the unique specific entropy may provide a physical explanation for the distance indicators based on the Sérsic profile put forward by Young & Currie and recently discussed by Binggeli & Jerjen.

Entanglement, holography and causal diamonds

NASA Astrophysics Data System (ADS)

de Boer, Jan; Haehl, Felix M.; Heller, Michal P.; Myers, Robert C.

2016-08-01

We argue that the degrees of freedom in a d-dimensional CFT can be reorganized in an insightful way by studying observables on the moduli space of causal diamonds (or equivalently, the space of pairs of timelike separated points). This 2 d-dimensional space naturally captures some of the fundamental nonlocality and causal structure inherent in the entanglement of CFT states. For any primary CFT operator, we construct an observable on this space, which is defined by smearing the associated one-point function over causal diamonds. Known examples of such quantities are the entanglement entropy of vacuum excitations and its higher spin generalizations. We show that in holographic CFTs, these observables are given by suitably defined integrals of dual bulk fields over the corresponding Ryu-Takayanagi minimal surfaces. Furthermore, we explain connections to the operator product expansion and the first law of entanglemententropy from this unifying point of view. We demonstrate that for small perturbations of the vacuum, our observables obey linear two-derivative equations of motion on the space of causal diamonds. In two dimensions, the latter is given by a product of two copies of a two-dimensional de Sitter space. For a class of universal states, we show that the entanglement entropy and its spin-three generalization obey nonlinear equations of motion with local interactions on this moduli space, which can be identified with Liouville and Toda equations, respectively. This suggests the possibility of extending the definition of our new observables beyond the linear level more generally and in such a way that they give rise to new dynamically interacting theories on the moduli space of causal diamonds. Various challenges one has to face in order to implement this idea are discussed.

Hawking radiation of Dirac particles via tunneling from a black plane

NASA Astrophysics Data System (ADS)

Li, Hui-Ling; Zhou, Teng-Jiao; Cai, Min

2008-12-01

Extending Kerner and Mann’s fermion tunneling, we investigate the Dirac particle’s tunneling radiation from a black plane in Anti-de Sitter space-time. The result shows that the tunneling probability is related to the change of Bekenstein-Hawking entropy.

Non-analyticity of holographic Rényi entropy in Lovelock gravity

NASA Astrophysics Data System (ADS)

Puletti, V. Giangreco M.; Pourhasan, Razieh

2017-08-01

We compute holographic Rényi entropies for spherical entangling surfaces on the boundary while considering third order Lovelock gravity with negative cosmological constant in the bulk. Our study shows that third order Lovelock black holes with hyperbolic event horizon are unstable, and at low temperatures those with smaller mass are favoured, giving rise to first order phase transitions in the bulk. We determine regions in the Lovelock parameter space in arbitrary dimensions, where bulk phase transitions happen and where boundary causality constraints are met. We show that each of these points corresponds to a dual boundary conformal field theory whose Rényi entropy exhibits a kink at a certain critical index n.

Identifying critical transitions and their leading biomolecular networks in complex diseases.

PubMed

Liu, Rui; Li, Meiyi; Liu, Zhi-Ping; Wu, Jiarui; Chen, Luonan; Aihara, Kazuyuki

2012-01-01

Identifying a critical transition and its leading biomolecular network during the initiation and progression of a complex disease is a challenging task, but holds the key to early diagnosis and further elucidation of the essential mechanisms of disease deterioration at the network level. In this study, we developed a novel computational method for identifying early-warning signals of the critical transition and its leading network during a disease progression, based on high-throughput data using a small number of samples. The leading network makes the first move from the normal state toward the disease state during a transition, and thus is causally related with disease-driving genes or networks. Specifically, we first define a state-transition-based local network entropy (SNE), and prove that SNE can serve as a general early-warning indicator of any imminent transitions, regardless of specific differences among systems. The effectiveness of this method was validated by functional analysis and experimental data.

Entropy, complexity, and Markov diagrams for random walk cancer models.

PubMed

Newton, Paul K; Mason, Jeremy; Hurt, Brian; Bethel, Kelly; Bazhenova, Lyudmila; Nieva, Jorge; Kuhn, Peter

2014-12-19

The notion of entropy is used to compare the complexity associated with 12 common cancers based on metastatic tumor distribution autopsy data. We characterize power-law distributions, entropy, and Kullback-Liebler divergence associated with each primary cancer as compared with data for all cancer types aggregated. We then correlate entropy values with other measures of complexity associated with Markov chain dynamical systems models of progression. The Markov transition matrix associated with each cancer is associated with a directed graph model where nodes are anatomical locations where a metastatic tumor could develop, and edge weightings are transition probabilities of progression from site to site. The steady-state distribution corresponds to the autopsy data distribution. Entropy correlates well with the overall complexity of the reduced directed graph structure for each cancer and with a measure of systemic interconnectedness of the graph, called graph conductance. The models suggest that grouping cancers according to their entropy values, with skin, breast, kidney, and lung cancers being prototypical high entropy cancers, stomach, uterine, pancreatic and ovarian being mid-level entropy cancers, and colorectal, cervical, bladder, and prostate cancers being prototypical low entropy cancers, provides a potentially useful framework for viewing metastatic cancer in terms of predictability, complexity, and metastatic potential.

Entropy, complexity, and Markov diagrams for random walk cancer models

NASA Astrophysics Data System (ADS)

Newton, Paul K.; Mason, Jeremy; Hurt, Brian; Bethel, Kelly; Bazhenova, Lyudmila; Nieva, Jorge; Kuhn, Peter

2014-12-01

The notion of entropy is used to compare the complexity associated with 12 common cancers based on metastatic tumor distribution autopsy data. We characterize power-law distributions, entropy, and Kullback-Liebler divergence associated with each primary cancer as compared with data for all cancer types aggregated. We then correlate entropy values with other measures of complexity associated with Markov chain dynamical systems models of progression. The Markov transition matrix associated with each cancer is associated with a directed graph model where nodes are anatomical locations where a metastatic tumor could develop, and edge weightings are transition probabilities of progression from site to site. The steady-state distribution corresponds to the autopsy data distribution. Entropy correlates well with the overall complexity of the reduced directed graph structure for each cancer and with a measure of systemic interconnectedness of the graph, called graph conductance. The models suggest that grouping cancers according to their entropy values, with skin, breast, kidney, and lung cancers being prototypical high entropy cancers, stomach, uterine, pancreatic and ovarian being mid-level entropy cancers, and colorectal, cervical, bladder, and prostate cancers being prototypical low entropy cancers, provides a potentially useful framework for viewing metastatic cancer in terms of predictability, complexity, and metastatic potential.

Weighted fractional permutation entropy and fractional sample entropy for nonlinear Potts financial dynamics

NASA Astrophysics Data System (ADS)

Xu, Kaixuan; Wang, Jun

2017-02-01

In this paper, recently introduced permutation entropy and sample entropy are further developed to the fractional cases, weighted fractional permutation entropy (WFPE) and fractional sample entropy (FSE). The fractional order generalization of information entropy is utilized in the above two complexity approaches, to detect the statistical characteristics of fractional order information in complex systems. The effectiveness analysis of proposed methods on the synthetic data and the real-world data reveals that tuning the fractional order allows a high sensitivity and more accurate characterization to the signal evolution, which is useful in describing the dynamics of complex systems. Moreover, the numerical research on nonlinear complexity behaviors is compared between the returns series of Potts financial model and the actual stock markets. And the empirical results confirm the feasibility of the proposed model.

Investigating dynamical complexity in the magnetosphere using various entropy measures

NASA Astrophysics Data System (ADS)

Balasis, Georgios; Daglis, Ioannis A.; Papadimitriou, Constantinos; Kalimeri, Maria; Anastasiadis, Anastasios; Eftaxias, Konstantinos

2009-09-01

The complex system of the Earth's magnetosphere corresponds to an open spatially extended nonequilibrium (input-output) dynamical system. The nonextensive Tsallis entropy has been recently introduced as an appropriate information measure to investigate dynamical complexity in the magnetosphere. The method has been employed for analyzing Dst time series and gave promising results, detecting the complexity dissimilarity among different physiological and pathological magnetospheric states (i.e., prestorm activity and intense magnetic storms, respectively). This paper explores the applicability and effectiveness of a variety of computable entropy measures (e.g., block entropy, Kolmogorov entropy, T complexity, and approximate entropy) to the investigation of dynamical complexity in the magnetosphere. We show that as the magnetic storm approaches there is clear evidence of significant lower complexity in the magnetosphere. The observed higher degree of organization of the system agrees with that inferred previously, from an independent linear fractal spectral analysis based on wavelet transforms. This convergence between nonlinear and linear analyses provides a more reliable detection of the transition from the quiet time to the storm time magnetosphere, thus showing evidence that the occurrence of an intense magnetic storm is imminent. More precisely, we claim that our results suggest an important principle: significant complexity decrease and accession of persistency in Dst time series can be confirmed as the magnetic storm approaches, which can be used as diagnostic tools for the magnetospheric injury (global instability). Overall, approximate entropy and Tsallis entropy yield superior results for detecting dynamical complexity changes in the magnetosphere in comparison to the other entropy measures presented herein. Ultimately, the analysis tools developed in the course of this study for the treatment of Dst index can provide convenience for space weather applications.

Phase retrieval from intensity-only data by relative entropy minimization.

PubMed

Deming, Ross W

2007-11-01

A recursive algorithm, which appears to be new, is presented for estimating the amplitude and phase of a wave field from intensity-only measurements on two or more scan planes at different axial positions. The problem is framed as a nonlinear optimization, in which the angular spectrum of the complex field model is adjusted in order to minimize the relative entropy, or Kullback-Leibler divergence, between the measured and reconstructed intensities. The most common approach to this so-called phase retrieval problem is a variation of the well-known Gerchberg-Saxton algorithm devised by Misell (J. Phys. D6, L6, 1973), which is efficient and extremely simple to implement. The new algorithm has a computational structure that is very similar to Misell's approach, despite the fundamental difference in the optimization criteria used for each. Based upon results from noisy simulated data, the new algorithm appears to be more robust than Misell's approach and to produce better results from low signal-to-noise ratio data. The convergence of the new algorithm is examined.

DNA entropy reveals a significant difference in complexity between housekeeping and tissue specific gene promoters.

PubMed

Thomas, David; Finan, Chris; Newport, Melanie J; Jones, Susan

2015-10-01

The complexity of DNA can be quantified using estimates of entropy. Variation in DNA complexity is expected between the promoters of genes with different transcriptional mechanisms; namely housekeeping (HK) and tissue specific (TS). The former are transcribed constitutively to maintain general cellular functions, and the latter are transcribed in restricted tissue and cells types for specific molecular events. It is known that promoter features in the human genome are related to tissue specificity, but this has been difficult to quantify on a genomic scale. If entropy effectively quantifies DNA complexity, calculating the entropies of HK and TS gene promoters as profiles may reveal significant differences. Entropy profiles were calculated for a total dataset of 12,003 human gene promoters and for 501 housekeeping (HK) and 587 tissue specific (TS) human gene promoters. The mean profiles show the TS promoters have a significantly lower entropy (p<2.2e-16) than HK gene promoters. The entropy distributions for the 3 datasets show that promoter entropies could be used to identify novel HK genes. Functional features comprise DNA sequence patterns that are non-random and hence they have lower entropies. The lower entropy of TS gene promoters can be explained by a higher density of positive and negative regulatory elements, required for genes with complex spatial and temporary expression. Copyright © 2015 Elsevier Ltd. All rights reserved.

Entropy, complexity, and Markov diagrams for random walk cancer models

PubMed Central

Newton, Paul K.; Mason, Jeremy; Hurt, Brian; Bethel, Kelly; Bazhenova, Lyudmila; Nieva, Jorge; Kuhn, Peter

2014-01-01

The notion of entropy is used to compare the complexity associated with 12 common cancers based on metastatic tumor distribution autopsy data. We characterize power-law distributions, entropy, and Kullback-Liebler divergence associated with each primary cancer as compared with data for all cancer types aggregated. We then correlate entropy values with other measures of complexity associated with Markov chain dynamical systems models of progression. The Markov transition matrix associated with each cancer is associated with a directed graph model where nodes are anatomical locations where a metastatic tumor could develop, and edge weightings are transition probabilities of progression from site to site. The steady-state distribution corresponds to the autopsy data distribution. Entropy correlates well with the overall complexity of the reduced directed graph structure for each cancer and with a measure of systemic interconnectedness of the graph, called graph conductance. The models suggest that grouping cancers according to their entropy values, with skin, breast, kidney, and lung cancers being prototypical high entropy cancers, stomach, uterine, pancreatic and ovarian being mid-level entropy cancers, and colorectal, cervical, bladder, and prostate cancers being prototypical low entropy cancers, provides a potentially useful framework for viewing metastatic cancer in terms of predictability, complexity, and metastatic potential. PMID:25523357

Multifractals embedded in short time series: An unbiased estimation of probability moment

NASA Astrophysics Data System (ADS)

Qiu, Lu; Yang, Tianguang; Yin, Yanhua; Gu, Changgui; Yang, Huijie

2016-12-01

An exact estimation of probability moments is the base for several essential concepts, such as the multifractals, the Tsallis entropy, and the transfer entropy. By means of approximation theory we propose a new method called factorial-moment-based estimation of probability moments. Theoretical prediction and computational results show that it can provide us an unbiased estimation of the probability moments of continuous order. Calculations on probability redistribution model verify that it can extract exactly multifractal behaviors from several hundred recordings. Its powerfulness in monitoring evolution of scaling behaviors is exemplified by two empirical cases, i.e., the gait time series for fast, normal, and slow trials of a healthy volunteer, and the closing price series for Shanghai stock market. By using short time series with several hundred lengths, a comparison with the well-established tools displays significant advantages of its performance over the other methods. The factorial-moment-based estimation can evaluate correctly the scaling behaviors in a scale range about three generations wider than the multifractal detrended fluctuation analysis and the basic estimation. The estimation of partition function given by the wavelet transform modulus maxima has unacceptable fluctuations. Besides the scaling invariance focused in the present paper, the proposed factorial moment of continuous order can find its various uses, such as finding nonextensive behaviors of a complex system and reconstructing the causality relationship network between elements of a complex system.

Normalizing the causality between time series.

PubMed

Liang, X San

2015-08-01

Recently, a rigorous yet concise formula was derived to evaluate information flow, and hence the causality in a quantitative sense, between time series. To assess the importance of a resulting causality, it needs to be normalized. The normalization is achieved through distinguishing a Lyapunov exponent-like, one-dimensional phase-space stretching rate and a noise-to-signal ratio from the rate of information flow in the balance of the marginal entropy evolution of the flow recipient. It is verified with autoregressive models and applied to a real financial analysis problem. An unusually strong one-way causality is identified from IBM (International Business Machines Corporation) to GE (General Electric Company) in their early era, revealing to us an old story, which has almost faded into oblivion, about "Seven Dwarfs" competing with a giant for the mainframe computer market.

Normalizing the causality between time series

NASA Astrophysics Data System (ADS)

Liang, X. San

2015-08-01

Recently, a rigorous yet concise formula was derived to evaluate information flow, and hence the causality in a quantitative sense, between time series. To assess the importance of a resulting causality, it needs to be normalized. The normalization is achieved through distinguishing a Lyapunov exponent-like, one-dimensional phase-space stretching rate and a noise-to-signal ratio from the rate of information flow in the balance of the marginal entropy evolution of the flow recipient. It is verified with autoregressive models and applied to a real financial analysis problem. An unusually strong one-way causality is identified from IBM (International Business Machines Corporation) to GE (General Electric Company) in their early era, revealing to us an old story, which has almost faded into oblivion, about "Seven Dwarfs" competing with a giant for the mainframe computer market.

Tsirelson's bound from a generalized data processing inequality

NASA Astrophysics Data System (ADS)

Dahlsten, Oscar C. O.; Lercher, Daniel; Renner, Renato

2012-06-01

The strength of quantum correlations is bounded from above by Tsirelson's bound. We establish a connection between this bound and the fact that correlations between two systems cannot increase under local operations, a property known as the data processing inequality (DPI). More specifically, we consider arbitrary convex probabilistic theories. These can be equipped with an entropy measure that naturally generalizes the von Neumann entropy, as shown recently in Short and Wehner (2010 New J. Phys. 12 033023) and Barnum et al (2010 New J. Phys. 12 033024). We prove that if the DPI holds with respect to this generalized entropy measure then the underlying theory necessarily respects Tsirelson's bound. We, moreover, generalize this statement to any entropy measure satisfying certain minimal requirements. A consequence of our result is that not all the entropic relations used for deriving Tsirelson's bound via information causality in Pawlowski et al (2009 Nature 461 1101-4) are necessary.

Entropy bounds in terms of the w parameter

NASA Astrophysics Data System (ADS)

Abreu, Gabriel; Barceló, Carlos; Visser, Matt

2011-12-01

In a pair of recent articles [PRL 105 (2010) 041302; JHEP 1103 (2011) 056] two of the current authors have developed an entropy bound for equilibrium uncollapsed matter using only classical general relativity, basic thermodynamics, and the Unruh effect. An odd feature of that bound, [InlineMediaObject not available: see fulltext.], was that the proportionality constant, 1/2 , was weaker than that expected from black hole thermodynamics, 1/4 . In the current article we strengthen the previous results by obtaining a bound involving the (suitably averaged) w parameter. Simple causality arguments restrict this averaged < w> parameter to be ≤ 1. When equality holds, the entropy bound saturates at the value expected based on black hole thermodynamics. We also add some clarifying comments regarding the (net) positivity of the chemical potential. Overall, we find that even in the absence of any black hole region, we can nevertheless get arbitrarily close to the Bekenstein entropy.

Characterization of Early Partial Seizure Onset: Frequency, Complexity and Entropy

PubMed Central

Jouny, Christophe C.; Bergey, Gregory K.

2011-01-01

Objective A clear classification of partial seizures onset features is not yet established. Complexity and entropy have been very widely used to describe dynamical systems, but a systematic evaluation of these measures to characterize partial seizures has never been performed. Methods Eighteen different measures including power in frequency bands up to 300Hz, Gabor atom density (GAD), Higuchi fractal dimension (HFD), Lempel-Ziv complexity, Shannon entropy, sample entropy, and permutation entropy, were selected to test sensitivity to partial seizure onset. Intracranial recordings from forty-five patients with mesial temporal, neocortical temporal and neocortical extratemporal seizure foci were included (331 partial seizures). Results GAD, Lempel-Ziv complexity, HFD, high frequency activity, and sample entropy were the most reliable measures to assess early seizure onset. Conclusions Increases in complexity and occurrence of high-frequency components appear to be commonly associated with early stages of partial seizure evolution from all regions. The type of measure (frequency-based, complexity or entropy) does not predict the efficiency of the method to detect seizure onset. Significance Differences between measures such as GAD and HFD highlight the multimodal nature of partial seizure onsets. Improved methods for early seizure detection may be achieved from a better understanding of these underlying dynamics. PMID:21872526

Entropy coders for image compression based on binary forward classification

NASA Astrophysics Data System (ADS)

Yoo, Hoon; Jeong, Jechang

2000-12-01

Entropy coders as a noiseless compression method are widely used as final step compression for images, and there have been many contributions to increase of entropy coder performance and to reduction of entropy coder complexity. In this paper, we propose some entropy coders based on the binary forward classification (BFC). The BFC requires overhead of classification but there is no change between the amount of input information and the total amount of classified output information, which we prove this property in this paper. And using the proved property, we propose entropy coders that are the BFC followed by Golomb-Rice coders (BFC+GR) and the BFC followed by arithmetic coders (BFC+A). The proposed entropy coders introduce negligible additional complexity due to the BFC. Simulation results also show better performance than other entropy coders that have similar complexity to the proposed coders.

Marginally trapped surfaces and AdS/CFT

NASA Astrophysics Data System (ADS)

Grado-White, Brianna; Marolf, Donald

2018-02-01

It has been proposed that the areas of marginally trapped or anti-trapped surfaces (also known as leaves of holographic screens) may encode some notion of entropy. To connect this to AdS/CFT, we study the case of marginally trapped surfaces anchored to an AdS boundary. We establish that such boundary-anchored leaves lie between the causal and extremal surfaces defined by the anchor and that they have area bounded below by that of the minimal extremal surface. This suggests that the area of any leaf represents a coarse-grained von Neumann entropy for the associated region of the dual CFT. We further demonstrate that the leading area-divergence of a boundary-anchored marginally trapped surface agrees with that for the associated extremal surface, though subleading divergences generally differ. Finally, we generalize an argument of Bousso and Engelhardt to show that holographic screens with all leaves anchored to the same boundary set have leaf-areas that increase monotonically along the screen, and we describe a construction through which this monotonicity can take the more standard form of requiring entropy to increase with boundary time. This construction is related to what one might call future causal holographic information, which in such cases also provides an upper bound on the area of the associated leaves.

Noise and complexity in human postural control: interpreting the different estimations of entropy.

PubMed

Rhea, Christopher K; Silver, Tobin A; Hong, S Lee; Ryu, Joong Hyun; Studenka, Breanna E; Hughes, Charmayne M L; Haddad, Jeffrey M

2011-03-17

Over the last two decades, various measures of entropy have been used to examine the complexity of human postural control. In general, entropy measures provide information regarding the health, stability and adaptability of the postural system that is not captured when using more traditional analytical techniques. The purpose of this study was to examine how noise, sampling frequency and time series length influence various measures of entropy when applied to human center of pressure (CoP) data, as well as in synthetic signals with known properties. Such a comparison is necessary to interpret data between and within studies that use different entropy measures, equipment, sampling frequencies or data collection durations. The complexity of synthetic signals with known properties and standing CoP data was calculated using Approximate Entropy (ApEn), Sample Entropy (SampEn) and Recurrence Quantification Analysis Entropy (RQAEn). All signals were examined at varying sampling frequencies and with varying amounts of added noise. Additionally, an increment time series of the original CoP data was examined to remove long-range correlations. Of the three measures examined, ApEn was the least robust to sampling frequency and noise manipulations. Additionally, increased noise led to an increase in SampEn, but a decrease in RQAEn. Thus, noise can yield inconsistent results between the various entropy measures. Finally, the differences between the entropy measures were minimized in the increment CoP data, suggesting that long-range correlations should be removed from CoP data prior to calculating entropy. The various algorithms typically used to quantify the complexity (entropy) of CoP may yield very different results, particularly when sampling frequency and noise are different. The results of this study are discussed within the context of the neural noise and loss of complexity hypotheses.

TRENTOOL: A Matlab open source toolbox to analyse information flow in time series data with transfer entropy

PubMed Central

2011-01-01

Background Transfer entropy (TE) is a measure for the detection of directed interactions. Transfer entropy is an information theoretic implementation of Wiener's principle of observational causality. It offers an approach to the detection of neuronal interactions that is free of an explicit model of the interactions. Hence, it offers the power to analyze linear and nonlinear interactions alike. This allows for example the comprehensive analysis of directed interactions in neural networks at various levels of description. Here we present the open-source MATLAB toolbox TRENTOOL that allows the user to handle the considerable complexity of this measure and to validate the obtained results using non-parametrical statistical testing. We demonstrate the use of the toolbox and the performance of the algorithm on simulated data with nonlinear (quadratic) coupling and on local field potentials (LFP) recorded from the retina and the optic tectum of the turtle (Pseudemys scripta elegans) where a neuronal one-way connection is likely present. Results In simulated data TE detected information flow in the simulated direction reliably with false positives not exceeding the rates expected under the null hypothesis. In the LFP data we found directed interactions from the retina to the tectum, despite the complicated signal transformations between these stages. No false positive interactions in the reverse directions were detected. Conclusions TRENTOOL is an implementation of transfer entropy and mutual information analysis that aims to support the user in the application of this information theoretic measure. TRENTOOL is implemented as a MATLAB toolbox and available under an open source license (GPL v3). For the use with neural data TRENTOOL seamlessly integrates with the popular FieldTrip toolbox. PMID:22098775

TRENTOOL: a Matlab open source toolbox to analyse information flow in time series data with transfer entropy.

PubMed

Lindner, Michael; Vicente, Raul; Priesemann, Viola; Wibral, Michael

2011-11-18

Transfer entropy (TE) is a measure for the detection of directed interactions. Transfer entropy is an information theoretic implementation of Wiener's principle of observational causality. It offers an approach to the detection of neuronal interactions that is free of an explicit model of the interactions. Hence, it offers the power to analyze linear and nonlinear interactions alike. This allows for example the comprehensive analysis of directed interactions in neural networks at various levels of description. Here we present the open-source MATLAB toolbox TRENTOOL that allows the user to handle the considerable complexity of this measure and to validate the obtained results using non-parametrical statistical testing. We demonstrate the use of the toolbox and the performance of the algorithm on simulated data with nonlinear (quadratic) coupling and on local field potentials (LFP) recorded from the retina and the optic tectum of the turtle (Pseudemys scripta elegans) where a neuronal one-way connection is likely present. In simulated data TE detected information flow in the simulated direction reliably with false positives not exceeding the rates expected under the null hypothesis. In the LFP data we found directed interactions from the retina to the tectum, despite the complicated signal transformations between these stages. No false positive interactions in the reverse directions were detected. TRENTOOL is an implementation of transfer entropy and mutual information analysis that aims to support the user in the application of this information theoretic measure. TRENTOOL is implemented as a MATLAB toolbox and available under an open source license (GPL v3). For the use with neural data TRENTOOL seamlessly integrates with the popular FieldTrip toolbox.

Model-Free Reconstruction of Excitatory Neuronal Connectivity from Calcium Imaging Signals

PubMed Central

Stetter, Olav; Battaglia, Demian; Soriano, Jordi; Geisel, Theo

2012-01-01

A systematic assessment of global neural network connectivity through direct electrophysiological assays has remained technically infeasible, even in simpler systems like dissociated neuronal cultures. We introduce an improved algorithmic approach based on Transfer Entropy to reconstruct structural connectivity from network activity monitored through calcium imaging. We focus in this study on the inference of excitatory synaptic links. Based on information theory, our method requires no prior assumptions on the statistics of neuronal firing and neuronal connections. The performance of our algorithm is benchmarked on surrogate time series of calcium fluorescence generated by the simulated dynamics of a network with known ground-truth topology. We find that the functional network topology revealed by Transfer Entropy depends qualitatively on the time-dependent dynamic state of the network (bursting or non-bursting). Thus by conditioning with respect to the global mean activity, we improve the performance of our method. This allows us to focus the analysis to specific dynamical regimes of the network in which the inferred functional connectivity is shaped by monosynaptic excitatory connections, rather than by collective synchrony. Our method can discriminate between actual causal influences between neurons and spurious non-causal correlations due to light scattering artifacts, which inherently affect the quality of fluorescence imaging. Compared to other reconstruction strategies such as cross-correlation or Granger Causality methods, our method based on improved Transfer Entropy is remarkably more accurate. In particular, it provides a good estimation of the excitatory network clustering coefficient, allowing for discrimination between weakly and strongly clustered topologies. Finally, we demonstrate the applicability of our method to analyses of real recordings of in vitro disinhibited cortical cultures where we suggest that excitatory connections are characterized by an elevated level of clustering compared to a random graph (although not extreme) and can be markedly non-local. PMID:22927808

Identifying Seizure Onset Zone From the Causal Connectivity Inferred Using Directed Information

NASA Astrophysics Data System (ADS)

Malladi, Rakesh; Kalamangalam, Giridhar; Tandon, Nitin; Aazhang, Behnaam

2016-10-01

In this paper, we developed a model-based and a data-driven estimator for directed information (DI) to infer the causal connectivity graph between electrocorticographic (ECoG) signals recorded from brain and to identify the seizure onset zone (SOZ) in epileptic patients. Directed information, an information theoretic quantity, is a general metric to infer causal connectivity between time-series and is not restricted to a particular class of models unlike the popular metrics based on Granger causality or transfer entropy. The proposed estimators are shown to be almost surely convergent. Causal connectivity between ECoG electrodes in five epileptic patients is inferred using the proposed DI estimators, after validating their performance on simulated data. We then proposed a model-based and a data-driven SOZ identification algorithm to identify SOZ from the causal connectivity inferred using model-based and data-driven DI estimators respectively. The data-driven SOZ identification outperforms the model-based SOZ identification algorithm when benchmarked against visual analysis by neurologist, the current clinical gold standard. The causal connectivity analysis presented here is the first step towards developing novel non-surgical treatments for epilepsy.

Causality, apparent ``superluminality,'' and reshaping in barrier penetration

NASA Astrophysics Data System (ADS)

Sokolovski, D.

2010-04-01

We consider tunneling of a nonrelativistic particle across a potential barrier. It is shown that the barrier acts as an effective beam splitter which builds up the transmitted pulse from the copies of the initial envelope shifted in the coordinate space backward relative to the free propagation. Although along each pathway causality is explicitly obeyed, in special cases reshaping can result an overall reduction of the initial envelope, accompanied by an arbitrary coordinate shift. In the case of a high barrier the delay amplitude distribution (DAD) mimics a Dirac δ function, the transmission amplitude is superoscillatory for finite momenta and tunneling leads to an accurate advancement of the (reduced) initial envelope by the barrier width. In the case of a wide barrier, initial envelope is accurately translated into the complex coordinate plane. The complex shift, given by the first moment of the DAD, accounts for both the displacement of the maximum of the transmitted probability density and the increase in its velocity. It is argued that analyzing apparent “superluminality” in terms of spacial displacements helps avoid contradiction associated with time parameters such as the phase time.

Correntropy-based partial directed coherence for testing multivariate Granger causality in nonlinear processes

NASA Astrophysics Data System (ADS)

Kannan, Rohit; Tangirala, Arun K.

2014-06-01

Identification of directional influences in multivariate systems is of prime importance in several applications of engineering and sciences such as plant topology reconstruction, fault detection and diagnosis, and neurosciences. A spectrum of related directionality measures, ranging from linear measures such as partial directed coherence (PDC) to nonlinear measures such as transfer entropy, have emerged over the past two decades. The PDC-based technique is simple and effective, but being a linear directionality measure has limited applicability. On the other hand, transfer entropy, despite being a robust nonlinear measure, is computationally intensive and practically implementable only for bivariate processes. The objective of this work is to develop a nonlinear directionality measure, termed as KPDC, that possesses the simplicity of PDC but is still applicable to nonlinear processes. The technique is founded on a nonlinear measure called correntropy, a recently proposed generalized correlation measure. The proposed method is equivalent to constructing PDC in a kernel space where the PDC is estimated using a vector autoregressive model built on correntropy. A consistent estimator of the KPDC is developed and important theoretical results are established. A permutation scheme combined with the sequential Bonferroni procedure is proposed for testing hypothesis on absence of causality. It is demonstrated through several case studies that the proposed methodology effectively detects Granger causality in nonlinear processes.

Clausius entropy for arbitrary bifurcate null surfaces

NASA Astrophysics Data System (ADS)

Baccetti, Valentina; Visser, Matt

2014-02-01

Jacobson’s thermodynamic derivation of the Einstein equations was originally applied only to local Rindler horizons. But at least some parts of that construction can usefully be extended to give meaningful results for arbitrary bifurcate null surfaces. As presaged in Jacobson’s original article, this more general construction sharply brings into focus the questions: is entropy objectively ‘real’? Or is entropy in some sense subjective and observer-dependent? These innocent questions open a Pandora’s box of often inconclusive debate. A consensus opinion, though certainly not universally held, seems to be that Clausius entropy (thermodynamic entropy, defined via a Clausius relation {\\rm{d}}S = \\unicode{x111} Q/T) should be objectively real, but that the ontological status of statistical entropy (Shannon or von Neumann entropy) is much more ambiguous, and much more likely to be observer-dependent. This question is particularly pressing when it comes to understanding Bekenstein entropy (black hole entropy). To perhaps further add to the confusion, we shall argue that even the Clausius entropy can often be observer-dependent. In the current article we shall conclusively demonstrate that one can meaningfully assign a notion of Clausius entropy to arbitrary bifurcate null surfaces—effectively defining a ‘virtual Clausius entropy’ for arbitrary ‘virtual (local) causal horizons’. As an application, we see that we can implement a version of the generalized second law (GSL) for this virtual Clausius entropy. This version of GSL can be related to certain (nonstandard) integral variants of the null energy condition. Because the concepts involved are rather subtle, we take some effort in being careful and explicit in developing our framework. In future work we will apply this construction to generalize Jacobson’s derivation of the Einstein equations.

Directed dynamical influence is more detectable with noise

PubMed Central

Jiang, Jun-Jie; Huang, Zi-Gang; Huang, Liang; Liu, Huan; Lai, Ying-Cheng

2016-01-01

Successful identification of directed dynamical influence in complex systems is relevant to significant problems of current interest. Traditional methods based on Granger causality and transfer entropy have issues such as difficulty with nonlinearity and large data requirement. Recently a framework based on nonlinear dynamical analysis was proposed to overcome these difficulties. We find, surprisingly, that noise can counterintuitively enhance the detectability of directed dynamical influence. In fact, intentionally injecting a proper amount of asymmetric noise into the available time series has the unexpected benefit of dramatically increasing confidence in ascertaining the directed dynamical influence in the underlying system. This result is established based on both real data and model time series from nonlinear ecosystems. We develop a physical understanding of the beneficial role of noise in enhancing detection of directed dynamical influence. PMID:27066763

Directed dynamical influence is more detectable with noise.

PubMed

Jiang, Jun-Jie; Huang, Zi-Gang; Huang, Liang; Liu, Huan; Lai, Ying-Cheng

2016-04-12

Successful identification of directed dynamical influence in complex systems is relevant to significant problems of current interest. Traditional methods based on Granger causality and transfer entropy have issues such as difficulty with nonlinearity and large data requirement. Recently a framework based on nonlinear dynamical analysis was proposed to overcome these difficulties. We find, surprisingly, that noise can counterintuitively enhance the detectability of directed dynamical influence. In fact, intentionally injecting a proper amount of asymmetric noise into the available time series has the unexpected benefit of dramatically increasing confidence in ascertaining the directed dynamical influence in the underlying system. This result is established based on both real data and model time series from nonlinear ecosystems. We develop a physical understanding of the beneficial role of noise in enhancing detection of directed dynamical influence.

A New Scrambling Evaluation Scheme Based on Spatial Distribution Entropy and Centroid Difference of Bit-Plane

NASA Astrophysics Data System (ADS)

Zhao, Liang; Adhikari, Avishek; Sakurai, Kouichi

Watermarking is one of the most effective techniques for copyright protection and information hiding. It can be applied in many fields of our society. Nowadays, some image scrambling schemes are used as one part of the watermarking algorithm to enhance the security. Therefore, how to select an image scrambling scheme and what kind of the image scrambling scheme may be used for watermarking are the key problems. Evaluation method of the image scrambling schemes can be seen as a useful test tool for showing the property or flaw of the image scrambling method. In this paper, a new scrambling evaluation system based on spatial distribution entropy and centroid difference of bit-plane is presented to obtain the scrambling degree of image scrambling schemes. Our scheme is illustrated and justified through computer simulations. The experimental results show (in Figs. 6 and 7) that for the general gray-scale image, the evaluation degree of the corresponding cipher image for the first 4 significant bit-planes selection is nearly the same as that for the 8 bit-planes selection. That is why, instead of taking 8 bit-planes of a gray-scale image, it is sufficient to take only the first 4 significant bit-planes for the experiment to find the scrambling degree. This 50% reduction in the computational cost makes our scheme efficient.

Generalized sample entropy analysis for traffic signals based on similarity measure

NASA Astrophysics Data System (ADS)

Shang, Du; Xu, Mengjia; Shang, Pengjian

2017-05-01

Sample entropy is a prevailing method used to quantify the complexity of a time series. In this paper a modified method of generalized sample entropy and surrogate data analysis is proposed as a new measure to assess the complexity of a complex dynamical system such as traffic signals. The method based on similarity distance presents a different way of signals patterns match showing distinct behaviors of complexity. Simulations are conducted over synthetic data and traffic signals for providing the comparative study, which is provided to show the power of the new method. Compared with previous sample entropy and surrogate data analysis, the new method has two main advantages. The first one is that it overcomes the limitation about the relationship between the dimension parameter and the length of series. The second one is that the modified sample entropy functions can be used to quantitatively distinguish time series from different complex systems by the similar measure.

Defense Standardization Program Journal, January/March 2013

DTIC Science & Technology

2013-03-01

image plane , representing half the distance across the iris along the horizontal Pupil-to-iris ratio Degree to which the pupil is dilated or constricted... the Poincare indices, ori- entation zone coherences, entropy of local orientations, and core orien- tation field masks Number of deltas Detected deltas...based on the combination of the Poincare indices, ori- entation zone coherences, entropy of local orientations, and delta ori- entation field masks

Entropy in molecular recognition by proteins

PubMed Central

Caro, José A.; Harpole, Kyle W.; Kasinath, Vignesh; Lim, Jackwee; Granja, Jeffrey; Valentine, Kathleen G.; Sharp, Kim A.

2017-01-01

Molecular recognition by proteins is fundamental to molecular biology. Dissection of the thermodynamic energy terms governing protein–ligand interactions has proven difficult, with determination of entropic contributions being particularly elusive. NMR relaxation measurements have suggested that changes in protein conformational entropy can be quantitatively obtained through a dynamical proxy, but the generality of this relationship has not been shown. Twenty-eight protein–ligand complexes are used to show a quantitative relationship between measures of fast side-chain motion and the underlying conformational entropy. We find that the contribution of conformational entropy can range from favorable to unfavorable, which demonstrates the potential of this thermodynamic variable to modulate protein–ligand interactions. For about one-quarter of these complexes, the absence of conformational entropy would render the resulting affinity biologically meaningless. The dynamical proxy for conformational entropy or “entropy meter” also allows for refinement of the contributions of solvent entropy and the loss in rotational-translational entropy accompanying formation of high-affinity complexes. Furthermore, structure-based application of the approach can also provide insight into long-lived specific water–protein interactions that escape the generic treatments of solvent entropy based simply on changes in accessible surface area. These results provide a comprehensive and unified view of the general role of entropy in high-affinity molecular recognition by proteins. PMID:28584100

Entropy in molecular recognition by proteins.

PubMed

Caro, José A; Harpole, Kyle W; Kasinath, Vignesh; Lim, Jackwee; Granja, Jeffrey; Valentine, Kathleen G; Sharp, Kim A; Wand, A Joshua

2017-06-20

Molecular recognition by proteins is fundamental to molecular biology. Dissection of the thermodynamic energy terms governing protein-ligand interactions has proven difficult, with determination of entropic contributions being particularly elusive. NMR relaxation measurements have suggested that changes in protein conformational entropy can be quantitatively obtained through a dynamical proxy, but the generality of this relationship has not been shown. Twenty-eight protein-ligand complexes are used to show a quantitative relationship between measures of fast side-chain motion and the underlying conformational entropy. We find that the contribution of conformational entropy can range from favorable to unfavorable, which demonstrates the potential of this thermodynamic variable to modulate protein-ligand interactions. For about one-quarter of these complexes, the absence of conformational entropy would render the resulting affinity biologically meaningless. The dynamical proxy for conformational entropy or "entropy meter" also allows for refinement of the contributions of solvent entropy and the loss in rotational-translational entropy accompanying formation of high-affinity complexes. Furthermore, structure-based application of the approach can also provide insight into long-lived specific water-protein interactions that escape the generic treatments of solvent entropy based simply on changes in accessible surface area. These results provide a comprehensive and unified view of the general role of entropy in high-affinity molecular recognition by proteins.

Noise and Complexity in Human Postural Control: Interpreting the Different Estimations of Entropy

PubMed Central

Rhea, Christopher K.; Silver, Tobin A.; Hong, S. Lee; Ryu, Joong Hyun; Studenka, Breanna E.; Hughes, Charmayne M. L.; Haddad, Jeffrey M.

2011-01-01

Background Over the last two decades, various measures of entropy have been used to examine the complexity of human postural control. In general, entropy measures provide information regarding the health, stability and adaptability of the postural system that is not captured when using more traditional analytical techniques. The purpose of this study was to examine how noise, sampling frequency and time series length influence various measures of entropy when applied to human center of pressure (CoP) data, as well as in synthetic signals with known properties. Such a comparison is necessary to interpret data between and within studies that use different entropy measures, equipment, sampling frequencies or data collection durations. Methods and Findings The complexity of synthetic signals with known properties and standing CoP data was calculated using Approximate Entropy (ApEn), Sample Entropy (SampEn) and Recurrence Quantification Analysis Entropy (RQAEn). All signals were examined at varying sampling frequencies and with varying amounts of added noise. Additionally, an increment time series of the original CoP data was examined to remove long-range correlations. Of the three measures examined, ApEn was the least robust to sampling frequency and noise manipulations. Additionally, increased noise led to an increase in SampEn, but a decrease in RQAEn. Thus, noise can yield inconsistent results between the various entropy measures. Finally, the differences between the entropy measures were minimized in the increment CoP data, suggesting that long-range correlations should be removed from CoP data prior to calculating entropy. Conclusions The various algorithms typically used to quantify the complexity (entropy) of CoP may yield very different results, particularly when sampling frequency and noise are different. The results of this study are discussed within the context of the neural noise and loss of complexity hypotheses. PMID:21437281

Modular Hamiltonians on the null plane and the Markov property of the vacuum state

NASA Astrophysics Data System (ADS)

Casini, Horacio; Testé, Eduardo; Torroba, Gonzalo

2017-09-01

We compute the modular Hamiltonians of regions having the future horizon lying on a null plane. For a CFT this is equivalent to regions with a boundary of arbitrary shape lying on the null cone. These Hamiltonians have a local expression on the horizon formed by integrals of the stress tensor. We prove this result in two different ways, and show that the modular Hamiltonians of these regions form an infinite dimensional Lie algebra. The corresponding group of unitary transformations moves the fields on the null surface locally along the null generators with arbitrary null line dependent velocities, but act non-locally outside the null plane. We regain this result in greater generality using more abstract tools on the algebraic quantum field theory. Finally, we show that modular Hamiltonians on the null surface satisfy a Markov property that leads to the saturation of the strong sub-additive inequality for the entropies and to the strong super-additivity of the relative entropy.

Power-law scaling for macroscopic entropy and microscopic complexity: Evidence from human movement and posture

NASA Astrophysics Data System (ADS)

Hong, S. Lee; Bodfish, James W.; Newell, Karl M.

2006-03-01

We investigated the relationship between macroscopic entropy and microscopic complexity of the dynamics of body rocking and sitting still across adults with stereotyped movement disorder and mental retardation (profound and severe) against controls matched for age, height, and weight. This analysis was performed through the examination of center of pressure (COP) motion on the mediolateral (side-to-side) and anteroposterior (fore-aft) dimensions and the entropy of the relative phase between the two dimensions of motion. Intentional body rocking and stereotypical body rocking possessed similar slopes for their respective frequency spectra, but differences were revealed during maintenance of sitting postures. The dynamics of sitting in the control group produced lower spectral slopes and higher complexity (approximate entropy). In the controls, the higher complexity found on each dimension of motion was related to a weaker coupling between dimensions. Information entropy of the relative phase between the two dimensions of COP motion and irregularity (complexity) of their respective motions fitted a power-law function, revealing a relationship between macroscopic entropy and microscopic complexity across both groups and behaviors. This power-law relation affords the postulation that the organization of movement and posture dynamics occurs as a fractal process.

How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems.

PubMed

Hanel, Rudolf; Thurner, Stefan; Gell-Mann, Murray

2014-05-13

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and Markovian systems in statistical mechanics, information theory, and statistics. For several decades there has been an ongoing controversy over whether the notion of the maximum entropy principle can be extended in a meaningful way to nonextensive, nonergodic, and complex statistical systems and processes. In this paper we start by reviewing how Boltzmann-Gibbs-Shannon entropy is related to multiplicities of independent random processes. We then show how the relaxation of independence naturally leads to the most general entropies that are compatible with the first three Shannon-Khinchin axioms, the (c,d)-entropies. We demonstrate that the MEP is a perfectly consistent concept for nonergodic and complex statistical systems if their relative entropy can be factored into a generalized multiplicity and a constraint term. The problem of finding such a factorization reduces to finding an appropriate representation of relative entropy in a linear basis. In a particular example we show that path-dependent random processes with memory naturally require specific generalized entropies. The example is to our knowledge the first exact derivation of a generalized entropy from the microscopic properties of a path-dependent random process.

Quantifying complexity of financial short-term time series by composite multiscale entropy measure

NASA Astrophysics Data System (ADS)

Niu, Hongli; Wang, Jun

2015-05-01

It is significant to study the complexity of financial time series since the financial market is a complex evolved dynamic system. Multiscale entropy is a prevailing method used to quantify the complexity of a time series. Due to its less reliability of entropy estimation for short-term time series at large time scales, a modification method, the composite multiscale entropy, is applied to the financial market. To qualify its effectiveness, its applications in the synthetic white noise and 1 / f noise with different data lengths are reproduced first in the present paper. Then it is introduced for the first time to make a reliability test with two Chinese stock indices. After conducting on short-time return series, the CMSE method shows the advantages in reducing deviations of entropy estimation and demonstrates more stable and reliable results when compared with the conventional MSE algorithm. Finally, the composite multiscale entropy of six important stock indices from the world financial markets is investigated, and some useful and interesting empirical results are obtained.

Entropy in an expanding universe.

PubMed

Frautschi, S

1982-08-13

The question of how the observed evolution of organized structures from initial chaos in the expanding universe can be reconciled with the laws of statistical mechanics is studied, with emphasis on effects of the expansion and gravity. Some major sources of entropy increase are listed. An expanding "causal" region is defined in which the entropy, though increasing, tends to fall further and further behind its maximum possible value, thus allowing for the development of order. The related questions of whether entropy will continue increasing without limit in the future, and whether such increase in the form of Hawking radiation or radiation from positronium might enable life to maintain itself permanently, are considered. Attempts to find a scheme for preserving life based on solid structures fail because events such as quantum tunneling recurrently disorganize matter on a very long but fixed time scale, whereas all energy sources slow down progressively in an expanding universe. However, there remains hope that other modes of life capable of maintaining themselves permanently can be found.

Emergent 1d Ising Behavior in AN Elementary Cellular Automaton Model

NASA Astrophysics Data System (ADS)

Kassebaum, Paul G.; Iannacchione, Germano S.

The fundamental nature of an evolving one-dimensional (1D) Ising model is investigated with an elementary cellular automaton (CA) simulation. The emergent CA simulation employs an ensemble of cells in one spatial dimension, each cell capable of two microstates interacting with simple nearest-neighbor rules and incorporating an external field. The behavior of the CA model provides insight into the dynamics of coupled two-state systems not expressible by exact analytical solutions. For instance, state progression graphs show the causal dynamics of a system through time in relation to the system's entropy. Unique graphical analysis techniques are introduced through difference patterns, diffusion patterns, and state progression graphs of the 1D ensemble visualizing the evolution. All analyses are consistent with the known behavior of the 1D Ising system. The CA simulation and new pattern recognition techniques are scalable (in both dimension, complexity, and size) and have many potential applications such as complex design of materials, control of agent systems, and evolutionary mechanism design.

Refined generalized multiscale entropy analysis for physiological signals

NASA Astrophysics Data System (ADS)

Liu, Yunxiao; Lin, Youfang; Wang, Jing; Shang, Pengjian

2018-01-01

Multiscale entropy analysis has become a prevalent complexity measurement and been successfully applied in various fields. However, it only takes into account the information of mean values (first moment) in coarse-graining procedure. Then generalized multiscale entropy (MSEn) considering higher moments to coarse-grain a time series was proposed and MSEσ2 has been implemented. However, the MSEσ2 sometimes may yield an imprecise estimation of entropy or undefined entropy, and reduce statistical reliability of sample entropy estimation as scale factor increases. For this purpose, we developed the refined model, RMSEσ2, to improve MSEσ2. Simulations on both white noise and 1 / f noise show that RMSEσ2 provides higher entropy reliability and reduces the occurrence of undefined entropy, especially suitable for short time series. Besides, we discuss the effect on RMSEσ2 analysis from outliers, data loss and other concepts in signal processing. We apply the proposed model to evaluate the complexity of heartbeat interval time series derived from healthy young and elderly subjects, patients with congestive heart failure and patients with atrial fibrillation respectively, compared to several popular complexity metrics. The results demonstrate that RMSEσ2 measured complexity (a) decreases with aging and diseases, and (b) gives significant discrimination between different physiological/pathological states, which may facilitate clinical application.

Rényi entropy of the totally asymmetric exclusion process

NASA Astrophysics Data System (ADS)

Wood, Anthony J.; Blythe, Richard A.; Evans, Martin R.

2017-11-01

The Rényi entropy is a generalisation of the Shannon entropy that is sensitive to the fine details of a probability distribution. We present results for the Rényi entropy of the totally asymmetric exclusion process (TASEP). We calculate explicitly an entropy whereby the squares of configuration probabilities are summed, using the matrix product formalism to map the problem to one involving a six direction lattice walk in the upper quarter plane. We derive the generating function across the whole phase diagram, using an obstinate kernel method. This gives the leading behaviour of the Rényi entropy and corrections in all phases of the TASEP. The leading behaviour is given by the result for a Bernoulli measure and we conjecture that this holds for all Rényi entropies. Within the maximal current phase the correction to the leading behaviour is logarithmic in the system size. Finally, we remark upon a special property of equilibrium systems whereby discontinuities in the Rényi entropy arise away from phase transitions, which we refer to as secondary transitions. We find no such secondary transition for this nonequilibrium system, supporting the notion that these are specific to equilibrium cases.

A new strategy for array optimization applied to Brazilian Decimetric Array

NASA Astrophysics Data System (ADS)

Faria, C.; Stephany, S.; Sawant, H. S.

Radio interferometric arrays measure the Fourier transform of the sky brightness distribution in a finite set of points that are determined by the cross-correlation of different pairs of antennas of the array The sky brightness distribution is reconstructed by the inverse Fourier transform of the sampled visibilities The quality of the reconstructed images strongly depends on the array configuration since it determines the sampling function and therefore the points in the Fourier Plane This work proposes a new optimization strategy for the array configuration that is based on the entropy of the distribution of the samples points in the Fourier plane A stochastic optimizer the Ant Colony Optimization employs entropy of the point distribution in the Fourier plane to iteratively refine the candidate solutions The proposed strategy was developed for the Brazilian Decimetric Array BDA a radio interferometric array that is currently being developed for solar observations at the Brazilian Institute for Space Research Configurations results corresponding to the Fourier plane coverage synthesized beam and side lobes levels are shown for an optimized BDA configuration obtained with the proposed strategy and compared to the results for a standard T array configuration that was originally proposed

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy.

PubMed

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

Characterization of complexity in the electroencephalograph activity of Alzheimer's disease based on fuzzy entropy

NASA Astrophysics Data System (ADS)

Cao, Yuzhen; Cai, Lihui; Wang, Jiang; Wang, Ruofan; Yu, Haitao; Cao, Yibin; Liu, Jing

2015-08-01

In this paper, experimental neurophysiologic recording and statistical analysis are combined to investigate the nonlinear characteristic and the cognitive function of the brain. Fuzzy approximate entropy and fuzzy sample entropy are applied to characterize the model-based simulated series and electroencephalograph (EEG) series of Alzheimer's disease (AD). The effectiveness and advantages of these two kinds of fuzzy entropy are first verified through the simulated EEG series generated by the alpha rhythm model, including stronger relative consistency and robustness. Furthermore, in order to detect the abnormality of irregularity and chaotic behavior in the AD brain, the complexity features based on these two fuzzy entropies are extracted in the delta, theta, alpha, and beta bands. It is demonstrated that, due to the introduction of fuzzy set theory, the fuzzy entropies could better distinguish EEG signals of AD from that of the normal than the approximate entropy and sample entropy. Moreover, the entropy values of AD are significantly decreased in the alpha band, particularly in the temporal brain region, such as electrode T3 and T4. In addition, fuzzy sample entropy could achieve higher group differences in different brain regions and higher average classification accuracy of 88.1% by support vector machine classifier. The obtained results prove that fuzzy sample entropy may be a powerful tool to characterize the complexity abnormalities of AD, which could be helpful in further understanding of the disease.

Singular spectrum and singular entropy used in signal processing of NC table

NASA Astrophysics Data System (ADS)

Wang, Linhong; He, Yiwen

2011-12-01

NC (numerical control) table is a complex dynamic system. The dynamic characteristics caused by backlash, friction and elastic deformation among each component are so complex that they have become the bottleneck of enhancing the positioning accuracy, tracking accuracy and dynamic behavior of NC table. This paper collects vibration acceleration signals from NC table, analyzes the signals with SVD (singular value decomposition) method, acquires the singular spectrum and calculates the singular entropy of the signals. The signal characteristics and their regulations of NC table are revealed via the characteristic quantities such as singular spectrum, singular entropy etc. The steep degrees of singular spectrums can be used to discriminate complex degrees of signals. The results show that the signals in direction of driving axes are the simplest and the signals in perpendicular direction are the most complex. The singular entropy values can be used to study the indetermination of signals. The results show that the signals of NC table are not simple signal nor white noise, the entropy values in direction of driving axe are lower, the entropy values increase along with the increment of driving speed and the entropy values at the abnormal working conditions such as resonance or creeping etc decrease obviously.

An application of sample entropy to precipitation in Paraíba State, Brazil

NASA Astrophysics Data System (ADS)

Xavier, Sílvio Fernando Alves; da Silva Jale, Jader; Stosic, Tatijana; dos Santos, Carlos Antonio Costa; Singh, Vijay P.

2018-05-01

A climate system is characterized to be a complex non-linear system. In order to describe the complex characteristics of precipitation series in Paraíba State, Brazil, we aim the use of sample entropy, a kind of entropy-based algorithm, to evaluate the complexity of precipitation series. Sixty-nine meteorological stations are distributed over four macroregions: Zona da Mata, Agreste, Borborema, and Sertão. The results of the analysis show that intricacies of monthly average precipitation have differences in the macroregions. Sample entropy is able to reflect the dynamic change of precipitation series providing a new way to investigate complexity of hydrological series. The complexity exhibits areal variation of local water resource systems which can influence the basis for utilizing and developing resources in dry areas.

Dynamical complexity of short and noisy time series. Compression-Complexity vs. Shannon entropy

NASA Astrophysics Data System (ADS)

Nagaraj, Nithin; Balasubramanian, Karthi

2017-07-01

Shannon entropy has been extensively used for characterizing complexity of time series arising from chaotic dynamical systems and stochastic processes such as Markov chains. However, for short and noisy time series, Shannon entropy performs poorly. Complexity measures which are based on lossless compression algorithms are a good substitute in such scenarios. We evaluate the performance of two such Compression-Complexity Measures namely Lempel-Ziv complexity (LZ) and Effort-To-Compress (ETC) on short time series from chaotic dynamical systems in the presence of noise. Both LZ and ETC outperform Shannon entropy (H) in accurately characterizing the dynamical complexity of such systems. For very short binary sequences (which arise in neuroscience applications), ETC has higher number of distinct complexity values than LZ and H, thus enabling a finer resolution. For two-state ergodic Markov chains, we empirically show that ETC converges to a steady state value faster than LZ. Compression-Complexity measures are promising for applications which involve short and noisy time series.

Spacetime thermodynamics in the presence of torsion

NASA Astrophysics Data System (ADS)

Dey, Ramit; Liberati, Stefano; Pranzetti, Daniele

2017-12-01

It was shown by Jacobson in 1995 that the Einstein equation can be derived as a local constitutive equation for an equilibrium spacetime thermodynamics. With the aim to understand if such thermodynamical description is an intrinsic property of gravitation, many attempts have been made so far to generalize this treatment to a broader class of gravitational theories. Here we consider the case of the Einstein-Cartan theory as a prototype of theories with nonpropagating torsion. In doing so, we study the properties of Killing horizons in the presence of torsion, establish the notion of local causal horizon in Riemann-Cartan spacetimes, and derive the generalized Raychaudhuri equation for these kinds of geometries. Then, starting with the entropy that can be associated to these local causal horizons, we derive the Einstein-Cartan equation by implementing the Clausius equation. We outline two ways of proceeding with the derivation depending on whether we take torsion as a geometric field or as a matter field. In both cases we need to add internal entropy production terms to the Clausius equation as the shear and twist cannot be taken to be 0 a priori for our setup. This fact implies the necessity of a nonequilibrium thermodynamics treatment for the local causal horizon. Furthermore, it implies that a nonzero twist at the horizon in general contributes to the Hartle-Hawking tidal heating for black holes with possible implications for future observations.

On the role of the entorhinal cortex in the effective connectivity of the hippocampal formation.

PubMed

López-Madrona, Víctor J; Matias, Fernanda S; Pereda, Ernesto; Canals, Santiago; Mirasso, Claudio R

2017-04-01

Inferring effective connectivity from neurophysiological data is a challenging task. In particular, only a finite (and usually small) number of sites are simultaneously recorded, while the response of one of these sites can be influenced by other sites that are not being recorded. In the hippocampal formation, for instance, the connections between areas CA1-CA3, the dentate gyrus (DG), and the entorhinal cortex (EC) are well established. However, little is known about the relations within the EC layers, which might strongly affect the resulting effective connectivity estimations. In this work, we build excitatory/inhibitory neuronal populations representing the four areas CA1, CA3, the DG, and the EC and fix their connectivities. We model the EC by three layers (LII, LIII, and LV) and assume any possible connection between them. Our results, based on Granger Causality (GC) and Partial Transfer Entropy (PTE) measurements, reveal that the estimation of effective connectivity in the hippocampus strongly depends on the connectivities between EC layers. Moreover, we find, for certain EC configurations, very different results when comparing GC and PTE measurements. We further demonstrate that causal links can be robustly inferred regardless of the excitatory or inhibitory nature of the connection, adding complexity to their interpretation. Overall, our work highlights the importance of a careful analysis of the connectivity methods to prevent unrealistic conclusions when only partial information about the experimental system is available, as usually happens in brain networks. Our results suggest that the combination of causality measures with neuronal modeling based on precise neuroanatomical tracing may provide a powerful framework to disambiguate causal interactions in the brain.

Dynamic NMR study of ethene exchange in cationic CNN-type platinum(II) complexes.

PubMed

Plutino, M Rosaria; Fenech, Lucia; Stoccoro, Sergio; Rizzato, Silvia; Castellano, Carlo; Albinati, Alberto

2010-01-18

Cationic ethylene platinum(II) complexes of the type [Pt(CNN)(C(2)H(4))](+), containing a methyl fragment and different diimines (NN), or terdentate (kappaC-kappa(2)NN') anionic ligands, were synthesized and fully characterized both as solids and in solution [NN = 2,2'-dipyridylamine, 1; 2,2'-dipyridylsulfide, 2; 1,10-phenanthroline, 3; 4,7-diphenyl-1,10-phenanthroline, 4; 3,4,7,8-tetramethyl-1,10-phenanthroline, 5; 2,2'-bipyridine, 6; HC-NN = 6-tert-butyl-2,2'-bipyridine, 7; 6-neo-pentyl-2,2'-bipyridine, 8; 6-phenyl-2,2'-bipyridine, 9; 6-(alpha-methyl)benzyl-2,2'-bipyridine, 10; 6-(alpha-ethyl)benzyl-2,2'-bipyridine, 11; 6-(alpha,alpha-dimethyl)benzyl-2,2'-bipyridine, 12]. Crystals suitable for X-ray analysis of complexes 5 and 7 were obtained. Ethene exchange at the cyclometalated platinum(II) complexes 7, 8, and 10-12 was studied by (1)H NMR line-broadening experiments in chloroform-d, as a function of both temperature and olefin concentrations. For the other prepared complexes the process was too fast to be monitored on the NMR time scale even at the lowest temperature. The ethylene exchange rates show a linear dependence on the concentration of the free ligand, with a negligible k(1) term indicating that either a solvolytic or a dissociative pathway to the products is absent or negligible. The values of the second-order rate constants k(exc), as obtained by linear regression analysis of the experimental data at 298 K, are in a range of ca. 10(4)-10(5) s(-1) m(-1). The activation entropies are negative, ranging between -129 and -112 J K(-1) mol(-1), as expected for associative processes. The activation process is largely entropy controlled: the TDeltaS()() contribution to the free energy of activation is extremely large, amounting to more than 80% for all complexes, with a smaller enthalpy contribution. All the experimental findings evidence that the mechanism takes place via an associative attack by the entering olefin, through a well-ordered, stable pentacoordinated transition state with the two ethene molecules on the trigonal plane. The reactivity of [Pt(CNN)(C(2)H(4))](+) complexes is strongly dependent on the choice of coordinated 6-substituted-2,2'-bipyridines, especially when the terdentate anionic fragment is capable of generating steric crowding and congestion on the coordination plane.

Filter-based multiscale entropy analysis of complex physiological time series.

PubMed

Xu, Yuesheng; Zhao, Liang

2013-08-01

Multiscale entropy (MSE) has been widely and successfully used in analyzing the complexity of physiological time series. We reinterpret the averaging process in MSE as filtering a time series by a filter of a piecewise constant type. From this viewpoint, we introduce filter-based multiscale entropy (FME), which filters a time series to generate multiple frequency components, and then we compute the blockwise entropy of the resulting components. By choosing filters adapted to the feature of a given time series, FME is able to better capture its multiscale information and to provide more flexibility for studying its complexity. Motivated by the heart rate turbulence theory, which suggests that the human heartbeat interval time series can be described in piecewise linear patterns, we propose piecewise linear filter multiscale entropy (PLFME) for the complexity analysis of the time series. Numerical results from PLFME are more robust to data of various lengths than those from MSE. The numerical performance of the adaptive piecewise constant filter multiscale entropy without prior information is comparable to that of PLFME, whose design takes prior information into account.

Processing of positive-causal and negative-causal coherence relations in primary school children and adults: a test of the cumulative cognitive complexity approach in German.

PubMed

Knoepke, Julia; Richter, Tobias; Isberner, Maj-Britt; Naumann, Johannes; Neeb, Yvonne; Weinert, Sabine

2017-03-01

Establishing local coherence relations is central to text comprehension. Positive-causal coherence relations link a cause and its consequence, whereas negative-causal coherence relations add a contrastive meaning (negation) to the causal link. According to the cumulative cognitive complexity approach, negative-causal coherence relations are cognitively more complex than positive-causal ones. Therefore, they require greater cognitive effort during text comprehension and are acquired later in language development. The present cross-sectional study tested these predictions for German primary school children from Grades 1 to 4 and adults in reading and listening comprehension. Accuracy data in a semantic verification task support the predictions of the cumulative cognitive complexity approach. Negative-causal coherence relations are cognitively more demanding than positive-causal ones. Moreover, our findings indicate that children's comprehension of negative-causal coherence relations continues to develop throughout the course of primary school. Findings are discussed with respect to the generalizability of the cumulative cognitive complexity approach to German.

Averaged null energy condition from causality

DOE PAGES

Hartman, Thomas; Kundu, Sandipan; Tajdini, Amirhossein

2017-07-14

Unitary, Lorentz-invariant quantum field theories in at spacetime obey mi-crocausality: commutators vanish at spacelike separation. For interacting theories in more than two dimensions, we show that this implies that the averaged null energy,more » $$\\int$$duT uu, must be non-negative. This non-local operator appears in the operator product expansion of local operators in the lightcone limit, and therefore contributes to n-point functions. We derive a sum rule that isolates this contribution and is manifestly positive. The argument also applies to certain higher spin operators other than the stress tensor, generating an infinite family of new constraints of the form RduX uuu∙∙∙u ≥ 0. These lead to new inequalities for the coupling constants of spinning operators in conformal field theory, which include as special cases (but are generally stronger than) the existing constraints from the lightcone bootstrap, deep inelastic scattering, conformal collider methods, and relative entropy. We also comment on the relation to the recent derivation of the averaged null energy condition from relative entropy, and suggest a more general connection between causality and information-theoretic inequalities in QFT.« less

Averaged null energy condition from causality

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hartman, Thomas; Kundu, Sandipan; Tajdini, Amirhossein

Unitary, Lorentz-invariant quantum field theories in at spacetime obey mi-crocausality: commutators vanish at spacelike separation. For interacting theories in more than two dimensions, we show that this implies that the averaged null energy,more » $$\\int$$duT uu, must be non-negative. This non-local operator appears in the operator product expansion of local operators in the lightcone limit, and therefore contributes to n-point functions. We derive a sum rule that isolates this contribution and is manifestly positive. The argument also applies to certain higher spin operators other than the stress tensor, generating an infinite family of new constraints of the form RduX uuu∙∙∙u ≥ 0. These lead to new inequalities for the coupling constants of spinning operators in conformal field theory, which include as special cases (but are generally stronger than) the existing constraints from the lightcone bootstrap, deep inelastic scattering, conformal collider methods, and relative entropy. We also comment on the relation to the recent derivation of the averaged null energy condition from relative entropy, and suggest a more general connection between causality and information-theoretic inequalities in QFT.« less

Averaged null energy condition from causality

NASA Astrophysics Data System (ADS)

Hartman, Thomas; Kundu, Sandipan; Tajdini, Amirhossein

2017-07-01

Unitary, Lorentz-invariant quantum field theories in flat spacetime obey mi-crocausality: commutators vanish at spacelike separation. For interacting theories in more than two dimensions, we show that this implies that the averaged null energy, ∫ duT uu , must be non-negative. This non-local operator appears in the operator product expansion of local operators in the lightcone limit, and therefore contributes to n-point functions. We derive a sum rule that isolates this contribution and is manifestly positive. The argument also applies to certain higher spin operators other than the stress tensor, generating an infinite family of new constraints of the form ∫ duX uuu··· u ≥ 0. These lead to new inequalities for the coupling constants of spinning operators in conformal field theory, which include as special cases (but are generally stronger than) the existing constraints from the lightcone bootstrap, deep inelastic scattering, conformal collider methods, and relative entropy. We also comment on the relation to the recent derivation of the averaged null energy condition from relative entropy, and suggest a more general connection between causality and information-theoretic inequalities in QFT.

Shearlet-based measures of entropy and complexity for two-dimensional patterns

NASA Astrophysics Data System (ADS)

Brazhe, Alexey

2018-06-01

New spatial entropy and complexity measures for two-dimensional patterns are proposed. The approach is based on the notion of disequilibrium and is built on statistics of directional multiscale coefficients of the fast finite shearlet transform. Shannon entropy and Jensen-Shannon divergence measures are employed. Both local and global spatial complexity and entropy estimates can be obtained, thus allowing for spatial mapping of complexity in inhomogeneous patterns. The algorithm is validated in numerical experiments with a gradually decaying periodic pattern and Ising surfaces near critical state. It is concluded that the proposed algorithm can be instrumental in describing a wide range of two-dimensional imaging data, textures, or surfaces, where an understanding of the level of order or randomness is desired.

Non-uniform multivariate embedding to assess the information transfer in cardiovascular and cardiorespiratory variability series.

PubMed

Faes, Luca; Nollo, Giandomenico; Porta, Alberto

2012-03-01

The complexity of the short-term cardiovascular control prompts for the introduction of multivariate (MV) nonlinear time series analysis methods to assess directional interactions reflecting the underlying regulatory mechanisms. This study introduces a new approach for the detection of nonlinear Granger causality in MV time series, based on embedding the series by a sequential, non-uniform procedure, and on estimating the information flow from one series to another by means of the corrected conditional entropy. The approach is validated on short realizations of linear stochastic and nonlinear deterministic processes, and then evaluated on heart period, systolic arterial pressure and respiration variability series measured from healthy humans in the resting supine position and in the upright position after head-up tilt. Copyright © 2011 Elsevier Ltd. All rights reserved.

Three faces of entropy for complex systems: Information, thermodynamics, and the maximum entropy principle

NASA Astrophysics Data System (ADS)

Thurner, Stefan; Corominas-Murtra, Bernat; Hanel, Rudolf

2017-09-01

There are at least three distinct ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a means for statistical inference on multinomial processes (Jaynes maximum entropy principle). Even though these notions represent fundamentally different concepts, the functional form of the entropy for thermodynamic systems in equilibrium, for ergodic sources in information theory, and for independent sampling processes in statistical systems, is degenerate, H (p ) =-∑ipilogpi . For many complex systems, which are typically history-dependent, nonergodic, and nonmultinomial, this is no longer the case. Here we show that for such processes, the three entropy concepts lead to different functional forms of entropy, which we will refer to as SEXT for extensive entropy, SIT for the source information rate in information theory, and SMEP for the entropy functional that appears in the so-called maximum entropy principle, which characterizes the most likely observable distribution functions of a system. We explicitly compute these three entropy functionals for three concrete examples: for Pólya urn processes, which are simple self-reinforcing processes, for sample-space-reducing (SSR) processes, which are simple history dependent processes that are associated with power-law statistics, and finally for multinomial mixture processes.

Evaluation of spectral entropy to measure anaesthetic depth and antinociception in sevoflurane-anaesthetised Beagle dogs.

PubMed

Morgaz, Juan; Granados, María del Mar; Domínguez, Juan Manuel; Navarrete, Rocío; Fernández, Andrés; Galán, Alba; Muñoz, Pilar; Gómez-Villamandos, Rafael J

2011-06-01

The use of spectral entropy to determine anaesthetic depth and antinociception was evaluated in sevoflurane-anaesthetised Beagle dogs. Dogs were anaesthetised at each of five multiples of their individual minimum alveolar concentrations (MAC; 0.75, 1, 1.25, 1.5 and 1.75 MAC), and response entropy (RE), state entropy (SE), RE-SE difference, burst suppression rate (BSR) and cardiorespiratory parameters were recorded before and after a painful stimulus. RE, SE and RE-SE difference did not change significantly after the stimuli. The correlation between MAC-entropy parameters was weak, but these values increased when 1.75 MAC results were excluded from the analysis. BSR was different to zero at 1.5 and 1.75 MAC. It was concluded that RE and RE-SE differences were not adequate indicators of antinociception and SE and RE were unable to detect deep planes of anaesthesia in dogs, although they both distinguished the awake and unconscious states. Copyright © 2010 Elsevier Ltd. All rights reserved.

Analysis of the Influence of Complexity and Entropy of Odorant on Fractal Dynamics and Entropy of EEG Signal.

PubMed

Namazi, Hamidreza; Akrami, Amin; Nazeri, Sina; Kulish, Vladimir V

2016-01-01

An important challenge in brain research is to make out the relation between the features of olfactory stimuli and the electroencephalogram (EEG) signal. Yet, no one has discovered any relation between the structures of olfactory stimuli and the EEG signal. This study investigates the relation between the structures of EEG signal and the olfactory stimulus (odorant). We show that the complexity of the EEG signal is coupled with the molecular complexity of the odorant, where more structurally complex odorant causes less fractal EEG signal. Also, odorant having higher entropy causes the EEG signal to have lower approximate entropy. The method discussed here can be applied and investigated in case of patients with brain diseases as the rehabilitation purpose.

Analysis of the Influence of Complexity and Entropy of Odorant on Fractal Dynamics and Entropy of EEG Signal

PubMed Central

Akrami, Amin; Nazeri, Sina

2016-01-01

An important challenge in brain research is to make out the relation between the features of olfactory stimuli and the electroencephalogram (EEG) signal. Yet, no one has discovered any relation between the structures of olfactory stimuli and the EEG signal. This study investigates the relation between the structures of EEG signal and the olfactory stimulus (odorant). We show that the complexity of the EEG signal is coupled with the molecular complexity of the odorant, where more structurally complex odorant causes less fractal EEG signal. Also, odorant having higher entropy causes the EEG signal to have lower approximate entropy. The method discussed here can be applied and investigated in case of patients with brain diseases as the rehabilitation purpose. PMID:27699169

Does horizon entropy satisfy a quantum null energy conjecture?

NASA Astrophysics Data System (ADS)

Fu, Zicao; Marolf, Donald

2016-12-01

A modern version of the idea that the area of event horizons gives 4G times an entropy is the Hubeny-Rangamani causal holographic information (CHI) proposal for holographic field theories. Given a region R of a holographic QFTs, CHI computes A/4G on a certain cut of an event horizon in the gravitational dual. The result is naturally interpreted as a coarse-grained entropy for the QFT. CHI is known to be finitely greater than the fine-grained Hubeny-Rangamani-Takayanagi (HRT) entropy when \\partial R lies on a Killing horizon of the QFT spacetime, and in this context satisfies other non-trivial properties expected of an entropy. Here we present evidence that it also satisfies the quantum null energy condition (QNEC), which bounds the second derivative of the entropy of a quantum field theory on one side of a non-expanding null surface by the flux of stress-energy across the surface. In particular, we show CHI to satisfy the QNEC in 1  +  1 holographic CFTs when evaluated in states dual to conical defects in AdS3. This surprising result further supports the idea that CHI defines a useful notion of coarse-grained holographic entropy, and suggests unprecedented bounds on the rate at which bulk horizon generators emerge from a caustic. To supplement our motivation, we include an appendix deriving a corresponding coarse-grained generalized second law for 1  +  1 holographic CFTs perturbatively coupled to dilaton gravity.

Exploring stability of entropy analysis for signal with different trends

NASA Astrophysics Data System (ADS)

Zhang, Yin; Li, Jin; Wang, Jun

2017-03-01

Considering the effects of environment disturbances and instrument systems, the actual detecting signals always are carrying different trends, which result in that it is difficult to accurately catch signals complexity. So choosing steady and effective analysis methods is very important. In this paper, we applied entropy measures-the base-scale entropy and approximate entropy to analyze signal complexity, and studied the effect of trends on the ideal signal and the heart rate variability (HRV) signals, that is, linear, periodic, and power-law trends which are likely to occur in actual signals. The results show that approximate entropy is unsteady when we embed different trends into the signals, so it is not suitable to analyze signal with trends. However, the base-scale entropy has preferable stability and accuracy for signal with different trends. So the base-scale entropy is an effective method to analyze the actual signals.

Mood states modulate complexity in heartbeat dynamics: A multiscale entropy analysis

NASA Astrophysics Data System (ADS)

Valenza, G.; Nardelli, M.; Bertschy, G.; Lanata, A.; Scilingo, E. P.

2014-07-01

This paper demonstrates that heartbeat complex dynamics is modulated by different pathological mental states. Multiscale entropy analysis was performed on R-R interval series gathered from the electrocardiogram of eight bipolar patients who exhibited mood states among depression, hypomania, and euthymia, i.e., good affective balance. Three different methodologies for the choice of the sample entropy radius value were also compared. We show that the complexity level can be used as a marker of mental states being able to discriminate among the three pathological mood states, suggesting to use heartbeat complexity as a more objective clinical biomarker for mental disorders.

Characterization of physiological networks in sleep apnea patients using artificial neural networks for Granger causality computation

NASA Astrophysics Data System (ADS)

Cárdenas, Jhon; Orjuela-Cañón, Alvaro D.; Cerquera, Alexander; Ravelo, Antonio

2017-11-01

Different studies have used Transfer Entropy (TE) and Granger Causality (GC) computation to quantify interconnection between physiological systems. These methods have disadvantages in parametrization and availability in analytic formulas to evaluate the significance of the results. Other inconvenience is related with the assumptions in the distribution of the models generated from the data. In this document, the authors present a way to measure the causality that connect the Central Nervous System (CNS) and the Cardiac System (CS) in people diagnosed with obstructive sleep apnea syndrome (OSA) before and during treatment with continuous positive air pressure (CPAP). For this purpose, artificial neural networks were used to obtain models for GC computation, based on time series of normalized powers calculated from electrocardiography (EKG) and electroencephalography (EEG) signals recorded in polysomnography (PSG) studies.

Towards thermodynamics of universal horizons in Einstein-æther theory.

PubMed

Berglund, Per; Bhattacharyya, Jishnu; Mattingly, David

2013-02-15

Holography grew out of black hole thermodynamics, which relies on the causal structure and general covariance of general relativity. In Einstein-æther theory, a generally covariant theory with a dynamical timelike unit vector, every solution breaks local Lorentz invariance, thereby grossly modifying the causal structure of gravity. However, there are still absolute causal boundaries, called "universal horizons," which are not Killing horizons yet obey a first law of black hole mechanics and must have an entropy if they do not violate a generalized second law. We couple a scalar field to the timelike vector and show via the tunneling approach that the universal horizon radiates as a blackbody at a fixed temperature, even if the scalar field equations also violate local Lorentz invariance. This suggests that the class of holographic theories may be much broader than currently assumed.

Effect of electron count and chemical complexity in the Ta-Nb-Hf-Zr-Ti high-entropy alloy superconductor.

PubMed

von Rohr, Fabian; Winiarski, Michał J; Tao, Jing; Klimczuk, Tomasz; Cava, Robert Joseph

2016-11-15

High-entropy alloys are made from random mixtures of principal elements on simple lattices, stabilized by a high mixing entropy. The recently discovered body-centered cubic (BCC) Ta-Nb-Hf-Zr-Ti high-entropy alloy superconductor appears to display properties of both simple crystalline intermetallics and amorphous materials; e.g., it has a well-defined superconducting transition along with an exceptional robustness against disorder. Here we show that the valence electron count dependence of the superconducting transition temperature in the high-entropy alloy falls between those of analogous simple solid solutions and amorphous materials and test the effect of alloy complexity on the superconductivity. We propose high-entropy alloys as excellent intermediate systems for studying superconductivity as it evolves between crystalline and amorphous materials.

Dynamical entropy via entropy of non-random matrices: application to stability and complexity in modelling ecosystems.

PubMed

Chakrabarti, C G; Ghosh, Koyel

2013-10-01

In the present paper we have first introduced a measure of dynamical entropy of an ecosystem on the basis of the dynamical model of the system. The dynamical entropy which depends on the eigenvalues of the community matrix of the system leads to a consistent measure of complexity of the ecosystem to characterize the dynamical behaviours such as the stability, instability and periodicity around the stationary states of the system. We have illustrated the theory with some model ecosystems. Copyright © 2013 Elsevier Inc. All rights reserved.

Studying the dynamics of interbeat interval time series of healthy and congestive heart failure subjects using scale based symbolic entropy analysis

PubMed Central

Awan, Imtiaz; Aziz, Wajid; Habib, Nazneen; Alowibdi, Jalal S.; Saeed, Sharjil; Nadeem, Malik Sajjad Ahmed; Shah, Syed Ahsin Ali

2018-01-01

Considerable interest has been devoted for developing a deeper understanding of the dynamics of healthy biological systems and how these dynamics are affected due to aging and disease. Entropy based complexity measures have widely been used for quantifying the dynamics of physical and biological systems. These techniques have provided valuable information leading to a fuller understanding of the dynamics of these systems and underlying stimuli that are responsible for anomalous behavior. The single scale based traditional entropy measures yielded contradictory results about the dynamics of real world time series data of healthy and pathological subjects. Recently the multiscale entropy (MSE) algorithm was introduced for precise description of the complexity of biological signals, which was used in numerous fields since its inception. The original MSE quantified the complexity of coarse-grained time series using sample entropy. The original MSE may be unreliable for short signals because the length of the coarse-grained time series decreases with increasing scaling factor τ, however, MSE works well for long signals. To overcome the drawback of original MSE, various variants of this method have been proposed for evaluating complexity efficiently. In this study, we have proposed multiscale normalized corrected Shannon entropy (MNCSE), in which instead of using sample entropy, symbolic entropy measure NCSE has been used as an entropy estimate. The results of the study are compared with traditional MSE. The effectiveness of the proposed approach is demonstrated using noise signals as well as interbeat interval signals from healthy and pathological subjects. The preliminary results of the study indicate that MNCSE values are more stable and reliable than original MSE values. The results show that MNCSE based features lead to higher classification accuracies in comparison with the MSE based features. PMID:29771977

Studying the dynamics of interbeat interval time series of healthy and congestive heart failure subjects using scale based symbolic entropy analysis.

PubMed

Awan, Imtiaz; Aziz, Wajid; Shah, Imran Hussain; Habib, Nazneen; Alowibdi, Jalal S; Saeed, Sharjil; Nadeem, Malik Sajjad Ahmed; Shah, Syed Ahsin Ali

2018-01-01

Considerable interest has been devoted for developing a deeper understanding of the dynamics of healthy biological systems and how these dynamics are affected due to aging and disease. Entropy based complexity measures have widely been used for quantifying the dynamics of physical and biological systems. These techniques have provided valuable information leading to a fuller understanding of the dynamics of these systems and underlying stimuli that are responsible for anomalous behavior. The single scale based traditional entropy measures yielded contradictory results about the dynamics of real world time series data of healthy and pathological subjects. Recently the multiscale entropy (MSE) algorithm was introduced for precise description of the complexity of biological signals, which was used in numerous fields since its inception. The original MSE quantified the complexity of coarse-grained time series using sample entropy. The original MSE may be unreliable for short signals because the length of the coarse-grained time series decreases with increasing scaling factor τ, however, MSE works well for long signals. To overcome the drawback of original MSE, various variants of this method have been proposed for evaluating complexity efficiently. In this study, we have proposed multiscale normalized corrected Shannon entropy (MNCSE), in which instead of using sample entropy, symbolic entropy measure NCSE has been used as an entropy estimate. The results of the study are compared with traditional MSE. The effectiveness of the proposed approach is demonstrated using noise signals as well as interbeat interval signals from healthy and pathological subjects. The preliminary results of the study indicate that MNCSE values are more stable and reliable than original MSE values. The results show that MNCSE based features lead to higher classification accuracies in comparison with the MSE based features.

n-Order and maximum fuzzy similarity entropy for discrimination of signals of different complexity: Application to fetal heart rate signals.

PubMed

Zaylaa, Amira; Oudjemia, Souad; Charara, Jamal; Girault, Jean-Marc

2015-09-01

This paper presents two new concepts for discrimination of signals of different complexity. The first focused initially on solving the problem of setting entropy descriptors by varying the pattern size instead of the tolerance. This led to the search for the optimal pattern size that maximized the similarity entropy. The second paradigm was based on the n-order similarity entropy that encompasses the 1-order similarity entropy. To improve the statistical stability, n-order fuzzy similarity entropy was proposed. Fractional Brownian motion was simulated to validate the different methods proposed, and fetal heart rate signals were used to discriminate normal from abnormal fetuses. In all cases, it was found that it was possible to discriminate time series of different complexity such as fractional Brownian motion and fetal heart rate signals. The best levels of performance in terms of sensitivity (90%) and specificity (90%) were obtained with the n-order fuzzy similarity entropy. However, it was shown that the optimal pattern size and the maximum similarity measurement were related to intrinsic features of the time series. Copyright © 2015 Elsevier Ltd. All rights reserved.

Causal Wave Propagation for Relativistic Massive Particles: Physical Asymptotics in Action

ERIC Educational Resources Information Center

Berry, M. V.

2012-01-01

Wavepackets representing relativistic quantum particles injected into a half-space, from a source that is switched on at a definite time, are represented by superpositions of plane waves that must include negative frequencies. Propagation is causal: it is a consequence of analyticity that at time t no part of the wave has travelled farther than…

Measuring Complexity and Predictability of Time Series with Flexible Multiscale Entropy for Sensor Networks

PubMed Central

Zhou, Renjie; Yang, Chen; Wan, Jian; Zhang, Wei; Guan, Bo; Xiong, Naixue

2017-01-01

Measurement of time series complexity and predictability is sometimes the cornerstone for proposing solutions to topology and congestion control problems in sensor networks. As a method of measuring time series complexity and predictability, multiscale entropy (MSE) has been widely applied in many fields. However, sample entropy, which is the fundamental component of MSE, measures the similarity of two subsequences of a time series with either zero or one, but without in-between values, which causes sudden changes of entropy values even if the time series embraces small changes. This problem becomes especially severe when the length of time series is getting short. For solving such the problem, we propose flexible multiscale entropy (FMSE), which introduces a novel similarity function measuring the similarity of two subsequences with full-range values from zero to one, and thus increases the reliability and stability of measuring time series complexity. The proposed method is evaluated on both synthetic and real time series, including white noise, 1/f noise and real vibration signals. The evaluation results demonstrate that FMSE has a significant improvement in reliability and stability of measuring complexity of time series, especially when the length of time series is short, compared to MSE and composite multiscale entropy (CMSE). The proposed method FMSE is capable of improving the performance of time series analysis based topology and traffic congestion control techniques. PMID:28383496

Measuring Complexity and Predictability of Time Series with Flexible Multiscale Entropy for Sensor Networks.

PubMed

Zhou, Renjie; Yang, Chen; Wan, Jian; Zhang, Wei; Guan, Bo; Xiong, Naixue

2017-04-06

Measurement of time series complexity and predictability is sometimes the cornerstone for proposing solutions to topology and congestion control problems in sensor networks. As a method of measuring time series complexity and predictability, multiscale entropy (MSE) has been widely applied in many fields. However, sample entropy, which is the fundamental component of MSE, measures the similarity of two subsequences of a time series with either zero or one, but without in-between values, which causes sudden changes of entropy values even if the time series embraces small changes. This problem becomes especially severe when the length of time series is getting short. For solving such the problem, we propose flexible multiscale entropy (FMSE), which introduces a novel similarity function measuring the similarity of two subsequences with full-range values from zero to one, and thus increases the reliability and stability of measuring time series complexity. The proposed method is evaluated on both synthetic and real time series, including white noise, 1/f noise and real vibration signals. The evaluation results demonstrate that FMSE has a significant improvement in reliability and stability of measuring complexity of time series, especially when the length of time series is short, compared to MSE and composite multiscale entropy (CMSE). The proposed method FMSE is capable of improving the performance of time series analysis based topology and traffic congestion control techniques.

Large rotating field entropy change in ErFeO3 single crystal with angular distribution contribution

NASA Astrophysics Data System (ADS)

Huang, Ruoxiang; Cao, Shixun; Ren, Wei; Zhan, Sheng; Kang, Baojuan; Zhang, Jincang

2013-10-01

We report the rotating field entropy of ErFeO3 single-crystal in a temperature range of 3-40 K. The giant magnetic entropy change, ΔSM = -20.7 J/(kg K), and the refrigerant capacity, RC = 273.5 J/kg, are observed near T =6 K. The anisotropic constants at 6 K, K1 = 1.24× 103 J/kg, K2 = 0.74 × 103 J/kg, in the bc plane are obtained. By considering the magnetocrystalline anisotropy and Fermi-Dirac angular distribution along the orientation of spontaneous magnetization, the experimental results can be well simulated. Our present work demonstrates that ErFeO3 crystal may find practical use for low temperature anisotropic magnetic refrigeration.

Respiration and heart rate complexity: Effects of age and gender assessed by band-limited transfer entropy

PubMed Central

Nemati, Shamim; Edwards, Bradley A.; Lee, Joon; Pittman-Polletta, Benjamin; Butler, James P.; Malhotra, Atul

2013-01-01

Aging and disease are accompanied with a reduction of complex variability in the temporal patterns of heart rate. This reduction has been attributed to a break down of the underlying regulatory feedback mechanisms that maintain a homeodynamic state. Previous work has established the utility of entropy as an index of disorder, for quantification of changes in heart rate complexity. However, questions remain regarding the origin of heart rate complexity and the mechanisms involved in its reduction with aging and disease. In this work we use a newly developed technique based on the concept of band-limited transfer entropy to assess the aging-related changes in contribution of respiration and blood pressure to entropy of heart rate at different frequency bands. Noninvasive measurements of heart beat interval, respiration, and systolic blood pressure were recorded from 20 young (21–34 years) and 20 older (68–85 years) healthy adults. Band-limited transfer entropy analysis revealed a reduction in high-frequency contribution of respiration to heart rate complexity (p < 0.001) with normal aging, particularly in men. These results have the potential for dissecting the relative contributions of respiration and blood pressure-related reflexes to heart rate complexity and their degeneration with normal aging. PMID:23811194

Decreased resting-state brain activity complexity in schizophrenia characterized by both increased regularity and randomness.

PubMed

Yang, Albert C; Hong, Chen-Jee; Liou, Yin-Jay; Huang, Kai-Lin; Huang, Chu-Chung; Liu, Mu-En; Lo, Men-Tzung; Huang, Norden E; Peng, Chung-Kang; Lin, Ching-Po; Tsai, Shih-Jen

2015-06-01

Schizophrenia is characterized by heterogeneous pathophysiology. Using multiscale entropy (MSE) analysis, which enables capturing complex dynamics of time series, we characterized MSE patterns of blood-oxygen-level-dependent (BOLD) signals across different time scales and determined whether BOLD activity in patients with schizophrenia exhibits increased complexity (increased entropy in all time scales), decreased complexity toward regularity (decreased entropy in all time scales), or decreased complexity toward uncorrelated randomness (high entropy in short time scales followed by decayed entropy as the time scale increases). We recruited 105 patients with schizophrenia with an age of onset between 18 and 35 years and 210 age- and sex-matched healthy volunteers. Results showed that MSE of BOLD signals in patients with schizophrenia exhibited two routes of decreased BOLD complexity toward either regular or random patterns. Reduced BOLD complexity toward regular patterns was observed in the cerebellum and temporal, middle, and superior frontal regions, and reduced BOLD complexity toward randomness was observed extensively in the inferior frontal, occipital, and postcentral cortices as well as in the insula and middle cingulum. Furthermore, we determined that the two types of complexity change were associated differently with psychopathology; specifically, the regular type of BOLD complexity change was associated with positive symptoms of schizophrenia, whereas the randomness type of BOLD complexity was associated with negative symptoms of the illness. These results collectively suggested that resting-state dynamics in schizophrenia exhibit two routes of pathologic change toward regular or random patterns, which contribute to the differences in syndrome domains of psychosis in patients with schizophrenia. © 2015 Wiley Periodicals, Inc.

Processing of Positive-Causal and Negative-Causal Coherence Relations in Primary School Children and Adults: A Test of the Cumulative Cognitive Complexity Approach in German

ERIC Educational Resources Information Center

Knoepke, Julia; Richter, Tobias; Isberner, Maj-Britt; Naumann, Johannes; Neeb, Yvonne; Weinert, Sabine

2017-01-01

Establishing local coherence relations is central to text comprehension. Positive-causal coherence relations link a cause and its consequence, whereas negative-causal coherence relations add a contrastive meaning (negation) to the causal link. According to the cumulative cognitive complexity approach, negative-causal coherence relations are…

Effect of electron count and chemical complexity in the Ta-Nb-Hf-Zr-Ti high-entropy alloy superconductor

DOE Office of Scientific and Technical Information (OSTI.GOV)

von Rohr, Fabian; Winiarski, Michał J.; Tao, Jing

High-entropy alloys are made from random mixtures of principal elements on simple lattices, stabilized by a high mixing entropy. The recently discovered body-centered cubic (BCC) Ta-Nb-Hf-Zr-Ti high-entropy alloy superconductor appears to display properties of both simple crystalline intermetallics and amorphous materials; e.g., it has a well-defined superconducting transition along with an exceptional robustness against disorder. Here we show that the valence electron count dependence of the superconducting transition temperature in the high-entropy alloy falls between those of analogous simple solid solutions and amorphous materials and test the effect of alloy complexity on the superconductivity. We propose high-entropy alloys as excellentmore » intermediate systems for studying superconductivity as it evolves between crystalline and amorphous materials.« less

Effect of electron count and chemical complexity in the Ta-Nb-Hf-Zr-Ti high-entropy alloy superconductor

PubMed Central

von Rohr, Fabian; Winiarski, Michał J.; Tao, Jing; Klimczuk, Tomasz; Cava, Robert Joseph

2016-01-01

High-entropy alloys are made from random mixtures of principal elements on simple lattices, stabilized by a high mixing entropy. The recently discovered body-centered cubic (BCC) Ta-Nb-Hf-Zr-Ti high-entropy alloy superconductor appears to display properties of both simple crystalline intermetallics and amorphous materials; e.g., it has a well-defined superconducting transition along with an exceptional robustness against disorder. Here we show that the valence electron count dependence of the superconducting transition temperature in the high-entropy alloy falls between those of analogous simple solid solutions and amorphous materials and test the effect of alloy complexity on the superconductivity. We propose high-entropy alloys as excellent intermediate systems for studying superconductivity as it evolves between crystalline and amorphous materials. PMID:27803330

Effect of electron count and chemical complexity in the Ta-Nb-Hf-Zr-Ti high-entropy alloy superconductor

DOE PAGES

von Rohr, Fabian; Winiarski, Michał J.; Tao, Jing; ...

2016-11-01

High-entropy alloys are made from random mixtures of principal elements on simple lattices, stabilized by a high mixing entropy. The recently discovered body-centered cubic (BCC) Ta-Nb-Hf-Zr-Ti high-entropy alloy superconductor appears to display properties of both simple crystalline intermetallics and amorphous materials; e.g., it has a well-defined superconducting transition along with an exceptional robustness against disorder. Here we show that the valence electron count dependence of the superconducting transition temperature in the high-entropy alloy falls between those of analogous simple solid solutions and amorphous materials and test the effect of alloy complexity on the superconductivity. We propose high-entropy alloys as excellentmore » intermediate systems for studying superconductivity as it evolves between crystalline and amorphous materials.« less

Subband Image Coding with Jointly Optimized Quantizers

NASA Technical Reports Server (NTRS)

Kossentini, Faouzi; Chung, Wilson C.; Smith Mark J. T.

1995-01-01

An iterative design algorithm for the joint design of complexity- and entropy-constrained subband quantizers and associated entropy coders is proposed. Unlike conventional subband design algorithms, the proposed algorithm does not require the use of various bit allocation algorithms. Multistage residual quantizers are employed here because they provide greater control of the complexity-performance tradeoffs, and also because they allow efficient and effective high-order statistical modeling. The resulting subband coder exploits statistical dependencies within subbands, across subbands, and across stages, mainly through complexity-constrained high-order entropy coding. Experimental results demonstrate that the complexity-rate-distortion performance of the new subband coder is exceptional.

Classical and quantum entropy of parton distributions

NASA Astrophysics Data System (ADS)

Hagiwara, Yoshikazu; Hatta, Yoshitaka; Xiao, Bo-Wen; Yuan, Feng

2018-05-01

We introduce the semiclassical Wehrl entropy for the nucleon as a measure of complexity of the multiparton configuration in phase space. This gives a new perspective on the nucleon tomography. We evaluate the entropy in the small-x region and compare with the quantum von Neumann entropy. We also argue that the growth of entropy at small x is eventually slowed down due to the Pomeron loop effect.

Multiscale sample entropy and cross-sample entropy based on symbolic representation and similarity of stock markets

NASA Astrophysics Data System (ADS)

Wu, Yue; Shang, Pengjian; Li, Yilong

2018-03-01

A modified multiscale sample entropy measure based on symbolic representation and similarity (MSEBSS) is proposed in this paper to research the complexity of stock markets. The modified algorithm reduces the probability of inducing undefined entropies and is confirmed to be robust to strong noise. Considering the validity and accuracy, MSEBSS is more reliable than Multiscale entropy (MSE) for time series mingled with much noise like financial time series. We apply MSEBSS to financial markets and results show American stock markets have the lowest complexity compared with European and Asian markets. There are exceptions to the regularity that stock markets show a decreasing complexity over the time scale, indicating a periodicity at certain scales. Based on MSEBSS, we introduce the modified multiscale cross-sample entropy measure based on symbolic representation and similarity (MCSEBSS) to consider the degree of the asynchrony between distinct time series. Stock markets from the same area have higher synchrony than those from different areas. And for stock markets having relative high synchrony, the entropy values will decrease with the increasing scale factor. While for stock markets having high asynchrony, the entropy values will not decrease with the increasing scale factor sometimes they tend to increase. So both MSEBSS and MCSEBSS are able to distinguish stock markets of different areas, and they are more helpful if used together for studying other features of financial time series.

Entropy and entropy production in Fokker–Plank equation under the generalized fluctuation–dissipation relation

NASA Astrophysics Data System (ADS)

Guo, Ran

2018-04-01

In this paper, we investigate the definition of the entropy in the Fokker–Planck equation under the generalized fluctuation–dissipation relation (FDR), which describes a Brownian particle moving in a complex medium with friction and multiplicative noise. The friction and the noise are related by the generalized FDR. The entropy for such a system is defined first. According to the definition of the entropy, we calculate the entropy production and the entropy flux. Lastly, we make a numerical calculation to display the results in figures.

Identification of breathing cracks in a beam structure with entropy

NASA Astrophysics Data System (ADS)

Wimarshana, Buddhi; Wu, Nan; Wu, Christine

2016-04-01

A cantilever beam with a breathing crack is studied to detect and evaluate the crack using entropy measures. Closed cracks in engineering structures lead to proportional complexities to their vibration responses due to weak bi-linearity imposed by the crack breathing phenomenon. Entropy is a measure of system complexity and has the potential in quantifying the complexity. The weak bi-linearity in vibration signals can be amplified using wavelet transformation to increase the sensitivity of the measurements. A mathematical model of harmonically excited unit length steel cantilever beam with a breathing crack located near the fixed end is established, and an iterative numerical method is applied to generate accurate time domain dynamic responses. The bi-linearity in time domain signals due to the crack breathing are amplified by wavelet transformation first, and then the complexities due to bi-linearity is quantified using sample entropy to detect the possible crack and estimate the crack depth. It is observed that the method is capable of identifying crack depths even at very early stages of 3% with the increase in the entropy values more than 10% compared with the healthy beam. The current study extends the entropy based damage detection of rotary machines to structural analysis and takes a step further in high-sensitivity structural health monitoring by combining wavelet transformation with entropy calculations. The proposed technique can also be applied to other types of structures, such as plates and shells.

Complexity of cardiovascular rhythms during head-up tilt test by entropy of patterns.

PubMed

Wejer, Dorota; Graff, Beata; Makowiec, Danuta; Budrejko, Szymon; Struzik, Zbigniew R

2017-05-01

The head-up tilt (HUT) test, which provokes transient dynamical alterations in the regulation of cardiovascular system, provides insights into complex organization of this system. Based on signals with heart period intervals (RR-intervals) and/or systolic blood pressure (SBP), differences in the cardiovascular regulation between vasovagal patients (VVS) and the healthy people group (CG) are investigated. Short-term relations among signal data represented symbolically by three-beat patterns allow to qualify and quantify the complexity of the cardiovascular regulation by Shannon entropy. Four types of patterns: permutation, ordinal, deterministic and dynamical, are used, and different resolutions of signal values in the the symbolization are applied in order to verify how entropy of patterns depends on a way in which values of signals are preprocessed. At rest, in the physiologically important signal resolution ranges, independently of the type of patterns used in estimates, the complexity of SBP signals in VVS is different from the complexity found in CG. Entropy of VVS is higher than CG what could be interpreted as substantial presence of noisy ingredients in SBP of VVS. After tilting this relation switches. Entropy of CG occurs significantly higher than VVS for SBP signals. In the case of RR-intervals and large resolutions, the complexity after the tilt becomes reduced when compared to the complexity of RR-intervals at rest for both groups. However, in the case of VVS patients this reduction is significantly stronger than in CG. Our observations about opposite switches in entropy between CG and VVS might support a hypothesis that baroreflex in VVS affects stronger the heart rate because of the inefficient regulation (possibly impaired local vascular tone alternations) of the blood pressure.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kanno, Sugumi; IKERBASQUE, Basque Foundation for Science, Maria Diaz de Haro 3, 48013, Bilbao; Laboratory for Quantum Gravity & Strings and Astrophysics, Cosmology & Gravity Center, Department of Mathematics & Applied Mathematics, University of Cape Town, Private Bag, Rondebosch 7701

We explore quantum entanglement between two causally disconnected regions in the multiverse. We first consider a free massive scalar field, and compute the entanglement negativity between two causally separated open charts in de Sitter space. The qualitative feature of it turns out to be in agreement with that of the entanglement entropy. We then introduce two observers who determine the entanglement between two causally disconnected de Sitter spaces. When one of the observers remains constrained to a region of the open chart in a de Sitter space, we find that the scale dependence enters into the entanglement. We show thatmore » a state which is initially maximally entangled becomes more entangled or less entangled on large scales depending on the mass of the scalar field and recovers the initial entanglement in the small scale limit. We argue that quantum entanglement may provide some evidence for the existence of the multiverse.« less

Entanglement negativity in the multiverse

NASA Astrophysics Data System (ADS)

Kanno, Sugumi; Shock, Jonathan P.; Soda, Jiro

2015-03-01

We explore quantum entanglement between two causally disconnected regions in the multiverse. We first consider a free massive scalar field, and compute the entanglement negativity between two causally separated open charts in de Sitter space. The qualitative feature of it turns out to be in agreement with that of the entanglement entropy. We then introduce two observers who determine the entanglement between two causally disconnected de Sitter spaces. When one of the observers remains constrained to a region of the open chart in a de Sitter space, we find that the scale dependence enters into the entanglement. We show that a state which is initially maximally entangled becomes more entangled or less entangled on large scales depending on the mass of the scalar field and recovers the initial entanglement in the small scale limit. We argue that quantum entanglement may provide some evidence for the existence of the multiverse.

Entanglement negativity in the multiverse

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kanno, Sugumi; Shock, Jonathan P.; Soda, Jiro, E-mail: sugumi.kanno@ehu.es, E-mail: jonathan.shock@uct.ac.za, E-mail: jiro@phys.sci.kobe-u.ac.jp

2015-03-01

We explore quantum entanglement between two causally disconnected regions in the multiverse. We first consider a free massive scalar field, and compute the entanglement negativity between two causally separated open charts in de Sitter space. The qualitative feature of it turns out to be in agreement with that of the entanglement entropy. We then introduce two observers who determine the entanglement between two causally disconnected de Sitter spaces. When one of the observers remains constrained to a region of the open chart in a de Sitter space, we find that the scale dependence enters into the entanglement. We show thatmore » a state which is initially maximally entangled becomes more entangled or less entangled on large scales depending on the mass of the scalar field and recovers the initial entanglement in the small scale limit. We argue that quantum entanglement may provide some evidence for the existence of the multiverse.« less

Note on transmitted complexity for quantum dynamical systems

NASA Astrophysics Data System (ADS)

Watanabe, Noboru; Muto, Masahiro

2017-10-01

Transmitted complexity (mutual entropy) is one of the important measures for quantum information theory developed recently in several ways. We will review the fundamental concepts of the Kossakowski, Ohya and Watanabe entropy and define a transmitted complexity for quantum dynamical systems. This article is part of the themed issue `Second quantum revolution: foundational questions'.

Resting state fMRI entropy probes complexity of brain activity in adults with ADHD.

PubMed

Sokunbi, Moses O; Fung, Wilson; Sawlani, Vijay; Choppin, Sabine; Linden, David E J; Thome, Johannes

2013-12-30

In patients with attention deficit hyperactivity disorder (ADHD), quantitative neuroimaging techniques have revealed abnormalities in various brain regions, including the frontal cortex, striatum, cerebellum, and occipital cortex. Nonlinear signal processing techniques such as sample entropy have been used to probe the regularity of brain magnetoencephalography signals in patients with ADHD. In the present study, we extend this technique to analyse the complex output patterns of the 4 dimensional resting state functional magnetic resonance imaging signals in adult patients with ADHD. After adjusting for the effect of age, we found whole brain entropy differences (P=0.002) between groups and negative correlation (r=-0.45) between symptom scores and mean whole brain entropy values, indicating lower complexity in patients. In the regional analysis, patients showed reduced entropy in frontal and occipital regions bilaterally and a significant negative correlation between the symptom scores and the entropy maps at a family-wise error corrected cluster level of P<0.05 (P=0.001, initial threshold). Our findings support the hypothesis of abnormal frontal-striatal-cerebellar circuits in ADHD and the suggestion that sample entropy is a useful tool in revealing abnormalities in the brain dynamics of patients with psychiatric disorders. © 2013 Elsevier Ireland Ltd. All rights reserved.

Gender differences in offaxis neuromuscular control during stepping under a slippery condition.

PubMed

Lee, Song Joo; Ren, Yupeng; Geiger, François; Zhang, Li-Qun

2013-11-01

Females are at greater risks of musculoskeletal injuries than are males, which may be related to decreased neuromuscular control in axial and/or frontal planes, offaxis neuromuscular control. The objective of this study was to investigate gender differences in offaxis neuromuscular control during stepping under a slippery condition. Forty-three healthy subjects (21 males and 22 females) performed different stepping tasks under a slippery condition, namely, free pivoting task (FPT) to control axial plane pivoting, free sliding task (FST) to control frontal plane sliding, and free pivoting and sliding task (FPST) to control axial pivoting, and frontal sliding on a custom-made offaxis elliptical trainer. Compared to males, females showed significantly higher pivoting instability, higher max internal and external pivoting angles, higher mean max medial and lateral sliding distance, and higher entropy of time to peak EMG in the medial and lateral gastrocnemius muscles during the FPST and higher entropy of time to peak EMG in the lateral gastrocnemius muscle during the FPT and FST. The findings may help us understand potential injury risk factors associated with gender differences, and provide a basis for developing targeted neuromuscular training to improve offaxis neuromuscular control, and reduce musculoskeletal injuries associated with excessive offaxis loadings.

Causal analysis of self-sustaining processes in the logarithmic layer of wall-bounded turbulence

NASA Astrophysics Data System (ADS)

Bae, H. J.; Encinar, M. P.; Lozano-Durán, A.

2018-04-01

Despite the large amount of information provided by direct numerical simulations of turbulent flows, their underlying dynamics remain elusive even in the most simple and canonical configurations. Most common approaches to investigate the turbulence phenomena do not provide a clear causal inference between events, which is essential to determine the dynamics of self-sustaining processes. In the present work, we examine the causal interactions between streaks, rolls and mean shear in the logarithmic layer of a minimal turbulent channel flow. Causality between structures is assessed in a non-intrusive manner by transfer entropy, i.e., how much the uncertainty of one structure is reduced by knowing the past states of the others. We choose to represent streaks by the first Fourier modes of the streamwise velocity, while rolls are defined by the wall-normal and spanwise velocity modes. The results show that the process is mainly unidirectional rather than cyclic, and that the log-layer motions are sustained by extracting energy from the mean shear which controls the dynamics and time-scales. The well-known lift-up effect is also identified, but shown to be of secondary importance in the causal network between shear, streaks and rolls.

Causal analysis of self-sustaining processes in the log-layer of wall-bounded turbulence

NASA Astrophysics Data System (ADS)

Lozano-Duran, Adrian; Bae, Hyunji Jane

2017-11-01

Despite the large amount of information provided by direct numerical simulations of turbulent flows, the underlying dynamics remain elusive even in the most simple and canonical configurations. Most standard methods used to investigate turbulence do not provide a clear causal inference between events, which is necessary to determine this dynamics, particularly in self-sustaning processes. In the present work, we examine the causal interactions between streaks and rolls in the logarithmic layer of minimal turbulent channel flow. Causality between structures is assessed in a non-intrusive manner by transfer entropy, i.e., how much the uncertainty of one structure is reduced by knowing the past states of the others. Streaks are represented by the first Fourier modes of the streamwise velocity, while rolls are defined by the wall-normal and spanwise velocities. The results show that the process is mainly unidirectional rather than cyclic, and that the log-layer motions are sustained by extracting energy from the mean shear, which controls the dynamics and time-scales. The well-known lift-up effect is shown to be not a key ingredient in the causal network between shear, streaks and rolls. Funded by ERC Coturb Madrid Summer Program.

Complexity quantification of cardiac variability time series using improved sample entropy (I-SampEn).

PubMed

Marwaha, Puneeta; Sunkaria, Ramesh Kumar

2016-09-01

The sample entropy (SampEn) has been widely used to quantify the complexity of RR-interval time series. It is a fact that higher complexity, and hence, entropy is associated with the RR-interval time series of healthy subjects. But, SampEn suffers from the disadvantage that it assigns higher entropy to the randomized surrogate time series as well as to certain pathological time series, which is a misleading observation. This wrong estimation of the complexity of a time series may be due to the fact that the existing SampEn technique updates the threshold value as a function of long-term standard deviation (SD) of a time series. However, time series of certain pathologies exhibits substantial variability in beat-to-beat fluctuations. So the SD of the first order difference (short term SD) of the time series should be considered while updating threshold value, to account for period-to-period variations inherited in a time series. In the present work, improved sample entropy (I-SampEn), a new methodology has been proposed in which threshold value is updated by considering the period-to-period variations of a time series. The I-SampEn technique results in assigning higher entropy value to age-matched healthy subjects than patients suffering atrial fibrillation (AF) and diabetes mellitus (DM). Our results are in agreement with the theory of reduction in complexity of RR-interval time series in patients suffering from chronic cardiovascular and non-cardiovascular diseases.

Simplifying Causal Complexity: How Interactions between Modes of Causal Induction and Information Availability Lead to Heuristic-Driven Reasoning

ERIC Educational Resources Information Center

Grotzer, Tina A.; Tutwiler, M. Shane

2014-01-01

This article considers a set of well-researched default assumptions that people make in reasoning about complex causality and argues that, in part, they result from the forms of causal induction that we engage in and the type of information available in complex environments. It considers how information often falls outside our attentional frame…

A model for Entropy Production, Entropy Decrease and Action Minimization in Self-Organization

NASA Astrophysics Data System (ADS)

Georgiev, Georgi; Chatterjee, Atanu; Vu, Thanh; Iannacchione, Germano

In self-organization energy gradients across complex systems lead to change in the structure of systems, decreasing their internal entropy to ensure the most efficient energy transport and therefore maximum entropy production in the surroundings. This approach stems from fundamental variational principles in physics, such as the principle of least action. It is coupled to the total energy flowing through a system, which leads to increase the action efficiency. We compare energy transport through a fluid cell which has random motion of its molecules, and a cell which can form convection cells. We examine the signs of change of entropy, and the action needed for the motion inside those systems. The system in which convective motion occurs, reduces the time for energy transmission, compared to random motion. For more complex systems, those convection cells form a network of transport channels, for the purpose of obeying the equations of motion in this geometry. Those transport networks are an essential feature of complex systems in biology, ecology, economy and society.

Use of information entropy measures of sitting postural sway to quantify developmental delay in infants

PubMed Central

Deffeyes, Joan E; Harbourne, Regina T; DeJong, Stacey L; Kyvelidou, Anastasia; Stuberg, Wayne A; Stergiou, Nicholas

2009-01-01

Background By quantifying the information entropy of postural sway data, the complexity of the postural movement of different populations can be assessed, giving insight into pathologic motor control functioning. Methods In this study, developmental delay of motor control function in infants was assessed by analysis of sitting postural sway data acquired from force plate center of pressure measurements. Two types of entropy measures were used: symbolic entropy, including a new asymmetric symbolic entropy measure, and approximate entropy, a more widely used entropy measure. For each method of analysis, parameters were adjusted to optimize the separation of the results from the infants with delayed development from infants with typical development. Results The method that gave the widest separation between the populations was the asymmetric symbolic entropy method, which we developed by modification of the symbolic entropy algorithm. The approximate entropy algorithm also performed well, using parameters optimized for the infant sitting data. The infants with delayed development were found to have less complex patterns of postural sway in the medial-lateral direction, and were found to have different left-right symmetry in their postural sway, as compared to typically developing infants. Conclusion The results of this study indicate that optimization of the entropy algorithm for infant sitting postural sway data can greatly improve the ability to separate the infants with developmental delay from typically developing infants. PMID:19671183

The gravity duals of modular Hamiltonians

DOE PAGES

Jafferis, Daniel L.; Suh, S. Josephine

2016-09-12

In this study, we investigate modular Hamiltonians defined with respect to arbitrary spatial regions in quantum field theory states which have semi-classical gravity duals. We find prescriptions in the gravity dual for calculating the action of the modular Hamiltonian on its defining state, including its dual metric, and also on small excitations around the state. Curiously, use of the covariant holographic entanglement entropy formula leads us to the conclusion that the modular Hamiltonian, which in the quantum field theory acts only in the causal completion of the region, does not commute with bulk operators whose entire gauge-invariant description is space-likemore » to the causal completion of the region.« less

The gravity duals of modular Hamiltonians

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jafferis, Daniel L.; Suh, S. Josephine

In this study, we investigate modular Hamiltonians defined with respect to arbitrary spatial regions in quantum field theory states which have semi-classical gravity duals. We find prescriptions in the gravity dual for calculating the action of the modular Hamiltonian on its defining state, including its dual metric, and also on small excitations around the state. Curiously, use of the covariant holographic entanglement entropy formula leads us to the conclusion that the modular Hamiltonian, which in the quantum field theory acts only in the causal completion of the region, does not commute with bulk operators whose entire gauge-invariant description is space-likemore » to the causal completion of the region.« less

Uniqueness and characterization theorems for generalized entropies

NASA Astrophysics Data System (ADS)

Enciso, Alberto; Tempesta, Piergiulio

2017-12-01

The requirement that an entropy function be composable is key: it means that the entropy of a compound system can be calculated in terms of the entropy of its independent components. We prove that, under mild regularity assumptions, the only composable generalized entropy in trace form is the Tsallis one-parameter family (which contains Boltzmann-Gibbs as a particular case). This result leads to the use of generalized entropies that are not of trace form, such as Rényi’s entropy, in the study of complex systems. In this direction, we also present a characterization theorem for a large class of composable non-trace-form entropy functions with features akin to those of Rényi’s entropy.

Thermodynamics of Terrestrial Evolution

PubMed Central

Kirkaldy, J. S.

1965-01-01

The causal element of biological evolution and development can be understood in terms of a potential function which is generalized from the variational principles of irreversible thermodynamics. This potential function is approximated by the rate of entropy production in a configuration space which admits of macroscopic excursions by fluctuation and regression as well as microscopic ones. Analogously to Onsager's dissipation function, the potential takes the form of a saddle surface in this configuration space. The path of evolution following from an initial high dissipation state within the fixed constraint provided by the invariant energy flux from the sun tends toward the stable saddle point by a series of spontaneous regressions which lower the entropy production rate and by an alternating series of spontaneous fluctuations which introduce new internal constraints and lead to a higher entropy production rate. The potential thus rationalizes the system's observed tendency toward “chemical imperialism” (high dissipation) while simultaneously accommodating the development of “dynamic efficiency” and complication (low dissipation). PMID:5884019

Multivariate multiscale entropy of financial markets

NASA Astrophysics Data System (ADS)

Lu, Yunfan; Wang, Jun

2017-11-01

In current process of quantifying the dynamical properties of the complex phenomena in financial market system, the multivariate financial time series are widely concerned. In this work, considering the shortcomings and limitations of univariate multiscale entropy in analyzing the multivariate time series, the multivariate multiscale sample entropy (MMSE), which can evaluate the complexity in multiple data channels over different timescales, is applied to quantify the complexity of financial markets. Its effectiveness and advantages have been detected with numerical simulations with two well-known synthetic noise signals. For the first time, the complexity of four generated trivariate return series for each stock trading hour in China stock markets is quantified thanks to the interdisciplinary application of this method. We find that the complexity of trivariate return series in each hour show a significant decreasing trend with the stock trading time progressing. Further, the shuffled multivariate return series and the absolute multivariate return series are also analyzed. As another new attempt, quantifying the complexity of global stock markets (Asia, Europe and America) is carried out by analyzing the multivariate returns from them. Finally we utilize the multivariate multiscale entropy to assess the relative complexity of normalized multivariate return volatility series with different degrees.

Nonlinear Complexity Analysis of Brain fMRI Signals in Schizophrenia

PubMed Central

Sokunbi, Moses O.; Gradin, Victoria B.; Waiter, Gordon D.; Cameron, George G.; Ahearn, Trevor S.; Murray, Alison D.; Steele, Douglas J.; Staff, Roger T.

2014-01-01

We investigated the differences in brain fMRI signal complexity in patients with schizophrenia while performing the Cyberball social exclusion task, using measures of Sample entropy and Hurst exponent (H). 13 patients meeting diagnostic and Statistical Manual of Mental Disorders, 4th Edition (DSM IV) criteria for schizophrenia and 16 healthy controls underwent fMRI scanning at 1.5 T. The fMRI data of both groups of participants were pre-processed, the entropy characterized and the Hurst exponent extracted. Whole brain entropy and H maps of the groups were generated and analysed. The results after adjusting for age and sex differences together show that patients with schizophrenia exhibited higher complexity than healthy controls, at mean whole brain and regional levels. Also, both Sample entropy and Hurst exponent agree that patients with schizophrenia have more complex fMRI signals than healthy controls. These results suggest that schizophrenia is associated with more complex signal patterns when compared to healthy controls, supporting the increase in complexity hypothesis, where system complexity increases with age or disease, and also consistent with the notion that schizophrenia is characterised by a dysregulation of the nonlinear dynamics of underlying neuronal systems. PMID:24824731

An investigation of combustion and entropy noise

NASA Technical Reports Server (NTRS)

Strahle, W. C.

1977-01-01

The relative importance of entropy and direct combustion noise in turbopropulsion systems and the parameters upon which these noise sources depend were studied. Theory and experiment were employed to determine that at least with the apparatus used here, entropy noise can dominate combustion noise if there is a sufficient pressure gradient terminating the combustor. Measurements included combustor interior fluctuating pressure, near and far field fluctuating pressure, and combustor exit plane fluctuating temperatures, as well as mean pressures and temperatures. Analysis techniques included spectral, cross-correlation, cross power spectra, and ordinary and partial coherence analysis. Also conducted were combustor liner modification experiments to investigate the origin of the frequency content of combustion noise. Techniques were developed to extract nonpropagational pseudo-sound and the heat release fluctuation spectra from the data.

Optimal causal inference: estimating stored information and approximating causal architecture.

PubMed

Still, Susanne; Crutchfield, James P; Ellison, Christopher J

2010-09-01

We introduce an approach to inferring the causal architecture of stochastic dynamical systems that extends rate-distortion theory to use causal shielding--a natural principle of learning. We study two distinct cases of causal inference: optimal causal filtering and optimal causal estimation. Filtering corresponds to the ideal case in which the probability distribution of measurement sequences is known, giving a principled method to approximate a system's causal structure at a desired level of representation. We show that in the limit in which a model-complexity constraint is relaxed, filtering finds the exact causal architecture of a stochastic dynamical system, known as the causal-state partition. From this, one can estimate the amount of historical information the process stores. More generally, causal filtering finds a graded model-complexity hierarchy of approximations to the causal architecture. Abrupt changes in the hierarchy, as a function of approximation, capture distinct scales of structural organization. For nonideal cases with finite data, we show how the correct number of the underlying causal states can be found by optimal causal estimation. A previously derived model-complexity control term allows us to correct for the effect of statistical fluctuations in probability estimates and thereby avoid overfitting.

High Order Entropy-Constrained Residual VQ for Lossless Compression of Images

NASA Technical Reports Server (NTRS)

Kossentini, Faouzi; Smith, Mark J. T.; Scales, Allen

1995-01-01

High order entropy coding is a powerful technique for exploiting high order statistical dependencies. However, the exponentially high complexity associated with such a method often discourages its use. In this paper, an entropy-constrained residual vector quantization method is proposed for lossless compression of images. The method consists of first quantizing the input image using a high order entropy-constrained residual vector quantizer and then coding the residual image using a first order entropy coder. The distortion measure used in the entropy-constrained optimization is essentially the first order entropy of the residual image. Experimental results show very competitive performance.

Innovative techniques to analyze time series of geomagnetic activity indices

NASA Astrophysics Data System (ADS)

Balasis, Georgios; Papadimitriou, Constantinos; Daglis, Ioannis A.; Potirakis, Stelios M.; Eftaxias, Konstantinos

2016-04-01

Magnetic storms are undoubtedly among the most important phenomena in space physics and also a central subject of space weather. The non-extensive Tsallis entropy has been recently introduced, as an effective complexity measure for the analysis of the geomagnetic activity Dst index. The Tsallis entropy sensitively shows the complexity dissimilarity among different "physiological" (normal) and "pathological" states (intense magnetic storms). More precisely, the Tsallis entropy implies the emergence of two distinct patterns: (i) a pattern associated with the intense magnetic storms, which is characterized by a higher degree of organization, and (ii) a pattern associated with normal periods, which is characterized by a lower degree of organization. Other entropy measures such as Block Entropy, T-Complexity, Approximate Entropy, Sample Entropy and Fuzzy Entropy verify the above mentioned result. Importantly, the wavelet spectral analysis in terms of Hurst exponent, H, also shows the existence of two different patterns: (i) a pattern associated with the intense magnetic storms, which is characterized by a fractional Brownian persistent behavior (ii) a pattern associated with normal periods, which is characterized by a fractional Brownian anti-persistent behavior. Finally, we observe universality in the magnetic storm and earthquake dynamics, on a basis of a modified form of the Gutenberg-Richter law for the Tsallis statistics. This finding suggests a common approach to the interpretation of both phenomena in terms of the same driving physical mechanism. Signatures of discrete scale invariance in Dst time series further supports the aforementioned proposal.

Performance of children with developmental dyslexia on high and low topological entropy artificial grammar learning task.

PubMed

Katan, Pesia; Kahta, Shani; Sasson, Ayelet; Schiff, Rachel

2017-07-01

Graph complexity as measured by topological entropy has been previously shown to affect performance on artificial grammar learning tasks among typically developing children. The aim of this study was to examine the effect of graph complexity on implicit sequential learning among children with developmental dyslexia. Our goal was to determine whether children's performance depends on the complexity level of the grammar system learned. We conducted two artificial grammar learning experiments that compared performance of children with developmental dyslexia with that of age- and reading level-matched controls. Experiment 1 was a high topological entropy artificial grammar learning task that aimed to establish implicit learning phenomena in children with developmental dyslexia using previously published experimental conditions. Experiment 2 is a lower topological entropy variant of that task. Results indicated that given a high topological entropy grammar system, children with developmental dyslexia who were similar to the reading age-matched control group had substantial difficulty in performing the task as compared to typically developing children, who exhibited intact implicit learning of the grammar. On the other hand, when tested on a lower topological entropy grammar system, all groups performed above chance level, indicating that children with developmental dyslexia were able to identify rules from a given grammar system. The results reinforced the significance of graph complexity when experimenting with artificial grammar learning tasks, particularly with dyslexic participants.

Analysis of crude oil markets with improved multiscale weighted permutation entropy

NASA Astrophysics Data System (ADS)

Niu, Hongli; Wang, Jun; Liu, Cheng

2018-03-01

Entropy measures are recently extensively used to study the complexity property in nonlinear systems. Weighted permutation entropy (WPE) can overcome the ignorance of the amplitude information of time series compared with PE and shows a distinctive ability to extract complexity information from data having abrupt changes in magnitude. Improved (or sometimes called composite) multi-scale (MS) method possesses the advantage of reducing errors and improving the accuracy when applied to evaluate multiscale entropy values of not enough long time series. In this paper, we combine the merits of WPE and improved MS to propose the improved multiscale weighted permutation entropy (IMWPE) method for complexity investigation of a time series. Then it is validated effective through artificial data: white noise and 1 / f noise, and real market data of Brent and Daqing crude oil. Meanwhile, the complexity properties of crude oil markets are explored respectively of return series, volatility series with multiple exponents and EEMD-produced intrinsic mode functions (IMFs) which represent different frequency components of return series. Moreover, the instantaneous amplitude and frequency of Brent and Daqing crude oil are analyzed by the Hilbert transform utilized to each IMF.

Curvature Constraints from the Causal Entropic Principle

NASA Astrophysics Data System (ADS)

Bozek, Brandon

2010-01-01

Current cosmological observations indicate a preference for a cosmological constant that is drastically smaller than what can be explained by conventional particle physics. The Causal Entropic Principle (Bousso, et al.) provides an alternative approach to anthropic attempts to predict our observed value of the cosmological constant by calculating the entropy created within a causal diamond. We have extended this work to use the Causal Entropic Principle to predict the preferred curvature within the "multiverse." We have found that values larger than ρk = 40*ρm are disfavored by more than 99.99% and a peak value at ρΛ = 7.9*10-123 and ρk =4.3*ρm for open universes. For universes that allow only positive curvature or both positive and negative curvature, we find a correlation between curvature and dark energy that leads to an extended region of preferred values. Our universe is found to be disfavored to an extent depending on the priors on curvature. We also provide a comparison to previous anthropic constraints on open universes and discuss future directions for this work.

Curvature constraints from the causal entropic principle

NASA Astrophysics Data System (ADS)

Bozek, Brandon; Albrecht, Andreas; Phillips, Daniel

2009-07-01

Current cosmological observations indicate a preference for a cosmological constant that is drastically smaller than what can be explained by conventional particle physics. The causal entropic principle (Bousso et al.) provides an alternative approach to anthropic attempts to predict our observed value of the cosmological constant by calculating the entropy created within a causal diamond. We have extended this work to use the causal entropic principle to predict the preferred curvature within the “multiverse.” We have found that values larger than ρk=40ρm are disfavored by more than 99.99% peak value at ρΛ=7.9×10-123 and ρk=4.3ρm for open universes. For universes that allow only positive curvature or both positive and negative curvature, we find a correlation between curvature and dark energy that leads to an extended region of preferred values. Our universe is found to be disfavored to an extent depending on the priors on curvature. We also provide a comparison to previous anthropic constraints on open universes and discuss future directions for this work.

Curvature constraints from the causal entropic principle

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bozek, Brandon; Albrecht, Andreas; Phillips, Daniel

2009-07-15

Current cosmological observations indicate a preference for a cosmological constant that is drastically smaller than what can be explained by conventional particle physics. The causal entropic principle (Bousso et al.) provides an alternative approach to anthropic attempts to predict our observed value of the cosmological constant by calculating the entropy created within a causal diamond. We have extended this work to use the causal entropic principle to predict the preferred curvature within the 'multiverse'. We have found that values larger than {rho}{sub k}=40{rho}{sub m} are disfavored by more than 99.99% peak value at {rho}{sub {lambda}}=7.9x10{sup -123} and {rho}{sub k}=4.3{rho}{sub m}more » for open universes. For universes that allow only positive curvature or both positive and negative curvature, we find a correlation between curvature and dark energy that leads to an extended region of preferred values. Our universe is found to be disfavored to an extent depending on the priors on curvature. We also provide a comparison to previous anthropic constraints on open universes and discuss future directions for this work.« less

Assessing Understanding of Complex Causal Networks Using an Interactive Game

ERIC Educational Resources Information Center

Ross, Joel

2013-01-01

Assessing people's understanding of the causal relationships found in large-scale complex systems may be necessary for addressing many critical social concerns, such as environmental sustainability. Existing methods for assessing systems thinking and causal understanding frequently use the technique of cognitive causal mapping. However, the…

Understanding neuromotor strategy during functional upper extremity tasks using symbolic dynamics.

PubMed

Nathan, Dominic E; Guastello, Stephen J; Prost, Robert W; Jeutter, Dean C

2012-01-01

The ability to model and quantify brain activation patterns that pertain to natural neuromotor strategy of the upper extremities during functional task performance is critical to the development of therapeutic interventions such as neuroprosthetic devices. The mechanisms of information flow, activation sequence and patterns, and the interaction between anatomical regions of the brain that are specific to movement planning, intention and execution of voluntary upper extremity motor tasks were investigated here. This paper presents a novel method using symbolic dynamics (orbital decomposition) and nonlinear dynamic tools of entropy, self-organization and chaos to describe the underlying structure of activation shifts in regions of the brain that are involved with the cognitive aspects of functional upper extremity task performance. Several questions were addressed: (a) How is it possible to distinguish deterministic or causal patterns of activity in brain fMRI from those that are really random or non-contributory to the neuromotor control process? (b) Can the complexity of activation patterns over time be quantified? (c) What are the optimal ways of organizing fMRI data to preserve patterns of activation, activation levels, and extract meaningful temporal patterns as they evolve over time? Analysis was performed using data from a custom developed time resolved fMRI paradigm involving human subjects (N=18) who performed functional upper extremity motor tasks with varying time delays between the onset of intention and onset of actual movements. The results indicate that there is structure in the data that can be quantified through entropy and dimensional complexity metrics and statistical inference, and furthermore, orbital decomposition is sensitive in capturing the transition of states that correlate with the cognitive aspects of functional task performance.

Dynamical complexity detection in geomagnetic activity indices using wavelet transforms and Tsallis entropy

NASA Astrophysics Data System (ADS)

Balasis, G.; Daglis, I. A.; Papadimitriou, C.; Kalimeri, M.; Anastasiadis, A.; Eftaxias, K.

2008-12-01

Dynamical complexity detection for output time series of complex systems is one of the foremost problems in physics, biology, engineering, and economic sciences. Especially in magnetospheric physics, accurate detection of the dissimilarity between normal and abnormal states (e.g. pre-storm activity and magnetic storms) can vastly improve space weather diagnosis and, consequently, the mitigation of space weather hazards. Herein, we examine the fractal spectral properties of the Dst data using a wavelet analysis technique. We show that distinct changes in associated scaling parameters occur (i.e., transition from anti- persistent to persistent behavior) as an intense magnetic storm approaches. We then analyze Dst time series by introducing the non-extensive Tsallis entropy, Sq, as an appropriate complexity measure. The Tsallis entropy sensitively shows the complexity dissimilarity among different "physiological" (normal) and "pathological" states (intense magnetic storms). The Tsallis entropy implies the emergence of two distinct patterns: (i) a pattern associated with the intense magnetic storms, which is characterized by a higher degree of organization, and (ii) a pattern associated with normal periods, which is characterized by a lower degree of organization.

An Environmental Sociology for the Anthropocene.

PubMed

Bowden, Gary

2017-02-01

Attention to the relationship between nature and society has been a defining feature of environmental sociology since its inception. Early research, incorporating insights from ecology, argued for the need to (1) theorize the causal connections between nature and society and (2) contextualize those connections in terms of biophysical limits resulting from resource scarcity. Over the past two decades, partly in response to new forms of existential threat such as climate change, the treatment of nature and society as distinct entities has given way to a focus on socio-natural assemblages. Using the Anthropocene as a lens to explore this emerging view, it is argued (1) that current theorizing on the socio-natural assemblage needs to pay more attention to the issues of temporality and complexity, (2) that taking these factors into account reconceptualizes the nature-society relationship as a complex, evolving socio-natural assemblage, (3) that this evolutionary process needs to be understood in the context of cosmic evolution and the tension between entropy and the emergence of local complexity, and (4) that constraints on human development arise from the tension between these two tendencies, not from resource scarcity. An environmental sociology for the Anthropocene, one based on assumptions about the nature of causal dynamics and context consistent with our understanding of current earth system science, is proposed. L'attention portée à la relation entre la nature et la société a été un trait caractéristique de la sociologie de l'environnement depuis sa création. La recherche initiale, intégrant les connaissances de l'écologie, a soutenu la nécessité de (1) théoriser les liens causaux entre la nature et la société et (2) contextualiser ces connexions en termes de limites biophysiques résultant de la pénurie de ressources. Au cours des deux derniéres décennies, en partie en réponse à de nouvelles formes de menace existentielle telles que le changement climatique, le traitement de la nature et de la société en tant qu'entités distinctes a fait place à un accent sur les assemblages socio-naturels. En utilisant l'anthropocéne comme une lentille pour explorer ce point de vue émergeant, on fait valoir (1) que la théorisation actuelle sur l'assemblage socio-naturel doit accorder plus d'attention aux questions de temporalité et de complexité, (2) que prendre ces facteurs en compte reconceptualise la relation entre la nature et la société en tant qu'assemblage socio-naturel complexe et en évolution, (3) que ce processus évolutif doit être compris dans le contexte de l'évolution cosmique et de la tension entre entropie et émergence de la complexité locale, et (4) sur le développement humain découlent de la tension entre ces deux tendances, et non de la pénurie de ressources. Une sociologie de l'environnement pour l'anthropocéne, fondée sur des hypothéses sur la nature de la dynamique causale et du contexte compatible avec notre compréhension de la science actuelle du systéme terrestre, est proposée. © 2017 Canadian Sociological Association/La Société canadienne de sociologie.

A surprising role for conformational entropy in protein function

PubMed Central

Wand, A. Joshua; Moorman, Veronica R.; Harpole, Kyle W.

2014-01-01

Formation of high-affinity complexes is critical for the majority of enzymatic reactions involving proteins. The creation of the family of Michaelis and other intermediate complexes during catalysis clearly involves a complicated manifold of interactions that are diverse and complex. Indeed, computing the energetics of interactions between proteins and small molecule ligands using molecular structure alone remains a grand challenge. One of the most difficult contributions to the free energy of protein-ligand complexes to experimentally access is that due to changes in protein conformational entropy. Fortunately, recent advances in solution nuclear magnetic resonance (NMR) relaxation methods have enabled the use of measures-of-motion between conformational states of a protein as a proxy for conformational entropy. This review briefly summarizes the experimental approaches currently employed to characterize fast internal motion in proteins, how this information is used to gain insight into conformational entropy, what has been learned and what the future may hold for this emerging view of protein function. PMID:23478875

Parameters Selection for Bivariate Multiscale Entropy Analysis of Postural Fluctuations in Fallers and Non-Fallers Older Adults.

PubMed

Ramdani, Sofiane; Bonnet, Vincent; Tallon, Guillaume; Lagarde, Julien; Bernard, Pierre Louis; Blain, Hubert

2016-08-01

Entropy measures are often used to quantify the regularity of postural sway time series. Recent methodological developments provided both multivariate and multiscale approaches allowing the extraction of complexity features from physiological signals; see "Dynamical complexity of human responses: A multivariate data-adaptive framework," in Bulletin of Polish Academy of Science and Technology, vol. 60, p. 433, 2012. The resulting entropy measures are good candidates for the analysis of bivariate postural sway signals exhibiting nonstationarity and multiscale properties. These methods are dependant on several input parameters such as embedding parameters. Using two data sets collected from institutionalized frail older adults, we numerically investigate the behavior of a recent multivariate and multiscale entropy estimator; see "Multivariate multiscale entropy: A tool for complexity analysis of multichannel data," Physics Review E, vol. 84, p. 061918, 2011. We propose criteria for the selection of the input parameters. Using these optimal parameters, we statistically compare the multivariate and multiscale entropy values of postural sway data of non-faller subjects to those of fallers. These two groups are discriminated by the resulting measures over multiple time scales. We also demonstrate that the typical parameter settings proposed in the literature lead to entropy measures that do not distinguish the two groups. This last result confirms the importance of the selection of appropriate input parameters.

Quantum phases of dimerized and frustrated Heisenberg spin chains with s = 1/2, 1 and 3/2: an entanglement entropy and fidelity study.

PubMed

Goli, V M L Durga Prasad; Sahoo, Shaon; Ramasesha, S; Sen, Diptiman

2013-03-27

We study here different regions in phase diagrams of the spin-1/2, spin-1 and spin-3/2 one-dimensional antiferromagnetic Heisenberg systems with frustration (next-nearest-neighbor interaction J2) and dimerization (δ). In particular, we analyze the behaviors of the bipartite entanglement entropy and fidelity at the gapless to gapped phase transitions and across the lines separating different phases in the J2-δ plane. All the calculations in this work are based on numerical exact diagonalizations of finite systems.

Calculation of Cyclodextrin Binding Affinities: Energy, Entropy, and Implications for Drug Design

PubMed Central

Chen, Wei; Chang, Chia-En; Gilson, Michael K.

2004-01-01

The second generation Mining Minima method yields binding affinities accurate to within 0.8 kcal/mol for the associations of α-, β-, and γ-cyclodextrin with benzene, resorcinol, flurbiprofen, naproxen, and nabumetone. These calculations require hours to a day on a commodity computer. The calculations also indicate that the changes in configurational entropy upon binding oppose association by as much as 24 kcal/mol and result primarily from a narrowing of energy wells in the bound versus the free state, rather than from a drop in the number of distinct low-energy conformations on binding. Also, the configurational entropy is found to vary substantially among the bound conformations of a given cyclodextrin-guest complex. This result suggests that the configurational entropy must be accounted for to reliably rank docked conformations in both host-guest and ligand-protein complexes. In close analogy with the common experimental observation of entropy-enthalpy compensation, the computed entropy changes show a near-linear relationship with the changes in mean potential plus solvation energy. PMID:15339804

On the relation between correlation dimension, approximate entropy and sample entropy parameters, and a fast algorithm for their calculation

NASA Astrophysics Data System (ADS)

Zurek, Sebastian; Guzik, Przemyslaw; Pawlak, Sebastian; Kosmider, Marcin; Piskorski, Jaroslaw

2012-12-01

We explore the relation between correlation dimension, approximate entropy and sample entropy parameters, which are commonly used in nonlinear systems analysis. Using theoretical considerations we identify the points which are shared by all these complexity algorithms and show explicitly that the above parameters are intimately connected and mutually interdependent. A new geometrical interpretation of sample entropy and correlation dimension is provided and the consequences for the interpretation of sample entropy, its relative consistency and some of the algorithms for parameter selection for this quantity are discussed. To get an exact algorithmic relation between the three parameters we construct a very fast algorithm for simultaneous calculations of the above, which uses the full time series as the source of templates, rather than the usual 10%. This algorithm can be used in medical applications of complexity theory, as it can calculate all three parameters for a realistic recording of 104 points within minutes with the use of an average notebook computer.

A trade-off between local and distributed information processing associated with remote episodic versus semantic memory.

PubMed

Heisz, Jennifer J; Vakorin, Vasily; Ross, Bernhard; Levine, Brian; McIntosh, Anthony R

2014-01-01

Episodic memory and semantic memory produce very different subjective experiences yet rely on overlapping networks of brain regions for processing. Traditional approaches for characterizing functional brain networks emphasize static states of function and thus are blind to the dynamic information processing within and across brain regions. This study used information theoretic measures of entropy to quantify changes in the complexity of the brain's response as measured by magnetoencephalography while participants listened to audio recordings describing past personal episodic and general semantic events. Personal episodic recordings evoked richer subjective mnemonic experiences and more complex brain responses than general semantic recordings. Critically, we observed a trade-off between the relative contribution of local versus distributed entropy, such that personal episodic recordings produced relatively more local entropy whereas general semantic recordings produced relatively more distributed entropy. Changes in the relative contributions of local and distributed entropy to the total complexity of the system provides a potential mechanism that allows the same network of brain regions to represent cognitive information as either specific episodes or more general semantic knowledge.

Epoch-based Entropy for Early Screening of Alzheimer's Disease.

PubMed

Houmani, N; Dreyfus, G; Vialatte, F B

2015-12-01

In this paper, we introduce a novel entropy measure, termed epoch-based entropy. This measure quantifies disorder of EEG signals both at the time level and spatial level, using local density estimation by a Hidden Markov Model on inter-channel stationary epochs. The investigation is led on a multi-centric EEG database recorded from patients at an early stage of Alzheimer's disease (AD) and age-matched healthy subjects. We investigate the classification performances of this method, its robustness to noise, and its sensitivity to sampling frequency and to variations of hyperparameters. The measure is compared to two alternative complexity measures, Shannon's entropy and correlation dimension. The classification accuracies for the discrimination of AD patients from healthy subjects were estimated using a linear classifier designed on a development dataset, and subsequently tested on an independent test set. Epoch-based entropy reached a classification accuracy of 83% on the test dataset (specificity = 83.3%, sensitivity = 82.3%), outperforming the two other complexity measures. Furthermore, it was shown to be more stable to hyperparameter variations, and less sensitive to noise and sampling frequency disturbances than the other two complexity measures.

Entropy of electromyography time series

NASA Astrophysics Data System (ADS)

Kaufman, Miron; Zurcher, Ulrich; Sung, Paul S.

2007-12-01

A nonlinear analysis based on Renyi entropy is applied to electromyography (EMG) time series from back muscles. The time dependence of the entropy of the EMG signal exhibits a crossover from a subdiffusive regime at short times to a plateau at longer times. We argue that this behavior characterizes complex biological systems. The plateau value of the entropy can be used to differentiate between healthy and low back pain individuals.

Universal rule for the symmetric division of plant cells

PubMed Central

Besson, Sébastien; Dumais, Jacques

2011-01-01

The division of eukaryotic cells involves the assembly of complex cytoskeletal structures to exert the forces required for chromosome segregation and cytokinesis. In plants, empirical evidence suggests that tensional forces within the cytoskeleton cause cells to divide along the plane that minimizes the surface area of the cell plate (Errera’s rule) while creating daughter cells of equal size. However, exceptions to Errera’s rule cast doubt on whether a broadly applicable rule can be formulated for plant cell division. Here, we show that the selection of the plane of division involves a competition between alternative configurations whose geometries represent local area minima. We find that the probability of observing a particular division configuration increases inversely with its relative area according to an exponential probability distribution known as the Gibbs measure. Moreover, a comparison across land plants and their most recent algal ancestors confirms that the probability distribution is widely conserved and independent of cell shape and size. Using a maximum entropy formulation, we show that this empirical division rule is predicted by the dynamics of the tense cytoskeletal elements that lead to the positioning of the preprophase band. Based on the fact that the division plane is selected from the sole interaction of the cytoskeleton with cell shape, we posit that the new rule represents the default mechanism for plant cell division when internal or external cues are absent. PMID:21383128

Anomalous dynamics triggered by a non-convex equation of state in relativistic flows

NASA Astrophysics Data System (ADS)

Ibáñez, J. M.; Marquina, A.; Serna, S.; Aloy, M. A.

2018-05-01

The non-monotonicity of the local speed of sound in dense matter at baryon number densities much higher than the nuclear saturation density (n0 ≈ 0.16 fm-3) suggests the possible existence of a non-convex thermodynamics which will lead to a non-convex dynamics. Here, we explore the rich and complex dynamics that an equation of state (EoS) with non-convex regions in the pressure-density plane may develop as a result of genuinely relativistic effects, without a classical counterpart. To this end, we have introduced a phenomenological EoS, the parameters of which can be restricted owing to causality and thermodynamic stability constraints. This EoS can be regarded as a toy model with which we may mimic realistic (and far more complex) EoSs of practical use in the realm of relativistic hydrodynamics.

Stability of Tsallis entropy and instabilities of Rényi and normalized Tsallis entropies: a basis for q-exponential distributions.

PubMed

Abe, Sumiyoshi

2002-10-01

The q-exponential distributions, which are generalizations of the Zipf-Mandelbrot power-law distribution, are frequently encountered in complex systems at their stationary states. From the viewpoint of the principle of maximum entropy, they can apparently be derived from three different generalized entropies: the Rényi entropy, the Tsallis entropy, and the normalized Tsallis entropy. Accordingly, mere fittings of observed data by the q-exponential distributions do not lead to identification of the correct physical entropy. Here, stabilities of these entropies, i.e., their behaviors under arbitrary small deformation of a distribution, are examined. It is shown that, among the three, the Tsallis entropy is stable and can provide an entropic basis for the q-exponential distributions, whereas the others are unstable and cannot represent any experimentally observable quantities.

From Matter to Life

NASA Astrophysics Data System (ADS)

Imari Walker, Sara; Davies, Paul C. W.; Ellis, George F. R.

2017-02-01

1. Introduction Sara Imari Walker, Paul C. W. Davies and F. R. Ellis; Part I. Physics and Life: 2. The 'hard problem' of life Sara Imari Walker and Paul C. W. Davies; 3. Beyond initial conditions and laws of motion: constructor theory of information and life Chiara Marletto; Part II. Bio from Bit: 4. (How) did information emerge? Anne-Marie Grisogono; 5. On the emerging codes for chemical evolution Jillian E. Smith-Carpenter, Sha Li, Jay T. Goodwin, Anil K. Mehta and David G. Lynn; 6. Digital and analogue information in organisms Denis Noble; 7. From entropy to information: biased typewriters and the origin of life Christoph Adami and Thomas Labar; Part III. Life's Hidden Information: 8. Cryptographic nature David Krakauer; 9. Noise and function Steven Weinstein and Theodore Pavlic; 10. The many faces of state space compression David Wolpert, Eric Libby, Joshua Grochow and Simon DeDeo; 11. Causality, information and biological computation: an algorithmic software approach to life, disease and the immune system Hector Zenil, Angelika Schmidt and Jesper Tegnér; Part IV. Complexity and Causality: 12. Life's information hierarchy Jessica Flack; 13. Living through downward causation: from molecules to ecosystems Keith D. Farnsworth, George F. R. Ellis and Luc Jaeger; 14. Automata and animats: from dynamics to cause-effect structures Larissa Albantakis and Giulio Tononi; 15. Biological information, causality and specificity - an intimate relationship Karola Stotz and Paul Griffiths; Part V. From Matter to Mind: 16. Major transitions in political order Simon DeDeo; 17. Bits from biology for computational intelligence Michael Wibral, Joseph Lizier and Viola Priesemann; 18. Machine learning and the questions it raises G. Andrew D. Briggs and Dawid Potgieter.

Revisiting the phase transition of AdS-Maxwell-power-Yang-Mills black holes via AdS/CFT tools

NASA Astrophysics Data System (ADS)

El Moumni, H.

2018-01-01

In the present work we investigate the Van der Waals-like phase transition of AdS black hole solution in the Einstein-Maxwell-power-Yang-Mills gravity (EMPYM) via different approaches. After reconsidering this phase structure in the entropy-thermal plane, we recall the nonlocal observables such as holographic entanglement entropy and two point correlation function to show that the both observables exhibit a Van der Waals-like behavior as the case of the thermal entropy. By checking the Maxwell's equal area law and calculating the critical exponent for different values of charge C and nonlinearity parameter q we confirm that the first and the second order phases persist in the holographic framework. Also the validity of the Maxwell law is governed by the proximity to the critical point.

Finding the Cause: Verbal Framing Helps Children Extract Causal Evidence Embedded in a Complex Scene

ERIC Educational Resources Information Center

Butler, Lucas P.; Markman, Ellen M.

2012-01-01

In making causal inferences, children must both identify a causal problem and selectively attend to meaningful evidence. Four experiments demonstrate that verbally framing an event ("Which animals make Lion laugh?") helps 4-year-olds extract evidence from a complex scene to make accurate causal inferences. Whereas framing was unnecessary when…

Spread of entanglement and causality

NASA Astrophysics Data System (ADS)

Casini, Horacio; Liu, Hong; Mezei, Márk

2016-07-01

We investigate causality constraints on the time evolution of entanglement entropy after a global quench in relativistic theories. We first provide a general proof that the so-called tsunami velocity is bounded by the speed of light. We then generalize the free particle streaming model of [1] to general dimensions and to an arbitrary entanglement pattern of the initial state. In more than two spacetime dimensions the spread of entanglement in these models is highly sensitive to the initial entanglement pattern, but we are able to prove an upper bound on the normalized rate of growth of entanglement entropy, and hence the tsunami velocity. The bound is smaller than what one gets for quenches in holographic theories, which highlights the importance of interactions in the spread of entanglement in many-body systems. We propose an interacting model which we believe provides an upper bound on the spread of entanglement for interacting relativistic theories. In two spacetime dimensions with multiple intervals, this model and its variations are able to reproduce intricate results exhibited by holographic theories for a significant part of the parameter space. For higher dimensions, the model bounds the tsunami velocity at the speed of light. Finally, we construct a geometric model for entanglement propagation based on a tensor network construction for global quenches.

Revealing Relationships among Relevant Climate Variables with Information Theory

NASA Technical Reports Server (NTRS)

Knuth, Kevin H.; Golera, Anthony; Curry, Charles T.; Huyser, Karen A.; Kevin R. Wheeler; Rossow, William B.

2005-01-01

The primary objective of the NASA Earth-Sun Exploration Technology Office is to understand the observed Earth climate variability, thus enabling the determination and prediction of the climate's response to both natural and human-induced forcing. We are currently developing a suite of computational tools that will allow researchers to calculate, from data, a variety of information-theoretic quantities such as mutual information, which can be used to identify relationships among climate variables, and transfer entropy, which indicates the possibility of causal interactions. Our tools estimate these quantities along with their associated error bars, the latter of which is critical for describing the degree of uncertainty in the estimates. This work is based upon optimal binning techniques that we have developed for piecewise-constant, histogram-style models of the underlying density functions. Two useful side benefits have already been discovered. The first allows a researcher to determine whether there exist sufficient data to estimate the underlying probability density. The second permits one to determine an acceptable degree of round-off when compressing data for efficient transfer and storage. We also demonstrate how mutual information and transfer entropy can be applied so as to allow researchers not only to identify relations among climate variables, but also to characterize and quantify their possible causal interactions.

Information Theoretic Approaches to Rapid Discovery of Relationships in Large Climate Data Sets

NASA Technical Reports Server (NTRS)

Knuth, Kevin H.; Rossow, William B.; Clancy, Daniel (Technical Monitor)

2002-01-01

Mutual information as the asymptotic Bayesian measure of independence is an excellent starting point for investigating the existence of possible relationships among climate-relevant variables in large data sets, As mutual information is a nonlinear function of of its arguments, it is not beholden to the assumption of a linear relationship between the variables in question and can reveal features missed in linear correlation analyses. However, as mutual information is symmetric in its arguments, it only has the ability to reveal the probability that two variables are related. it provides no information as to how they are related; specifically, causal interactions or a relation based on a common cause cannot be detected. For this reason we also investigate the utility of a related quantity called the transfer entropy. The transfer entropy can be written as a difference between mutual informations and has the capability to reveal whether and how the variables are causally related. The application of these information theoretic measures is rested on some familiar examples using data from the International Satellite Cloud Climatology Project (ISCCP) to identify relation between global cloud cover and other variables, including equatorial pacific sea surface temperature (SST), over seasonal and El Nino Southern Oscillation (ENSO) cycles.

Generalized permutation entropy analysis based on the two-index entropic form S q , δ

NASA Astrophysics Data System (ADS)

Xu, Mengjia; Shang, Pengjian

2015-05-01

Permutation entropy (PE) is a novel measure to quantify the complexity of nonlinear time series. In this paper, we propose a generalized permutation entropy ( P E q , δ ) based on the recently postulated entropic form, S q , δ , which was proposed as an unification of the well-known Sq of nonextensive-statistical mechanics and S δ , a possibly appropriate candidate for the black-hole entropy. We find that P E q , δ with appropriate parameters can amplify minor changes and trends of complexities in comparison to PE. Experiments with this generalized permutation entropy method are performed with both synthetic and stock data showing its power. Results show that P E q , δ is an exponential function of q and the power ( k ( δ ) ) is a constant if δ is determined. Some discussions about k ( δ ) are provided. Besides, we also find some interesting results about power law.

Entropy-based complexity of the cardiovascular control in Parkinson disease: comparison between binning and k-nearest-neighbor approaches.

PubMed

Porta, Alberto; Bari, Vlasta; Bassani, Tito; Marchi, Andrea; Tassin, Stefano; Canesi, Margherita; Barbic, Franca; Furlan, Raffaello

2013-01-01

Entropy-based approaches are frequently used to quantify complexity of short-term cardiovascular control from spontaneous beat-to-beat variability of heart period (HP) and systolic arterial pressure (SAP). Among these tools the ones optimizing a critical parameter such as the pattern length are receiving more and more attention. This study compares two entropy-based techniques for the quantification of complexity making use of completely different strategies to optimize the pattern length. Comparison was carried out over HP and SAP variability series recorded from 12 Parkinson's disease (PD) patients without orthostatic hypotension or symptoms of orthostatic intolerance and 12 age-matched healthy control (HC) subjects. Regardless of the method, complexity of cardiovascular control increased in PD group, thus suggesting the early impairment of cardiovascular function.

A new complexity measure for time series analysis and classification

NASA Astrophysics Data System (ADS)

Nagaraj, Nithin; Balasubramanian, Karthi; Dey, Sutirth

2013-07-01

Complexity measures are used in a number of applications including extraction of information from data such as ecological time series, detection of non-random structure in biomedical signals, testing of random number generators, language recognition and authorship attribution etc. Different complexity measures proposed in the literature like Shannon entropy, Relative entropy, Lempel-Ziv, Kolmogrov and Algorithmic complexity are mostly ineffective in analyzing short sequences that are further corrupted with noise. To address this problem, we propose a new complexity measure ETC and define it as the "Effort To Compress" the input sequence by a lossless compression algorithm. Here, we employ the lossless compression algorithm known as Non-Sequential Recursive Pair Substitution (NSRPS) and define ETC as the number of iterations needed for NSRPS to transform the input sequence to a constant sequence. We demonstrate the utility of ETC in two applications. ETC is shown to have better correlation with Lyapunov exponent than Shannon entropy even with relatively short and noisy time series. The measure also has a greater rate of success in automatic identification and classification of short noisy sequences, compared to entropy and a popular measure based on Lempel-Ziv compression (implemented by Gzip).

Sample entropy and regularity dimension in complexity analysis of cortical surface structure in early Alzheimer's disease and aging.

PubMed

Chen, Ying; Pham, Tuan D

2013-05-15

We apply for the first time the sample entropy (SampEn) and regularity dimension model for measuring signal complexity to quantify the structural complexity of the brain on MRI. The concept of the regularity dimension is based on the theory of chaos for studying nonlinear dynamical systems, where power laws and entropy measure are adopted to develop the regularity dimension for modeling a mathematical relationship between the frequencies with which information about signal regularity changes in various scales. The sample entropy and regularity dimension of MRI-based brain structural complexity are computed for early Alzheimer's disease (AD) elder adults and age and gender-matched non-demented controls, as well as for a wide range of ages from young people to elder adults. A significantly higher global cortical structure complexity is detected in AD individuals (p<0.001). The increase of SampEn and the regularity dimension are also found to be accompanied with aging which might indicate an age-related exacerbation of cortical structural irregularity. The provided model can be potentially used as an imaging bio-marker for early prediction of AD and age-related cognitive decline. Copyright © 2013 Elsevier B.V. All rights reserved.

Cause-and-effect relationships in tandem swimmer models using transfer entropy

NASA Astrophysics Data System (ADS)

Peterson, Sean; Rosen, Maxwell; Gementzopoulos, Antonios; Zhang, Peng; Porfiri, Maurizio

2017-11-01

Swimming in a group affords a number of advantages to fish, including an enhanced ability to escape from predators, search for food, and mate. To study coordinated movements of fish, principled approaches are needed to unravel cause-and-effect relationships from raw-time series of multiple bodies moving in an encompassing fluid. In this work, we aim at demonstrating the validity of transfer entropy to elucidate cause-and-effect relationships in a fluid-structure interaction problem. Specifically, we consider two tandem airfoils in a uniform flow, wherein the pitching angle of one airfoil is actively controlled while the other is allowed to passively rotate. The active control alternates the pitch angle based upon an underlying two-state ergodic Markov process. We monitor the pitch angle of both the active and passive airfoils in time and demonstrate that transfer entropy can detect causality independent of which airfoil is actuated. The influence estimated by transfer entropy is found to be modulated by the distance between the two airfoils. The proposed data-driven technique offers a model-free perspective on fluid-structure interactions that can help illuminate the mechanisms of swimming in coordination. This work was supported by the National Science Foundation under Grant Numbers CBET-1332204 and CMMI-1433670.

Kramers-Kronig relations and causality conditions for graphene in the framework of the Dirac model

NASA Astrophysics Data System (ADS)

Klimchitskaya, G. L.; Mostepanenko, V. M.

2018-04-01

We analyze the concept of causality for the conductivity of graphene described by the Dirac model. It is recalled that the condition of causality leads to the analyticity of conductivity in the upper half-plane of complex frequencies and to the standard symmetry properties for its real and imaginary parts. This results in the Kramers-Kronig relations, which explicit form depends on whether the conductivity has no pole at zero frequency (as in the case of zero temperature when the band gap of graphene is larger than twice the chemical potential) or it has a pole (as in all other cases, specifically, at nonzero temperature). Through the direct analytic calculation it is shown that the real and imaginary parts of graphene conductivity, found recently on the basis of first principles of thermal quantum field theory using the polarization tensor in (2 +1 )-dimensional space-time, satisfy the Kramers-Kronig relations precisely. In so doing, the values of two integrals in the commonly used tables, which are also important for a wider area of dispersion relations in quantum field theory and elementary particle physics, are corrected. The obtained results are not of only fundamental theoretical character, but can be used as a guideline in testing the validity of different phenomenological approaches and for the interpretation of experimental data.

Ventilatory Patterning in a Mouse Model of Stroke

PubMed Central

Koo, Brian B; Strohl, Kingman P; Gillombardo, Carl B; Jacono, Frank J

2010-01-01

Cheyne-Stokes respiration (CSR) is a breathing pattern characterized by waxing and waning of breath volume and frequency, and is often recognized following stroke, when causal pathways are often obscure. We used an animal model to address the hypothesis that cerebral infarction is a mechanism for producing breathing instability. Fourteen male A/J mice underwent either stroke (n=7) or sham (n=7) procedure. Ventilation was measured using whole body plethysmography. Respiratory rate (RR), tidal volume (VT) and minute ventilation (Ve) mean values and coefficient of variation were computed for ventilation and oscillatory behavior. In addition, the ventilatory data were computationally fit to models to quantify autocorrelation, mutual information, sample entropy and a nonlinear complexity index. At the same time post procedure, stroke when compared to sham animal breathing consisted of a lower RR and autocorrelation, higher coefficient of variation for VT and higher coefficient of variation for Ve. Mutual information and the nonlinear complexity index were higher in breathing following stroke which also demonstrated a waxing/waning pattern. The absence of stroke in the sham animals was verified anatomically. We conclude that ventilatory pattern following cerebral infarction demonstrated increased variability with increased nonlinear patterning and a waxing/waning pattern, consistent with CSR. PMID:20472101

Thermodynamics of pairing in mesoscopic systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sumaryada, Tony; Volya, Alexander

Using numerical and analytical methods implemented for different models, we conduct a systematic study of the thermodynamic properties of pairing correlations in mesoscopic nuclear systems. Various quantities are calculated and analyzed using the exact solution of pairing. An in-depth comparison of canonical, grand canonical, and microcanonical ensembles is conducted. The nature of the pairing phase transition in a small system is of a particular interest. We discuss the onset of discontinuity in the thermodynamic variables, fluctuations, and evolution of zeros of the canonical and grand canonical partition functions in the complex plane. The behavior of the invariant correlational entropy ismore » also studied in the transitional region of interest. The change in the character of the phase transition due to the presence of a magnetic field is discussed along with studies of superconducting thermodynamics.« less

An improved version of NCOREL: A computer program for 3-D nonlinear supersonic potential flow computations

NASA Technical Reports Server (NTRS)

Siclari, Michael J.

1988-01-01

A computer code called NCOREL (for Nonconical Relaxation) has been developed to solve for supersonic full potential flows over complex geometries. The method first solves for the conical at the apex and then marches downstream in a spherical coordinate system. Implicit relaxation techniques are used to numerically solve the full potential equation at each subsequent crossflow plane. Many improvements have been made to the original code including more reliable numerics for computing wing-body flows with multiple embedded shocks, inlet flow through simulation, wake model and entropy corrections. Line relaxation or approximate factorization schemes are optionally available. Improved internal grid generation using analytic conformal mappings, supported by a simple geometric Harris wave drag input that was originally developed for panel methods and internal geometry package are some of the new features.

Antipsychotics reverse abnormal EEG complexity in drug-naïve schizophrenia: A multiscale entropy analysis

PubMed Central

Takahashi, Tetsuya; Cho, Raymond Y.; Mizuno, Tomoyuki; Kikuchi, Mitsuru; Murata, Tetsuhito; Takahashi, Koichi; Wada, Yuji

2010-01-01

Multiscale entropy (MSE) analysis is a novel entropy-based approach for measuring dynamical complexity in physiological systems over a range of temporal scales. To evaluate this analytic approach as an aid to elucidating the pathophysiologic mechanisms in schizophrenia, we examined MSE in EEG activity in drug-naïve schizophrenia subjects pre- and post-treatment with antipsychotics in comparison with traditional EEG analysis. We recorded eyes-closed resting state EEG from frontal, temporal, parietal and occipital regions in drug-naïve 22 schizophrenia and 24 age-matched healthy control subjects. Fifteen patients were re-evaluated within 2–8 weeks after the initiation of antipsychotic treatment. For each participant, MSE was calculated on one continuous 60 second epoch for each experimental session. Schizophrenia subjects showed significantly higher complexity at higher time scales (lower frequencies), than that of healthy controls in fronto-centro-temporal, but not in parieto-occipital regions. Post-treatment, this higher complexity decreased to healthy control subject levels selectively in fronto-central regions, while the increased complexity in temporal sites remained higher. Comparative power analysis identified spectral slowing in frontal regions in pre-treatment schizophrenia subjects, consistent with previous findings, whereas no antipsychotic treatment effect was observed. In summary, multiscale entropy measures identified abnormal dynamical EEG signal complexity in anterior brain areas in schizophrenia that normalized selectively in fronto-central areas with antipsychotic treatment. These findings show that entropy-based analytic methods may serve as a novel approach for characterizing and understanding abnormal cortical dynamics in schizophrenia, and elucidating the therapeutic mechanisms of antipsychotics. PMID:20149880

The Effects of Aging and Dual Tasking on Human Gait Complexity During Treadmill Walking: A Comparative Study Using Quantized Dynamical Entropy and Sample Entropy.

PubMed

Ahmadi, Samira; Wu, Christine; Sepehri, Nariman; Kantikar, Anuprita; Nankar, Mayur; Szturm, Tony

2018-01-01

Quantized dynamical entropy (QDE) has recently been proposed as a new measure to quantify the complexity of dynamical systems with the purpose of offering a better computational efficiency. This paper further investigates the viability of this method using five different human gait signals. These signals are recorded while normal walking and while performing secondary tasks among two age groups (young and older age groups). The results are compared with the outcomes of previously established sample entropy (SampEn) measure for the same signals. We also study how analyzing segmented and spatially and temporally normalized signal differs from analyzing whole data. Our findings show that human gait signals become more complex as people age and while they are cognitively loaded. Center of pressure (COP) displacement in mediolateral direction is the best signal for showing the gait changes. Moreover, the results suggest that by segmenting data, more information about intrastride dynamical features are obtained. Most importantly, QDE is shown to be a reliable measure for human gait complexity analysis.

Thermodynamics of complex structures formed between single-stranded DNA oligomers and the KH domains of the far upstream element binding protein

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chakraborty, Kaushik; Sinha, Sudipta Kumar; Bandyopadhyay, Sanjoy, E-mail: sanjoy@chem.iitkgp.ernet.in

The noncovalent interaction between protein and DNA is responsible for regulating the genetic activities in living organisms. The most critical issue in this problem is to understand the underlying driving force for the formation and stability of the complex. To address this issue, we have performed atomistic molecular dynamics simulations of two DNA binding K homology (KH) domains (KH3 and KH4) of the far upstream element binding protein (FBP) complexed with two single-stranded DNA (ss-DNA) oligomers in aqueous media. Attempts have been made to calculate the individual components of the net entropy change for the complexation process by adopting suitablemore » statistical mechanical approaches. Our calculations reveal that translational, rotational, and configurational entropy changes of the protein and the DNA components have unfavourable contributions for this protein-DNA association process and such entropy lost is compensated by the entropy gained due to the release of hydration layer water molecules. The free energy change corresponding to the association process has also been calculated using the Free Energy Perturbation (FEP) method. The free energy gain associated with the KH4–DNA complex formation has been found to be noticeably higher than that involving the formation of the KH3–DNA complex.« less

Formalizing the Role of Agent-Based Modeling in Causal Inference and Epidemiology

PubMed Central

Marshall, Brandon D. L.; Galea, Sandro

2015-01-01

Calls for the adoption of complex systems approaches, including agent-based modeling, in the field of epidemiology have largely centered on the potential for such methods to examine complex disease etiologies, which are characterized by feedback behavior, interference, threshold dynamics, and multiple interacting causal effects. However, considerable theoretical and practical issues impede the capacity of agent-based methods to examine and evaluate causal effects and thus illuminate new areas for intervention. We build on this work by describing how agent-based models can be used to simulate counterfactual outcomes in the presence of complexity. We show that these models are of particular utility when the hypothesized causal mechanisms exhibit a high degree of interdependence between multiple causal effects and when interference (i.e., one person's exposure affects the outcome of others) is present and of intrinsic scientific interest. Although not without challenges, agent-based modeling (and complex systems methods broadly) represent a promising novel approach to identify and evaluate complex causal effects, and they are thus well suited to complement other modern epidemiologic methods of etiologic inquiry. PMID:25480821

Bidirectional Cardio-Respiratory Interactions in Heart Failure.

PubMed

Radovanović, Nikola N; Pavlović, Siniša U; Milašinović, Goran; Kirćanski, Bratislav; Platiša, Mirjana M

2018-01-01

We investigated cardio-respiratory coupling in patients with heart failure by quantification of bidirectional interactions between cardiac (RR intervals) and respiratory signals with complementary measures of time series analysis. Heart failure patients were divided into three groups of twenty, age and gender matched, subjects: with sinus rhythm (HF-Sin), with sinus rhythm and ventricular extrasystoles (HF-VES), and with permanent atrial fibrillation (HF-AF). We included patients with indication for implantation of implantable cardioverter defibrillator or cardiac resynchronization therapy device. ECG and respiratory signals were simultaneously acquired during 20 min in supine position at spontaneous breathing frequency in 20 healthy control subjects and in patients before device implantation. We used coherence, Granger causality and cross-sample entropy analysis as complementary measures of bidirectional interactions between RR intervals and respiratory rhythm. In heart failure patients with arrhythmias (HF-VES and HF-AF) there is no coherence between signals ( p < 0.01), while in HF-Sin it is reduced ( p < 0.05), compared with control subjects. In all heart failure groups causality between signals is diminished, but with significantly stronger causality of RR signal in respiratory signal in HF-VES. Cross-sample entropy analysis revealed the strongest synchrony between respiratory and RR signal in HF-VES group. Beside respiratory sinus arrhythmia there is another type of cardio-respiratory interaction based on the synchrony between cardiac and respiratory rhythm. Both of them are altered in heart failure patients. Respiratory sinus arrhythmia is reduced in HF-Sin patients and vanished in heart failure patients with arrhythmias. Contrary, in HF-Sin and HF-VES groups, synchrony increased, probably as consequence of some dominant neural compensatory mechanisms. The coupling of cardiac and respiratory rhythm in heart failure patients varies depending on the presence of atrial/ventricular arrhythmias and it could be revealed by complementary methods of time series analysis.

Three perspectives on complexity: entropy, compression, subsymmetry

NASA Astrophysics Data System (ADS)

Nagaraj, Nithin; Balasubramanian, Karthi

2017-12-01

There is no single universally accepted definition of `Complexity'. There are several perspectives on complexity and what constitutes complex behaviour or complex systems, as opposed to regular, predictable behaviour and simple systems. In this paper, we explore the following perspectives on complexity: effort-to-describe (Shannon entropy H, Lempel-Ziv complexity LZ), effort-to-compress (ETC complexity) and degree-of-order (Subsymmetry or SubSym). While Shannon entropy and LZ are very popular and widely used, ETC is relatively a new complexity measure. In this paper, we also propose a novel normalized complexity measure SubSym based on the existing idea of counting the number of subsymmetries or palindromes within a sequence. We compare the performance of these complexity measures on the following tasks: (A) characterizing complexity of short binary sequences of lengths 4 to 16, (B) distinguishing periodic and chaotic time series from 1D logistic map and 2D Hénon map, (C) analyzing the complexity of stochastic time series generated from 2-state Markov chains, and (D) distinguishing between tonic and irregular spiking patterns generated from the `Adaptive exponential integrate-and-fire' neuron model. Our study reveals that each perspective has its own advantages and uniqueness while also having an overlap with each other.

Multiscale entropy-based methods for heart rate variability complexity analysis

NASA Astrophysics Data System (ADS)

Silva, Luiz Eduardo Virgilio; Cabella, Brenno Caetano Troca; Neves, Ubiraci Pereira da Costa; Murta Junior, Luiz Otavio

2015-03-01

Physiologic complexity is an important concept to characterize time series from biological systems, which associated to multiscale analysis can contribute to comprehension of many complex phenomena. Although multiscale entropy has been applied to physiological time series, it measures irregularity as function of scale. In this study we purpose and evaluate a set of three complexity metrics as function of time scales. Complexity metrics are derived from nonadditive entropy supported by generation of surrogate data, i.e. SDiffqmax, qmax and qzero. In order to access accuracy of proposed complexity metrics, receiver operating characteristic (ROC) curves were built and area under the curves was computed for three physiological situations. Heart rate variability (HRV) time series in normal sinus rhythm, atrial fibrillation, and congestive heart failure data set were analyzed. Results show that proposed metric for complexity is accurate and robust when compared to classic entropic irregularity metrics. Furthermore, SDiffqmax is the most accurate for lower scales, whereas qmax and qzero are the most accurate when higher time scales are considered. Multiscale complexity analysis described here showed potential to assess complex physiological time series and deserves further investigation in wide context.

Renyi entropy measures of heart rate Gaussianity.

PubMed

Lake, Douglas E

2006-01-01

Sample entropy and approximate entropy are measures that have been successfully utilized to study the deterministic dynamics of heart rate (HR). A complementary stochastic point of view and a heuristic argument using the Central Limit Theorem suggests that the Gaussianity of HR is a complementary measure of the physiological complexity of the underlying signal transduction processes. Renyi entropy (or q-entropy) is a widely used measure of Gaussianity in many applications. Particularly important members of this family are differential (or Shannon) entropy (q = 1) and quadratic entropy (q = 2). We introduce the concepts of differential and conditional Renyi entropy rate and, in conjunction with Burg's theorem, develop a measure of the Gaussianity of a linear random process. Robust algorithms for estimating these quantities are presented along with estimates of their standard errors.

A mechanism producing power law etc. distributions

NASA Astrophysics Data System (ADS)

Li, Heling; Shen, Hongjun; Yang, Bin

2017-07-01

Power law distribution is playing an increasingly important role in the complex system study. Based on the insolvability of complex systems, the idea of incomplete statistics is utilized and expanded, three different exponential factors are introduced in equations about the normalization condition, statistical average and Shannon entropy, with probability distribution function deduced about exponential function, power function and the product form between power function and exponential function derived from Shannon entropy and maximal entropy principle. So it is shown that maximum entropy principle can totally replace equal probability hypothesis. Owing to the fact that power and probability distribution in the product form between power function and exponential function, which cannot be derived via equal probability hypothesis, can be derived by the aid of maximal entropy principle, it also can be concluded that maximal entropy principle is a basic principle which embodies concepts more extensively and reveals basic principles on motion laws of objects more fundamentally. At the same time, this principle also reveals the intrinsic link between Nature and different objects in human society and principles complied by all.

Entanglement entropy and entanglement spectrum of Bi_1-xSb_x (111) bilayers.

PubMed

Brzezińska, Marta; Bieniek, Maciej; Woźniak, Tomasz; Potasz, Paweł; Wójs, Arkadiusz

2018-02-14

We study topological properties of Bi$_{1-x}$Sb$_{x}$ bilayers in the (111) plane using entanglement measures. Electronic structures are investigated within multi-orbital tight-binding model and structural stability is confirmed through first-principles calculations. Topologically non-trivial nature of bismuth bilayer is proved by the presence of spectral flow in the entanglement spectrum. We consider topological phase transitions driven by a composition change x, an applied external electric field in Bi bilayer and strain in Sb bilayer. Composition- and strain-induced phase transitions reveal a finite discontinuity in the entanglement entropy. This quantity remains a continuous function of the electric field strength, but shows a finite discontinuity in the first derivative. We relate the difference in behavior of the entanglement entropy to the breaking of inversion symmetry in the last case. © 2018 IOP Publishing Ltd.

Entanglement entropy and entanglement spectrum of Bi1-x Sb x (1 1 1) bilayers.

PubMed

Brzezińska, Marta; Bieniek, Maciej; Woźniak, Tomasz; Potasz, Paweł; Wójs, Arkadiusz

2018-02-28

We study topological properties of Bi 1-x Sb x bilayers in the (1 1 1) plane using entanglement measures. Electronic structures are investigated within multi-orbital tight-binding model and structural stability is confirmed through first-principles calculations. The topologically non-trivial nature of the bismuth bilayer is proved by the presence of spectral flow in the entanglement spectrum. We consider topological phase transitions driven by a composition change x, an applied external electric field in Bi bilayers and strain in Sb bilayers. Composition- and strain-induced phase transitions reveal a finite discontinuity in the entanglement entropy. This quantity remains a continuous function of the electric field strength, but shows a finite discontinuity in the first derivative. We relate the difference in behavior of the entanglement entropy to the breaking of inversion symmetry in the last case.

Entanglement entropy and entanglement spectrum of Bi1-x Sb x (1 1 1) bilayers

NASA Astrophysics Data System (ADS)

Brzezińska, Marta; Bieniek, Maciej; Woźniak, Tomasz; Potasz, Paweł; Wójs, Arkadiusz

2018-03-01

We study topological properties of Bi1-x Sb x bilayers in the (1 1 1) plane using entanglement measures. Electronic structures are investigated within multi-orbital tight-binding model and structural stability is confirmed through first-principles calculations. The topologically non-trivial nature of the bismuth bilayer is proved by the presence of spectral flow in the entanglement spectrum. We consider topological phase transitions driven by a composition change x, an applied external electric field in Bi bilayers and strain in Sb bilayers. Composition- and strain-induced phase transitions reveal a finite discontinuity in the entanglement entropy. This quantity remains a continuous function of the electric field strength, but shows a finite discontinuity in the first derivative. We relate the difference in behavior of the entanglement entropy to the breaking of inversion symmetry in the last case.

Causality and complexity: the myth of objectivity in science.

PubMed

Mikulecky, Donald C

2007-10-01

Two distinctly different worldviews dominate today's thinking in science and in the world of ideas outside of science. Using the approach advocated by Robert M. Hutchins, it is possible to see a pattern of interaction between ideas in science and in other spheres such as philosophy, religion, and politics. Instead of compartmentalizing these intellectual activities, it is worthwhile to look for common threads of mutual influence. Robert Rosen has created an approach to scientific epistemology that might seem radical to some. However, it has characteristics that resemble ideas in other fields, in particular in the writings of George Lakoff, Leo Strauss, and George Soros. Historically, the atmosphere at the University of Chicago during Hutchins' presidency gave rise to Rashevsky's relational biology, which Rosen carried forward. Strauss was writing his political philosophy there at the same time. One idea is paramount in all this, and it is Lakoff who gives us the most insight into how the worldviews differ using this idea. The central difference has to do with causality, the fundamental concept that we use to build a worldview. Causal entailment has two distinct forms in Lakoff 's analysis: direct causality and complex causality. Rosen's writings on complexity create a picture of complex causality that is extremely useful in its detail, grounding in the ideas of Aristotle. Strauss asks for a return to the ancients to put philosophy back on track. Lakoff sees the weaknesses in Western philosophy in a similar way, and Rosen provides tools for dealing with the problem. This introduction to the relationships between the thinking of these authors is meant to stimulate further discourse on the role of complex causal entailment in all areas of thought, and how it brings them together in a holistic worldview. The worldview built on complex causality is clearly distinct from that built around simple, direct causality. One important difference is that the impoverished causal entailment that accompanies the machine metaphor in science is unable to give us a clear way to distinguish living organisms from machines. Complex causality finds a dichotomy between organisms, which are closed to efficient cause, and machines, which require entailment from outside. An argument can be made that confusing living organisms with machines, as is done in the worldview using direct cause, makes religion a necessity to supply the missing causal entailment.

A Complex Systems Approach to Causal Discovery in Psychiatry.

PubMed

Saxe, Glenn N; Statnikov, Alexander; Fenyo, David; Ren, Jiwen; Li, Zhiguo; Prasad, Meera; Wall, Dennis; Bergman, Nora; Briggs, Ernestine C; Aliferis, Constantin

2016-01-01

Conventional research methodologies and data analytic approaches in psychiatric research are unable to reliably infer causal relations without experimental designs, or to make inferences about the functional properties of the complex systems in which psychiatric disorders are embedded. This article describes a series of studies to validate a novel hybrid computational approach--the Complex Systems-Causal Network (CS-CN) method-designed to integrate causal discovery within a complex systems framework for psychiatric research. The CS-CN method was first applied to an existing dataset on psychopathology in 163 children hospitalized with injuries (validation study). Next, it was applied to a much larger dataset of traumatized children (replication study). Finally, the CS-CN method was applied in a controlled experiment using a 'gold standard' dataset for causal discovery and compared with other methods for accurately detecting causal variables (resimulation controlled experiment). The CS-CN method successfully detected a causal network of 111 variables and 167 bivariate relations in the initial validation study. This causal network had well-defined adaptive properties and a set of variables was found that disproportionally contributed to these properties. Modeling the removal of these variables resulted in significant loss of adaptive properties. The CS-CN method was successfully applied in the replication study and performed better than traditional statistical methods, and similarly to state-of-the-art causal discovery algorithms in the causal detection experiment. The CS-CN method was validated, replicated, and yielded both novel and previously validated findings related to risk factors and potential treatments of psychiatric disorders. The novel approach yields both fine-grain (micro) and high-level (macro) insights and thus represents a promising approach for complex systems-oriented research in psychiatry.

Exploratory Causal Analysis in Bivariate Time Series Data

NASA Astrophysics Data System (ADS)

McCracken, James M.

Many scientific disciplines rely on observational data of systems for which it is difficult (or impossible) to implement controlled experiments and data analysis techniques are required for identifying causal information and relationships directly from observational data. This need has lead to the development of many different time series causality approaches and tools including transfer entropy, convergent cross-mapping (CCM), and Granger causality statistics. In this thesis, the existing time series causality method of CCM is extended by introducing a new method called pairwise asymmetric inference (PAI). It is found that CCM may provide counter-intuitive causal inferences for simple dynamics with strong intuitive notions of causality, and the CCM causal inference can be a function of physical parameters that are seemingly unrelated to the existence of a driving relationship in the system. For example, a CCM causal inference might alternate between ''voltage drives current'' and ''current drives voltage'' as the frequency of the voltage signal is changed in a series circuit with a single resistor and inductor. PAI is introduced to address both of these limitations. Many of the current approaches in the times series causality literature are not computationally straightforward to apply, do not follow directly from assumptions of probabilistic causality, depend on assumed models for the time series generating process, or rely on embedding procedures. A new approach, called causal leaning, is introduced in this work to avoid these issues. The leaning is found to provide causal inferences that agree with intuition for both simple systems and more complicated empirical examples, including space weather data sets. The leaning may provide a clearer interpretation of the results than those from existing time series causality tools. A practicing analyst can explore the literature to find many proposals for identifying drivers and causal connections in times series data sets, but little research exists of how these tools compare to each other in practice. This work introduces and defines exploratory causal analysis (ECA) to address this issue along with the concept of data causality in the taxonomy of causal studies introduced in this work. The motivation is to provide a framework for exploring potential causal structures in time series data sets. ECA is used on several synthetic and empirical data sets, and it is found that all of the tested time series causality tools agree with each other (and intuitive notions of causality) for many simple systems but can provide conflicting causal inferences for more complicated systems. It is proposed that such disagreements between different time series causality tools during ECA might provide deeper insight into the data than could be found otherwise.

Using entropy measures to characterize human locomotion.

PubMed

Leverick, Graham; Szturm, Tony; Wu, Christine Q

2014-12-01

Entropy measures have been widely used to quantify the complexity of theoretical and experimental dynamical systems. In this paper, the value of using entropy measures to characterize human locomotion is demonstrated based on their construct validity, predictive validity in a simple model of human walking and convergent validity in an experimental study. Results show that four of the five considered entropy measures increase meaningfully with the increased probability of falling in a simple passive bipedal walker model. The same four entropy measures also experienced statistically significant increases in response to increasing age and gait impairment caused by cognitive interference in an experimental study. Of the considered entropy measures, the proposed quantized dynamical entropy (QDE) and quantization-based approximation of sample entropy (QASE) offered the best combination of sensitivity to changes in gait dynamics and computational efficiency. Based on these results, entropy appears to be a viable candidate for assessing the stability of human locomotion.

The Entropy of Non-Ergodic Complex Systems — a Derivation from First Principles

NASA Astrophysics Data System (ADS)

Thurner, Stefan; Hanel, Rudolf

In information theory the 4 Shannon-Khinchin1,2 (SK) axioms determine Boltzmann Gibbs entropy, S -∑i pilog pi, as the unique entropy. Physics is different from information in the sense that physical systems can be non-ergodic or non-Markovian. To characterize such strongly interacting, statistical systems - complex systems in particular - within a thermodynamical framework it might be necessary to introduce generalized entropies. A series of such entropies have been proposed in the past decades. Until now the understanding of their fundamental origin and their deeper relations to complex systems remains unclear. To clarify the situation we note that non-ergodicity explicitly violates the fourth SK axiom. We show that by relaxing this axiom the entropy generalizes to, S ∑i Γ(d + 1, 1 - c log pi), where Γ is the incomplete Gamma function, and c and d are scaling exponents. All recently proposed entropies compatible with the first 3 SK axioms appear to be special cases. We prove that each statistical system is uniquely characterized by the pair of the two scaling exponents (c, d), which defines equivalence classes for all systems. The corresponding distribution functions are special forms of Lambert-W exponentials containing, as special cases, Boltzmann, stretched exponential and Tsallis distributions (power-laws) - all widely abundant in nature. This derivation is the first ab initio justification for generalized entropies. We next show how the phasespace volume of a system is related to its generalized entropy, and provide a concise criterion when it is not of Boltzmann-Gibbs type but assumes a generalized form. We show that generalized entropies only become relevant when the dynamically (statistically) relevant fraction of degrees of freedom in a system vanishes in the thermodynamic limit. These are systems where the bulk of the degrees of freedom is frozen. Systems governed by generalized entropies are therefore systems whose phasespace volume effectively collapses to a lower-dimensional 'surface'. We explicitly illustrate the situation for accelerating random walks, and a spin system on a constant-conectancy network. We argue that generalized entropies should be relevant for self-organized critical systems such as sand piles, for spin systems which form meta-structures such as vortices, domains, instantons, etc., and for problems associated with anomalous diffusion.

Information Flows? A Critique of Transfer Entropies

NASA Astrophysics Data System (ADS)

James, Ryan G.; Barnett, Nix; Crutchfield, James P.

2016-06-01

A central task in analyzing complex dynamics is to determine the loci of information storage and the communication topology of information flows within a system. Over the last decade and a half, diagnostics for the latter have come to be dominated by the transfer entropy. Via straightforward examples, we show that it and a derivative quantity, the causation entropy, do not, in fact, quantify the flow of information. At one and the same time they can overestimate flow or underestimate influence. We isolate why this is the case and propose several avenues to alternate measures for information flow. We also address an auxiliary consequence: The proliferation of networks as a now-common theoretical model for large-scale systems, in concert with the use of transferlike entropies, has shoehorned dyadic relationships into our structural interpretation of the organization and behavior of complex systems. This interpretation thus fails to include the effects of polyadic dependencies. The net result is that much of the sophisticated organization of complex systems may go undetected.

Refined composite multivariate generalized multiscale fuzzy entropy: A tool for complexity analysis of multichannel signals

NASA Astrophysics Data System (ADS)

Azami, Hamed; Escudero, Javier

2017-01-01

Multiscale entropy (MSE) is an appealing tool to characterize the complexity of time series over multiple temporal scales. Recent developments in the field have tried to extend the MSE technique in different ways. Building on these trends, we propose the so-called refined composite multivariate multiscale fuzzy entropy (RCmvMFE) whose coarse-graining step uses variance (RCmvMFEσ2) or mean (RCmvMFEμ). We investigate the behavior of these multivariate methods on multichannel white Gaussian and 1/ f noise signals, and two publicly available biomedical recordings. Our simulations demonstrate that RCmvMFEσ2 and RCmvMFEμ lead to more stable results and are less sensitive to the signals' length in comparison with the other existing multivariate multiscale entropy-based methods. The classification results also show that using both the variance and mean in the coarse-graining step offers complexity profiles with complementary information for biomedical signal analysis. We also made freely available all the Matlab codes used in this paper.

Performance of Children with Developmental Dyslexia on High and Low Topological Entropy Artificial Grammar Learning Task

ERIC Educational Resources Information Center

Katan, Pesia; Kahta, Shani; Sasson, Ayelet; Schiff, Rachel

2017-01-01

Graph complexity as measured by topological entropy has been previously shown to affect performance on artificial grammar learning tasks among typically developing children. The aim of this study was to examine the effect of graph complexity on implicit sequential learning among children with developmental dyslexia. Our goal was to determine…

Markov and non-Markov processes in complex systems by the dynamical information entropy

NASA Astrophysics Data System (ADS)

Yulmetyev, R. M.; Gafarov, F. M.

1999-12-01

We consider the Markov and non-Markov processes in complex systems by the dynamical information Shannon entropy (DISE) method. The influence and important role of the two mutually dependent channels of entropy alternation (creation or generation of correlation) and anti-correlation (destroying or annihilation of correlation) have been discussed. The developed method has been used for the analysis of the complex systems of various natures: slow neutron scattering in liquid cesium, psychology (short-time numeral and pattern human memory and effect of stress on the dynamical taping-test), random dynamics of RR-intervals in human ECG (problem of diagnosis of various disease of the human cardio-vascular systems), chaotic dynamics of the parameters of financial markets and ecological systems.

Towards an information geometric characterization/classification of complex systems. I. Use of generalized entropies

NASA Astrophysics Data System (ADS)

Ghikas, Demetris P. K.; Oikonomou, Fotios D.

2018-04-01

Using the generalized entropies which depend on two parameters we propose a set of quantitative characteristics derived from the Information Geometry based on these entropies. Our aim, at this stage, is to construct first some fundamental geometric objects which will be used in the development of our geometrical framework. We first establish the existence of a two-parameter family of probability distributions. Then using this family we derive the associated metric and we state a generalized Cramer-Rao Inequality. This gives a first two-parameter classification of complex systems. Finally computing the scalar curvature of the information manifold we obtain a further discrimination of the corresponding classes. Our analysis is based on the two-parameter family of generalized entropies of Hanel and Thurner (2011).

Planck absolute entropy of a rotating BTZ black hole

NASA Astrophysics Data System (ADS)

Riaz, S. M. Jawwad

2018-04-01

In this paper, the Planck absolute entropy and the Bekenstein-Smarr formula of the rotating Banados-Teitelboim-Zanelli (BTZ) black hole are presented via a complex thermodynamical system contributed by its inner and outer horizons. The redefined entropy approaches zero as the temperature of the rotating BTZ black hole tends to absolute zero, satisfying the Nernst formulation of a black hole. Hence, it can be regarded as the Planck absolute entropy of the rotating BTZ black hole.

Use and validity of principles of extremum of entropy production in the study of complex systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Heitor Reis, A., E-mail: ahr@uevora.pt

2014-07-15

It is shown how both the principles of extremum of entropy production, which are often used in the study of complex systems, follow from the maximization of overall system conductivities, under appropriate constraints. In this way, the maximum rate of entropy production (MEP) occurs when all the forces in the system are kept constant. On the other hand, the minimum rate of entropy production (mEP) occurs when all the currents that cross the system are kept constant. A brief discussion on the validity of the application of the mEP and MEP principles in several cases, and in particular to themore » Earth’s climate is also presented. -- Highlights: •The principles of extremum of entropy production are not first principles. •They result from the maximization of conductivities under appropriate constraints. •The conditions of their validity are set explicitly. •Some long-standing controversies are discussed and clarified.« less

Characterising Dynamic Instability in High Water-Cut Oil-Water Flows Using High-Resolution Microwave Sensor Signals

NASA Astrophysics Data System (ADS)

Liu, Weixin; Jin, Ningde; Han, Yunfeng; Ma, Jing

2018-06-01

In the present study, multi-scale entropy algorithm was used to characterise the complex flow phenomena of turbulent droplets in high water-cut oil-water two-phase flow. First, we compared multi-scale weighted permutation entropy (MWPE), multi-scale approximate entropy (MAE), multi-scale sample entropy (MSE) and multi-scale complexity measure (MCM) for typical nonlinear systems. The results show that MWPE presents satisfied variability with scale and anti-noise ability. Accordingly, we conducted an experiment of vertical upward oil-water two-phase flow with high water-cut and collected the signals of a high-resolution microwave resonant sensor, based on which two indexes, the entropy rate and mean value of MWPE, were extracted. Besides, the effects of total flow rate and water-cut on these two indexes were analysed. Our researches show that MWPE is an effective method to uncover the dynamic instability of oil-water two-phase flow with high water-cut.

Multiscale entropy analysis of human gait dynamics

NASA Astrophysics Data System (ADS)

Costa, M.; Peng, C.-K.; L. Goldberger, Ary; Hausdorff, Jeffrey M.

2003-12-01

We compare the complexity of human gait time series from healthy subjects under different conditions. Using the recently developed multiscale entropy algorithm, which provides a way to measure complexity over a range of scales, we observe that normal spontaneous walking has the highest complexity when compared to slow and fast walking and also to walking paced by a metronome. These findings have implications for modeling locomotor control and for quantifying gait dynamics in physiologic and pathologic states.

Multiscale entropy analysis of heart rate variability in heart failure, hypertensive, and sinoaortic-denervated rats: classical and refined approaches.

PubMed

Silva, Luiz Eduardo Virgilio; Lataro, Renata Maria; Castania, Jaci Airton; da Silva, Carlos Alberto Aguiar; Valencia, Jose Fernando; Murta, Luiz Otavio; Salgado, Helio Cesar; Fazan, Rubens; Porta, Alberto

2016-07-01

The analysis of heart rate variability (HRV) by nonlinear methods has been gaining increasing interest due to their ability to quantify the complexity of cardiovascular regulation. In this study, multiscale entropy (MSE) and refined MSE (RMSE) were applied to track the complexity of HRV as a function of time scale in three pathological conscious animal models: rats with heart failure (HF), spontaneously hypertensive rats (SHR), and rats with sinoaortic denervation (SAD). Results showed that HF did not change HRV complexity, although there was a tendency to decrease the entropy in HF animals. On the other hand, SHR group was characterized by reduced complexity at long time scales, whereas SAD animals exhibited a smaller short- and long-term irregularity. We propose that short time scales (1 to 4), accounting for fast oscillations, are more related to vagal and respiratory control, whereas long time scales (5 to 20), accounting for slow oscillations, are more related to sympathetic control. The increased sympathetic modulation is probably the main reason for the lower entropy observed at high scales for both SHR and SAD groups, acting as a negative factor for the cardiovascular complexity. This study highlights the contribution of the multiscale complexity analysis of HRV for understanding the physiological mechanisms involved in cardiovascular regulation. Copyright © 2016 the American Physiological Society.

Shannon information, LMC complexity and Rényi entropies: a straightforward approach.

PubMed

López-Ruiz, Ricardo

2005-04-01

The LMC complexity, an indicator of complexity based on a probabilistic description, is revisited. A straightforward approach allows us to establish the time evolution of this indicator in a near-equilibrium situation and gives us a new insight for interpreting the LMC complexity for a general non equilibrium system. Its relationship with the Rényi entropies is also explained. One of the advantages of this indicator is that its calculation does not require a considerable computational effort in many cases of physical and biological interest.

Salient target detection based on pseudo-Wigner-Ville distribution and Rényi entropy.

PubMed

Xu, Yuannan; Zhao, Yuan; Jin, Chenfei; Qu, Zengfeng; Liu, Liping; Sun, Xiudong

2010-02-15

We present what we believe to be a novel method based on pseudo-Wigner-Ville distribution (PWVD) and Rényi entropy for salient targets detection. In the foundation of studying the statistical property of Rényi entropy via PWVD, the residual entropy-based saliency map of an input image can be obtained. From the saliency map, target detection is completed by the simple and convenient threshold segmentation. Experimental results demonstrate the proposed method can detect targets effectively in complex ground scenes.

Inhomogeneous point-process entropy: An instantaneous measure of complexity in discrete systems

NASA Astrophysics Data System (ADS)

Valenza, Gaetano; Citi, Luca; Scilingo, Enzo Pasquale; Barbieri, Riccardo

2014-05-01

Measures of entropy have been widely used to characterize complexity, particularly in physiological dynamical systems modeled in discrete time. Current approaches associate these measures to finite single values within an observation window, thus not being able to characterize the system evolution at each moment in time. Here, we propose a new definition of approximate and sample entropy based on the inhomogeneous point-process theory. The discrete time series is modeled through probability density functions, which characterize and predict the time until the next event occurs as a function of the past history. Laguerre expansions of the Wiener-Volterra autoregressive terms account for the long-term nonlinear information. As the proposed measures of entropy are instantaneously defined through probability functions, the novel indices are able to provide instantaneous tracking of the system complexity. The new measures are tested on synthetic data, as well as on real data gathered from heartbeat dynamics of healthy subjects and patients with cardiac heart failure and gait recordings from short walks of young and elderly subjects. Results show that instantaneous complexity is able to effectively track the system dynamics and is not affected by statistical noise properties.

Multiwavelet packet entropy and its application in transmission line fault recognition and classification.

PubMed

Liu, Zhigang; Han, Zhiwei; Zhang, Yang; Zhang, Qiaoge

2014-11-01

Multiwavelets possess better properties than traditional wavelets. Multiwavelet packet transformation has more high-frequency information. Spectral entropy can be applied as an analysis index to the complexity or uncertainty of a signal. This paper tries to define four multiwavelet packet entropies to extract the features of different transmission line faults, and uses a radial basis function (RBF) neural network to recognize and classify 10 fault types of power transmission lines. First, the preprocessing and postprocessing problems of multiwavelets are presented. Shannon entropy and Tsallis entropy are introduced, and their difference is discussed. Second, multiwavelet packet energy entropy, time entropy, Shannon singular entropy, and Tsallis singular entropy are defined as the feature extraction methods of transmission line fault signals. Third, the plan of transmission line fault recognition using multiwavelet packet entropies and an RBF neural network is proposed. Finally, the experimental results show that the plan with the four multiwavelet packet energy entropies defined in this paper achieves better performance in fault recognition. The performance with SA4 (symmetric antisymmetric) multiwavelet packet Tsallis singular entropy is the best among the combinations of different multiwavelet packets and the four multiwavelet packet entropies.

Suitability of the rare-earth compounds Dy2Ti2O7 and Gd3Al5O12 for low temperature (4K-20K) magnetic refrigeration cycle

NASA Technical Reports Server (NTRS)

Flood, D. J.

1973-01-01

Measurements were made of the magnetic entropy and magnetization of powered samples of the compounds Dy2Ti2O7 and Gd3Al5O12. The magnetization was measured for temperatures at and below 4.2 K, in applied fields ranging to 7.0 tesla. Isothermal changes in magnetic entropy were measured for temperatures from 1.2 to 20 K, in applied fields up to 10 tesla. The results of the measurements are consistent with a doublet ground state for Dy2Ti2O7, and an eight-fold degenerate ground state for Gd3Al5O12. Absolute values of magnetic entropy have been obtained at the lower temperatures, permitting the isotherms to be properly located in the S-H plane with the use of adiabatic magnetization data. The iso-field lines in the S-T plane were determined. The results indicate that Dy2Ti2O7 can absorb a maximum of 71 + or - 4 joules/kg of heat at 4.2 K, while Gd3Al5O12 can absorb 233 + or - joules/kg at the same temperature. The large difference between the two is most likely a result of crystal field interactions in the dysoprosium compound. Both materials can be cycled adiabatically between 4.2 and 20 K.

A coarse-grained generalized second law for holographic conformal field theories

NASA Astrophysics Data System (ADS)

Bunting, William; Fu, Zicao; Marolf, Donald

2016-03-01

We consider the universal sector of a d\\gt 2 dimensional large-N strongly interacting holographic CFT on a black hole spacetime background B. When our CFT d is coupled to dynamical Einstein-Hilbert gravity with Newton constant G d , the combined system can be shown to satisfy a version of the thermodynamic generalized second law (GSL) at leading order in G d . The quantity {S}{CFT}+\\frac{A({H}B,{perturbed})}{4{G}d} is non-decreasing, where A({H}B,{perturbed}) is the (time-dependent) area of the new event horizon in the coupled theory. Our S CFT is the notion of (coarse-grained) CFT entropy outside the black hole given by causal holographic information—a quantity in turn defined in the AdS{}d+1 dual by the renormalized area {A}{ren}({H}{{bulk}}) of a corresponding bulk causal horizon. A corollary is that the fine-grained GSL must hold for finite processes taken as a whole, though local decreases of the fine-grained generalized entropy are not obviously forbidden. Another corollary, given by setting {G}d=0, states that no finite process taken as a whole can increase the renormalized free energy F={E}{out}-{{TS}}{CFT}-{{Ω }}J, with T,{{Ω }} constants set by {H}B. This latter corollary constitutes a 2nd law for appropriate non-compact AdS event horizons.

Accelerated and decelerated expansion in a causal dissipative cosmology

NASA Astrophysics Data System (ADS)

Cruz, Miguel; Cruz, Norman; Lepe, Samuel

2017-12-01

In this work we explore a new cosmological solution for an universe filled with one dissipative fluid, described by a barotropic equation of state (EoS) p =ω ρ , in the framework of the full Israel-Stewart theory. The form of the bulk viscosity has been assumed of the form ξ =ξ0ρ1 /2. The relaxation time is taken to be a function of the EoS, the bulk viscosity and the speed of bulk viscous perturbations, cb. The solution presents an initial singularity, where the curvature scalar diverges as the scale factor goes to zero. Depending on the values for ω , ξ0, cb accelerated and decelerated cosmic expansion can be obtained. In the case of accelerated expansion, the viscosity drives the effective EoS to be of quintessence type, for the single fluid with positive pressure. Nevertheless, we show that only the solution with decelerated expansion satisfies the thermodynamics conditions d S /d t >0 (growth of the entropy) and d2S /d t2<0 (convexity condition). We show that an exact stiff matter EoS is not allowed in the framework of the full causal thermodynamic approach; and in the case of a EoS very close to the stiff matter regime, we found that dissipative effects becomes negligible so the entropy remains constant. Finally, we show numerically that the solution is stable under small perturbations.

Spectral simplicity of apparent complexity. II. Exact complexities and complexity spectra

NASA Astrophysics Data System (ADS)

Riechers, Paul M.; Crutchfield, James P.

2018-03-01

The meromorphic functional calculus developed in Part I overcomes the nondiagonalizability of linear operators that arises often in the temporal evolution of complex systems and is generic to the metadynamics of predicting their behavior. Using the resulting spectral decomposition, we derive closed-form expressions for correlation functions, finite-length Shannon entropy-rate approximates, asymptotic entropy rate, excess entropy, transient information, transient and asymptotic state uncertainties, and synchronization information of stochastic processes generated by finite-state hidden Markov models. This introduces analytical tractability to investigating information processing in discrete-event stochastic processes, symbolic dynamics, and chaotic dynamical systems. Comparisons reveal mathematical similarities between complexity measures originally thought to capture distinct informational and computational properties. We also introduce a new kind of spectral analysis via coronal spectrograms and the frequency-dependent spectra of past-future mutual information. We analyze a number of examples to illustrate the methods, emphasizing processes with multivariate dependencies beyond pairwise correlation. This includes spectral decomposition calculations for one representative example in full detail.

Acoustic integrated extinction.

PubMed

Norris, Andrew N

2015-05-08

The integrated extinction (IE) is defined as the integral of the scattering cross section as a function of wavelength. Sohl et al. (2007 J. Acoust. Soc. Am. 122 , 3206-3210. (doi:10.1121/1.2801546)) derived an IE expression for acoustic scattering that is causal, i.e. the scattered wavefront in the forward direction arrives later than the incident plane wave in the background medium. The IE formula was based on electromagnetic results, for which scattering is causal by default. Here, we derive a formula for the acoustic IE that is valid for causal and non-causal scattering. The general result is expressed as an integral of the time-dependent forward scattering function. The IE reduces to a finite integral for scatterers with zero long-wavelength monopole and dipole amplitudes. Implications for acoustic cloaking are discussed and a new metric is proposed for broadband acoustic transparency.

Sample entropy analysis of cervical neoplasia gene-expression signatures

PubMed Central

Botting, Shaleen K; Trzeciakowski, Jerome P; Benoit, Michelle F; Salama, Salama A; Diaz-Arrastia, Concepcion R

2009-01-01

Background We introduce Approximate Entropy as a mathematical method of analysis for microarray data. Approximate entropy is applied here as a method to classify the complex gene expression patterns resultant of a clinical sample set. Since Entropy is a measure of disorder in a system, we believe that by choosing genes which display minimum entropy in normal controls and maximum entropy in the cancerous sample set we will be able to distinguish those genes which display the greatest variability in the cancerous set. Here we describe a method of utilizing Approximate Sample Entropy (ApSE) analysis to identify genes of interest with the highest probability of producing an accurate, predictive, classification model from our data set. Results In the development of a diagnostic gene-expression profile for cervical intraepithelial neoplasia (CIN) and squamous cell carcinoma of the cervix, we identified 208 genes which are unchanging in all normal tissue samples, yet exhibit a random pattern indicative of the genetic instability and heterogeneity of malignant cells. This may be measured in terms of the ApSE when compared to normal tissue. We have validated 10 of these genes on 10 Normal and 20 cancer and CIN3 samples. We report that the predictive value of the sample entropy calculation for these 10 genes of interest is promising (75% sensitivity, 80% specificity for prediction of cervical cancer over CIN3). Conclusion The success of the Approximate Sample Entropy approach in discerning alterations in complexity from biological system with such relatively small sample set, and extracting biologically relevant genes of interest hold great promise. PMID:19232110

Chaos in Magnetic Flux Ropes

NASA Astrophysics Data System (ADS)

Gekelman, W. N.; DeHaas, T.; Van Compernolle, B.

2013-12-01

Magnetic Flux Ropes Immersed in a uniform magnetoplasma are observed to twist about themselves, writhe about each other and rotate about a central axis. They are kink unstable and smash into one another as they move. Full three dimensional magnetic field and flows are measured at thousands of time steps. Each collision results in magnetic field line generation and the generation of a quasi-seperatrix layer and induced electric fields. Three dimensional magnetic field lines are computed by conditionally averaging the data using correlation techniques. The permutation entropy1 ,which is related to the Lyapunov exponent, can be calculated from the the time series of the magnetic field data (this is also done with flows) and used to calculate the positions of the data on a Jensen Shannon complexity map2. The location of data on this map indicates if the magnetic fields are stochastic, or fall into regions of minimal or maximal complexity. The complexity is a function of space and time. The complexity map, and analysis will be explained in the course of the talk. Other types of chaotic dynamical models such as the Lorentz, Gissinger and Henon process also fall on the map and can give a clue to the nature of the flux rope turbulence. The ropes fall in the region of the C-H plane where chaotic systems lie. The entropy and complexity change in space and time which reflects the change and possibly type of chaos associated with the ropes. The maps give insight as to the type of chaos (deterministic chaos, fractional diffusion , Levi flights..) and underlying dynamical process. The power spectra of much of the magnetic and flow data is exponential and Lorentzian structures in the time domain are embedded in them. Other quantities such as the Hurst exponent are evaluated for both magnetic fields and plasma flow. Work Supported by a UC-LANL Lab fund and the Basic Plasma Science Facility which is funded by DOE and NSF. 1) C. Bandt, B. Pompe, Phys. Rev. Lett., 88,174102 (2007) 2) O. Russo et al., Phys. Rev. Lett., 99, 154102 (2007), J. Maggs, G.Morales, 55, 085015 (2013)

Nonlinear digital signal processing in mental health: characterization of major depression using instantaneous entropy measures of heartbeat dynamics.

PubMed

Valenza, Gaetano; Garcia, Ronald G; Citi, Luca; Scilingo, Enzo P; Tomaz, Carlos A; Barbieri, Riccardo

2015-01-01

Nonlinear digital signal processing methods that address system complexity have provided useful computational tools for helping in the diagnosis and treatment of a wide range of pathologies. More specifically, nonlinear measures have been successful in characterizing patients with mental disorders such as Major Depression (MD). In this study, we propose the use of instantaneous measures of entropy, namely the inhomogeneous point-process approximate entropy (ipApEn) and the inhomogeneous point-process sample entropy (ipSampEn), to describe a novel characterization of MD patients undergoing affective elicitation. Because these measures are built within a nonlinear point-process model, they allow for the assessment of complexity in cardiovascular dynamics at each moment in time. Heartbeat dynamics were characterized from 48 healthy controls and 48 patients with MD while emotionally elicited through either neutral or arousing audiovisual stimuli. Experimental results coming from the arousing tasks show that ipApEn measures are able to instantaneously track heartbeat complexity as well as discern between healthy subjects and MD patients. Conversely, standard heart rate variability (HRV) analysis performed in both time and frequency domains did not show any statistical significance. We conclude that measures of entropy based on nonlinear point-process models might contribute to devising useful computational tools for care in mental health.

Transverse kinetics of a charged drop in an external electric field

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bondarenko, S.; Komoshvili, K.

2016-01-22

We investigate a non-equilibrium behavior of a small, dense and charged drop in the transverse plane. A collective motion of the drop’s particles with constant entropy is described. Namely, we solve Vlasov’s equation with non-isotropic initial conditions. Thereby a non-equilibrium distribution function of the process of the droplet evolution in the transverse plane is calculated. An external electric field is included in the initial conditions of the equation that affects on the form of the obtained solution. Applicability of the results to the description of initial states of quark-gluon plasma is also discussed.

Text mining by Tsallis entropy

NASA Astrophysics Data System (ADS)

Jamaati, Maryam; Mehri, Ali

2018-01-01

Long-range correlations between the elements of natural languages enable them to convey very complex information. Complex structure of human language, as a manifestation of natural languages, motivates us to apply nonextensive statistical mechanics in text mining. Tsallis entropy appropriately ranks the terms' relevance to document subject, taking advantage of their spatial correlation length. We apply this statistical concept as a new powerful word ranking metric in order to extract keywords of a single document. We carry out an experimental evaluation, which shows capability of the presented method in keyword extraction. We find that, Tsallis entropy has reliable word ranking performance, at the same level of the best previous ranking methods.

Entropy production and nonlinear Fokker-Planck equations.

PubMed

Casas, G A; Nobre, F D; Curado, E M F

2012-12-01

The entropy time rate of systems described by nonlinear Fokker-Planck equations--which are directly related to generalized entropic forms--is analyzed. Both entropy production, associated with irreversible processes, and entropy flux from the system to its surroundings are studied. Some examples of known generalized entropic forms are considered, and particularly, the flux and production of the Boltzmann-Gibbs entropy, obtained from the linear Fokker-Planck equation, are recovered as particular cases. Since nonlinear Fokker-Planck equations are appropriate for the dynamical behavior of several physical phenomena in nature, like many within the realm of complex systems, the present analysis should be applicable to irreversible processes in a large class of nonlinear systems, such as those described by Tsallis and Kaniadakis entropies.

An entropy method for induced drag minimization

NASA Technical Reports Server (NTRS)

Greene, George C.

1989-01-01

A fundamentally new approach to the aircraft minimum induced drag problem is presented. The method, a 'viscous lifting line', is based on the minimum entropy production principle and does not require the planar wake assumption. An approximate, closed form solution is obtained for several wing configurations including a comparison of wing extension, winglets, and in-plane wing sweep, with and without a constraint on wing-root bending moment. Like the classical lifting-line theory, this theory predicts that induced drag is proportional to the square of the lift coefficient and inversely proportioinal to the wing aspect ratio. Unlike the classical theory, it predicts that induced drag is Reynolds number dependent and that the optimum spanwise circulation distribution is non-elliptic.

Entropy-based link prediction in weighted networks

NASA Astrophysics Data System (ADS)

Xu, Zhongqi; Pu, Cunlai; Ramiz Sharafat, Rajput; Li, Lunbo; Yang, Jian

2017-01-01

Information entropy has been proved to be an effective tool to quantify the structural importance of complex networks. In the previous work (Xu et al, 2016 \\cite{xu2016}), we measure the contribution of a path in link prediction with information entropy. In this paper, we further quantify the contribution of a path with both path entropy and path weight, and propose a weighted prediction index based on the contributions of paths, namely Weighted Path Entropy (WPE), to improve the prediction accuracy in weighted networks. Empirical experiments on six weighted real-world networks show that WPE achieves higher prediction accuracy than three typical weighted indices.

Complexity of intracranial pressure correlates with outcome after traumatic brain injury

PubMed Central

Lu, Cheng-Wei; Czosnyka, Marek; Shieh, Jiann-Shing; Smielewska, Anna; Pickard, John D.

2012-01-01

This study applied multiscale entropy analysis to investigate the correlation between the complexity of intracranial pressure waveform and outcome after traumatic brain injury. Intracranial pressure and arterial blood pressure waveforms were low-pass filtered to remove the respiratory and pulse components and then processed using a multiscale entropy algorithm to produce a complexity index. We identified significant differences across groups classified by the Glasgow Outcome Scale in intracranial pressure, pressure-reactivity index and complexity index of intracranial pressure (P < 0.0001; P = 0.001; P < 0.0001, respectively). Outcome was dichotomized as survival/death and also as favourable/unfavourable. The complexity index of intracranial pressure achieved the strongest statistical significance (F = 28.7; P < 0.0001 and F = 17.21; P < 0.0001, respectively) and was identified as a significant independent predictor of mortality and favourable outcome in a multivariable logistic regression model (P < 0.0001). The results of this study suggest that complexity of intracranial pressure assessed by multiscale entropy was significantly associated with outcome in patients with brain injury. PMID:22734128

Formalizing the role of agent-based modeling in causal inference and epidemiology.

PubMed

Marshall, Brandon D L; Galea, Sandro

2015-01-15

Calls for the adoption of complex systems approaches, including agent-based modeling, in the field of epidemiology have largely centered on the potential for such methods to examine complex disease etiologies, which are characterized by feedback behavior, interference, threshold dynamics, and multiple interacting causal effects. However, considerable theoretical and practical issues impede the capacity of agent-based methods to examine and evaluate causal effects and thus illuminate new areas for intervention. We build on this work by describing how agent-based models can be used to simulate counterfactual outcomes in the presence of complexity. We show that these models are of particular utility when the hypothesized causal mechanisms exhibit a high degree of interdependence between multiple causal effects and when interference (i.e., one person's exposure affects the outcome of others) is present and of intrinsic scientific interest. Although not without challenges, agent-based modeling (and complex systems methods broadly) represent a promising novel approach to identify and evaluate complex causal effects, and they are thus well suited to complement other modern epidemiologic methods of etiologic inquiry. © The Author 2014. Published by Oxford University Press on behalf of the Johns Hopkins Bloomberg School of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

The Riemann Problem for the Multidimensional Isentropic System of Gas Dynamics is Ill-Posed if It Contains a Shock

NASA Astrophysics Data System (ADS)

Markfelder, Simon; Klingenberg, Christian

2018-03-01

In this paper we consider the isentropic compressible Euler equations in two space dimensions together with particular initial data. This data consists of two constant states, where one state lies in the lower and the other state in the upper half plane. The aim is to investigate whether there exists a unique entropy solution or if the convex integration method produces infinitely many entropy solutions. For some initial states this question has been answered by Feireisl and Kreml (J Hyperbolic Differ Equ 12(3):489-499, 2015), and also Chen and Chen (J Hyperbolic Differ Equ 4(1):105-122, 2007), where there exists a unique entropy solution. For other initial states Chiodaroli and Kreml (Arch Ration Mech Anal 214(3):1019-1049, 2014) and Chiodaroli et al. (Commun Pure Appl Math 68(7):1157-1190, 2015), showed that there are infinitely many entropy solutions. For still other initial states the question on uniqueness remained open and this will be the content of this paper. This paper can be seen as a completion of the aforementioned papers by showing that the solution is non-unique in all cases (except if the solution is smooth).

Entanglement entropy and complexity for one-dimensional holographic superconductors

NASA Astrophysics Data System (ADS)

Kord Zangeneh, Mahdi; Ong, Yen Chin; Wang, Bin

2017-08-01

Holographic superconductor is an important arena for holography, as it allows concrete calculations to further understand the dictionary between bulk physics and boundary physics. An important quantity of recent interest is the holographic complexity. Conflicting claims had been made in the literature concerning the behavior of holographic complexity during phase transition. We clarify this issue by performing a numerical study on one-dimensional holographic superconductor. Our investigation shows that holographic complexity does not behave in the same way as holographic entanglement entropy. Nevertheless, the universal terms of both quantities are finite and reflect the phase transition at the same critical temperature.

Dynamical complexity changes during two forms of meditation

NASA Astrophysics Data System (ADS)

Li, Jin; Hu, Jing; Zhang, Yinhong; Zhang, Xiaofeng

2011-06-01

Detection of dynamical complexity changes in natural and man-made systems has deep scientific and practical meaning. We use the base-scale entropy method to analyze dynamical complexity changes for heart rate variability (HRV) series during specific traditional forms of Chinese Chi and Kundalini Yoga meditation techniques in healthy young adults. The results show that dynamical complexity decreases in meditation states for two forms of meditation. Meanwhile, we detected changes in probability distribution of m-words during meditation and explained this changes using probability distribution of sine function. The base-scale entropy method may be used on a wider range of physiologic signals.

A causal viscous cosmology without singularities

NASA Astrophysics Data System (ADS)

Laciana, Carlos E.

2017-05-01

An isotropic and homogeneous cosmological model with a source of dark energy is studied. That source is simulated with a viscous relativistic fluid with minimal causal correction. In this model the restrictions on the parameters coming from the following conditions are analized: (a) energy density without singularities along time, (b) scale factor increasing with time, (c) universe accelerated at present time, (d) state equation for dark energy with " w" bounded and close to -1. It is found that those conditions are satisfied for the following two cases. (i) When the transport coefficient (τ _{Π}), associated to the causal correction, is negative, with the additional restriction ζ | τ _{Π}| >2/3, where ζ is the relativistic bulk viscosity coefficient. The state equation is in the "phantom" energy sector. (ii) For τ _{Π} positive, in the "k-essence" sector. It is performed an exact calculation for the case where the equation of state is constant, finding that option (ii) is favored in relation to (i), because in (ii) the entropy is always increasing, while this does no happen in (i).

Multiscale permutation entropy analysis of electrocardiogram

NASA Astrophysics Data System (ADS)

Liu, Tiebing; Yao, Wenpo; Wu, Min; Shi, Zhaorong; Wang, Jun; Ning, Xinbao

2017-04-01

To make a comprehensive nonlinear analysis to ECG, multiscale permutation entropy (MPE) was applied to ECG characteristics extraction to make a comprehensive nonlinear analysis of ECG. Three kinds of ECG from PhysioNet database, congestive heart failure (CHF) patients, healthy young and elderly subjects, are applied in this paper. We set embedding dimension to 4 and adjust scale factor from 2 to 100 with a step size of 2, and compare MPE with multiscale entropy (MSE). As increase of scale factor, MPE complexity of the three ECG signals are showing first-decrease and last-increase trends. When scale factor is between 10 and 32, complexities of the three ECG had biggest difference, entropy of the elderly is 0.146 less than the CHF patients and 0.025 larger than the healthy young in average, in line with normal physiological characteristics. Test results showed that MPE can effectively apply in ECG nonlinear analysis, and can effectively distinguish different ECG signals.

High-lying single-particle modes, chaos, correlational entropy, and doubling phase transition

DOE Office of Scientific and Technical Information (OSTI.GOV)

Stoyanov, Chavdar; Zelevinsky, Vladimir

Highly excited single-particle states in nuclei are coupled with the excitations of a more complex character, first of all with collective phononlike modes of the core. In the framework of the quasiparticle-phonon model, we consider the structure of resulting complex configurations, using the 1k{sub 17/2} orbital in {sup 209}Pb as an example. Although, on the level of one- and two-phonon admixtures, the fully chaotic Gaussian orthogonal ensemble regime is not reached, the eigenstates of the model carry a significant degree of complexity that can be quantified with the aid of correlational invariant entropy. With artificially enhanced particle-core coupling, the systemmore » undergoes the doubling phase transition with the quasiparticle strength concentrated in two repelling peaks. This phase transition is clearly detected by correlational entropy.« less

Optimality and inference in hydrology from entropy production considerations: synthetic hillslope numerical experiments

NASA Astrophysics Data System (ADS)

Kollet, S. J.

2015-05-01

In this study, entropy production optimization and inference principles are applied to a synthetic semi-arid hillslope in high-resolution, physics-based simulations. The results suggest that entropy or power is indeed maximized, because of the strong nonlinearity of variably saturated flow and competing processes related to soil moisture fluxes, the depletion of gradients, and the movement of a free water table. Thus, it appears that the maximum entropy production (MEP) principle may indeed be applicable to hydrologic systems. In the application to hydrologic system, the free water table constitutes an important degree of freedom in the optimization of entropy production and may also relate the theory to actual observations. In an ensuing analysis, an attempt is made to transfer the complex, "microscopic" hillslope model into a macroscopic model of reduced complexity using the MEP principle as an interference tool to obtain effective conductance coefficients and forces/gradients. The results demonstrate a new approach for the application of MEP to hydrologic systems and may form the basis for fruitful discussions and research in future.

Dislocations and deformation microstructure in a B2-ordered Al28Co20Cr11Fe15Ni26 high-entropy alloy

NASA Astrophysics Data System (ADS)

Feuerbacher, Michael

2016-07-01

High-entropy alloys are multicomponent metallic materials currently attracting high research interest. They display a unique combination of chemical disorder and crystalline long-range order, and due to their attractive properties are promising candidates for technological application. Many high-entropy alloys possess surprisingly high strength, occasionally in combination with high ductility and low density. The mechanisms effecting these attractive mechanical properties are not understood. This study addresses the deformation mechanism of a Al28Co20Cr11Fe15Ni26 high-entropy alloy, which is a two-phase material, consisting of a B2-ordered matrix and disordered body-centred inclusions. We quantitatively analyse the microstructure and dislocations in deformed samples by transmission-electron-microscopic methods including weak-beam imaging and convergent-beam electron diffraction. We find that the deformation process in the B2 phase is dominated by heterogeneous slip of screw dislocations gliding on planes. The dislocations are perfect superdislocations of the B2 lattice and show no dissociation. This indicates that the antiphase-boundary energy in the structure is very high, inhibiting spread of the dislocation core. Along with the observation of a widely extending strain field associated to the dislocations, our results provide a possible explanation for the high strength of this high-entropy alloy as a direct consequence of its dislocation structure.

Evidence for Chaotic Edge Turbulence in the Alcator C-Mod Tokamak

NASA Astrophysics Data System (ADS)

Zhu, Ziyan; White, Anne; Carter, Troy; Terry, Jim; Baek, Seung Gyou

2017-10-01

Turbulence greatly reduces the confinement time of magnetic-confined plasmas; understanding the nature of this turbulence and the associated transport is therefore of great importance. This research seeks to establish whether turbulent fluctuations in Alcator C-Mod are chaotic or stochastic. Stochastic fluctuations may lead to a random walk diffusive transport, whereas a diffusive description is unlikely to be valid for chaotic fluctuations since it lives in restricted areas of phase space (e.g., on attractors). Analysis of the time series obtained with the O-mode reflectometer and the gas puff imaging (GPI) systems reveals that the turbulent density fluctuations in C-Mod are chaotic. Supporting evidence for this conclusion includes the observation of an exponential power spectra (which is associated with Lorentzian-shaped pulses in the time series), the population of the corresponding Bandt-Pompe (BP) probability distribution, and the location of the signal on the Complexity-Entropy plane (C-H plane). These analysis techniques will be briefly introduced along with a discussion of the analysis results. The classification of edge turbulence as chaotic opens the door for further work to understand the underlying process and the impact on turbulent transport. Supported by USDoE awards DE-FC02-99ER54512 and DE-FC02-07ER54918:011.

A Critical Look at Entropy-Based Gene-Gene Interaction Measures.

PubMed

Lee, Woojoo; Sjölander, Arvid; Pawitan, Yudi

2016-07-01

Several entropy-based measures for detecting gene-gene interaction have been proposed recently. It has been argued that the entropy-based measures are preferred because entropy can better capture the nonlinear relationships between genotypes and traits, so they can be useful to detect gene-gene interactions for complex diseases. These suggested measures look reasonable at intuitive level, but so far there has been no detailed characterization of the interactions captured by them. Here we study analytically the properties of some entropy-based measures for detecting gene-gene interactions in detail. The relationship between interactions captured by the entropy-based measures and those of logistic regression models is clarified. In general we find that the entropy-based measures can suffer from a lack of specificity in terms of target parameters, i.e., they can detect uninteresting signals as interactions. Numerical studies are carried out to confirm theoretical findings. © 2016 WILEY PERIODICALS, INC.

Ground-state entropy of the potts antiferromagnet with next-nearest-neighbor spin-spin couplings on strips of the square lattice

PubMed

Chang; Shrock

2000-10-01

We present exact calculations of the zero-temperature partition function (chromatic polynomial) and W(q), the exponent of the ground-state entropy, for the q-state Potts antiferromagnet with next-nearest-neighbor spin-spin couplings on square lattice strips, of width L(y)=3 and L(y)=4 vertices and arbitrarily great length Lx vertices, with both free and periodic boundary conditions. The resultant values of W for a range of physical q values are compared with each other and with the values for the full two-dimensional lattice. These results give insight into the effect of such nonnearest-neighbor couplings on the ground-state entropy. We show that the q=2 (Ising) and q=4 Potts antiferromagnets have zero-temperature critical points on the Lx-->infinity limits of the strips that we study. With the generalization of q from Z+ to C, we determine the analytic structure of W(q) in the q plane for the various cases.

On entropy, financial markets and minority games

NASA Astrophysics Data System (ADS)

Zapart, Christopher A.

2009-04-01

The paper builds upon an earlier statistical analysis of financial time series with Shannon information entropy, published in [L. Molgedey, W. Ebeling, Local order, entropy and predictability of financial time series, European Physical Journal B-Condensed Matter and Complex Systems 15/4 (2000) 733-737]. A novel generic procedure is proposed for making multistep-ahead predictions of time series by building a statistical model of entropy. The approach is first demonstrated on the chaotic Mackey-Glass time series and later applied to Japanese Yen/US dollar intraday currency data. The paper also reinterprets Minority Games [E. Moro, The minority game: An introductory guide, Advances in Condensed Matter and Statistical Physics (2004)] within the context of physical entropy, and uses models derived from minority game theory as a tool for measuring the entropy of a model in response to time series. This entropy conditional upon a model is subsequently used in place of information-theoretic entropy in the proposed multistep prediction algorithm.

Measuring Information-Transfer Delays

PubMed Central

Wibral, Michael; Pampu, Nicolae; Priesemann, Viola; Siebenhühner, Felix; Seiwert, Hannes; Lindner, Michael; Lizier, Joseph T.; Vicente, Raul

2013-01-01

In complex networks such as gene networks, traffic systems or brain circuits it is important to understand how long it takes for the different parts of the network to effectively influence one another. In the brain, for example, axonal delays between brain areas can amount to several tens of milliseconds, adding an intrinsic component to any timing-based processing of information. Inferring neural interaction delays is thus needed to interpret the information transfer revealed by any analysis of directed interactions across brain structures. However, a robust estimation of interaction delays from neural activity faces several challenges if modeling assumptions on interaction mechanisms are wrong or cannot be made. Here, we propose a robust estimator for neuronal interaction delays rooted in an information-theoretic framework, which allows a model-free exploration of interactions. In particular, we extend transfer entropy to account for delayed source-target interactions, while crucially retaining the conditioning on the embedded target state at the immediately previous time step. We prove that this particular extension is indeed guaranteed to identify interaction delays between two coupled systems and is the only relevant option in keeping with Wiener’s principle of causality. We demonstrate the performance of our approach in detecting interaction delays on finite data by numerical simulations of stochastic and deterministic processes, as well as on local field potential recordings. We also show the ability of the extended transfer entropy to detect the presence of multiple delays, as well as feedback loops. While evaluated on neuroscience data, we expect the estimator to be useful in other fields dealing with network dynamics. PMID:23468850

Like Beauty, Complexity is Hard to Define

NASA Astrophysics Data System (ADS)

Tsallis, Constantino

Like beauty, complexity is hard to define and rather easy to identify: nonlinear dynamics, strongly interconnected simple elements, some sort of divisoria aquorum between order and disorder. Before focusing on complexity, let us remember that the theoretical pillars of contemporary physics are mechanics (Newtonian, relativistic, quantum), Maxwell electromagnetism, and (Boltzmann-Gibbs, BG) statistical mechanics - obligatory basic disciplines in any advanced course in physics. The firstprinciple statistical-mechanical approach starts from (microscopic) electro-mechanics and theory of probabilities, and, through a variety of possible mesoscopic descriptions, arrives to (oscopic) thermodynamics. In the middle of this trip, we cross energy and entropy. Energy is related to the possible microscopic configurations of the system, whereas entropy is related to the corresponding probabilities. Therefore, in some sense, entropy represents a concept which, epistemologically speaking, is one step further with regard to energy. The fact that energy is not parameter-independent is very familiar: the kinetic energy of a truck is very different from that of a fly, and the relativistic energy of a fast electron is very different from its classical value, and so on. What about entropy? One hundred and forty years of tradition, and hundreds - we may even say thousands - of impressive theoretical successes of the parameter-free BG entropy have sedimented, in the mind of many scientists, the conviction that it is unique. However, it can be straightforwardly argued that, in general, this is not the case...

Dynamic Cross-Entropy.

PubMed

Aur, Dorian; Vila-Rodriguez, Fidel

2017-01-01

Complexity measures for time series have been used in many applications to quantify the regularity of one dimensional time series, however many dynamical systems are spatially distributed multidimensional systems. We introduced Dynamic Cross-Entropy (DCE) a novel multidimensional complexity measure that quantifies the degree of regularity of EEG signals in selected frequency bands. Time series generated by discrete logistic equations with varying control parameter r are used to test DCE measures. Sliding window DCE analyses are able to reveal specific period doubling bifurcations that lead to chaos. A similar behavior can be observed in seizures triggered by electroconvulsive therapy (ECT). Sample entropy data show the level of signal complexity in different phases of the ictal ECT. The transition to irregular activity is preceded by the occurrence of cyclic regular behavior. A significant increase of DCE values in successive order from high frequencies in gamma to low frequencies in delta band reveals several phase transitions into less ordered states, possible chaos in the human brain. To our knowledge there are no reliable techniques able to reveal the transition to chaos in case of multidimensional times series. In addition, DCE based on sample entropy appears to be robust to EEG artifacts compared to DCE based on Shannon entropy. The applied technique may offer new approaches to better understand nonlinear brain activity. Copyright © 2016 Elsevier B.V. All rights reserved.

Intrinsic Information Processing and Energy Dissipation in Stochastic Input-Output Dynamical Systems

DTIC Science & Technology

2015-07-09

Crutchfield. Information Anatomy of Stochastic Equilibria, Entropy , (08 2014): 0. doi: 10.3390/e16094713 Virgil Griffith, Edwin Chong, Ryan James...Christopher Ellison, James Crutchfield. Intersection Information Based on Common Randomness, Entropy , (04 2014): 0. doi: 10.3390/e16041985 TOTAL: 5 Number...Learning Group Seminar, Complexity Sciences Center, UC Davis. Korana Burke and Greg Wimsatt (UCD), reviewed PRL “Measurement of Stochastic Entropy

Complexity Measures in Magnetoencephalography: Measuring "Disorder" in Schizophrenia

PubMed Central

Brookes, Matthew J.; Hall, Emma L.; Robson, Siân E.; Price, Darren; Palaniyappan, Lena; Liddle, Elizabeth B.; Liddle, Peter F.; Robinson, Stephen E.; Morris, Peter G.

2015-01-01

This paper details a methodology which, when applied to magnetoencephalography (MEG) data, is capable of measuring the spatio-temporal dynamics of ‘disorder’ in the human brain. Our method, which is based upon signal entropy, shows that spatially separate brain regions (or networks) generate temporally independent entropy time-courses. These time-courses are modulated by cognitive tasks, with an increase in local neural processing characterised by localised and transient increases in entropy in the neural signal. We explore the relationship between entropy and the more established time-frequency decomposition methods, which elucidate the temporal evolution of neural oscillations. We observe a direct but complex relationship between entropy and oscillatory amplitude, which suggests that these metrics are complementary. Finally, we provide a demonstration of the clinical utility of our method, using it to shed light on aberrant neurophysiological processing in schizophrenia. We demonstrate significantly increased task induced entropy change in patients (compared to controls) in multiple brain regions, including a cingulo-insula network, bilateral insula cortices and a right fronto-parietal network. These findings demonstrate potential clinical utility for our method and support a recent hypothesis that schizophrenia can be characterised by abnormalities in the salience network (a well characterised distributed network comprising bilateral insula and cingulate cortices). PMID:25886553

Complex Causal Process Diagrams for Analyzing the Health Impacts of Policy Interventions

PubMed Central

Joffe, Michael; Mindell, Jennifer

2006-01-01

Causal diagrams are rigorous tools for controlling confounding. They also can be used to describe complex causal systems, which is done routinely in communicable disease epidemiology. The use of change diagrams has advantages over static diagrams, because change diagrams are more tractable, relate better to interventions, and have clearer interpretations. Causal diagrams are a useful basis for modeling. They make assumptions explicit, provide a framework for analysis, generate testable predictions, explore the effects of interventions, and identify data gaps. Causal diagrams can be used to integrate different types of information and to facilitate communication both among public health experts and between public health experts and experts in other fields. Causal diagrams allow the use of instrumental variables, which can help control confounding and reverse causation. PMID:16449586

Detecting thermal phase transitions in corneal stroma by fluorescence micro-imaging analysis

NASA Astrophysics Data System (ADS)

Matteini, P.; Rossi, F.; Ratto, F.; Bruno, I.; Nesi, P.; Pini, R.

2008-02-01

Thermal modifications induced in corneal stroma were investigated by the use of fluorescence microscopy. Freshly extracted porcine corneas were immersed for 5 minutes in a water bath at temperatures in the 35-90°C range and stored in formalin. The samples were then sliced in 200-μm-thick transversal sections and analyzed under a stereomicroscope to assess corneal shrinkage. Fluorescence images of the thermally treated corneal samples were acquired using a slow-scan cooled CCD camera, after staining the slices with Indocyanine Green (ICG) fluorescent dye which allowed to detect fluorescence signal from the whole tissue. All measurements were performed using an inverted epifluorescence microscope equipped with a mercury lamp. The thermally-induced modifications to the corneal specimens were evaluated by studying the grey level distribution in the fluorescence images. For each acquired image, Discrete Fourier Transform (DFT) and entropy analyses were performed. The spatial distribution of DFT absolute value indicated the spatial orientation of the lamellar planes, while entropy was used to study the image texture, correlated to the stromal structural transitions. As a result, it was possible to indicate a temperature threshold value (62°C) for high thermal damage, resulting in a disorganization of the lamellar planes and in full agreement with the measured temperature for corneal shrinkage onset. Analysis of the image entropy evidenced five strong modifications in stromal architecture at temperatures of ~45°C, 53°C, 57°C, 66°C, 75°C. The proposed procedure proved to be an effective micro-imaging method capable of detecting subtle changes in corneal tissue subjected to thermal treatment.

Causal inference in public health.

PubMed

Glass, Thomas A; Goodman, Steven N; Hernán, Miguel A; Samet, Jonathan M

2013-01-01

Causal inference has a central role in public health; the determination that an association is causal indicates the possibility for intervention. We review and comment on the long-used guidelines for interpreting evidence as supporting a causal association and contrast them with the potential outcomes framework that encourages thinking in terms of causes that are interventions. We argue that in public health this framework is more suitable, providing an estimate of an action's consequences rather than the less precise notion of a risk factor's causal effect. A variety of modern statistical methods adopt this approach. When an intervention cannot be specified, causal relations can still exist, but how to intervene to change the outcome will be unclear. In application, the often-complex structure of causal processes needs to be acknowledged and appropriate data collected to study them. These newer approaches need to be brought to bear on the increasingly complex public health challenges of our globalized world.

Mathematical investigations of branch length similarity entropy profiles of shapes for various resolutions

NASA Astrophysics Data System (ADS)

Jeon, Wonju; Lee, Sang-Hee

2012-12-01

In our previous study, we defined the branch length similarity (BLS) entropy for a simple network consisting of a single node and numerous branches. As the first application of this entropy to characterize shapes, the BLS entropy profiles of 20 battle tank shapes were calculated from simple networks created by connecting pixels in the boundary of the shape. The profiles successfully characterized the tank shapes through a comparison of their BLS entropy profiles. Following the application, this entropy was used to characterize human's emotional faces, such as happiness and sad, and to measure the degree of complexity for termite tunnel networks. These applications indirectly indicate that the BLS entropy profile can be a useful tool to characterize networks and shapes. However, the ability of the BLS entropy in the characterization depends on the image resolution because the entropy is determined by the number of nodes for the boundary of a shape. Higher resolution means more nodes. If the entropy is to be widely used in the scientific community, the effect of the resolution on the entropy profile should be understood. In the present study, we mathematically investigated the BLS entropy profile of a shape with infinite resolution and numerically investigated the variation in the pattern of the entropy profile caused by changes in the resolution change in the case of finite resolution.

Structural Evolutions of STOCK Markets Controlled by Generalized Entropy Principles of Complex Systems

NASA Astrophysics Data System (ADS)

Wang, Yi Jiao; Feng, Qing Yi; Chai, Li He

As one of the most important financial markets and one of the main parts of economic system, the stock market has become the research focus in economics. The stock market is a typical complex open system far from equilibrium. Many available models that make huge contribution to researches on market are strong in describing the market however, ignoring strong nonlinear interactions among active agents and weak in reveal underlying dynamic mechanisms of structural evolutions of market. From econophysical perspectives, this paper analyzes the complex interactions among agents and defines the generalized entropy in stock markets. Nonlinear evolutionary dynamic equation for the stock markets is then derived from Maximum Generalized Entropy Principle. Simulations are accordingly conducted for a typical case with the given data, by which the structural evolution of the stock market system is demonstrated. Some discussions and implications are finally provided.

Unveiling causal activity of complex networks

NASA Astrophysics Data System (ADS)

Williams-García, Rashid V.; Beggs, John M.; Ortiz, Gerardo

2017-07-01

We introduce a novel tool for analyzing complex network dynamics, allowing for cascades of causally-related events, which we call causal webs (c-webs), to be separated from other non-causally-related events. This tool shows that traditionally-conceived avalanches may contain mixtures of spatially-distinct but temporally-overlapping cascades of events, and dynamical disorder or noise. In contrast, c-webs separate these components, unveiling previously hidden features of the network and dynamics. We apply our method to mouse cortical data with resulting statistics which demonstrate for the first time that neuronal avalanches are not merely composed of causally-related events. The original version of this article was uploaded to the arXiv on March 17th, 2016 [1].

The Correlation Entropy as a Measure of the Complexity of High-Lying Single-Particle Modes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Stoyanov, Chavdar; Zelevinsky, Vladimir; Department of Physics and Astronomy, Michigan State University, East Lansing, Michigan 48824-1321

Highly-excited single-particle states in nuclei are coupled with the excitations of a more complex character, first of all with collective phonon-like modes of the core. In the framework of the quasiparticle-phonon model we consider the structure of resulting complex configurations using the 1k17/2 orbital in 209Pb as an example. The eigenstates of the model carry significant degree of complexity that can be quantified with the aid of correlational invariant entropy. With artificially enhanced particle-core coupling, the system undergoes the doubling phase transition with the quasiparticle strength concentrated in two repelling peaks.

Center for Quantum Algorithms and Complexity

DTIC Science & Technology

2014-05-12

precisely, it asserts that for any subset L of particles, the entanglement entropy between L and L̄ is bounded by the surface area of L (the area is...ground states of gapped local Hamiltonians. Roughly, it says that the entanglement in such states is very local, and the entanglement entropy scales...the theorem states that the entanglement entropy is bounded by exp(X), where X = log(d/?). Hastingss result implies that ground states of gapped 1D

Weighted multiscale Rényi permutation entropy of nonlinear time series

NASA Astrophysics Data System (ADS)

Chen, Shijian; Shang, Pengjian; Wu, Yue

2018-04-01

In this paper, based on Rényi permutation entropy (RPE), which has been recently suggested as a relative measure of complexity in nonlinear systems, we propose multiscale Rényi permutation entropy (MRPE) and weighted multiscale Rényi permutation entropy (WMRPE) to quantify the complexity of nonlinear time series over multiple time scales. First, we apply MPRE and WMPRE to the synthetic data and make a comparison of modified methods and RPE. Meanwhile, the influence of the change of parameters is discussed. Besides, we interpret the necessity of considering not only multiscale but also weight by taking the amplitude into account. Then MRPE and WMRPE methods are employed to the closing prices of financial stock markets from different areas. By observing the curves of WMRPE and analyzing the common statistics, stock markets are divided into 4 groups: (1) DJI, S&P500, and HSI, (2) NASDAQ and FTSE100, (3) DAX40 and CAC40, and (4) ShangZheng and ShenCheng. Results show that the standard deviations of weighted methods are smaller, showing WMRPE is able to ensure the results more robust. Besides, WMPRE can provide abundant dynamical properties of complex systems, and demonstrate the intrinsic mechanism.

Effect of chunk strength on the performance of children with developmental dyslexia on artificial grammar learning task may be related to complexity.

PubMed

Schiff, Rachel; Katan, Pesia; Sasson, Ayelet; Kahta, Shani

2017-07-01

There's a long held view that chunks play a crucial role in artificial grammar learning performance. We compared chunk strength influences on performance, in high and low topological entropy (a measure of complexity) grammar systems, with dyslexic children, age-matched and reading-level-matched control participants. Findings show that age-matched control participants' performance reflected equivalent influence of chunk strength in the two topological entropy conditions, as typically found in artificial grammar learning experiments. By contrast, dyslexic children and reading-level-matched controls' performance reflected knowledge of chunk strength only under the low topological entropy condition. In the low topological entropy grammar system, they appeared completely unable to utilize chunk strength to make appropriate test item selections. In line with previous research, this study suggests that for typically developing children, it is the chunks that are attended during artificial grammar learning and create a foundation on which implicit associative learning mechanisms operate, and these chunks are unitized to different strengths. However, for children with dyslexia, it is complexity that may influence the subsequent memorability of chunks, independently of their strength.

Confidence intervals and hypothesis testing for the Permutation Entropy with an application to epilepsy

NASA Astrophysics Data System (ADS)

Traversaro, Francisco; O. Redelico, Francisco

2018-04-01

In nonlinear dynamics, and to a lesser extent in other fields, a widely used measure of complexity is the Permutation Entropy. But there is still no known method to determine the accuracy of this measure. There has been little research on the statistical properties of this quantity that characterize time series. The literature describes some resampling methods of quantities used in nonlinear dynamics - as the largest Lyapunov exponent - but these seems to fail. In this contribution, we propose a parametric bootstrap methodology using a symbolic representation of the time series to obtain the distribution of the Permutation Entropy estimator. We perform several time series simulations given by well-known stochastic processes: the 1/fα noise family, and show in each case that the proposed accuracy measure is as efficient as the one obtained by the frequentist approach of repeating the experiment. The complexity of brain electrical activity, measured by the Permutation Entropy, has been extensively used in epilepsy research for detection in dynamical changes in electroencephalogram (EEG) signal with no consideration of the variability of this complexity measure. An application of the parametric bootstrap methodology is used to compare normal and pre-ictal EEG signals.

A Study of Students' Reasoning about Probabilistic Causality: Implications for Understanding Complex Systems and for Instructional Design

ERIC Educational Resources Information Center

Grotzer, Tina A.; Solis, S. Lynneth; Tutwiler, M. Shane; Cuzzolino, Megan Powell

2017-01-01

Understanding complex systems requires reasoning about causal relationships that behave or appear to behave probabilistically. Features such as distributed agency, large spatial scales, and time delays obscure co-variation relationships and complex interactions can result in non-deterministic relationships between causes and effects that are best…

Exploring total cardiac variability in healthy and pathophysiological subjects using improved refined multiscale entropy.

PubMed

Marwaha, Puneeta; Sunkaria, Ramesh Kumar

2017-02-01

Multiscale entropy (MSE) and refined multiscale entropy (RMSE) techniques are being widely used to evaluate the complexity of a time series across multiple time scales 't'. Both these techniques, at certain time scales (sometimes for the entire time scales, in the case of RMSE), assign higher entropy to the HRV time series of certain pathologies than that of healthy subjects, and to their corresponding randomized surrogate time series. This incorrect assessment of signal complexity may be due to the fact that these techniques suffer from the following limitations: (1) threshold value 'r' is updated as a function of long-term standard deviation and hence unable to explore the short-term variability as well as substantial variability inherited in beat-to-beat fluctuations of long-term HRV time series. (2) In RMSE, entropy values assigned to different filtered scaled time series are the result of changes in variance, but do not completely reflect the real structural organization inherited in original time series. In the present work, we propose an improved RMSE (I-RMSE) technique by introducing a new procedure to set the threshold value by taking into account the period-to-period variability inherited in a signal and evaluated it on simulated and real HRV database. The proposed I-RMSE assigns higher entropy to the age-matched healthy subjects than that of patients suffering from atrial fibrillation, congestive heart failure, sudden cardiac death and diabetes mellitus, for the entire time scales. The results strongly support the reduction in complexity of HRV time series in female group, old-aged, patients suffering from severe cardiovascular and non-cardiovascular diseases, and in their corresponding surrogate time series.

Developing Causal Understanding with Causal Maps: The Impact of Total Links, Temporal Flow, and Lateral Position of Outcome Nodes

ERIC Educational Resources Information Center

Jeong, Allan; Lee, Woon Jee

2012-01-01

This study examined some of the methodological approaches used by students to construct causal maps in order to determine which approaches help students understand the underlying causes and causal mechanisms in a complex system. This study tested the relationship between causal understanding (ratio of root causes correctly/incorrectly identified,…

Near-field electromagnetic holography for high-resolution analysis of network interactions in neuronal tissue

PubMed Central

Kjeldsen, Henrik D.; Kaiser, Marcus; Whittington, Miles A.

2015-01-01

Background Brain function is dependent upon the concerted, dynamical interactions between a great many neurons distributed over many cortical subregions. Current methods of quantifying such interactions are limited by consideration only of single direct or indirect measures of a subsample of all neuronal population activity. New method Here we present a new derivation of the electromagnetic analogy to near-field acoustic holography allowing high-resolution, vectored estimates of interactions between sources of electromagnetic activity that significantly improves this situation. In vitro voltage potential recordings were used to estimate pseudo-electromagnetic energy flow vector fields, current and energy source densities and energy dissipation in reconstruction planes at depth into the neural tissue parallel to the recording plane of the microelectrode array. Results The properties of the reconstructed near-field estimate allowed both the utilization of super-resolution techniques to increase the imaging resolution beyond that of the microelectrode array, and facilitated a novel approach to estimating causal relationships between activity in neocortical subregions. Comparison with existing methods The holographic nature of the reconstruction method allowed significantly better estimation of the fine spatiotemporal detail of neuronal population activity, compared with interpolation alone, beyond the spatial resolution of the electrode arrays used. Pseudo-energy flow vector mapping was possible with high temporal precision, allowing a near-realtime estimate of causal interaction dynamics. Conclusions Basic near-field electromagnetic holography provides a powerful means to increase spatial resolution from electrode array data with careful choice of spatial filters and distance to reconstruction plane. More detailed approaches may provide the ability to volumetrically reconstruct activity patterns on neuronal tissue, but the ability to extract vectored data with the method presented already permits the study of dynamic causal interactions without bias from any prior assumptions on anatomical connectivity. PMID:26026581

Near-field electromagnetic holography for high-resolution analysis of network interactions in neuronal tissue.

PubMed

Kjeldsen, Henrik D; Kaiser, Marcus; Whittington, Miles A

2015-09-30

Brain function is dependent upon the concerted, dynamical interactions between a great many neurons distributed over many cortical subregions. Current methods of quantifying such interactions are limited by consideration only of single direct or indirect measures of a subsample of all neuronal population activity. Here we present a new derivation of the electromagnetic analogy to near-field acoustic holography allowing high-resolution, vectored estimates of interactions between sources of electromagnetic activity that significantly improves this situation. In vitro voltage potential recordings were used to estimate pseudo-electromagnetic energy flow vector fields, current and energy source densities and energy dissipation in reconstruction planes at depth into the neural tissue parallel to the recording plane of the microelectrode array. The properties of the reconstructed near-field estimate allowed both the utilization of super-resolution techniques to increase the imaging resolution beyond that of the microelectrode array, and facilitated a novel approach to estimating causal relationships between activity in neocortical subregions. The holographic nature of the reconstruction method allowed significantly better estimation of the fine spatiotemporal detail of neuronal population activity, compared with interpolation alone, beyond the spatial resolution of the electrode arrays used. Pseudo-energy flow vector mapping was possible with high temporal precision, allowing a near-realtime estimate of causal interaction dynamics. Basic near-field electromagnetic holography provides a powerful means to increase spatial resolution from electrode array data with careful choice of spatial filters and distance to reconstruction plane. More detailed approaches may provide the ability to volumetrically reconstruct activity patterns on neuronal tissue, but the ability to extract vectored data with the method presented already permits the study of dynamic causal interactions without bias from any prior assumptions on anatomical connectivity. Copyright © 2015 The Authors. Published by Elsevier B.V. All rights reserved.

The coupling analysis between stock market indices based on permutation measures

NASA Astrophysics Data System (ADS)

Shi, Wenbin; Shang, Pengjian; Xia, Jianan; Yeh, Chien-Hung

2016-04-01

Many information-theoretic methods have been proposed for analyzing the coupling dependence between time series. And it is significant to quantify the correlation relationship between financial sequences since the financial market is a complex evolved dynamic system. Recently, we developed a new permutation-based entropy, called cross-permutation entropy (CPE), to detect the coupling structures between two synchronous time series. In this paper, we extend the CPE method to weighted cross-permutation entropy (WCPE), to address some of CPE's limitations, mainly its inability to differentiate between distinct patterns of a certain motif and the sensitivity of patterns close to the noise floor. It shows more stable and reliable results than CPE does when applied it to spiky data and AR(1) processes. Besides, we adapt the CPE method to infer the complexity of short-length time series by freely changing the time delay, and test it with Gaussian random series and random walks. The modified method shows the advantages in reducing deviations of entropy estimation compared with the conventional one. Finally, the weighted cross-permutation entropy of eight important stock indices from the world financial markets is investigated, and some useful and interesting empirical results are obtained.

Structure and Randomness of Continuous-Time, Discrete-Event Processes

NASA Astrophysics Data System (ADS)

Marzen, Sarah E.; Crutchfield, James P.

2017-10-01

Loosely speaking, the Shannon entropy rate is used to gauge a stochastic process' intrinsic randomness; the statistical complexity gives the cost of predicting the process. We calculate, for the first time, the entropy rate and statistical complexity of stochastic processes generated by finite unifilar hidden semi-Markov models—memoryful, state-dependent versions of renewal processes. Calculating these quantities requires introducing novel mathematical objects (ɛ -machines of hidden semi-Markov processes) and new information-theoretic methods to stochastic processes.

Theory and Normal Mode Analysis of Change in Protein Vibrational Dynamics on Ligand Binding

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mortisugu, Kei; Njunda, Brigitte; Smith, Jeremy C

2009-12-01

The change of protein vibrations on ligand binding is of functional and thermodynamic importance. Here, this process is characterized using a simple analytical 'ball-and-spring' model and all-atom normal-mode analysis (NMA) of the binding of the cancer drug, methotrexate (MTX) to its target, dihydrofolate reductase (DHFR). The analytical model predicts that the coupling between protein vibrations and ligand external motion generates entropy-rich, low-frequency vibrations in the complex. This is consistent with the atomistic NMA which reveals vibrational softening in forming the DHFR-MTX complex, a result also in qualitative agreement with neutron-scattering experiments. Energy minimization of the atomistic bound-state (B) structure whilemore » gradually decreasing the ligand interaction to zero allows the generation of a hypothetical 'intermediate' (I) state, without the ligand force field but with a structure similar to that of B. In going from I to B, it is found that the vibrational entropies of both the protein and MTX decrease while the complex structure becomes enthalpically stabilized. However, the relatively weak DHFR:MTX interaction energy results in the net entropy gain arising from coupling between the protein and MTX external motion being larger than the loss of vibrational entropy on complex formation. This, together with the I structure being more flexible than the unbound structure, results in the observed vibrational softening on ligand binding.« less

Real topological entropy versus metric entropy for birational measure-preserving transformations

NASA Astrophysics Data System (ADS)

Abarenkova, N.; Anglès d'Auriac, J.-Ch.; Boukraa, S.; Maillard, J.-M.

2000-10-01

We consider a family of birational measure-preserving transformations of two complex variables, depending on one parameter for which simple rational expressions for the dynamical zeta function have been conjectured, together with an equality between the topological entropy and the logarithm of the Arnold complexity (divided by the number of iterations). Similar results have been obtained for the adaptation of these two concepts to dynamical systems of real variables, yielding to introduce a “real topological entropy” and a “real Arnold complexity”. We try to compare, here, the Kolmogorov-Sinai metric entropy and this real Arnold complexity, or real topological entropy, on this particular example of a one-parameter dependent birational transformation of two variables. More precisely, we analyze, using an infinite precision calculation, the Lyapunov characteristic exponents for various values of the parameter of the birational transformation, in order to compare these results with the ones for the real Arnold complexity. We find a quite surprising result: for this very birational example, and, in fact, for a large set of birational measure-preserving mappings generated by involutions, the Lyapunov characteristic exponents seem to be equal to zero or, at least, extremely small, for all the orbits we have considered, and for all values of the parameter. Birational measure-preserving transformations, generated by involutions, could thus allow to better understand the difference between the topological description and the probabilistic description of discrete dynamical systems. Many birational measure-preserving transformations, generated by involutions, seem to provide examples of discrete dynamical systems which can be topologically chaotic while they are metrically almost quasi-periodic. Heuristically, this can be understood as a consequence of the fact that their orbits seem to form some kind of “transcendental foliation” of the two-dimensional space of variables.

Exploring the Molecular Design of Protein Interaction Sites with Molecular Dynamics Simulations and Free Energy Calculations†

PubMed Central

Liang, Shide; Li, Liwei; Hsu, Wei-Lun; Pilcher, Meaghan N.; Uversky, Vladimir; Zhou, Yaoqi; Dunker, A. Keith; Meroueh, Samy O.

2009-01-01

The significant work that has been invested toward understanding protein–protein interaction has not translated into significant advances in structure-based predictions. In particular redesigning protein surfaces to bind to unrelated receptors remains a challenge, partly due to receptor flexibility, which is often neglected in these efforts. In this work, we computationally graft the binding epitope of various small proteins obtained from the RCSB database to bind to barnase, lysozyme, and trypsin using a previously derived and validated algorithm. In an effort to probe the protein complexes in a realistic environment, all native and designer complexes were subjected to a total of nearly 400 ns of explicit-solvent molecular dynamics (MD) simulation. The MD data led to an unexpected observation: some of the designer complexes were highly unstable and decomposed during the trajectories. In contrast, the native and a number of designer complexes remained consistently stable. The unstable conformers provided us with a unique opportunity to define the structural and energetic factors that lead to unproductive protein–protein complexes. To that end we used free energy calculations following the MM-PBSA approach to determine the role of nonpolar effects, electrostatics and entropy in binding. Remarkably, we found that a majority of unstable complexes exhibited more favorable electrostatics than native or stable designer complexes, suggesting that favorable electrostatic interactions are not prerequisite for complex formation between proteins. However, nonpolar effects remained consistently more favorable in native and stable designer complexes reinforcing the importance of hydrophobic effects in protein–protein binding. While entropy systematically opposed binding in all cases, there was no observed trend in the entropy difference between native and designer complexes. A series of alanine scanning mutations of hot-spot residues at the interface of native and designer complexes showed less than optimal contacts of hot-spot residues with their surroundings in the unstable conformers, resulting in more favorable entropy for these complexes. Finally, disorder predictions revealed that secondary structures at the interface of unstable complexes exhibited greater disorder than the stable complexes. PMID:19113835

EEG based topography analysis in string recognition task

NASA Astrophysics Data System (ADS)

Ma, Xiaofei; Huang, Xiaolin; Shen, Yuxiaotong; Qin, Zike; Ge, Yun; Chen, Ying; Ning, Xinbao

2017-03-01

Vision perception and recognition is a complex process, during which different parts of brain are involved depending on the specific modality of the vision target, e.g. face, character, or word. In this study, brain activities in string recognition task compared with idle control state are analyzed through topographies based on multiple measurements, i.e. sample entropy, symbolic sample entropy and normalized rhythm power, extracted from simultaneously collected scalp EEG. Our analyses show that, for most subjects, both symbolic sample entropy and normalized gamma power in string recognition task are significantly higher than those in idle state, especially at locations of P4, O2, T6 and C4. It implies that these regions are highly involved in string recognition task. Since symbolic sample entropy measures complexity, from the perspective of new information generation, and normalized rhythm power reveals the power distributions in frequency domain, complementary information about the underlying dynamics can be provided through the two types of indices.

Ectopic beats in approximate entropy and sample entropy-based HRV assessment

NASA Astrophysics Data System (ADS)

Singh, Butta; Singh, Dilbag; Jaryal, A. K.; Deepak, K. K.

2012-05-01

Approximate entropy (ApEn) and sample entropy (SampEn) are the promising techniques for extracting complex characteristics of cardiovascular variability. Ectopic beats, originating from other than the normal site, are the artefacts contributing a serious limitation to heart rate variability (HRV) analysis. The approaches like deletion and interpolation are currently in use to eliminate the bias produced by ectopic beats. In this study, normal R-R interval time series of 10 healthy and 10 acute myocardial infarction (AMI) patients were analysed by inserting artificial ectopic beats. Then the effects of ectopic beats editing by deletion, degree-zero and degree-one interpolation on ApEn and SampEn have been assessed. Ectopic beats addition (even 2%) led to reduced complexity, resulting in decreased ApEn and SampEn of both healthy and AMI patient data. This reduction has been found to be dependent on level of ectopic beats. Editing of ectopic beats by interpolation degree-one method is found to be superior to other methods.

A pairwise maximum entropy model accurately describes resting-state human brain networks

PubMed Central

Watanabe, Takamitsu; Hirose, Satoshi; Wada, Hiroyuki; Imai, Yoshio; Machida, Toru; Shirouzu, Ichiro; Konishi, Seiki; Miyashita, Yasushi; Masuda, Naoki

2013-01-01

The resting-state human brain networks underlie fundamental cognitive functions and consist of complex interactions among brain regions. However, the level of complexity of the resting-state networks has not been quantified, which has prevented comprehensive descriptions of the brain activity as an integrative system. Here, we address this issue by demonstrating that a pairwise maximum entropy model, which takes into account region-specific activity rates and pairwise interactions, can be robustly and accurately fitted to resting-state human brain activities obtained by functional magnetic resonance imaging. Furthermore, to validate the approximation of the resting-state networks by the pairwise maximum entropy model, we show that the functional interactions estimated by the pairwise maximum entropy model reflect anatomical connexions more accurately than the conventional functional connectivity method. These findings indicate that a relatively simple statistical model not only captures the structure of the resting-state networks but also provides a possible method to derive physiological information about various large-scale brain networks. PMID:23340410

EEG analysis using wavelet-based information tools.

PubMed

Rosso, O A; Martin, M T; Figliola, A; Keller, K; Plastino, A

2006-06-15

Wavelet-based informational tools for quantitative electroencephalogram (EEG) record analysis are reviewed. Relative wavelet energies, wavelet entropies and wavelet statistical complexities are used in the characterization of scalp EEG records corresponding to secondary generalized tonic-clonic epileptic seizures. In particular, we show that the epileptic recruitment rhythm observed during seizure development is well described in terms of the relative wavelet energies. In addition, during the concomitant time-period the entropy diminishes while complexity grows. This is construed as evidence supporting the conjecture that an epileptic focus, for this kind of seizures, triggers a self-organized brain state characterized by both order and maximal complexity.

Gradient Dynamics and Entropy Production Maximization

NASA Astrophysics Data System (ADS)

Janečka, Adam; Pavelka, Michal

2018-01-01

We compare two methods for modeling dissipative processes, namely gradient dynamics and entropy production maximization. Both methods require similar physical inputs-how energy (or entropy) is stored and how it is dissipated. Gradient dynamics describes irreversible evolution by means of dissipation potential and entropy, it automatically satisfies Onsager reciprocal relations as well as their nonlinear generalization (Maxwell-Onsager relations), and it has statistical interpretation. Entropy production maximization is based on knowledge of free energy (or another thermodynamic potential) and entropy production. It also leads to the linear Onsager reciprocal relations and it has proven successful in thermodynamics of complex materials. Both methods are thermodynamically sound as they ensure approach to equilibrium, and we compare them and discuss their advantages and shortcomings. In particular, conditions under which the two approaches coincide and are capable of providing the same constitutive relations are identified. Besides, a commonly used but not often mentioned step in the entropy production maximization is pinpointed and the condition of incompressibility is incorporated into gradient dynamics.

Binding stability of peptides on major histocompatibility complex class I proteins: role of entropy and dynamics.

PubMed

Gul, Ahmet; Erman, Burak

2018-01-16

Prediction of peptide binding on specific human leukocyte antigens (HLA) has long been studied with successful results. We herein describe the effects of entropy and dynamics by investigating the binding stabilities of 10 nanopeptides on various HLA Class I alleles using a theoretical model based on molecular dynamics simulations. The fluctuational entropies of the peptides are estimated over a temperature range of 310-460 K. The estimated entropies correlate well with experimental binding affinities of the peptides: peptides that have higher binding affinities have lower entropies compared to non-binders, which have significantly larger entropies. The computation of the entropies is based on a simple model that requires short molecular dynamics trajectories and allows for approximate but rapid determination. The paper draws attention to the long neglected dynamic aspects of peptide binding, and provides a fast computation scheme that allows for rapid scanning of large numbers of peptides on selected HLA antigens, which may be useful in defining the right peptides for personal immunotherapy.

Binding stability of peptides on major histocompatibility complex class I proteins: role of entropy and dynamics

NASA Astrophysics Data System (ADS)

Gul, Ahmet; Erman, Burak

2018-03-01

Prediction of peptide binding on specific human leukocyte antigens (HLA) has long been studied with successful results. We herein describe the effects of entropy and dynamics by investigating the binding stabilities of 10 nanopeptides on various HLA Class I alleles using a theoretical model based on molecular dynamics simulations. The fluctuational entropies of the peptides are estimated over a temperature range of 310-460 K. The estimated entropies correlate well with experimental binding affinities of the peptides: peptides that have higher binding affinities have lower entropies compared to non-binders, which have significantly larger entropies. The computation of the entropies is based on a simple model that requires short molecular dynamics trajectories and allows for approximate but rapid determination. The paper draws attention to the long neglected dynamic aspects of peptide binding, and provides a fast computation scheme that allows for rapid scanning of large numbers of peptides on selected HLA antigens, which may be useful in defining the right peptides for personal immunotherapy.

Random versus maximum entropy models of neural population activity

NASA Astrophysics Data System (ADS)

Ferrari, Ulisse; Obuchi, Tomoyuki; Mora, Thierry

2017-04-01

The principle of maximum entropy provides a useful method for inferring statistical mechanics models from observations in correlated systems, and is widely used in a variety of fields where accurate data are available. While the assumptions underlying maximum entropy are intuitive and appealing, its adequacy for describing complex empirical data has been little studied in comparison to alternative approaches. Here, data from the collective spiking activity of retinal neurons is reanalyzed. The accuracy of the maximum entropy distribution constrained by mean firing rates and pairwise correlations is compared to a random ensemble of distributions constrained by the same observables. For most of the tested networks, maximum entropy approximates the true distribution better than the typical or mean distribution from that ensemble. This advantage improves with population size, with groups as small as eight being almost always better described by maximum entropy. Failure of maximum entropy to outperform random models is found to be associated with strong correlations in the population.

New Fault Recognition Method for Rotary Machinery Based on Information Entropy and a Probabilistic Neural Network.

PubMed

Jiang, Quansheng; Shen, Yehu; Li, Hua; Xu, Fengyu

2018-01-24

Feature recognition and fault diagnosis plays an important role in equipment safety and stable operation of rotating machinery. In order to cope with the complexity problem of the vibration signal of rotating machinery, a feature fusion model based on information entropy and probabilistic neural network is proposed in this paper. The new method first uses information entropy theory to extract three kinds of characteristics entropy in vibration signals, namely, singular spectrum entropy, power spectrum entropy, and approximate entropy. Then the feature fusion model is constructed to classify and diagnose the fault signals. The proposed approach can combine comprehensive information from different aspects and is more sensitive to the fault features. The experimental results on simulated fault signals verified better performances of our proposed approach. In real two-span rotor data, the fault detection accuracy of the new method is more than 10% higher compared with the methods using three kinds of information entropy separately. The new approach is proved to be an effective fault recognition method for rotating machinery.

Spatial chaos of Wang tiles with two symbols

NASA Astrophysics Data System (ADS)

Chen, Jin-Yu; Chen, Yu-Jie; Hu, Wen-Guei; Lin, Song-Sun

2016-02-01

This investigation completely classifies the spatial chaos problem in plane edge coloring (Wang tiles) with two symbols. For a set of Wang tiles B , spatial chaos occurs when the spatial entropy h ( B ) is positive. B is called a minimal cycle generator if P ( B ) ≠ 0̸ and P ( B ' ) = 0̸ whenever B ' ⫋ B , where P ( B ) is the set of all periodic patterns on ℤ2 generated by B . Given a set of Wang tiles B , write B = C 1 ∪ C 2 ∪ ⋯ ∪ C k ∪ N , where Cj, 1 ≤ j ≤ k, are minimal cycle generators and B contains no minimal cycle generator except those contained in C1∪C2∪⋯∪Ck. Then, the positivity of spatial entropy h ( B ) is completely determined by C1∪C2∪⋯∪Ck. Furthermore, there are 39 equivalence classes of marginal positive-entropy sets of Wang tiles and 18 equivalence classes of saturated zero-entropy sets of Wang tiles. For a set of Wang tiles B , h ( B ) is positive if and only if B contains a MPE set, and h ( B ) is zero if and only if B is a subset of a SZE set.

Progress towards measurement of entanglement entropy dynamics in one-dimensional interacting systems in the presence of disorder

NASA Astrophysics Data System (ADS)

Lukin, Alexander; Tai, M. Eric; Rispoli, Matthew; Schittko, Robert; Menke, Tim; Kaufman, Adam; Greiner, Markus

2017-04-01

Many-body localized states appear at odds with thermalization as they preserve the memory of their initial state. This behavior has drawn significant theoretical and experimental attention in recent years. Real space localization has been observed on various platforms and under a number of experimental conditions, both with and without interactions. However, the characteristic logarithmic growth of entanglement entropy, which distinguishes the many-body localized state from the non-interacting Anderson localized state, has only been studied in numerics and has yet to be investigated experimentally. We are working towards the phenomenon of localization in one dimensional, interacting Bose-Hubbard system using a quantum gas microscope. With site-resolved addressing and readout, our microscope provides full control over the studied system, in particular it allows us to add disorder into our system using a Fourier plane hologram. This gives us access to both local observables, such as the occupation of individual lattice sites, as well as the entanglement entropy. I will present our progress towards measuring the dependence of the entanglement entropy grows on the disorder strength and interactions in our system. National Science Foundation, Gordon and Betty Moore Foundation's EPiQS Initiative, Air Force Office of Scientific Research MURI program, NSF Graduate Research Fellowship Program (MNR).

Compression based entropy estimation of heart rate variability on multiple time scales.

PubMed

Baumert, Mathias; Voss, Andreas; Javorka, Michal

2013-01-01

Heart rate fluctuates beat by beat in a complex manner. The aim of this study was to develop a framework for entropy assessment of heart rate fluctuations on multiple time scales. We employed the Lempel-Ziv algorithm for lossless data compression to investigate the compressibility of RR interval time series on different time scales, using a coarse-graining procedure. We estimated the entropy of RR interval time series of 20 young and 20 old subjects and also investigated the compressibility of randomly shuffled surrogate RR time series. The original RR time series displayed significantly smaller compression entropy values than randomized RR interval data. The RR interval time series of older subjects showed significantly different entropy characteristics over multiple time scales than those of younger subjects. In conclusion, data compression may be useful approach for multiscale entropy assessment of heart rate variability.

Conditional Entropy-Constrained Residual VQ with Application to Image Coding

NASA Technical Reports Server (NTRS)

Kossentini, Faouzi; Chung, Wilson C.; Smith, Mark J. T.

1996-01-01

This paper introduces an extension of entropy-constrained residual vector quantization (VQ) where intervector dependencies are exploited. The method, which we call conditional entropy-constrained residual VQ, employs a high-order entropy conditioning strategy that captures local information in the neighboring vectors. When applied to coding images, the proposed method is shown to achieve better rate-distortion performance than that of entropy-constrained residual vector quantization with less computational complexity and lower memory requirements. Moreover, it can be designed to support progressive transmission in a natural way. It is also shown to outperform some of the best predictive and finite-state VQ techniques reported in the literature. This is due partly to the joint optimization between the residual vector quantizer and a high-order conditional entropy coder as well as the efficiency of the multistage residual VQ structure and the dynamic nature of the prediction.

The complexity of gene expression dynamics revealed by permutation entropy

PubMed Central

2010-01-01

Background High complexity is considered a hallmark of living systems. Here we investigate the complexity of temporal gene expression patterns using the concept of Permutation Entropy (PE) first introduced in dynamical systems theory. The analysis of gene expression data has so far focused primarily on the identification of differentially expressed genes, or on the elucidation of pathway and regulatory relationships. We aim to study gene expression time series data from the viewpoint of complexity. Results Applying the PE complexity metric to abiotic stress response time series data in Arabidopsis thaliana, genes involved in stress response and signaling were found to be associated with the highest complexity not only under stress, but surprisingly, also under reference, non-stress conditions. Genes with house-keeping functions exhibited lower PE complexity. Compared to reference conditions, the PE of temporal gene expression patterns generally increased upon stress exposure. High-complexity genes were found to have longer upstream intergenic regions and more cis-regulatory motifs in their promoter regions indicative of a more complex regulatory apparatus needed to orchestrate their expression, and to be associated with higher correlation network connectivity degree. Arabidopsis genes also present in other plant species were observed to exhibit decreased PE complexity compared to Arabidopsis specific genes. Conclusions We show that Permutation Entropy is a simple yet robust and powerful approach to identify temporal gene expression profiles of varying complexity that is equally applicable to other types of molecular profile data. PMID:21176199

Entropy model of dissipative structure on corporate social responsibility

NASA Astrophysics Data System (ADS)

Li, Zuozhi; Jiang, Jie

2017-06-01

Enterprise is prompted to fulfill the social responsibility requirement by the internal and external environment. In this complex system, some studies suggest that firms have an orderly or chaotic entropy exchange behavior. Based on the theory of dissipative structure, this paper constructs the entropy index system of corporate social responsibility(CSR) and explores the dissipative structure of CSR through Brusselator model criterion. Picking up listed companies of the equipment manufacturing, the research shows that CSR has positive incentive to negative entropy and promotes the stability of dissipative structure. In short, the dissipative structure of CSR has a positive impact on the interests of stakeholders and corporate social images.

Computational investigation of enthalpy-entropy compensation in complexation of glycoconjugated bile salts with β-cyclodextrin and analogs.

PubMed

Tidemand, Kasper D; Schönbeck, Christian; Holm, René; Westh, Peter; Peters, Günther H

2014-09-18

The inclusion complexes of glycoconjugated bile salts with β-cyclodextrin (β-CD) and 2-hydroxypropyl-β-cyclodextrins (HP-β-CD) in aqueous solution were investigated by molecular dynamics simulations to provide a molecular explanation of the experimentally observed destabilizing effect of the HP substituents. Good agreement with experimental data was found with respect to penetration depths of CDs. An increased degree of HP substitution (DS) resulted in an increased probability of blocking the cavity opening, thereby hindering the bile salt from entering CD. Further, the residence time of water molecules in the cavity increased with the DS. Release of water from the cavity resulted in a positive enthalpy change, which correlates qualitatively with the experimentally determined increase in complexation enthalpy and contributes to the enthalpy-entropy compensation. The positive change in complexation entropy with DS was not able to compensate for this unfavorable change in enthalpy induced by the HP substituents, resulting in a destabilizing effect. This was found to originate from fixation of the HP substituents and decreased free rotation of the bile salts within the CD cavities.

Complexity analysis of brain activity in attention-deficit/hyperactivity disorder: A multiscale entropy analysis.

PubMed

Chenxi, Li; Chen, Yanni; Li, Youjun; Wang, Jue; Liu, Tian

2016-06-01

The multiscale entropy (MSE) is a novel method for quantifying the intrinsic dynamical complexity of physiological systems over several scales. To evaluate this method as a promising way to explore the neural mechanisms in ADHD, we calculated the MSE in EEG activity during the designed task. EEG data were collected from 13 outpatient boys with a confirmed diagnosis of ADHD and 13 age- and gender-matched normal control children during their doing multi-source interference task (MSIT). We estimated the MSE by calculating the sample entropy values of delta, theta, alpha and beta frequency bands over twenty time scales using coarse-grained procedure. The results showed increased complexity of EEG data in delta and theta frequency bands and decreased complexity in alpha frequency bands in ADHD children. The findings of this study revealed aberrant neural connectivity of kids with ADHD during interference task. The results showed that MSE method may be a new index to identify and understand the neural mechanism of ADHD. Copyright © 2016 Elsevier Inc. All rights reserved.

Progressive low-bitrate digital color/monochrome image coding by neuro-fuzzy clustering

NASA Astrophysics Data System (ADS)

Mitra, Sunanda; Meadows, Steven

1997-10-01

Color image coding at low bit rates is an area of research that is just being addressed in recent literature since the problems of storage and transmission of color images are becoming more prominent in many applications. Current trends in image coding exploit the advantage of subband/wavelet decompositions in reducing the complexity in optimal scalar/vector quantizer (SQ/VQ) design. Compression ratios (CRs) of the order of 10:1 to 20:1 with high visual quality have been achieved by using vector quantization of subband decomposed color images in perceptually weighted color spaces. We report the performance of a recently developed adaptive vector quantizer, namely, AFLC-VQ for effective reduction in bit rates while maintaining high visual quality of reconstructed color as well as monochrome images. For 24 bit color images, excellent visual quality is maintained upto a bit rate reduction to approximately 0.48 bpp (for each color plane or monochrome 0.16 bpp, CR 50:1) by using the RGB color space. Further tuning of the AFLC-VQ, and addition of an entropy coder module after the VQ stage results in extremely low bit rates (CR 80:1) for good quality, reconstructed images. Our recent study also reveals that for similar visual quality, RGB color space requires less bits/pixel than either the YIQ, or HIS color space for storing the same information when entropy coding is applied. AFLC-VQ outperforms other standard VQ and adaptive SQ techniques in retaining visual fidelity at similar bit rate reduction.

Inferring causal molecular networks: empirical assessment through a community-based effort.

PubMed

Hill, Steven M; Heiser, Laura M; Cokelaer, Thomas; Unger, Michael; Nesser, Nicole K; Carlin, Daniel E; Zhang, Yang; Sokolov, Artem; Paull, Evan O; Wong, Chris K; Graim, Kiley; Bivol, Adrian; Wang, Haizhou; Zhu, Fan; Afsari, Bahman; Danilova, Ludmila V; Favorov, Alexander V; Lee, Wai Shing; Taylor, Dane; Hu, Chenyue W; Long, Byron L; Noren, David P; Bisberg, Alexander J; Mills, Gordon B; Gray, Joe W; Kellen, Michael; Norman, Thea; Friend, Stephen; Qutub, Amina A; Fertig, Elana J; Guan, Yuanfang; Song, Mingzhou; Stuart, Joshua M; Spellman, Paul T; Koeppl, Heinz; Stolovitzky, Gustavo; Saez-Rodriguez, Julio; Mukherjee, Sach

2016-04-01

It remains unclear whether causal, rather than merely correlational, relationships in molecular networks can be inferred in complex biological settings. Here we describe the HPN-DREAM network inference challenge, which focused on learning causal influences in signaling networks. We used phosphoprotein data from cancer cell lines as well as in silico data from a nonlinear dynamical model. Using the phosphoprotein data, we scored more than 2,000 networks submitted by challenge participants. The networks spanned 32 biological contexts and were scored in terms of causal validity with respect to unseen interventional data. A number of approaches were effective, and incorporating known biology was generally advantageous. Additional sub-challenges considered time-course prediction and visualization. Our results suggest that learning causal relationships may be feasible in complex settings such as disease states. Furthermore, our scoring approach provides a practical way to empirically assess inferred molecular networks in a causal sense.

Temperature variability analysis using wavelets and multiscale entropy in patients with systemic inflammatory response syndrome, sepsis, and septic shock.

PubMed

Papaioannou, Vasilios E; Chouvarda, Ioanna G; Maglaveras, Nikos K; Pneumatikos, Ioannis A

2012-12-12

Even though temperature is a continuous quantitative variable, its measurement has been considered a snapshot of a process, indicating whether a patient is febrile or afebrile. Recently, other diagnostic techniques have been proposed for the association between different properties of the temperature curve with severity of illness in the Intensive Care Unit (ICU), based on complexity analysis of continuously monitored body temperature. In this study, we tried to assess temperature complexity in patients with systemic inflammation during a suspected ICU-acquired infection, by using wavelets transformation and multiscale entropy of temperature signals, in a cohort of mixed critically ill patients. Twenty-two patients were enrolled in the study. In five, systemic inflammatory response syndrome (SIRS, group 1) developed, 10 had sepsis (group 2), and seven had septic shock (group 3). All temperature curves were studied during the first 24 hours of an inflammatory state. A wavelet transformation was applied, decomposing the signal in different frequency components (scales) that have been found to reflect neurogenic and metabolic inputs on temperature oscillations. Wavelet energy and entropy per different scales associated with complexity in specific frequency bands and multiscale entropy of the whole signal were calculated. Moreover, a clustering technique and a linear discriminant analysis (LDA) were applied for permitting pattern recognition in data sets and assessing diagnostic accuracy of different wavelet features among the three classes of patients. Statistically significant differences were found in wavelet entropy between patients with SIRS and groups 2 and 3, and in specific ultradian bands between SIRS and group 3, with decreased entropy in sepsis. Cluster analysis using wavelet features in specific bands revealed concrete clusters closely related with the groups in focus. LDA after wrapper-based feature selection was able to classify with an accuracy of more than 80% SIRS from the two sepsis groups, based on multiparametric patterns of entropy values in the very low frequencies and indicating reduced metabolic inputs on local thermoregulation, probably associated with extensive vasodilatation. We suggest that complexity analysis of temperature signals can assess inherent thermoregulatory dynamics during systemic inflammation and has increased discriminating value in patients with infectious versus noninfectious conditions, probably associated with severity of illness.

Temperature variability analysis using wavelets and multiscale entropy in patients with systemic inflammatory response syndrome, sepsis, and septic shock

PubMed Central

2012-01-01

Background Even though temperature is a continuous quantitative variable, its measurement has been considered a snapshot of a process, indicating whether a patient is febrile or afebrile. Recently, other diagnostic techniques have been proposed for the association between different properties of the temperature curve with severity of illness in the Intensive Care Unit (ICU), based on complexity analysis of continuously monitored body temperature. In this study, we tried to assess temperature complexity in patients with systemic inflammation during a suspected ICU-acquired infection, by using wavelets transformation and multiscale entropy of temperature signals, in a cohort of mixed critically ill patients. Methods Twenty-two patients were enrolled in the study. In five, systemic inflammatory response syndrome (SIRS, group 1) developed, 10 had sepsis (group 2), and seven had septic shock (group 3). All temperature curves were studied during the first 24 hours of an inflammatory state. A wavelet transformation was applied, decomposing the signal in different frequency components (scales) that have been found to reflect neurogenic and metabolic inputs on temperature oscillations. Wavelet energy and entropy per different scales associated with complexity in specific frequency bands and multiscale entropy of the whole signal were calculated. Moreover, a clustering technique and a linear discriminant analysis (LDA) were applied for permitting pattern recognition in data sets and assessing diagnostic accuracy of different wavelet features among the three classes of patients. Results Statistically significant differences were found in wavelet entropy between patients with SIRS and groups 2 and 3, and in specific ultradian bands between SIRS and group 3, with decreased entropy in sepsis. Cluster analysis using wavelet features in specific bands revealed concrete clusters closely related with the groups in focus. LDA after wrapper-based feature selection was able to classify with an accuracy of more than 80% SIRS from the two sepsis groups, based on multiparametric patterns of entropy values in the very low frequencies and indicating reduced metabolic inputs on local thermoregulation, probably associated with extensive vasodilatation. Conclusions We suggest that complexity analysis of temperature signals can assess inherent thermoregulatory dynamics during systemic inflammation and has increased discriminating value in patients with infectious versus noninfectious conditions, probably associated with severity of illness. PMID:22424316

Evaluation of Coal Gasification/Combined Cycle Power Plant Feasibility at the Sewells Point Naval Complex, Norfolk, Virginia.

DTIC Science & Technology

1981-07-01

2 No. Name Page I 3-2 Rankine Cycle Configuration and Temperature- Entropy Chart 3-6 S 3-3 Brayton Cycle Configuration and Temperature- Entropy Chart...shown in Exhibit 3-1 presents the combined cycle as integrated with the gasification plant, i.e., there is an interchange of electric power, feedwater ...Brayton and Rankine cycles , respectively. The cycle configuration and the temperature-entropy charts for these two cycles are shown in Exhibits 3-2 and 3

Direct comparison of phase-sensitive vibrational sum frequency generation with maximum entropy method: case study of water.

PubMed

de Beer, Alex G F; Samson, Jean-Sebastièn; Hua, Wei; Huang, Zishuai; Chen, Xiangke; Allen, Heather C; Roke, Sylvie

2011-12-14

We present a direct comparison of phase sensitive sum-frequency generation experiments with phase reconstruction obtained by the maximum entropy method. We show that both methods lead to the same complex spectrum. Furthermore, we discuss the strengths and weaknesses of each of these methods, analyzing possible sources of experimental and analytical errors. A simulation program for maximum entropy phase reconstruction is available at: http://lbp.epfl.ch/. © 2011 American Institute of Physics

Entropy: A Unifying Path for Understanding Complexity in Natural, Artificial and Social Systems

DTIC Science & Technology

2011-07-01

data in what concerns its consequences. Definitively the BG entropy can only be understood nowadays as a first, most important, step, but not as the...applications to natural systems (trapped ions, spin-glass, dusty plasma, earthquakes, turbulence, astrophysical objects, cosmology , black holes, etc

Anisotropic magnetocaloric response in AlFe 2B 2

DOE PAGES

Barua, R.; Lejeune, B. T.; Ke, L.; ...

2018-02-19

Experimental investigations of the magnetocaloric response of the intermetallic layered AlFe 2B 2 compound along the principle axes of the orthorhombic cell were carried out using aligned plate-like crystallites with an anisotropic [101] growth habit. Results were confirmed to be consistent with density functional theory calculations. Field-dependent magnetization data confirm that the a-axis is the easy direction of magnetization within the (ac) plane. The magnetocrystalline anisotropy energy required to rotate the spin quantization vector from the c-to the a-axis direction is determined as K~0.9 MJ/m 3 at 50 K. Magnetic entropy change curves measured near the Curie transition temperature ofmore » 285 K reveal a large rotating magnetic entropy change of 1.3 J kg -1K -1 at μ 0H app = 2 T, consistent with large differences in magnetic entropy change ΔS mag measured along the a- and c-axes. Overall, this study provides insight of both fundamental and applied relevance concerning pathways for maximizing the magnetocaloric potential of AlFe 2B 2 for thermal management applications.« less

Anisotropic magnetocaloric response in AlFe 2B 2

DOE Office of Scientific and Technical Information (OSTI.GOV)

Barua, R.; Lejeune, B. T.; Ke, L.

Experimental investigations of the magnetocaloric response of the intermetallic layered AlFe 2B 2 compound along the principle axes of the orthorhombic cell were carried out using aligned plate-like crystallites with an anisotropic [101] growth habit. Results were confirmed to be consistent with density functional theory calculations. Field-dependent magnetization data confirm that the a-axis is the easy direction of magnetization within the (ac) plane. The magnetocrystalline anisotropy energy required to rotate the spin quantization vector from the c-to the a-axis direction is determined as K~0.9 MJ/m 3 at 50 K. Magnetic entropy change curves measured near the Curie transition temperature ofmore » 285 K reveal a large rotating magnetic entropy change of 1.3 J kg -1K -1 at μ 0H app = 2 T, consistent with large differences in magnetic entropy change ΔS mag measured along the a- and c-axes. Overall, this study provides insight of both fundamental and applied relevance concerning pathways for maximizing the magnetocaloric potential of AlFe 2B 2 for thermal management applications.« less

Dynamic Uncertain Causality Graph for Knowledge Representation and Reasoning: Utilization of Statistical Data and Domain Knowledge in Complex Cases.

PubMed

Zhang, Qin; Yao, Quanying

2018-05-01

The dynamic uncertain causality graph (DUCG) is a newly presented framework for uncertain causality representation and probabilistic reasoning. It has been successfully applied to online fault diagnoses of large, complex industrial systems, and decease diagnoses. This paper extends the DUCG to model more complex cases than what could be previously modeled, e.g., the case in which statistical data are in different groups with or without overlap, and some domain knowledge and actions (new variables with uncertain causalities) are introduced. In other words, this paper proposes to use -mode, -mode, and -mode of the DUCG to model such complex cases and then transform them into either the standard -mode or the standard -mode. In the former situation, if no directed cyclic graph is involved, the transformed result is simply a Bayesian network (BN), and existing inference methods for BNs can be applied. In the latter situation, an inference method based on the DUCG is proposed. Examples are provided to illustrate the methodology.

Shakespeare and other English Renaissance authors as characterized by Information Theory complexity quantifiers

NASA Astrophysics Data System (ADS)

Rosso, Osvaldo A.; Craig, Hugh; Moscato, Pablo

2009-03-01

We introduce novel Information Theory quantifiers in a computational linguistic study that involves a large corpus of English Renaissance literature. The 185 texts studied (136 plays and 49 poems in total), with first editions that range from 1580 to 1640, form a representative set of its period. Our data set includes 30 texts unquestionably attributed to Shakespeare; in addition we also included A Lover’s Complaint, a poem which generally appears in Shakespeare collected editions but whose authorship is currently in dispute. Our statistical complexity quantifiers combine the power of Jensen-Shannon’s divergence with the entropy variations as computed from a probability distribution function of the observed word use frequencies. Our results show, among other things, that for a given entropy poems display higher complexity than plays, that Shakespeare’s work falls into two distinct clusters in entropy, and that his work is remarkable for its homogeneity and for its closeness to overall means.

Tunnelling with a negative cosmological constant

NASA Astrophysics Data System (ADS)

Gibbons, G. W.

1996-02-01

The point of this paper is to see what light new results in hyperbolic geometry may throw on gravitational entropy and whether gravitational entropy is relevant for the quantum origin of the universe. We introduce some new gravitational instantons which mediate the birth from nothing of closed universes containing wormholes and suggest that they may contribute to the density matrix of the universe. We also discuss the connection between their gravitational action and the topological and volumetric entropies introduced in hyperbolic geometry. These coincide for hyperbolic 4-manifolds, and increase with increasing topological complexity of the 4-manifold. We raise the question of whether the action also increases with the topological complexity of the initial 3-geometry, measured either by its 3-volume or its Matveev complexity. We point out, in distinction to the non-supergravity case, that universes with domains of negative cosmological constant separated by supergravity domain walls cannot be born from nothing. Finally we point out that our wormholes provide examples of the type of Perpetual Motion machines envisaged by Frolov and Novikov.

Is there a self-organization principle of river deltas?

NASA Astrophysics Data System (ADS)

Tejedor, Alejandro; Longjas, Anthony; Foufoula-Georgiou, Efi

2017-04-01

River deltas are known to possess a complex topological and flux-partitioning structure which has recently been quantified using spectral graph theory [Tejedor et al., 2015a,b]. By analysis of real and simulated deltas it has also been shown that there is promise in formalizing relationships between this topo-dynamic delta structure and the underlying delta forming processes [e.g., Tejedor et al., 2016]. The question we pose here is whether there exists a first order organizational principle behind the self-organization of river deltas and whether this principle can be unraveled from the co-evolving topo-dynamic structure encoded in the delta planform. To answer this question, we introduce a new metric, the nonlocal Entropy Rate (nER) that captures the information content of a delta network in terms of the degree of uncertainty in delivering fluxes from any point of the network to the shoreline. We hypothesize that if the "guiding principle" of undisturbed deltas is to efficiently and robustly build land by increasing the diversity of their flux pathways over the delta plane, then they would exhibit maximum nonlocal Entropy Rate at states at which geometry and flux dynamics are at equilibrium. At the same time, their nER would be non-optimal at transient states, such as before and after major avulsions during which topology and dynamics adjust to each other to reach a new equilibrium state. We will present our results for field and simulated deltas, which confirm this hypothesis and open up new ways of thinking about self-organization, complexity and robustness in river deltas. One particular connection of interest might have important implications since entropy rate and resilience are related by the fluctuation theorem [Demetrius and Manke, 2005], and therefore our results suggest that deltas might in fact self-organize to maximize their resilience to structural and dynamic perturbations. References: Tejedor, A., A. Longjas, I. Zaliapin, and E. Foufoula­-Georgiou (2015), Water Resour. Res., 51, 3998-4018. Tejedor, A., A. Longjas, I. Zaliapin, and E. Foufoula-­Georgiou (2015), Water Resour. Res., 51, 4019-4045. Tejedor, A., A. Longjas, R. Caldwell, D. A. Edmonds, I. Zaliapin, and E. Foufoula­-Georgiou (2016), Geophys. Res. Lett., 43, 3280-3287. Demetrius, L., and T. Manke (2005), Phys. A Stat. Mech. Appl., 346, 682-696.

Electrical conductivity and dielectric behavior in sodium zinc divanadates

NASA Astrophysics Data System (ADS)

Sallemi, F.; Louati, B.; Guidara, K.

2014-11-01

The Na2ZnV2O7 compound was obtained by the conventional solid-state reaction. The sample was characterized by X-ray powder diffraction, Raman and impedance spectroscopy. The ac electrical conductivity and dielectric properties have been investigated in the frequency and temperature range of 200 Hz-1 MHz and 513 K-729 K, respectively. The direct current conductivity process is thermally activated. The frequency dependence of the conductivity is interpreted using the power law. The close values of activation energies obtained from the analysis of hopping frequency and dc conductivity implies that the transport is due to Na+ cation displacement parallel to (0 0 1) plane located between ZnO4 and VO4 tetrahedra. The evolution of the complex permittivity as a function of angular frequency was investigated. Several important parameters such as charge carrier concentration, ionic mobility and diffusion coefficient were determined. Thermodynamic parameters such as the free energy of activation ∆F, the enthalpy ∆H, and the change in entropy ∆S have been calculated.

Källén-Lehmann spectroscopy for (un)physical degrees of freedom

NASA Astrophysics Data System (ADS)

Dudal, David; Oliveira, Orlando; Silva, Paulo J.

2014-01-01

We consider the problem of "measuring" the Källén-Lehmann spectral density of a particle (be it elementary or bound state) propagator by means of 4D lattice data. As the latter are obtained from operations at (Euclidean momentum squared) p2≥0, we are facing the generically ill-posed problem of converting a limited data set over the positive real axis to an integral representation, extending over the whole complex p2 plane. We employ a linear regularization strategy, commonly known as the Tikhonov method with the Morozov discrepancy principle, with suitable adaptations to realistic data, e.g. with an unknown threshold. An important virtue over the (standard) maximum entropy method is the possibility to also probe unphysical spectral densities, for example, of a confined gluon. We apply our proposal here to "physical" mock spectral data as a litmus test and then to the lattice SU(3) Landau gauge gluon at zero temperature.

Ising antiferromagnet on a finite triangular lattice with free boundary conditions

NASA Astrophysics Data System (ADS)

Kim, Seung-Yeon

2015-11-01

The exact integer values for the density of states of the Ising model on an equilateral triangular lattice with free boundary conditions are evaluated up to L = 24 spins on a side for the first time by using the microcanonical transfer matrix. The total number of states is 2 N s = 2300 ≈ 2.037 × 1090 for L = 24, where N s = L( L+1)/2 is the number of spins. Classifying all 2300 spin states according to their energy values is an enormous work. From the density of states, the exact partition function zeros in the complex temperature plane of the triangular-lattice Ising model are evaluated. Using the density of states and the partition function zeros, we investigate the properties of the triangularlattice Ising antiferromagnet. The scaling behavior of the ground-state entropy and the form of the correlation length at T = 0 are studied for the triangular-lattice Ising antiferromagnet with free boundary conditions. Also, the scaling behavior of the Fisher edge singularity is investigated.

Rényi entropy and Lempel-Ziv complexity of mechanomyographic recordings of diaphragm muscle as indexes of respiratory effort.

PubMed

Torres, Abel; Fiz, Jose A; Jane, Raimon; Laciar, Eric; Galdiz, Juan B; Gea, Joaquim; Morera, Josep

2008-01-01

The study of the mechanomyographic (MMG) signals of respiratory muscles is a promising technique in order to evaluate the respiratory muscles effort. A new approach for quantifying the relationship between respiratory MMG signals and respiratory effort is presented by analyzing the spatio-temporal patterns in the MMG signal using two non-linear methods: Rényi entropy and Lempel-Ziv (LZ) complexity analysis. Both methods are well suited to the analysis of non-stationary biomedical signals of short length. In this study, MMG signals of the diaphragm muscle acquired by means of a capacitive accelerometer applied on the costal wall were analyzed. The method was tested on an animal model (dogs), and the diaphragmatic MMG signal was recorded continuously while two non anesthetized mongrel dogs performed a spontaneous ventilation protocol with an incremental inspiratory load. The performance in discriminating high and low respiratory effort levels with these two methods was analyzed with the evaluation of the Pearson correlation coefficient between the MMG parameters and respiratory effort parameters extracted from the inspiratory pressure signal. The results obtained show an increase of the MMG signal Rényi entropy and LZ complexity values with the increase of the respiratory effort. Compared with other parameters analyzed in previous works, both Rényi entropy and LZ complexity indexes demonstrates better performance in all the signals analyzed. Our results suggest that these non-linear techniques are useful to detect and quantify changes in the respiratory effort by analyzing MMG respiratory signals.

Evidence for Chaotic Edge Turbulence in the Alcator C-Mod Tokamak

NASA Astrophysics Data System (ADS)

Zhu, Ziyan; White, Anne; Carter, Troy; Terry, Jim; Baek, Seung Gyou

2016-10-01

Turbulence greatly reduces the confinement time of magnetic-confined plasmas; understanding the nature of this turbulence and the associated transport is therefore of great importance. This research seeks to establish whether turbulent fluctuations in Alcator C-Mod are chaotic or stochastic. This has an important impact on transport caused by turbulence in C-Mod: stochastic fluctuations sample all of phase space and can lead to diffusive transport, whereas chaotic fluctuations live in a restricted phase space (e.g. on attractors) and a diffusive description may not be valid. By analyzing the time series from an O-Mode reflectometer, turbulent edge density fluctuations in Ohmic plasmas and L-mode plasmas in the Alcator C-Mod tokamak are shown to be chaotic. Supporting evidence for chaos in the edge region includes: the observation of an exponential power spectra (which is associated with Lorentzian-shaped pulses in the time series) and the location of the signal in the Complexity-Entropy plane (C-H plane) and its corresponding Brandt-Pompe (BP) probability distribution. These analysis techniques will be briefly introduced along with a discussion of the analysis results. Different diagnostic techniques, such as Gas Puff Imaging (GPI), could be used to confirm the results. Work supported by the U.S. Department of Energy Office of Science under Agreement DE-FC02-99ER54512 and DE-FC02-07ER54918:011.

Energetic basis on interactions between ferredoxin and ferredoxin NADP{sup +} reductase at varying physiological conditions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kinoshita, Misaki; Kim, Ju Yaen; Kume, Satoshi

In spite of a number of studies to characterize ferredoxin (Fd):ferredoxin NADP{sup +} reductase (FNR) interactions at limited conditions, detailed energetic investigation on how these proteins interact under near physiological conditions and its linkage to FNR activity are still lacking. We herein performed systematic Fd:FNR binding thermodynamics using isothermal titration calorimetry (ITC) at distinct pH (6.0 and 8.0), NaCl concentrations (0–200 mM), and temperatures (19–28 °C) for mimicking physiological conditions in chloroplasts. Energetically unfavorable endothermic enthalpy changes were accompanied by Fd:FNR complexation at all conditions. This energetic cost was compensated by favorable entropy changes, balanced by conformational and hydrational entropy. Increases inmore » the NaCl concentration and pH weakened interprotein affinity due to the less contribution of favorable entropy change regardless of energetic gains from enthalpy changes, suggesting that entropy drove complexation and modulated affinity. Effects of temperature on binding thermodynamics were much smaller than those of pH and NaCl. NaCl concentration and pH-dependent enthalpy and heat capacity changes provided clues for distinct binding modes. Moreover, decreases in the enthalpy level in the Hammond's postulate-based energy landscape implicated kinetic advantages for FNR activity. All these energetic interplays were comprehensively demonstrated by the driving force plot with the enthalpy-entropy compensation which may serve as an energetic buffer against outer stresses. We propose that high affinity at pH 6.0 may be beneficial for protection from proteolysis of Fd and FNR in rest states, and moderate affinity at pH 8.0 and proper NaCl concentrations with smaller endothermic enthalpy changes may contribute to increase FNR activity. - Highlights: • Energetics of Fd:FNR binding were examined by considering physiological conditions. • NaCl and pH affect energetically Fd:FNR binding with minimal effects of temperature. • Enthalpy and heat capacity may modulate binding kinetics and modes for FNR activity. • Entropy drives complexation by overcoming unfavorable enthalpy and tunes affinity. • Driving force plot reveals condition-dependent energetic interplays for complexation.« less

Thermodynamic studies of aqueous solutions of 2,2,2-cryptand at 298.15 K: enthalpy-entropy compensation, partial entropies, and complexation with K+ ions.

PubMed

Shaikh, Vasim R; Terdale, Santosh S; Ahamad, Abdul; Gupta, Gaurav R; Dagade, Dilip H; Hundiwale, Dilip G; Patil, Kesharsingh J

2013-12-19

The osmotic coefficient measurements for binary aqueous solutions of 2,2,2-cryptand (4,7,13,16,21,24-hexaoxa-1,10-diazabicyclo[8.8.8] hexacosane) in the concentration range of ~0.009 to ~0.24 mol·kg(-1) and in ternary aqueous solutions containing a fixed concentration of 2,2,2-cryptand of ~0.1 mol·kg(-1) with varying concentration of KBr (~0.06 to ~0.16 mol·kg(-1)) have been reported at 298.15 K. The diamine gets hydrolyzed in aqueous solutions and needs proper approach to obtain meaningful thermodynamic properties. The measured osmotic coefficient values are corrected for hydrolysis and are used to determine the solvent activity and mean ionic activity coefficients of solute as a function of concentration. Strong ion-pair formation is observed, and the ion-pair dissociation constant for the species [CrptH](+)[OH(-)] is reported. The excess and mixing thermodynamic properties (Gibbs free energy, enthalpy, and entropy changes) have been obtained using the activity data from this study and the heat data reported in the literature. Further, the data are utilized to compute the partial molal entropies of solvent and solute at finite as well as infinite dilution of 2,2,2-cryptand in water. The concentration dependent non-linear enthalpy-entropy compensation effect has been observed for the studied system, and the compensation temperature along with entropic parameter are reported. Using solute activity coefficient data in ternary solutions, the transfer Gibbs free energies for transfer of the cryptand from water to aqueous KBr as well as transfer of KBr from water to aqueous cryptand were obtained and utilized to obtain the salting constant (ks) and thermodynamic equilibrium constant (log K) values for the complex (2,2,2-cryptand:K(+)) at 298.15 K. The value of log K = 5.8 ± 0.1 obtained in this work is found to be in good agreement with that reported by Lehn and Sauvage. The standard molar entropy for complexation is also estimated for the 2,2,2-cryptand-KBr complex in aqueous medium.

Causality: Physics and Philosophy

ERIC Educational Resources Information Center

Chatterjee, Atanu

2013-01-01

Nature is a complex causal network exhibiting diverse forms and species. These forms or rather systems are physically open, structurally complex and naturally adaptive. They interact with the surrounding media by operating a positive-feedback loop through which, they adapt, organize and self-organize themselves in response to the ever-changing…

Evolution of Religious Beliefs

ScienceCinema

None

2018-05-11

Humans may be distinguished from all other animals in having beliefs about the causal interaction of physical objects. Causal beliefs are a developmental primitive in human children; animals, by contrast, have very few causal beliefs. The origin of human causal beliefs comes from the evolutionary advantage it gave in relation to complex tool making and use. Causal beliefs gave rise religion and mystical thinking as our ancestors wanted to know the causes of events that affected their lives.

Evolution of Religious Beliefs

DOE Office of Scientific and Technical Information (OSTI.GOV)

None

Humans may be distinguished from all other animals in having beliefs about the causal interaction of physical objects. Causal beliefs are a developmental primitive in human children; animals, by contrast, have very few causal beliefs. The origin of human causal beliefs comes from the evolutionary advantage it gave in relation to complex tool making and use. Causal beliefs gave rise religion and mystical thinking as our ancestors wanted to know the causes of events that affected their lives.

Prediction of the outcome in cardiac arrest patients undergoing hypothermia using EEG wavelet entropy.

PubMed

Moshirvaziri, Hana; Ramezan-Arab, Nima; Asgari, Shadnaz

2016-08-01

Cardiac arrest (CA) is the leading cause of death in the United States. Induction of hypothermia has been found to improve the functional recovery of CA patients after resuscitation. However, there is no clear guideline for the clinicians yet to determine the prognosis of the CA when patients are treated with hypothermia. The present work aimed at the development of a prognostic marker for the CA patients undergoing hypothermia. A quantitative measure of the complexity of Electroencephalogram (EEG) signals, called wavelet sub-band entropy, was employed to predict the patients' outcomes. We hypothesized that the EEG signals of the patients who survived would demonstrate more complexity and consequently higher values of wavelet sub-band entropies. A dataset of 16-channel EEG signals collected from CA patients undergoing hypothermia at Long Beach Memorial Medical Center was used to test the hypothesis. Following preprocessing of the signals and implementation of the wavelet transform, the wavelet sub-band entropies were calculated for different frequency bands and EEG channels. Then the values of wavelet sub-band entropies were compared among two groups of patients: survived vs. non-survived. Our results revealed that the brain high frequency oscillations (between 64100 Hz) captured from the inferior frontal lobes are significantly more complex in the CA patients who survived (p-value <; 0.02). Given that the non-invasive measurement of EEG is part of the standard clinical assessment for CA patients, the results of this study can enhance the management of the CA patients treated with hypothermia.

Correlation as a Determinant of Configurational Entropy in Supramolecular and Protein Systems

PubMed Central

2015-01-01

For biomolecules in solution, changes in configurational entropy are thought to contribute substantially to the free energies of processes like binding and conformational change. In principle, the configurational entropy can be strongly affected by pairwise and higher-order correlations among conformational degrees of freedom. However, the literature offers mixed perspectives regarding the contributions that changes in correlations make to changes in configurational entropy for such processes. Here we take advantage of powerful techniques for simulation and entropy analysis to carry out rigorous in silico studies of correlation in binding and conformational changes. In particular, we apply information-theoretic expansions of the configurational entropy to well-sampled molecular dynamics simulations of a model host–guest system and the protein bovine pancreatic trypsin inhibitor. The results bear on the interpretation of NMR data, as they indicate that changes in correlation are important determinants of entropy changes for biologically relevant processes and that changes in correlation may either balance or reinforce changes in first-order entropy. The results also highlight the importance of main-chain torsions as contributors to changes in protein configurational entropy. As simulation techniques grow in power, the mathematical techniques used here will offer new opportunities to answer challenging questions about complex molecular systems. PMID:24702693

On the Consequences of Clausius-Duhem Inequality for Electrolyte Solutions

NASA Astrophysics Data System (ADS)

Reis, Martina; Bassi, Adalberto Bono Maurizio Sacchi

2014-03-01

Based on the fundamentals of thermo-statics, non-equilibrium thermodynamics theories frequently employ an entropy inequality, where the entropy flux is collinear to the heat flux, and the entropy supply is proportional to the energy supply. Although this assumption is suitable for many material bodies, e.g. heat-conducting viscous fluids, there is a class of materials for which these assumptions are not valid. By assuming that the entropy flux and the entropy supply are constitutive quantities, in this work it is demonstrated that the entropy flux for a reacting ionic mixture of non-volatile solutes presents a non-collinear term due to the diffusive fluxes. The consequences of the collinearity between the entropy flux and the heat flux, as well as the proportionality of the entropy supply and the energy supply on the stability of chemical systems are also investigated. Furthermore, by considering an electrolyte solution of non-volatile solutes in phase equilibrium with water vapor, and the constitutive nature of the entropy flux, the stability of a vapor-electrolyte solution interface is studied. Despite this work only deals with electrolyte solutions, the results presented can be easily extended to more complex chemical reacting systems. The first author acknowledges financial support from CNPq (National Counsel of Technological and Scientific Development).

Rényi continuous entropy of DNA sequences.

PubMed

Vinga, Susana; Almeida, Jonas S

2004-12-07

Entropy measures of DNA sequences estimate their randomness or, inversely, their repeatability. L-block Shannon discrete entropy accounts for the empirical distribution of all length-L words and has convergence problems for finite sequences. A new entropy measure that extends Shannon's formalism is proposed. Renyi's quadratic entropy calculated with Parzen window density estimation method applied to CGR/USM continuous maps of DNA sequences constitute a novel technique to evaluate sequence global randomness without some of the former method drawbacks. The asymptotic behaviour of this new measure was analytically deduced and the calculation of entropies for several synthetic and experimental biological sequences was performed. The results obtained were compared with the distributions of the null model of randomness obtained by simulation. The biological sequences have shown a different p-value according to the kernel resolution of Parzen's method, which might indicate an unknown level of organization of their patterns. This new technique can be very useful in the study of DNA sequence complexity and provide additional tools for DNA entropy estimation. The main MATLAB applications developed and additional material are available at the webpage . Specialized functions can be obtained from the authors.

Quantitative Analysis of the Effective Functional Structure in Yeast Glycolysis

PubMed Central

De la Fuente, Ildefonso M.; Cortes, Jesus M.

2012-01-01

The understanding of the effective functionality that governs the enzymatic self-organized processes in cellular conditions is a crucial topic in the post-genomic era. In recent studies, Transfer Entropy has been proposed as a rigorous, robust and self-consistent method for the causal quantification of the functional information flow among nonlinear processes. Here, in order to quantify the functional connectivity for the glycolytic enzymes in dissipative conditions we have analyzed different catalytic patterns using the technique of Transfer Entropy. The data were obtained by means of a yeast glycolytic model formed by three delay differential equations where the enzymatic rate equations of the irreversible stages have been explicitly considered. These enzymatic activity functions were previously modeled and tested experimentally by other different groups. The results show the emergence of a new kind of dynamical functional structure, characterized by changing connectivity flows and a metabolic invariant that constrains the activity of the irreversible enzymes. In addition to the classical topological structure characterized by the specific location of enzymes, substrates, products and feedback-regulatory metabolites, an effective functional structure emerges in the modeled glycolytic system, which is dynamical and characterized by notable variations of the functional interactions. The dynamical structure also exhibits a metabolic invariant which constrains the functional attributes of the enzymes. Finally, in accordance with the classical biochemical studies, our numerical analysis reveals in a quantitative manner that the enzyme phosphofructokinase is the key-core of the metabolic system, behaving for all conditions as the main source of the effective causal flows in yeast glycolysis. PMID:22393350

A validation of dynamic causal modelling for 7T fMRI.

PubMed

Tak, S; Noh, J; Cheong, C; Zeidman, P; Razi, A; Penny, W D; Friston, K J

2018-07-15

There is growing interest in ultra-high field magnetic resonance imaging (MRI) in cognitive and clinical neuroscience studies. However, the benefits offered by higher field strength have not been evaluated in terms of effective connectivity and dynamic causal modelling (DCM). In this study, we address the validity of DCM for 7T functional MRI data at two levels. First, we evaluate the predictive validity of DCM estimates based upon 3T and 7T in terms of reproducibility. Second, we assess improvements in the efficiency of DCM estimates at 7T, in terms of the entropy of the posterior distribution over model parameters (i.e., information gain). Using empirical data recorded during fist-closing movements with 3T and 7T fMRI, we found a high reproducibility of average connectivity and condition-specific changes in connectivity - as quantified by the intra-class correlation coefficient (ICC = 0.862 and 0.936, respectively). Furthermore, we found that the posterior entropy of 7T parameter estimates was substantially less than that of 3T parameter estimates; suggesting the 7T data are more informative - and furnish more efficient estimates. In the framework of DCM, we treated field-dependent parameters for the BOLD signal model as free parameters, to accommodate fMRI data at 3T and 7T. In addition, we made the resting blood volume fraction a free parameter, because different brain regions can differ in their vascularization. In this paper, we showed DCM enables one to infer changes in effective connectivity from 7T data reliably and efficiently. Copyright © 2018 Elsevier B.V. All rights reserved.

Causal Learning with Local Computations

ERIC Educational Resources Information Center

Fernbach, Philip M.; Sloman, Steven A.

2009-01-01

The authors proposed and tested a psychological theory of causal structure learning based on local computations. Local computations simplify complex learning problems via cues available on individual trials to update a single causal structure hypothesis. Structural inferences from local computations make minimal demands on memory, require…

Modal Control of a Satellite in Orbit about L3.

DTIC Science & Technology

1980-12-01

the right- half of the complex plane , are removed via the controller moving the unstable roots from the right- half to the left- half of the ...complex plane . Simultaneously, the other system roots remain in their original locations in the complex plane . Since the Poincare exponents of Hamiltonian... half - plane , the conjugate root in the left- half -

Graphical Representation of Complex Solutions of the Quadratic Equation in the "xy" Plane

ERIC Educational Resources Information Center

McDonald, Todd

2006-01-01

This paper presents a visual representation of complex solutions of quadratic equations in the xy plane. Rather than moving to the complex plane, students are able to experience a geometric interpretation of the solutions in the xy plane. I am also working on these types of representations with higher order polynomials with some success.

Introduction of Entropy via the Boltzmann Distribution in Undergraduate Physical Chemistry: A Molecular Approach

ERIC Educational Resources Information Center

Kozliak, Evguenii I.

2004-01-01

A molecular approach for introducing entropy in undergraduate physical chemistry course and incorporating the features of Davies' treatment that meets the needs of the students but ignores the complexities of statistics and upgrades the qualitative, intuitive approach of Lambert for general chemistry to a semiquantitative treatment using Boltzmann…

Maximum Entropy for the International Division of Labor.

PubMed

Lei, Hongmei; Chen, Ying; Li, Ruiqi; He, Deli; Zhang, Jiang

2015-01-01

As a result of the international division of labor, the trade value distribution on different products substantiated by international trade flows can be regarded as one country's strategy for competition. According to the empirical data of trade flows, countries may spend a large fraction of export values on ubiquitous and competitive products. Meanwhile, countries may also diversify their exports share on different types of products to reduce the risk. In this paper, we report that the export share distribution curves can be derived by maximizing the entropy of shares on different products under the product's complexity constraint once the international market structure (the country-product bipartite network) is given. Therefore, a maximum entropy model provides a good fit to empirical data. The empirical data is consistent with maximum entropy subject to a constraint on the expected value of the product complexity for each country. One country's strategy is mainly determined by the types of products this country can export. In addition, our model is able to fit the empirical export share distribution curves of nearly every country very well by tuning only one parameter.

Maximum Entropy for the International Division of Labor

PubMed Central

Lei, Hongmei; Chen, Ying; Li, Ruiqi; He, Deli; Zhang, Jiang

2015-01-01

As a result of the international division of labor, the trade value distribution on different products substantiated by international trade flows can be regarded as one country’s strategy for competition. According to the empirical data of trade flows, countries may spend a large fraction of export values on ubiquitous and competitive products. Meanwhile, countries may also diversify their exports share on different types of products to reduce the risk. In this paper, we report that the export share distribution curves can be derived by maximizing the entropy of shares on different products under the product’s complexity constraint once the international market structure (the country-product bipartite network) is given. Therefore, a maximum entropy model provides a good fit to empirical data. The empirical data is consistent with maximum entropy subject to a constraint on the expected value of the product complexity for each country. One country’s strategy is mainly determined by the types of products this country can export. In addition, our model is able to fit the empirical export share distribution curves of nearly every country very well by tuning only one parameter. PMID:26172052

Inferring causal molecular networks: empirical assessment through a community-based effort

PubMed Central

Hill, Steven M.; Heiser, Laura M.; Cokelaer, Thomas; Unger, Michael; Nesser, Nicole K.; Carlin, Daniel E.; Zhang, Yang; Sokolov, Artem; Paull, Evan O.; Wong, Chris K.; Graim, Kiley; Bivol, Adrian; Wang, Haizhou; Zhu, Fan; Afsari, Bahman; Danilova, Ludmila V.; Favorov, Alexander V.; Lee, Wai Shing; Taylor, Dane; Hu, Chenyue W.; Long, Byron L.; Noren, David P.; Bisberg, Alexander J.; Mills, Gordon B.; Gray, Joe W.; Kellen, Michael; Norman, Thea; Friend, Stephen; Qutub, Amina A.; Fertig, Elana J.; Guan, Yuanfang; Song, Mingzhou; Stuart, Joshua M.; Spellman, Paul T.; Koeppl, Heinz; Stolovitzky, Gustavo; Saez-Rodriguez, Julio; Mukherjee, Sach

2016-01-01

Inferring molecular networks is a central challenge in computational biology. However, it has remained unclear whether causal, rather than merely correlational, relationships can be effectively inferred in complex biological settings. Here we describe the HPN-DREAM network inference challenge that focused on learning causal influences in signaling networks. We used phosphoprotein data from cancer cell lines as well as in silico data from a nonlinear dynamical model. Using the phosphoprotein data, we scored more than 2,000 networks submitted by challenge participants. The networks spanned 32 biological contexts and were scored in terms of causal validity with respect to unseen interventional data. A number of approaches were effective and incorporating known biology was generally advantageous. Additional sub-challenges considered time-course prediction and visualization. Our results constitute the most comprehensive assessment of causal network inference in a mammalian setting carried out to date and suggest that learning causal relationships may be feasible in complex settings such as disease states. Furthermore, our scoring approach provides a practical way to empirically assess the causal validity of inferred molecular networks. PMID:26901648

Argand-plane vorticity singularities in complex scalar optical fields: an experimental study using optical speckle.

PubMed

Rothschild, Freda; Bishop, Alexis I; Kitchen, Marcus J; Paganin, David M

2014-03-24

The Cornu spiral is, in essence, the image resulting from an Argand-plane map associated with monochromatic complex scalar plane waves diffracting from an infinite edge. Argand-plane maps can be useful in the analysis of more general optical fields. We experimentally study particular features of Argand-plane mappings known as "vorticity singularities" that are associated with mapping continuous single-valued complex scalar speckle fields to the Argand plane. Vorticity singularities possess a hierarchy of Argand-plane catastrophes including the fold, cusp and elliptic umbilic. We also confirm their connection to vortices in two-dimensional complex scalar waves. The study of vorticity singularities may also have implications for higher-dimensional fields such as coherence functions and multi-component fields such as vector and spinor fields.

Good Use of a `Bad' Metaphor. Entropy as Disorder

NASA Astrophysics Data System (ADS)

Haglund, Jesper

2017-05-01

Entropy is often introduced to students through the use of the disorder metaphor. However, many weaknesses and limitations of this metaphor have been identified, and it has therefore been argued that it is more harmful than useful in teaching. For instance, under the influence of the disorder metaphor, students tend to focus on spatial configuration with regard to entropy but disregard the role of energy, which may lead their intuition astray in problem solving. Albeit so, a review of research of students' ideas about entropy in relation to the disorder metaphor shows that students can use the metaphor in developing a more nuanced, complex view of the concept, by connecting entropy as disorder to other concepts such as microstates and spreading. The disorder metaphor—in combination with other explanatory approaches—can be used as a resource for learning, in giving students an early flavour of what entropy means, so long as we acknowledge its limitations; we can put this "bad" metaphor to good use in teaching.

Modeling Information Content Via Dirichlet-Multinomial Regression Analysis.

PubMed

Ferrari, Alberto

2017-01-01

Shannon entropy is being increasingly used in biomedical research as an index of complexity and information content in sequences of symbols, e.g. languages, amino acid sequences, DNA methylation patterns and animal vocalizations. Yet, distributional properties of information entropy as a random variable have seldom been the object of study, leading to researchers mainly using linear models or simulation-based analytical approach to assess differences in information content, when entropy is measured repeatedly in different experimental conditions. Here a method to perform inference on entropy in such conditions is proposed. Building on results coming from studies in the field of Bayesian entropy estimation, a symmetric Dirichlet-multinomial regression model, able to deal efficiently with the issue of mean entropy estimation, is formulated. Through a simulation study the model is shown to outperform linear modeling in a vast range of scenarios and to have promising statistical properties. As a practical example, the method is applied to a data set coming from a real experiment on animal communication.

A Wiener-Wavelet-Based filter for de-noising satellite soil moisture retrievals

NASA Astrophysics Data System (ADS)

Massari, Christian; Brocca, Luca; Ciabatta, Luca; Moramarco, Tommaso; Su, Chun-Hsu; Ryu, Dongryeol; Wagner, Wolfgang

2014-05-01

The reduction of noise in microwave satellite soil moisture (SM) retrievals is of paramount importance for practical applications especially for those associated with the study of climate changes, droughts, floods and other related hydrological processes. So far, Fourier based methods have been used for de-noising satellite SM retrievals by filtering either the observed emissivity time series (Du, 2012) or the retrieved SM observations (Su et al. 2013). This contribution introduces an alternative approach based on a Wiener-Wavelet-Based filtering (WWB) technique, which uses the Entropy-Based Wavelet de-noising method developed by Sang et al. (2009) to design both a causal and a non-causal version of the filter. WWB is used as a post-retrieval processing tool to enhance the quality of observations derived from the i) Advanced Microwave Scanning Radiometer for the Earth observing system (AMSR-E), ii) the Advanced SCATterometer (ASCAT), and iii) the Soil Moisture and Ocean Salinity (SMOS) satellite. The method is tested on three pilot sites located in Spain (Remedhus Network), in Greece (Hydrological Observatory of Athens) and in Australia (Oznet network), respectively. Different quantitative criteria are used to judge the goodness of the de-noising technique. Results show that WWB i) is able to improve both the correlation and the root mean squared differences between satellite retrievals and in situ soil moisture observations, and ii) effectively separates random noise from deterministic components of the retrieved signals. Moreover, the use of WWB de-noised data in place of raw observations within a hydrological application confirms the usefulness of the proposed filtering technique. Du, J. (2012), A method to improve satellite soil moisture retrievals based on Fourier analysis, Geophys. Res. Lett., 39, L15404, doi:10.1029/ 2012GL052435 Su,C.-H.,D.Ryu, A. W. Western, and W. Wagner (2013), De-noising of passive and active microwave satellite soil moisture time series, Geophys. Res. Lett., 40,3624-3630, doi:10.1002/grl.50695. Sang Y.-F., D. Wang, J.-C. Wu, Q.-P. Zhu, and L. Wang (2009), Entropy-Based Wavelet De-noising Method for Time Series Analysis, Entropy, 11, pp. 1123-1148, doi:10.3390/e11041123.

Functional Entropy Variables: A New Methodology for Deriving Thermodynamically Consistent Algorithms for Complex Fluids, with Particular Reference to the Isothermal Navier-Stokes-Korteweg Equations

DTIC Science & Technology

2012-11-01

multicorrector algorithm . Predictor stage: Set Cρn+1,(0) = C ρ n, (157) Cun+1,(0) = C u n, (158) Cvn+1,(0) = C v n. (159) Multicorrector stage: Repeat the... corrector algorithm given by (157)-(178). Remark 20. We adopt the preconditioned GMRES algorithm [53] from PETSc [2] to solve the linear system given by (175...ICES REPORT 12-43 November 2012 Functional Entropy Variables: A New Methodology for Deriving Thermodynamically Consistent Algorithms for Complex

Algorithmic complexity of quantum capacity

NASA Astrophysics Data System (ADS)

Oskouei, Samad Khabbazi; Mancini, Stefano

2018-04-01

We analyze the notion of quantum capacity from the perspective of algorithmic (descriptive) complexity. To this end, we resort to the concept of semi-computability in order to describe quantum states and quantum channel maps. We introduce algorithmic entropies (like algorithmic quantum coherent information) and derive relevant properties for them. Then we show that quantum capacity based on semi-computable concept equals the entropy rate of algorithmic coherent information, which in turn equals the standard quantum capacity. Thanks to this, we finally prove that the quantum capacity, for a given semi-computable channel, is limit computable.

Drug-disease association and drug-repositioning predictions in complex diseases using causal inference-probabilistic matrix factorization.

PubMed

Yang, Jihong; Li, Zheng; Fan, Xiaohui; Cheng, Yiyu

2014-09-22

The high incidence of complex diseases has become a worldwide threat to human health. Multiple targets and pathways are perturbed during the pathological process of complex diseases. Systematic investigation of complex relationship between drugs and diseases is necessary for new association discovery and drug repurposing. For this purpose, three causal networks were constructed herein for cardiovascular diseases, diabetes mellitus, and neoplasms, respectively. A causal inference-probabilistic matrix factorization (CI-PMF) approach was proposed to predict and classify drug-disease associations, and further used for drug-repositioning predictions. First, multilevel systematic relations between drugs and diseases were integrated from heterogeneous databases to construct causal networks connecting drug-target-pathway-gene-disease. Then, the association scores between drugs and diseases were assessed by evaluating a drug's effects on multiple targets and pathways. Furthermore, PMF models were learned based on known interactions, and associations were then classified into three types by trained models. Finally, therapeutic associations were predicted based upon the ranking of association scores and predicted association types. In terms of drug-disease association prediction, modified causal inference included in CI-PMF outperformed existing causal inference with a higher AUC (area under receiver operating characteristic curve) score and greater precision. Moreover, CI-PMF performed better than single modified causal inference in predicting therapeutic drug-disease associations. In the top 30% of predicted associations, 58.6% (136/232), 50.8% (31/61), and 39.8% (140/352) hit known therapeutic associations, while precisions obtained by the latter were only 10.2% (231/2264), 8.8% (36/411), and 9.7% (189/1948). Clinical verifications were further conducted for the top 100 newly predicted therapeutic associations. As a result, 21, 12, and 32 associations have been studied and many treatment effects of drugs on diseases were investigated for cardiovascular diseases, diabetes mellitus, and neoplasms, respectively. Related chains in causal networks were extracted for these 65 clinical-verified associations, and we further illustrated the therapeutic role of etodolac in breast cancer by inferred chains. Overall, CI-PMF is a useful approach for associating drugs with complex diseases and provides potential values for drug repositioning.

Spatiotemporal Permutation Entropy as a Measure for Complexity of Cardiac Arrhythmia

NASA Astrophysics Data System (ADS)

Schlemmer, Alexander; Berg, Sebastian; Lilienkamp, Thomas; Luther, Stefan; Parlitz, Ulrich

2018-05-01

Permutation entropy (PE) is a robust quantity for measuring the complexity of time series. In the cardiac community it is predominantly used in the context of electrocardiogram (ECG) signal analysis for diagnoses and predictions with a major application found in heart rate variability parameters. In this article we are combining spatial and temporal PE to form a spatiotemporal PE that captures both, complexity of spatial structures and temporal complexity at the same time. We demonstrate that the spatiotemporal PE (STPE) quantifies complexity using two datasets from simulated cardiac arrhythmia and compare it to phase singularity analysis and spatial PE (SPE). These datasets simulate ventricular fibrillation (VF) on a two-dimensional and a three-dimensional medium using the Fenton-Karma model. We show that SPE and STPE are robust against noise and demonstrate its usefulness for extracting complexity features at different spatial scales.

Causal reasoning with forces

PubMed Central

Wolff, Phillip; Barbey, Aron K.

2015-01-01

Causal composition allows people to generate new causal relations by combining existing causal knowledge. We introduce a new computational model of such reasoning, the force theory, which holds that people compose causal relations by simulating the processes that join forces in the world, and compare this theory with the mental model theory (Khemlani et al., 2014) and the causal model theory (Sloman et al., 2009), which explain causal composition on the basis of mental models and structural equations, respectively. In one experiment, the force theory was uniquely able to account for people's ability to compose causal relationships from complex animations of real-world events. In three additional experiments, the force theory did as well as or better than the other two theories in explaining the causal compositions people generated from linguistically presented causal relations. Implications for causal learning and the hierarchical structure of causal knowledge are discussed. PMID:25653611

Aftershocks of the western Argentina (Caucete) earthquake of 23 November 1977: some tectonic implications

USGS Publications Warehouse

Langer, C.J.; Bollinger, G.A.

1988-01-01

An aftershock survey, using a network of eight portable and two permanent seismographs, was conducted for the western Argentina (Caucete) earthquake (MS 7.3) of November 23, 1977. Monitoring began December 6, almost 2 weeks after the main shock and continued for 11 days. The data set includes 185 aftershock hypocenters that range in the depth from near surface to more than 30 km. The spatial distribution of those events occupied a volume of about 100 km long ??50 km wide ??30 km thick. The volumnar nature of the aftershock distribution is interpreted to be a result of a bimodal distribution of foci that define east- and west-dipping planar zones. Efforts to select which of those zones was associated with the causal faulting include special attention to the determination of the mainshock focal depth and dislocation theory modeling of the coseismic surface deformation in the epicentral region. Our focal depth (25-35 km) and modeling studies lead us to prefer an east-dipping plane as causal. A previous interpretation by other investigators used a shallower focal depth (17 km) and similar modeling calculations in choosing a west-dipping plane. Our selection of the east-dipping plane is physically more appealing because it places fault initiation at the base of the crustal seismogenic layer (rather than in the middle of that layer) which requires fault propagation to be updip (rather than downdip). ?? 1988.

Entropy of international trades

NASA Astrophysics Data System (ADS)

Oh, Chang-Young; Lee, D.-S.

2017-05-01

The organization of international trades is highly complex under the collective efforts towards economic profits of participating countries given inhomogeneous resources for production. Considering the trade flux as the probability of exporting a product from a country to another, we evaluate the entropy of the world trades in the period 1950-2000. The trade entropy has increased with time, and we show that it is mainly due to the extension of trade partnership. For a given number of trade partners, the mean trade entropy is about 60% of the maximum possible entropy, independent of time, which can be regarded as a characteristic of the trade fluxes' heterogeneity and is shown to be derived from the scaling and functional behaviors of the universal trade-flux distribution. The correlation and time evolution of the individual countries' gross-domestic products and the number of trade partners show that most countries achieved their economic growth partly by extending their trade relationship.

Effect of extreme data loss on heart rate signals quantified by entropy analysis

NASA Astrophysics Data System (ADS)

Li, Yu; Wang, Jun; Li, Jin; Liu, Dazhao

2015-02-01

The phenomenon of data loss always occurs in the analysis of large databases. Maintaining the stability of analysis results in the event of data loss is very important. In this paper, we used a segmentation approach to generate a synthetic signal that is randomly wiped from data according to the Gaussian distribution and the exponential distribution of the original signal. Then, the logistic map is used as verification. Finally, two methods of measuring entropy-base-scale entropy and approximate entropy-are comparatively analyzed. Our results show the following: (1) Two key parameters-the percentage and the average length of removed data segments-can change the sequence complexity according to logistic map testing. (2) The calculation results have preferable stability for base-scale entropy analysis, which is not sensitive to data loss. (3) The loss percentage of HRV signals should be controlled below the range (p = 30 %), which can provide useful information in clinical applications.

Quantifying networks complexity from information geometry viewpoint

DOE Office of Scientific and Technical Information (OSTI.GOV)

Felice, Domenico, E-mail: domenico.felice@unicam.it; Mancini, Stefano; INFN-Sezione di Perugia, Via A. Pascoli, I-06123 Perugia

We consider a Gaussian statistical model whose parameter space is given by the variances of random variables. Underlying this model we identify networks by interpreting random variables as sitting on vertices and their correlations as weighted edges among vertices. We then associate to the parameter space a statistical manifold endowed with a Riemannian metric structure (that of Fisher-Rao). Going on, in analogy with the microcanonical definition of entropy in Statistical Mechanics, we introduce an entropic measure of networks complexity. We prove that it is invariant under networks isomorphism. Above all, considering networks as simplicial complexes, we evaluate this entropy onmore » simplexes and find that it monotonically increases with their dimension.« less

Shannon entropy in the research on stationary regimes and the evolution of complexity

NASA Astrophysics Data System (ADS)

Eskov, V. M.; Eskov, V. V.; Vochmina, Yu. V.; Gorbunov, D. V.; Ilyashenko, L. K.

2017-05-01

The questions of the identification of complex biological systems (complexity) as special self-organizing systems or systems of the third type first defined by W. Weaver in 1948 continue to be of interest. No reports on the evaluation of entropy for systems of the third type were found among the publications currently available to the authors. The present study addresses the parameters of muscle biopotentials recorded using surface interference electromyography and presents the results of calculation of the Shannon entropy, autocorrelation functions, and statistical distribution functions for electromyograms of subjects in different physiological states (rest and tension of muscles). The results do not allow for statistically reliable discrimination between the functional states of muscles. However, the data obtained by calculating electromyogram quasiatttractor parameters and matrices of paired comparisons of electromyogram samples (calculation of the number k of "coinciding" pairs among the electromyogram samples) provide an integral characteristic that allows the identification of substantial differences between the state of rest and the different states of functional activity. Modifications and implementation of new methods in combination with the novel methods of the theory of chaos and self-organization are obviously essential. The stochastic approach paradigm is not applicable to systems of the third type due to continuous and chaotic changes of the parameters of the state vector x( t) of an organism or the contrasting constancy of these parameters (in the case of entropy).

Assessment of resampling methods for causality testing: A note on the US inflation behavior

PubMed Central

Kyrtsou, Catherine; Kugiumtzis, Dimitris; Diks, Cees

2017-01-01

Different resampling methods for the null hypothesis of no Granger causality are assessed in the setting of multivariate time series, taking into account that the driving-response coupling is conditioned on the other observed variables. As appropriate test statistic for this setting, the partial transfer entropy (PTE), an information and model-free measure, is used. Two resampling techniques, time-shifted surrogates and the stationary bootstrap, are combined with three independence settings (giving a total of six resampling methods), all approximating the null hypothesis of no Granger causality. In these three settings, the level of dependence is changed, while the conditioning variables remain intact. The empirical null distribution of the PTE, as the surrogate and bootstrapped time series become more independent, is examined along with the size and power of the respective tests. Additionally, we consider a seventh resampling method by contemporaneously resampling the driving and the response time series using the stationary bootstrap. Although this case does not comply with the no causality hypothesis, one can obtain an accurate sampling distribution for the mean of the test statistic since its value is zero under H0. Results indicate that as the resampling setting gets more independent, the test becomes more conservative. Finally, we conclude with a real application. More specifically, we investigate the causal links among the growth rates for the US CPI, money supply and crude oil. Based on the PTE and the seven resampling methods, we consistently find that changes in crude oil cause inflation conditioning on money supply in the post-1986 period. However this relationship cannot be explained on the basis of traditional cost-push mechanisms. PMID:28708870

Assessment of resampling methods for causality testing: A note on the US inflation behavior.

PubMed

Papana, Angeliki; Kyrtsou, Catherine; Kugiumtzis, Dimitris; Diks, Cees

2017-01-01

Different resampling methods for the null hypothesis of no Granger causality are assessed in the setting of multivariate time series, taking into account that the driving-response coupling is conditioned on the other observed variables. As appropriate test statistic for this setting, the partial transfer entropy (PTE), an information and model-free measure, is used. Two resampling techniques, time-shifted surrogates and the stationary bootstrap, are combined with three independence settings (giving a total of six resampling methods), all approximating the null hypothesis of no Granger causality. In these three settings, the level of dependence is changed, while the conditioning variables remain intact. The empirical null distribution of the PTE, as the surrogate and bootstrapped time series become more independent, is examined along with the size and power of the respective tests. Additionally, we consider a seventh resampling method by contemporaneously resampling the driving and the response time series using the stationary bootstrap. Although this case does not comply with the no causality hypothesis, one can obtain an accurate sampling distribution for the mean of the test statistic since its value is zero under H0. Results indicate that as the resampling setting gets more independent, the test becomes more conservative. Finally, we conclude with a real application. More specifically, we investigate the causal links among the growth rates for the US CPI, money supply and crude oil. Based on the PTE and the seven resampling methods, we consistently find that changes in crude oil cause inflation conditioning on money supply in the post-1986 period. However this relationship cannot be explained on the basis of traditional cost-push mechanisms.

Inferring interventional predictions from observational learning data.

PubMed

Meder, Bjorn; Hagmayer, York; Waldmann, Michael R

2008-02-01

Previous research has shown that people are capable of deriving correct predictions for previously unseen actions from passive observations of causal systems (Waldmann & Hagmayer, 2005). However, these studies were limited, since learning data were presented as tabulated data only, which may have turned the task more into a reasoning rather than a learning task. In two experiments, we therefore presented learners with trial-by-trial observational learning input referring to a complex causal model consisting of four events. To test the robustness of the capacity to derive correct observational and interventional inferences, we pitted causal order against the temporal order of learning events. The results show that people are, in principle, capable of deriving correct predictions after purely observational trial-by-trial learning, even with relatively complex causal models. However, conflicting temporal information can impair performance, particularly when the inferences require taking alternative causal pathways into account.

Brain entropy and human intelligence: A resting-state fMRI study

PubMed Central

Calderone, Daniel; Morales, Leah J.

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns. PMID:29432427

Brain entropy and human intelligence: A resting-state fMRI study.

PubMed

Saxe, Glenn N; Calderone, Daniel; Morales, Leah J

2018-01-01

Human intelligence comprises comprehension of and reasoning about an infinitely variable external environment. A brain capable of large variability in neural configurations, or states, will more easily understand and predict variable external events. Entropy measures the variety of configurations possible within a system, and recently the concept of brain entropy has been defined as the number of neural states a given brain can access. This study investigates the relationship between human intelligence and brain entropy, to determine whether neural variability as reflected in neuroimaging signals carries information about intellectual ability. We hypothesize that intelligence will be positively associated with entropy in a sample of 892 healthy adults, using resting-state fMRI. Intelligence is measured with the Shipley Vocabulary and WASI Matrix Reasoning tests. Brain entropy was positively associated with intelligence. This relation was most strongly observed in the prefrontal cortex, inferior temporal lobes, and cerebellum. This relationship between high brain entropy and high intelligence indicates an essential role for entropy in brain functioning. It demonstrates that access to variable neural states predicts complex behavioral performance, and specifically shows that entropy derived from neuroimaging signals at rest carries information about intellectual capacity. Future work in this area may elucidate the links between brain entropy in both resting and active states and various forms of intelligence. This insight has the potential to provide predictive information about adaptive behavior and to delineate the subdivisions and nature of intelligence based on entropic patterns.

Connecting complexity with spectral entropy using the Laplace transformed solution to the fractional diffusion equation

NASA Astrophysics Data System (ADS)

Liang, Yingjie; Chen, Wen; Magin, Richard L.

2016-07-01

Analytical solutions to the fractional diffusion equation are often obtained by using Laplace and Fourier transforms, which conveniently encode the order of the time and the space derivatives (α and β) as non-integer powers of the conjugate transform variables (s, and k) for the spectral and the spatial frequencies, respectively. This study presents a new solution to the fractional diffusion equation obtained using the Laplace transform and expressed as a Fox's H-function. This result clearly illustrates the kinetics of the underlying stochastic process in terms of the Laplace spectral frequency and entropy. The spectral entropy is numerically calculated by using the direct integration method and the adaptive Gauss-Kronrod quadrature algorithm. Here, the properties of spectral entropy are investigated for the cases of sub-diffusion and super-diffusion. We find that the overall spectral entropy decreases with the increasing α and β, and that the normal or Gaussian case with α = 1 and β = 2, has the lowest spectral entropy (i.e., less information is needed to describe the state of a Gaussian process). In addition, as the neighborhood over which the entropy is calculated increases, the spectral entropy decreases, which implies a spatial averaging or coarse graining of the material properties. Consequently, the spectral entropy is shown to provide a new way to characterize the temporal correlation of anomalous diffusion. Future studies should be designed to examine changes of spectral entropy in physical, chemical and biological systems undergoing phase changes, chemical reactions and tissue regeneration.

Permutation entropy analysis of financial time series based on Hill's diversity number

NASA Astrophysics Data System (ADS)

Zhang, Yali; Shang, Pengjian

2017-12-01

In this paper the permutation entropy based on Hill's diversity number (Nn,r) is introduced as a new way to assess the complexity of a complex dynamical system such as stock market. We test the performance of this method with simulated data. Results show that Nn,r with appropriate parameters is more sensitive to the change of system and describes the trends of complex systems clearly. In addition, we research the stock closing price series from different data that consist of six indices: three US stock indices and three Chinese stock indices during different periods, Nn,r can quantify the changes of complexity for stock market data. Moreover, we get richer information from Nn,r, and obtain some properties about the differences between the US and Chinese stock indices.

Investigation of shock waves in the relativistic Riemann problem: A comparison of viscous fluid dynamics to kinetic theory

NASA Astrophysics Data System (ADS)

Bouras, I.; Molnár, E.; Niemi, H.; Xu, Z.; El, A.; Fochler, O.; Greiner, C.; Rischke, D. H.

2010-08-01

We solve the relativistic Riemann problem in viscous matter using the relativistic Boltzmann equation and the relativistic causal dissipative fluid-dynamical approach of Israel and Stewart. Comparisons between these two approaches clarify and point out the regime of validity of second-order fluid dynamics in relativistic shock phenomena. The transition from ideal to viscous shocks is demonstrated by varying the shear viscosity to entropy density ratio η/s. We also find that a good agreement between these two approaches requires a Knudsen number Kn<1/2.

Tachyonic quench in a free bosonic field theory

NASA Astrophysics Data System (ADS)

Montes, Sebastián; Sierra, Germán; Rodríguez-Laguna, Javier

2018-02-01

We present a characterization of a bosonic field theory driven by a free (Gaussian) tachyonic Hamiltonian. This regime is obtained from a theory describing two coupled bosonic fields after a regular quench. Relevant physical quantities such as simple correlators, entanglement entropies, and the mutual information of disconnected subregions are computed. We show that the causal structure resembles a critical (massless) quench. For short times, physical quantities also resemble critical quenches. However, exponential divergences end up dominating the dynamics in a very characteristic way. This is related to the fact that the low-frequency modes do not equilibrate. Some applications and extensions are outlined.

Investigation of shock waves in the relativistic Riemann problem: A comparison of viscous fluid dynamics to kinetic theory

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bouras, I.; El, A.; Fochler, O.

2010-08-15

We solve the relativistic Riemann problem in viscous matter using the relativistic Boltzmann equation and the relativistic causal dissipative fluid-dynamical approach of Israel and Stewart. Comparisons between these two approaches clarify and point out the regime of validity of second-order fluid dynamics in relativistic shock phenomena. The transition from ideal to viscous shocks is demonstrated by varying the shear viscosity to entropy density ratio {eta}/s. We also find that a good agreement between these two approaches requires a Knudsen number Kn<1/2.

Nearly Perfect Fluidity in a High Temperature Superconductor

DOE PAGES

Rameau, J. D.; Reber, T. J.; Yang, H. -B.; ...

2014-10-13

Perfect fluids are characterized as having the smallest ratio of shear viscosity to entropy density, η/s, consistent with quantum uncertainty and causality. So far, nearly perfect fluids have only been observed in the quark-gluon plasma and in unitary atomic Fermi gases, exotic systems that are amongst the hottest and coldest objects in the known universe, respectively. We use angle resolved photoemission spectroscopy to measure the temperature dependence of an electronic analog of η/s in an optimally doped cuprate high-temperature superconductor, finding it too is a nearly perfect fluid around, and above, its superconducting transition temperature T c.

Nearly perfect fluidity in a high-temperature superconductor

NASA Astrophysics Data System (ADS)

Rameau, J. D.; Reber, T. J.; Yang, H.-B.; Akhanjee, S.; Gu, G. D.; Johnson, P. D.; Campbell, S.

2014-10-01

Perfect fluids are characterized as having the smallest ratio of shear viscosity to entropy density, η /s, consistent with quantum uncertainty and causality. So far, nearly perfect fluids have only been observed in the quark-gluon plasma and in unitary atomic Fermi gases, exotic systems that are amongst the hottest and coldest objects in the known universe, respectively. We use angle resolved photoemission spectroscopy to measure the temperature dependence of an electronic analog of η /s in an optimally doped cuprate high-temperature superconductor, finding it too is a nearly perfect fluid around, and above, its superconducting transition temperature Tc.

Bekenstein inequalities and nonlinear electrodynamics

NASA Astrophysics Data System (ADS)

Peñafiel, M. L.; Falciano, F. T.

2017-12-01

Bekenstein and Mayo proposed a generalized bound for the entropy, which implies some inequalities between the charge, energy, angular momentum, and size of the macroscopic system. Dain has shown that Maxwell's electrodynamics satisfies all three inequalities. We investigate the validity of these relations in the context of nonlinear electrodynamics and show that Born-Infeld electrodynamics satisfies all of them. However, contrary to the linear theory, there is no rigidity statement in Born-Infeld. We study the physical meaning and the relationship between these inequalities, and in particular, we analyze the connection between the energy-angular momentum inequality and causality.

The effect of orthostatic stress on multiscale entropy of heart rate and blood pressure.

PubMed

Turianikova, Zuzana; Javorka, Kamil; Baumert, Mathias; Calkovska, Andrea; Javorka, Michal

2011-09-01

Cardiovascular control acts over multiple time scales, which introduces a significant amount of complexity to heart rate and blood pressure time series. Multiscale entropy (MSE) analysis has been developed to quantify the complexity of a time series over multiple time scales. In previous studies, MSE analyses identified impaired cardiovascular control and increased cardiovascular risk in various pathological conditions. Despite the increasing acceptance of the MSE technique in clinical research, information underpinning the involvement of the autonomic nervous system in the MSE of heart rate and blood pressure is lacking. The objective of this study is to investigate the effect of orthostatic challenge on the MSE of heart rate and blood pressure variability (HRV, BPV) and the correlation between MSE (complexity measures) and traditional linear (time and frequency domain) measures. MSE analysis of HRV and BPV was performed in 28 healthy young subjects on 1000 consecutive heart beats in the supine and standing positions. Sample entropy values were assessed on scales of 1-10. We found that MSE of heart rate and blood pressure signals is sensitive to changes in autonomic balance caused by postural change from the supine to the standing position. The effect of orthostatic challenge on heart rate and blood pressure complexity depended on the time scale under investigation. Entropy values did not correlate with the mean values of heart rate and blood pressure and showed only weak correlations with linear HRV and BPV measures. In conclusion, the MSE analysis of heart rate and blood pressure provides a sensitive tool to detect changes in autonomic balance as induced by postural change.

Rolling bearing fault detection and diagnosis based on composite multiscale fuzzy entropy and ensemble support vector machines

NASA Astrophysics Data System (ADS)

Zheng, Jinde; Pan, Haiyang; Cheng, Junsheng

2017-02-01

To timely detect the incipient failure of rolling bearing and find out the accurate fault location, a novel rolling bearing fault diagnosis method is proposed based on the composite multiscale fuzzy entropy (CMFE) and ensemble support vector machines (ESVMs). Fuzzy entropy (FuzzyEn), as an improvement of sample entropy (SampEn), is a new nonlinear method for measuring the complexity of time series. Since FuzzyEn (or SampEn) in single scale can not reflect the complexity effectively, multiscale fuzzy entropy (MFE) is developed by defining the FuzzyEns of coarse-grained time series, which represents the system dynamics in different scales. However, the MFE values will be affected by the data length, especially when the data are not long enough. By combining information of multiple coarse-grained time series in the same scale, the CMFE algorithm is proposed in this paper to enhance MFE, as well as FuzzyEn. Compared with MFE, with the increasing of scale factor, CMFE obtains much more stable and consistent values for a short-term time series. In this paper CMFE is employed to measure the complexity of vibration signals of rolling bearings and is applied to extract the nonlinear features hidden in the vibration signals. Also the physically meanings of CMFE being suitable for rolling bearing fault diagnosis are explored. Based on these, to fulfill an automatic fault diagnosis, the ensemble SVMs based multi-classifier is constructed for the intelligent classification of fault features. Finally, the proposed fault diagnosis method of rolling bearing is applied to experimental data analysis and the results indicate that the proposed method could effectively distinguish different fault categories and severities of rolling bearings.

Evaluation of physiologic complexity in time series using generalized sample entropy and surrogate data analysis

NASA Astrophysics Data System (ADS)

Eduardo Virgilio Silva, Luiz; Otavio Murta, Luiz

2012-12-01

Complexity in time series is an intriguing feature of living dynamical systems, with potential use for identification of system state. Although various methods have been proposed for measuring physiologic complexity, uncorrelated time series are often assigned high values of complexity, errouneously classifying them as a complex physiological signals. Here, we propose and discuss a method for complex system analysis based on generalized statistical formalism and surrogate time series. Sample entropy (SampEn) was rewritten inspired in Tsallis generalized entropy, as function of q parameter (qSampEn). qSDiff curves were calculated, which consist of differences between original and surrogate series qSampEn. We evaluated qSDiff for 125 real heart rate variability (HRV) dynamics, divided into groups of 70 healthy, 44 congestive heart failure (CHF), and 11 atrial fibrillation (AF) subjects, and for simulated series of stochastic and chaotic process. The evaluations showed that, for nonperiodic signals, qSDiff curves have a maximum point (qSDiffmax) for q ≠1. Values of q where the maximum point occurs and where qSDiff is zero were also evaluated. Only qSDiffmax values were capable of distinguish HRV groups (p-values 5.10×10-3, 1.11×10-7, and 5.50×10-7 for healthy vs. CHF, healthy vs. AF, and CHF vs. AF, respectively), consistently with the concept of physiologic complexity, and suggests a potential use for chaotic system analysis.

Exploring resting-state EEG complexity before migraine attacks.

PubMed

Cao, Zehong; Lai, Kuan-Lin; Lin, Chin-Teng; Chuang, Chun-Hsiang; Chou, Chien-Chen; Wang, Shuu-Jiun

2018-06-01

Objective Entropy-based approaches to understanding the temporal dynamics of complexity have revealed novel insights into various brain activities. Herein, electroencephalogram complexity before migraine attacks was examined using an inherent fuzzy entropy approach, allowing the development of an electroencephalogram-based classification model to recognize the difference between interictal and preictal phases. Methods Forty patients with migraine without aura and 40 age-matched normal control subjects were recruited, and the resting-state electroencephalogram signals of their prefrontal and occipital areas were prospectively collected. The migraine phases were defined based on the headache diary, and the preictal phase was defined as within 72 hours before a migraine attack. Results The electroencephalogram complexity of patients in the preictal phase, which resembled that of normal control subjects, was significantly higher than that of patients in the interictal phase in the prefrontal area (FDR-adjusted p < 0.05) but not in the occipital area. The measurement of test-retest reliability (n = 8) using the intra-class correlation coefficient was good with r1 = 0.73 ( p = 0.01). Furthermore, the classification model, support vector machine, showed the highest accuracy (76 ± 4%) for classifying interictal and preictal phases using the prefrontal electroencephalogram complexity. Conclusion Entropy-based analytical methods identified enhancement or "normalization" of frontal electroencephalogram complexity during the preictal phase compared with the interictal phase. This classification model, using this complexity feature, may have the potential to provide a preictal alert to migraine without aura patients.

Dual-threshold segmentation using Arimoto entropy based on chaotic bee colony optimization

NASA Astrophysics Data System (ADS)

Li, Li

2018-03-01

In order to extract target from complex background more quickly and accurately, and to further improve the detection effect of defects, a method of dual-threshold segmentation using Arimoto entropy based on chaotic bee colony optimization was proposed. Firstly, the method of single-threshold selection based on Arimoto entropy was extended to dual-threshold selection in order to separate the target from the background more accurately. Then intermediate variables in formulae of Arimoto entropy dual-threshold selection was calculated by recursion to eliminate redundant computation effectively and to reduce the amount of calculation. Finally, the local search phase of artificial bee colony algorithm was improved by chaotic sequence based on tent mapping. The fast search for two optimal thresholds was achieved using the improved bee colony optimization algorithm, thus the search could be accelerated obviously. A large number of experimental results show that, compared with the existing segmentation methods such as multi-threshold segmentation method using maximum Shannon entropy, two-dimensional Shannon entropy segmentation method, two-dimensional Tsallis gray entropy segmentation method and multi-threshold segmentation method using reciprocal gray entropy, the proposed method can segment target more quickly and accurately with superior segmentation effect. It proves to be an instant and effective method for image segmentation.

Protein flexibility and conformational entropy in ligand design targeting the carbohydrate recognition domain of galectin-3.

PubMed

Diehl, Carl; Engström, Olof; Delaine, Tamara; Håkansson, Maria; Genheden, Samuel; Modig, Kristofer; Leffler, Hakon; Ryde, Ulf; Nilsson, Ulf J; Akke, Mikael

2010-10-20

Rational drug design is predicated on knowledge of the three-dimensional structure of the protein-ligand complex and the thermodynamics of ligand binding. Despite the fundamental importance of both enthalpy and entropy in driving ligand binding, the role of conformational entropy is rarely addressed in drug design. In this work, we have probed the conformational entropy and its relative contribution to the free energy of ligand binding to the carbohydrate recognition domain of galectin-3. Using a combination of NMR spectroscopy, isothermal titration calorimetry, and X-ray crystallography, we characterized the binding of three ligands with dissociation constants ranging over 2 orders of magnitude. (15)N and (2)H spin relaxation measurements showed that the protein backbone and side chains respond to ligand binding by increased conformational fluctuations, on average, that differ among the three ligand-bound states. Variability in the response to ligand binding is prominent in the hydrophobic core, where a distal cluster of methyl groups becomes more rigid, whereas methyl groups closer to the binding site become more flexible. The results reveal an intricate interplay between structure and conformational fluctuations in the different complexes that fine-tunes the affinity. The estimated change in conformational entropy is comparable in magnitude to the binding enthalpy, demonstrating that it contributes favorably and significantly to ligand binding. We speculate that the relatively weak inherent protein-carbohydrate interactions and limited hydrophobic effect associated with oligosaccharide binding might have exerted evolutionary pressure on carbohydrate-binding proteins to increase the affinity by means of conformational entropy.

Predictive uncertainty in auditory sequence processing

PubMed Central

Hansen, Niels Chr.; Pearce, Marcus T.

2014-01-01

Previous studies of auditory expectation have focused on the expectedness perceived by listeners retrospectively in response to events. In contrast, this research examines predictive uncertainty—a property of listeners' prospective state of expectation prior to the onset of an event. We examine the information-theoretic concept of Shannon entropy as a model of predictive uncertainty in music cognition. This is motivated by the Statistical Learning Hypothesis, which proposes that schematic expectations reflect probabilistic relationships between sensory events learned implicitly through exposure. Using probability estimates from an unsupervised, variable-order Markov model, 12 melodic contexts high in entropy and 12 melodic contexts low in entropy were selected from two musical repertoires differing in structural complexity (simple and complex). Musicians and non-musicians listened to the stimuli and provided explicit judgments of perceived uncertainty (explicit uncertainty). We also examined an indirect measure of uncertainty computed as the entropy of expectedness distributions obtained using a classical probe-tone paradigm where listeners rated the perceived expectedness of the final note in a melodic sequence (inferred uncertainty). Finally, we simulate listeners' perception of expectedness and uncertainty using computational models of auditory expectation. A detailed model comparison indicates which model parameters maximize fit to the data and how they compare to existing models in the literature. The results show that listeners experience greater uncertainty in high-entropy musical contexts than low-entropy contexts. This effect is particularly apparent for inferred uncertainty and is stronger in musicians than non-musicians. Consistent with the Statistical Learning Hypothesis, the results suggest that increased domain-relevant training is associated with an increasingly accurate cognitive model of probabilistic structure in music. PMID:25295018

Bianchi I cosmology in the presence of a causally regularized viscous fluid

NASA Astrophysics Data System (ADS)

Montani, Giovanni; Venanzi, Marta

2017-07-01

We analyze the dynamics of a Bianchi I cosmology in the presence of a viscous fluid, causally regularized according to the Lichnerowicz approach. We show how the effect induced by shear viscosity is still able to produce a matter creation phenomenon, meaning that also in the regularized theory we address, the Universe is emerging from a singularity with a vanishing energy density value. We discuss the structure of the singularity in the isotropic limit, when bulk viscosity is the only retained contribution. We see that, as far as viscosity is not a dominant effect, the dynamics of the isotropic Universe possesses the usual non-viscous power-law behaviour but in correspondence to an effective equation of state, depending on the bulk viscosity coefficient. Finally, we show that, in the limit of a strong non-thermodynamical equilibrium of the Universe mimicked by a dominant contribution of the effective viscous pressure, a power-law inflation behaviour of the Universe appears, the cosmological horizons are removed and a significant amount of entropy is produced.

Lexical mediation of phonotactic frequency effects on spoken word recognition: A Granger causality analysis of MRI-constrained MEG/EEG data.

PubMed

Gow, David W; Olson, Bruna B

2015-07-01

Phonotactic frequency effects play a crucial role in a number of debates over language processing and representation. It is unclear however, whether these effects reflect prelexical sensitivity to phonotactic frequency, or lexical "gang effects" in speech perception. In this paper, we use Granger causality analysis of MR-constrained MEG/EEG data to understand how phonotactic frequency influences neural processing dynamics during auditory lexical decision. Effective connectivity analysis showed weaker feedforward influence from brain regions involved in acoustic-phonetic processing (superior temporal gyrus) to lexical areas (supramarginal gyrus) for high phonotactic frequency words, but stronger top-down lexical influence for the same items. Low entropy nonwords (nonwords judged to closely resemble real words) showed a similar pattern of interactions between brain regions involved in lexical and acoustic-phonetic processing. These results contradict the predictions of a feedforward model of phonotactic frequency facilitation, but support the predictions of a lexically mediated account.

Lexical mediation of phonotactic frequency effects on spoken word recognition: A Granger causality analysis of MRI-constrained MEG/EEG data

PubMed Central

Gow, David W.; Olson, Bruna B.

2015-01-01

Phonotactic frequency effects play a crucial role in a number of debates over language processing and representation. It is unclear however, whether these effects reflect prelexical sensitivity to phonotactic frequency, or lexical “gang effects” in speech perception. In this paper, we use Granger causality analysis of MR-constrained MEG/EEG data to understand how phonotactic frequency influences neural processing dynamics during auditory lexical decision. Effective connectivity analysis showed weaker feedforward influence from brain regions involved in acoustic-phonetic processing (superior temporal gyrus) to lexical areas (supramarginal gyrus) for high phonotactic frequency words, but stronger top-down lexical influence for the same items. Low entropy nonwords (nonwords judged to closely resemble real words) showed a similar pattern of interactions between brain regions involved in lexical and acoustic-phonetic processing. These results contradict the predictions of a feedforward model of phonotactic frequency facilitation, but support the predictions of a lexically mediated account. PMID:25883413

Forces and Motion: How Young Children Understand Causal Events

ERIC Educational Resources Information Center

Goksun, Tilbe; George, Nathan R.; Hirsh-Pasek, Kathy; Golinkoff, Roberta M.

2013-01-01

How do children evaluate complex causal events? This study investigates preschoolers' representation of "force dynamics" in causal scenes, asking whether (a) children understand how single and dual forces impact an object's movement and (b) this understanding varies across cause types (Cause, Enable, Prevent). Three-and-a half- to…

MEMD-enhanced multivariate fuzzy entropy for the evaluation of complexity in biomedical signals.

PubMed

Azami, Hamed; Smith, Keith; Escudero, Javier

2016-08-01

Multivariate multiscale entropy (mvMSE) has been proposed as a combination of the coarse-graining process and multivariate sample entropy (mvSE) to quantify the irregularity of multivariate signals. However, both the coarse-graining process and mvSE may not be reliable for short signals. Although the coarse-graining process can be replaced with multivariate empirical mode decomposition (MEMD), the relative instability of mvSE for short signals remains a problem. Here, we address this issue by proposing the multivariate fuzzy entropy (mvFE) with a new fuzzy membership function. The results using white Gaussian noise show that the mvFE leads to more reliable and stable results, especially for short signals, in comparison with mvSE. Accordingly, we propose MEMD-enhanced mvFE to quantify the complexity of signals. The characteristics of brain regions influenced by partial epilepsy are investigated by focal and non-focal electroencephalogram (EEG) time series. In this sense, the proposed MEMD-enhanced mvFE and mvSE are employed to discriminate focal EEG signals from non-focal ones. The results demonstrate the MEMD-enhanced mvFE values have a smaller coefficient of variation in comparison with those obtained by the MEMD-enhanced mvSE, even for long signals. The results also show that the MEMD-enhanced mvFE has better performance to quantify focal and non-focal signals compared with multivariate multiscale permutation entropy.

The human brain pacemaker: Synchronized infra-slow neurovascular coupling in patients undergoing non-pulsatile cardiopulmonary bypass.

PubMed

Zanatta, Paolo; Toffolo, Gianna Maria; Sartori, Elisa; Bet, Anna; Baldanzi, Fabrizio; Agarwal, Nivedita; Golanov, Eugene

2013-05-15

In non-pulsatile cardiopulmonary bypass surgery, middle cerebral artery blood flow velocity (BFV) is characterized by infra-slow oscillations of approximately 0.06Hz, which are paralleled by changes in total EEG power variability (EEG-PV), measured in 2s intervals. Since the origin of these BFV oscillations is not known, we explored their possible causative relationships with oscillations in EEG-PV at around 0.06Hz. We monitored 28 patients undergoing non-pulsatile cardiopulmonary bypass using transcranial Doppler sonography and scalp electroencephalography at two levels of anesthesia, deep (prevalence of burst suppression rhythm) and moderate (prevalence of theta rhythm). Under deep anesthesia, the EEG bursts suppression pattern was highly correlative with BFV oscillations. Hence, a detailed quantitative picture of the coupling between electrical brain activity and BFV was derived, both in deep and moderate anesthesia, via linear and non linear processing of EEG-PV and BFV signals, resorting to widely used measures of signal coupling such as frequency of oscillations, coherence, Granger causality and cross-approximate entropy. Results strongly suggest the existence of coupling between EEG-PV and BFV. In moderate anesthesia EEG-PV mean dominant frequency is similar to frequency of BFV oscillations (0.065±0.010Hz vs 0.045±0.019Hz); coherence between the two signals was significant in about 55% of subjects, and the Granger causality suggested an EEG-PV→BFV causal effect direction. The strength of the coupling increased with deepening anesthesia, as EEG-PV oscillations mean dominant frequency virtually coincided with the BFV peak frequency (0.062±0.017Hz vs 0.060±0.024Hz), and coherence became significant in a larger number (65%) of subjects. Cross-approximate entropy decreased significantly from moderate to deep anesthesia, indicating a higher level of synchrony between the two signals. Presence of a subcortical brain pacemaker that drives vascular infra-slow oscillations in the brain is proposed. These findings allow to suggest an original hypothesis explaining the mechanism underlying infra-slow neurovascular coupling. Copyright © 2013 Elsevier Inc. All rights reserved.

The Model Analyst’s Toolkit: Scientific Model Development, Analysis, and Validation

DTIC Science & Technology

2013-11-20

Granger causality F-test validation 3.1.2. Dynamic time warping for uneven temporal relationships Many causal relationships are imperfectly...mapping for dynamic feedback models Granger causality and DTW can identify causal relationships and consider complex temporal factors. However, many ...variant of the tf-idf algorithm (Manning, Raghavan, Schutze et al., 2008), typically used in search engines, to “score” features. The (-log tf) in

A practical comparison of algorithms for the measurement of multiscale entropy in neural time series data.

PubMed

Kuntzelman, Karl; Jack Rhodes, L; Harrington, Lillian N; Miskovic, Vladimir

2018-06-01

There is a broad family of statistical methods for capturing time series regularity, with increasingly widespread adoption by the neuroscientific community. A common feature of these methods is that they permit investigators to quantify the entropy of brain signals - an index of unpredictability/complexity. Despite the proliferation of algorithms for computing entropy from neural time series data there is scant evidence concerning their relative stability and efficiency. Here we evaluated several different algorithmic implementations (sample, fuzzy, dispersion and permutation) of multiscale entropy in terms of their stability across sessions, internal consistency and computational speed, accuracy and precision using a combination of electroencephalogram (EEG) and synthetic 1/ƒ noise signals. Overall, we report fair to excellent internal consistency and longitudinal stability over a one-week period for the majority of entropy estimates, with several caveats. Computational timing estimates suggest distinct advantages for dispersion and permutation entropy over other entropy estimates. Considered alongside the psychometric evidence, we suggest several ways in which researchers can maximize computational resources (without sacrificing reliability), especially when working with high-density M/EEG data or multivoxel BOLD time series signals. Copyright © 2018 Elsevier Inc. All rights reserved.

Fault detection of the connection of lithium-ion power batteries based on entropy for electric vehicles

NASA Astrophysics Data System (ADS)

Yao, Lei; Wang, Zhenpo; Ma, Jun

2015-10-01

This paper proposes a method of fault detection of the connection of Lithium-Ion batteries based on entropy for electric vehicle. In electric vehicle operation process, some factors, such as road conditions, driving habits, vehicle performance, always affect batteries by vibration, which easily cause loosing or virtual connection between batteries. Through the simulation of the battery charging and discharging experiment under vibration environment, the data of voltage fluctuation can be obtained. Meanwhile, an optimal filtering method is adopted using discrete cosine filter method to analyze the characteristics of system noise, based on the voltage set when batteries are working under different vibration frequency. Experimental data processed by filtering is analyzed based on local Shannon entropy, ensemble Shannon entropy and sample entropy. And the best way to find a method of fault detection of the connection of lithium-ion batteries based on entropy is presented for electric vehicle. The experimental data shows that ensemble Shannon entropy can predict the accurate time and the location of battery connection failure in real time. Besides electric-vehicle industry, this method can also be used in other areas in complex vibration environment.

Measuring the hierarchy of feedforward networks

NASA Astrophysics Data System (ADS)

Corominas-Murtra, Bernat; Rodríguez-Caso, Carlos; Goñi, Joaquín; Solé, Ricard

2011-03-01

In this paper we explore the concept of hierarchy as a quantifiable descriptor of ordered structures, departing from the definition of three conditions to be satisfied for a hierarchical structure: order, predictability, and pyramidal structure. According to these principles, we define a hierarchical index taking concepts from graph and information theory. This estimator allows to quantify the hierarchical character of any system susceptible to be abstracted in a feedforward causal graph, i.e., a directed acyclic graph defined in a single connected structure. Our hierarchical index is a balance between this predictability and pyramidal condition by the definition of two entropies: one attending the onward flow and the other for the backward reversion. We show how this index allows to identify hierarchical, antihierarchical, and nonhierarchical structures. Our formalism reveals that departing from the defined conditions for a hierarchical structure, feedforward trees and the inverted tree graphs emerge as the only causal structures of maximal hierarchical and antihierarchical systems respectively. Conversely, null values of the hierarchical index are attributed to a number of different configuration networks; from linear chains, due to their lack of pyramid structure, to full-connected feedforward graphs where the diversity of onward pathways is canceled by the uncertainty (lack of predictability) when going backward. Some illustrative examples are provided for the distinction among these three types of hierarchical causal graphs.

Causal dissipation and shock profiles in the relativistic fluid dynamics of pure radiation.

PubMed

Freistühler, Heinrich; Temple, Blake

2014-06-08

CURRENT THEORIES OF DISSIPATION IN THE RELATIVISTIC REGIME SUFFER FROM ONE OF TWO DEFICITS: either their dissipation is not causal or no profiles for strong shock waves exist. This paper proposes a relativistic Navier-Stokes-Fourier-type viscosity and heat conduction tensor such that the resulting second-order system of partial differential equations for the fluid dynamics of pure radiation is symmetric hyperbolic. This system has causal dissipation as well as the property that all shock waves of arbitrary strength have smooth profiles. Entropy production is positive both on gradients near those of solutions to the dissipation-free equations and on gradients of shock profiles. This shows that the new dissipation stress tensor complies to leading order with the principles of thermodynamics. Whether higher order modifications of the ansatz are required to obtain full compatibility with the second law far from the zero-dissipation equilibrium is left to further investigations. The system has exactly three a priori free parameters χ , η , ζ , corresponding physically to heat conductivity, shear viscosity and bulk viscosity. If the bulk viscosity is zero (as is stated in the literature) and the total stress-energy tensor is trace free, the entire viscosity and heat conduction tensor is determined to within a constant factor.

Causal dissipation and shock profiles in the relativistic fluid dynamics of pure radiation

PubMed Central

Freistühler, Heinrich; Temple, Blake

2014-01-01

Current theories of dissipation in the relativistic regime suffer from one of two deficits: either their dissipation is not causal or no profiles for strong shock waves exist. This paper proposes a relativistic Navier–Stokes–Fourier-type viscosity and heat conduction tensor such that the resulting second-order system of partial differential equations for the fluid dynamics of pure radiation is symmetric hyperbolic. This system has causal dissipation as well as the property that all shock waves of arbitrary strength have smooth profiles. Entropy production is positive both on gradients near those of solutions to the dissipation-free equations and on gradients of shock profiles. This shows that the new dissipation stress tensor complies to leading order with the principles of thermodynamics. Whether higher order modifications of the ansatz are required to obtain full compatibility with the second law far from the zero-dissipation equilibrium is left to further investigations. The system has exactly three a priori free parameters χ,η,ζ, corresponding physically to heat conductivity, shear viscosity and bulk viscosity. If the bulk viscosity is zero (as is stated in the literature) and the total stress–energy tensor is trace free, the entire viscosity and heat conduction tensor is determined to within a constant factor. PMID:24910526

Decreased Complexity in Alzheimer's Disease: Resting-State fMRI Evidence of Brain Entropy Mapping.

PubMed

Wang, Bin; Niu, Yan; Miao, Liwen; Cao, Rui; Yan, Pengfei; Guo, Hao; Li, Dandan; Guo, Yuxiang; Yan, Tianyi; Wu, Jinglong; Xiang, Jie; Zhang, Hui

2017-01-01

Alzheimer's disease (AD) is a frequently observed, irreversible brain function disorder among elderly individuals. Resting-state functional magnetic resonance imaging (rs-fMRI) has been introduced as an alternative approach to assessing brain functional abnormalities in AD patients. However, alterations in the brain rs-fMRI signal complexities in mild cognitive impairment (MCI) and AD patients remain unclear. Here, we described the novel application of permutation entropy (PE) to investigate the abnormal complexity of rs-fMRI signals in MCI and AD patients. The rs-fMRI signals of 30 normal controls (NCs), 33 early MCI (EMCI), 32 late MCI (LMCI), and 29 AD patients were obtained from the Alzheimer's disease Neuroimaging Initiative (ADNI) database. After preprocessing, whole-brain entropy maps of the four groups were extracted and subjected to Gaussian smoothing. We performed a one-way analysis of variance (ANOVA) on the brain entropy maps of the four groups. The results after adjusting for age and sex differences together revealed that the patients with AD exhibited lower complexity than did the MCI and NC controls. We found five clusters that exhibited significant differences and were distributed primarily in the occipital, frontal, and temporal lobes. The average PE of the five clusters exhibited a decreasing trend from MCI to AD. The AD group exhibited the least complexity. Additionally, the average PE of the five clusters was significantly positively correlated with the Mini-Mental State Examination (MMSE) scores and significantly negatively correlated with Functional Assessment Questionnaire (FAQ) scores and global Clinical Dementia Rating (CDR) scores in the patient groups. Significant correlations were also found between the PE and regional homogeneity (ReHo) in the patient groups. These results indicated that declines in PE might be related to changes in regional functional homogeneity in AD. These findings suggested that complexity analyses using PE in rs-fMRI signals can provide important information about the fMRI characteristics of cognitive impairments in MCI and AD.

Decreased Complexity in Alzheimer's Disease: Resting-State fMRI Evidence of Brain Entropy Mapping

PubMed Central

Wang, Bin; Niu, Yan; Miao, Liwen; Cao, Rui; Yan, Pengfei; Guo, Hao; Li, Dandan; Guo, Yuxiang; Yan, Tianyi; Wu, Jinglong; Xiang, Jie; Zhang, Hui

2017-01-01

Alzheimer's disease (AD) is a frequently observed, irreversible brain function disorder among elderly individuals. Resting-state functional magnetic resonance imaging (rs-fMRI) has been introduced as an alternative approach to assessing brain functional abnormalities in AD patients. However, alterations in the brain rs-fMRI signal complexities in mild cognitive impairment (MCI) and AD patients remain unclear. Here, we described the novel application of permutation entropy (PE) to investigate the abnormal complexity of rs-fMRI signals in MCI and AD patients. The rs-fMRI signals of 30 normal controls (NCs), 33 early MCI (EMCI), 32 late MCI (LMCI), and 29 AD patients were obtained from the Alzheimer's disease Neuroimaging Initiative (ADNI) database. After preprocessing, whole-brain entropy maps of the four groups were extracted and subjected to Gaussian smoothing. We performed a one-way analysis of variance (ANOVA) on the brain entropy maps of the four groups. The results after adjusting for age and sex differences together revealed that the patients with AD exhibited lower complexity than did the MCI and NC controls. We found five clusters that exhibited significant differences and were distributed primarily in the occipital, frontal, and temporal lobes. The average PE of the five clusters exhibited a decreasing trend from MCI to AD. The AD group exhibited the least complexity. Additionally, the average PE of the five clusters was significantly positively correlated with the Mini-Mental State Examination (MMSE) scores and significantly negatively correlated with Functional Assessment Questionnaire (FAQ) scores and global Clinical Dementia Rating (CDR) scores in the patient groups. Significant correlations were also found between the PE and regional homogeneity (ReHo) in the patient groups. These results indicated that declines in PE might be related to changes in regional functional homogeneity in AD. These findings suggested that complexity analyses using PE in rs-fMRI signals can provide important information about the fMRI characteristics of cognitive impairments in MCI and AD. PMID:29209199

Combining Propensity Score Methods and Complex Survey Data to Estimate Population Treatment Effects

ERIC Educational Resources Information Center

Stuart, Elizabeth A.; Dong, Nianbo; Lenis, David

2016-01-01

Complex surveys are often used to estimate causal effects regarding the effects of interventions or exposures of interest. Propensity scores (Rosenbaum & Rubin, 1983) have emerged as one popular and effective tool for causal inference in non-experimental studies, as they can help ensure that groups being compared are similar with respect to a…

Domain-specific perceptual causality in children depends on the spatio-temporal configuration, not motion onset

PubMed Central

Schlottmann, Anne; Cole, Katy; Watts, Rhianna; White, Marina

2013-01-01

Humans, even babies, perceive causality when one shape moves briefly and linearly after another. Motion timing is crucial in this and causal impressions disappear with short delays between motions. However, the role of temporal information is more complex: it is both a cue to causality and a factor that constrains processing. It affects ability to distinguish causality from non-causality, and social from mechanical causality. Here we study both issues with 3- to 7-year-olds and adults who saw two computer-animated squares and chose if a picture of mechanical, social or non-causality fit each event best. Prior work fit with the standard view that early in development, the distinction between the social and physical domains depends mainly on whether or not the agents make contact, and that this reflects concern with domain-specific motion onset, in particular, whether the motion is self-initiated or not. The present experiments challenge both parts of this position. In Experiments 1 and 2, we showed that not just spatial, but also animacy and temporal information affect how children distinguish between physical and social causality. In Experiments 3 and 4 we showed that children do not seem to use spatio-temporal information in perceptual causality to make inferences about self- or other-initiated motion onset. Overall, spatial contact may be developmentally primary in domain-specific perceptual causality in that it is processed easily and is dominant over competing cues, but it is not the only cue used early on and it is not used to infer motion onset. Instead, domain-specific causal impressions may be automatic reactions to specific perceptual configurations, with a complex role for temporal information. PMID:23874308

Plane Transformations in a Complex Setting I: Homotheties-Translations

ERIC Educational Resources Information Center

Dana-Picard, T.

2006-01-01

A previous note described how complex numbers can be used for elementary analytic geometry in the plane, describing lines, circles and their intersections using complex Cartesian equations. In the present note, a description of elementary plane transformations, namely homotheties and translations, their group structure and their operations on…

Effect of temperature on the complexation of NpO 2 + with benzoic acid: Spectrophotometric and calorimetric studies

DOE Office of Scientific and Technical Information (OSTI.GOV)

Yang, Yanqiu; Zhang, Zhicheng; Liu, Guokui

The equilibrium constants of the 1:1 NpO2+/benzoate complex were determined by spectrophotometric titrations at variable temperatures (T = 283 to 343 K) and the ionic strength of 1.05 mol · kg-1. The enthalpy of complexation at T = 298 K was determined by microcalorimetric titrations. Similar to other monocarboxylates, benzoate forms a weak complex with NpO2+ and the complexation is strengthened as the temperature is increased. The complexation is endothermic and is entropy-driven. The enhancement of the complexation at elevated temperatures is primarily attributed to the increasingly larger entropy gain when the water molecules are released from the highly-ordered solvationmore » spheres of NpO2+ and benzoate to the bulk solvent where the degree of disorder is higher at higher temperatures. The spectroscopic features of the Np(V)/benzoate system, including the effect of temperature on the absorption bands, are discussed in terms of ligand field splitting and a thermal expansion mechanism.« less

Generative complexity of Gray-Scott model

NASA Astrophysics Data System (ADS)

Adamatzky, Andrew

2018-03-01

In the Gray-Scott reaction-diffusion system one reactant is constantly fed in the system, another reactant is reproduced by consuming the supplied reactant and also converted to an inert product. The rate of feeding one reactant in the system and the rate of removing another reactant from the system determine configurations of concentration profiles: stripes, spots, waves. We calculate the generative complexity-a morphological complexity of concentration profiles grown from a point-wise perturbation of the medium-of the Gray-Scott system for a range of the feeding and removal rates. The morphological complexity is evaluated using Shannon entropy, Simpson diversity, approximation of Lempel-Ziv complexity, and expressivity (Shannon entropy divided by space-filling). We analyse behaviour of the systems with highest values of the generative morphological complexity and show that the Gray-Scott systems expressing highest levels of the complexity are composed of the wave-fragments (similar to wave-fragments in sub-excitable media) and travelling localisations (similar to quasi-dissipative solitons and gliders in Conway's Game of Life).

Nonlinear stochastic interacting dynamics and complexity of financial gasket fractal-like lattice percolation

NASA Astrophysics Data System (ADS)

Zhang, Wei; Wang, Jun

2018-05-01

A novel nonlinear stochastic interacting price dynamics is proposed and investigated by the bond percolation on Sierpinski gasket fractal-like lattice, aim to make a new approach to reproduce and study the complexity dynamics of real security markets. Fractal-like lattices correspond to finite graphs with vertices and edges, which are similar to fractals, and Sierpinski gasket is a well-known example of fractals. Fractional ordinal array entropy and fractional ordinal array complexity are introduced to analyze the complexity behaviors of financial signals. To deeper comprehend the fluctuation characteristics of the stochastic price evolution, the complexity analysis of random logarithmic returns and volatility are preformed, including power-law distribution, fractional sample entropy and fractional ordinal array complexity. For further verifying the rationality and validity of the developed stochastic price evolution, the actual security market dataset are also studied with the same statistical methods for comparison. The empirical results show that this stochastic price dynamics can reconstruct complexity behaviors of the actual security markets to some extent.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Donnelly, William; Freidel, Laurent

We consider the problem of defining localized subsystems in gauge theory and gravity. Such systems are associated to spacelike hypersurfaces with boundaries and provide the natural setting for studying entanglement entropy of regions of space. We present a general formalism to associate a gauge-invariant classical phase space to a spatial slice with boundary by introducing new degrees of freedom on the boundary. In Yang-Mills theory the new degrees of freedom are a choice of gauge on the boundary, transformations of which are generated by the normal component of the nonabelian electric field. In general relativity the new degrees of freedommore » are the location of a codimension-2 surface and a choice of conformal normal frame. These degrees of freedom transform under a group of surface symmetries, consisting of diffeomorphisms of the codimension-2 boundary, and position-dependent linear deformations of its normal plane. We find the observables which generate these symmetries, consisting of the conformal normal metric and curvature of the normal connection. We discuss the implications for the problem of defining entanglement entropy in quantum gravity. Finally, our work suggests that the Bekenstein-Hawking entropy may arise from the different ways of gluing together two partial Cauchy surfaces at a cross-section of the horizon.« less

Entropy information of heart rate variability and its power spectrum during day and night

NASA Astrophysics Data System (ADS)

Jin, Li; Jun, Wang

2013-07-01

Physiologic systems generate complex fluctuations in their output signals that reflect the underlying dynamics. We employed the base-scale entropy method and the power spectral analysis to study the 24 hours heart rate variability (HRV) signals. The results show that such profound circadian-, age- and pathologic-dependent changes are accompanied by changes in base-scale entropy and power spectral distribution. Moreover, the base-scale entropy changes reflect the corresponding changes in the autonomic nerve outflow. With the suppression of the vagal tone and dominance of the sympathetic tone in congestive heart failure (CHF) subjects, there is more variability in the date fluctuation mode. So the higher base-scale entropy belongs to CHF subjects. With the decrease of the sympathetic tone and the respiratory frequency (RSA) becoming more pronounced with slower breathing during sleeping, the base-scale entropy drops in CHF subjects. The HRV series of the two healthy groups have the same diurnal/nocturnal trend as the CHF series. The fluctuation dynamics trend of data in the three groups can be described as “HF effect”.

Entropy production rate as a criterion for inconsistency in decision theory

NASA Astrophysics Data System (ADS)

Dixit, Purushottam D.

2018-05-01

Individual and group decisions are complex, often involving choosing an apt alternative from a multitude of options. Evaluating pairwise comparisons breaks down such complex decision problems into tractable ones. Pairwise comparison matrices (PCMs) are regularly used to solve multiple-criteria decision-making problems, for example, using Saaty’s analytic hierarchy process (AHP) framework. However, there are two significant drawbacks of using PCMs. First, humans evaluate PCMs in an inconsistent manner. Second, not all entries of a large PCM can be reliably filled by human decision makers. We address these two issues by first establishing a novel connection between PCMs and time-irreversible Markov processes. Specifically, we show that every PCM induces a family of dissipative maximum path entropy random walks (MERW) over the set of alternatives. We show that only ‘consistent’ PCMs correspond to detailed balanced MERWs. We identify the non-equilibrium entropy production in the induced MERWs as a metric of inconsistency of the underlying PCMs. Notably, the entropy production satisfies all of the recently laid out criteria for reasonable consistency indices. We also propose an approach to use incompletely filled PCMs in AHP. Potential future avenues are discussed as well.

Dimensionality and entropy of spontaneous and evoked rate activity

NASA Astrophysics Data System (ADS)

Engelken, Rainer; Wolf, Fred

Cortical circuits exhibit complex activity patterns both spontaneously and evoked by external stimuli. Finding low-dimensional structure in population activity is a challenge. What is the diversity of the collective neural activity and how is it affected by an external stimulus? Using concepts from ergodic theory, we calculate the attractor dimensionality and dynamical entropy production of these networks. We obtain these two canonical measures of the collective network dynamics from the full set of Lyapunov exponents. We consider a randomly-wired firing-rate network that exhibits chaotic rate fluctuations for sufficiently strong synaptic weights. We show that dynamical entropy scales logarithmically with synaptic coupling strength, while the attractor dimensionality saturates. Thus, despite the increasing uncertainty, the diversity of collective activity saturates for strong coupling. We find that a time-varying external stimulus drastically reduces both entropy and dimensionality. Finally, we analytically approximate the full Lyapunov spectrum in several limiting cases by random matrix theory. Our study opens a novel avenue to characterize the complex dynamics of rate networks and the geometric structure of the corresponding high-dimensional chaotic attractor. received funding from Evangelisches Studienwerk Villigst, DFG through CRC 889 and Volkswagen Foundation.

Spatial analysis of cities using Renyi entropy and fractal parameters

NASA Astrophysics Data System (ADS)

Chen, Yanguang; Feng, Jian

2017-12-01

The spatial distributions of cities fall into two groups: one is the simple distribution with characteristic scale (e.g. exponential distribution), and the other is the complex distribution without characteristic scale (e.g. power-law distribution). The latter belongs to scale-free distributions, which can be modeled with fractal geometry. However, fractal dimension is not suitable for the former distribution. In contrast, spatial entropy can be used to measure any types of urban distributions. This paper is devoted to generalizing multifractal parameters by means of dual relation between Euclidean and fractal geometries. The main method is mathematical derivation and empirical analysis, and the theoretical foundation is the discovery that the normalized fractal dimension is equal to the normalized entropy. Based on this finding, a set of useful spatial indexes termed dummy multifractal parameters are defined for geographical analysis. These indexes can be employed to describe both the simple distributions and complex distributions. The dummy multifractal indexes are applied to the population density distribution of Hangzhou city, China. The calculation results reveal the feature of spatio-temporal evolution of Hangzhou's urban morphology. This study indicates that fractal dimension and spatial entropy can be combined to produce a new methodology for spatial analysis of city development.

Spectral Entropies as Information-Theoretic Tools for Complex Network Comparison

NASA Astrophysics Data System (ADS)

De Domenico, Manlio; Biamonte, Jacob

2016-10-01

Any physical system can be viewed from the perspective that information is implicitly represented in its state. However, the quantification of this information when it comes to complex networks has remained largely elusive. In this work, we use techniques inspired by quantum statistical mechanics to define an entropy measure for complex networks and to develop a set of information-theoretic tools, based on network spectral properties, such as Rényi q entropy, generalized Kullback-Leibler and Jensen-Shannon divergences, the latter allowing us to define a natural distance measure between complex networks. First, we show that by minimizing the Kullback-Leibler divergence between an observed network and a parametric network model, inference of model parameter(s) by means of maximum-likelihood estimation can be achieved and model selection can be performed with appropriate information criteria. Second, we show that the information-theoretic metric quantifies the distance between pairs of networks and we can use it, for instance, to cluster the layers of a multilayer system. By applying this framework to networks corresponding to sites of the human microbiome, we perform hierarchical cluster analysis and recover with high accuracy existing community-based associations. Our results imply that spectral-based statistical inference in complex networks results in demonstrably superior performance as well as a conceptual backbone, filling a gap towards a network information theory.

Non-extensivity and complexity in the earthquake activity at the West Corinth rift (Greece)

NASA Astrophysics Data System (ADS)

Michas, Georgios; Vallianatos, Filippos; Sammonds, Peter

2013-04-01

Earthquakes exhibit complex phenomenology that is revealed from the fractal structure in space, time and magnitude. For that reason other tools rather than the simple Poissonian statistics seem more appropriate to describe the statistical properties of the phenomenon. Here we use Non-Extensive Statistical Physics [NESP] to investigate the inter-event time distribution of the earthquake activity at the west Corinth rift (central Greece). This area is one of the most seismotectonically active areas in Europe, with an important continental N-S extension and high seismicity rates. NESP concept refers to the non-additive Tsallis entropy Sq that includes Boltzmann-Gibbs entropy as a particular case. This concept has been successfully used for the analysis of a variety of complex dynamic systems including earthquakes, where fractality and long-range interactions are important. The analysis indicates that the cumulative inter-event time distribution can be successfully described with NESP, implying the complexity that characterizes the temporal occurrences of earthquakes. Further on, we use the Tsallis entropy (Sq) and the Fischer Information Measure (FIM) to investigate the complexity that characterizes the inter-event time distribution through different time windows along the evolution of the seismic activity at the West Corinth rift. The results of this analysis reveal a different level of organization and clusterization of the seismic activity in time. Acknowledgments. GM wish to acknowledge the partial support of the Greek State Scholarships Foundation (IKY).

Complexity of the heart rhythm after heart transplantation by entropy of transition network for RR-increments of RR time intervals between heartbeats.

PubMed

Makowiec, Danuta; Struzik, Zbigniew; Graff, Beata; Wdowczyk-Szulc, Joanna; Zarczynska-Buchnowiecka, Marta; Gruchala, Marcin; Rynkiewicz, Andrzej

2013-01-01

Network models have been used to capture, represent and analyse characteristics of living organisms and general properties of complex systems. The use of network representations in the characterization of time series complexity is a relatively new but quickly developing branch of time series analysis. In particular, beat-to-beat heart rate variability can be mapped out in a network of RR-increments, which is a directed and weighted graph with vertices representing RR-increments and the edges of which correspond to subsequent increments. We evaluate entropy measures selected from these network representations in records of healthy subjects and heart transplant patients, and provide an interpretation of the results.

A retrospective analysis of the effect of blood transfusion on cerebral oximetry entropy and acute kidney injury.

PubMed

Engoren, Milo; Brown, Russell R; Dubovoy, Anna

2017-01-01

Acute anemia is associated with both cerebral dysfunction and acute kidney injury and is often treated with red blood cell transfusion. We sought to determine if blood transfusion changed the cerebral oximetry entropy, a measure of the complexity or irregularity of the oximetry values, and if this change was associated with subsequent acute kidney injury. This was a retrospective, case-control study of patients undergoing cardiac surgery with cardiopulmonary bypass at a tertiary care hospital, comparing those who received a red blood cell transfusion to those who did not. Acute kidney injury was defined as a perioperative increase in serum creatinine by ⩾26.4 μmol/L or by ⩾50% increase. Entropy was measured using approximate entropy, sample entropy, forbidden word entropy and basescale4 entropy in 500-point sets. Forty-four transfused patients were matched to 88 randomly selected non-transfused patients. All measures of entropy had small changes in the transfused group, but increased in the non-transfused group (p<0.05, for all comparisons). Thirty-five of 132 patients (27%) suffered acute kidney injury. Based on preoperative factors, patients who suffered kidney injury were similar to those who did not, including baseline cerebral oximetry levels. After analysis with hierarchical logistic regression, the change in basescale4 entropy (odds ratio = 1.609, 95% confidence interval = 1.057-2.450, p = 0.027) and the interaction between basescale entropy and transfusion were significantly associated with subsequent development of acute kidney injury. The transfusion of red blood cells was associated with a smaller rise in entropy values compared to non-transfused patients, suggesting a change in the regulation of cerebral oxygenation, and these changes in cerebral oxygenation are also associated with acute kidney injury.

Dynamic approximate entropy electroanatomic maps detect rotors in a simulated atrial fibrillation model.

PubMed

Ugarte, Juan P; Orozco-Duque, Andrés; Tobón, Catalina; Kremen, Vaclav; Novak, Daniel; Saiz, Javier; Oesterlein, Tobias; Schmitt, Clauss; Luik, Armin; Bustamante, John

2014-01-01

There is evidence that rotors could be drivers that maintain atrial fibrillation. Complex fractionated atrial electrograms have been located in rotor tip areas. However, the concept of electrogram fractionation, defined using time intervals, is still controversial as a tool for locating target sites for ablation. We hypothesize that the fractionation phenomenon is better described using non-linear dynamic measures, such as approximate entropy, and that this tool could be used for locating the rotor tip. The aim of this work has been to determine the relationship between approximate entropy and fractionated electrograms, and to develop a new tool for rotor mapping based on fractionation levels. Two episodes of chronic atrial fibrillation were simulated in a 3D human atrial model, in which rotors were observed. Dynamic approximate entropy maps were calculated using unipolar electrogram signals generated over the whole surface of the 3D atrial model. In addition, we optimized the approximate entropy calculation using two real multi-center databases of fractionated electrogram signals, labeled in 4 levels of fractionation. We found that the values of approximate entropy and the levels of fractionation are positively correlated. This allows the dynamic approximate entropy maps to localize the tips from stable and meandering rotors. Furthermore, we assessed the optimized approximate entropy using bipolar electrograms generated over a vicinity enclosing a rotor, achieving rotor detection. Our results suggest that high approximate entropy values are able to detect a high level of fractionation and to locate rotor tips in simulated atrial fibrillation episodes. We suggest that dynamic approximate entropy maps could become a tool for atrial fibrillation rotor mapping.

Diagram-based Analysis of Causal Systems (DACS): elucidating inter-relationships between determinants of acute lower respiratory infections among children in sub-Saharan Africa.

PubMed

Rehfuess, Eva A; Best, Nicky; Briggs, David J; Joffe, Mike

2013-12-06

Effective interventions require evidence on how individual causal pathways jointly determine disease. Based on the concept of systems epidemiology, this paper develops Diagram-based Analysis of Causal Systems (DACS) as an approach to analyze complex systems, and applies it by examining the contributions of proximal and distal determinants of childhood acute lower respiratory infections (ALRI) in sub-Saharan Africa. Diagram-based Analysis of Causal Systems combines the use of causal diagrams with multiple routinely available data sources, using a variety of statistical techniques. In a step-by-step process, the causal diagram evolves from conceptual based on a priori knowledge and assumptions, through operational informed by data availability which then undergoes empirical testing, to integrated which synthesizes information from multiple datasets. In our application, we apply different regression techniques to Demographic and Health Survey (DHS) datasets for Benin, Ethiopia, Kenya and Namibia and a pooled World Health Survey (WHS) dataset for sixteen African countries. Explicit strategies are employed to make decisions transparent about the inclusion/omission of arrows, the sign and strength of the relationships and homogeneity/heterogeneity across settings.Findings about the current state of evidence on the complex web of socio-economic, environmental, behavioral and healthcare factors influencing childhood ALRI, based on DHS and WHS data, are summarized in an integrated causal diagram. Notably, solid fuel use is structured by socio-economic factors and increases the risk of childhood ALRI mortality. Diagram-based Analysis of Causal Systems is a means of organizing the current state of knowledge about a specific area of research, and a framework for integrating statistical analyses across a whole system. This partly a priori approach is explicit about causal assumptions guiding the analysis and about researcher judgment, and wrong assumptions can be reversed following empirical testing. This approach is well-suited to dealing with complex systems, in particular where data are scarce.

Diagram-based Analysis of Causal Systems (DACS): elucidating inter-relationships between determinants of acute lower respiratory infections among children in sub-Saharan Africa

PubMed Central

2013-01-01

Background Effective interventions require evidence on how individual causal pathways jointly determine disease. Based on the concept of systems epidemiology, this paper develops Diagram-based Analysis of Causal Systems (DACS) as an approach to analyze complex systems, and applies it by examining the contributions of proximal and distal determinants of childhood acute lower respiratory infections (ALRI) in sub-Saharan Africa. Results Diagram-based Analysis of Causal Systems combines the use of causal diagrams with multiple routinely available data sources, using a variety of statistical techniques. In a step-by-step process, the causal diagram evolves from conceptual based on a priori knowledge and assumptions, through operational informed by data availability which then undergoes empirical testing, to integrated which synthesizes information from multiple datasets. In our application, we apply different regression techniques to Demographic and Health Survey (DHS) datasets for Benin, Ethiopia, Kenya and Namibia and a pooled World Health Survey (WHS) dataset for sixteen African countries. Explicit strategies are employed to make decisions transparent about the inclusion/omission of arrows, the sign and strength of the relationships and homogeneity/heterogeneity across settings. Findings about the current state of evidence on the complex web of socio-economic, environmental, behavioral and healthcare factors influencing childhood ALRI, based on DHS and WHS data, are summarized in an integrated causal diagram. Notably, solid fuel use is structured by socio-economic factors and increases the risk of childhood ALRI mortality. Conclusions Diagram-based Analysis of Causal Systems is a means of organizing the current state of knowledge about a specific area of research, and a framework for integrating statistical analyses across a whole system. This partly a priori approach is explicit about causal assumptions guiding the analysis and about researcher judgment, and wrong assumptions can be reversed following empirical testing. This approach is well-suited to dealing with complex systems, in particular where data are scarce. PMID:24314302

Enthalpy-entropy compensation: the role of solvation.

PubMed

Dragan, Anatoliy I; Read, Christopher M; Crane-Robinson, Colyn

2017-05-01

Structural modifications to interacting systems frequently lead to changes in both the enthalpy (heat) and entropy of the process that compensate each other, so that the Gibbs free energy is little changed: a major barrier to the development of lead compounds in drug discovery. The conventional explanation for such enthalpy-entropy compensation (EEC) is that tighter contacts lead to a more negative enthalpy but increased molecular constraints, i.e., a compensating conformational entropy reduction. Changes in solvation can also contribute to EEC but this contribution is infrequently discussed. We review long-established and recent cases of EEC and conclude that the large fluctuations in enthalpy and entropy observed are too great to be a result of only conformational changes and must result, to a considerable degree, from variations in the amounts of water immobilized or released on forming complexes. Two systems exhibiting EEC show a correlation between calorimetric entropies and local mobilities, interpreted to mean conformational control of the binding entropy/free energy. However, a substantial contribution from solvation gives the same effect, as a consequence of a structural link between the amount of bound water and the protein flexibility. Only by assuming substantial changes in solvation-an intrinsically compensatory process-can a more complete understanding of EEC be obtained. Faced with such large, and compensating, changes in the enthalpies and entropies of binding, the best approach to engineering elevated affinities must be through the addition of ionic links, as they generate increased entropy without affecting the enthalpy.

Causality networks from multivariate time series and application to epilepsy.

PubMed

Siggiridou, Elsa; Koutlis, Christos; Tsimpiris, Alkiviadis; Kimiskidis, Vasilios K; Kugiumtzis, Dimitris

2015-08-01

Granger causality and variants of this concept allow the study of complex dynamical systems as networks constructed from multivariate time series. In this work, a large number of Granger causality measures used to form causality networks from multivariate time series are assessed. For this, realizations on high dimensional coupled dynamical systems are considered and the performance of the Granger causality measures is evaluated, seeking for the measures that form networks closest to the true network of the dynamical system. In particular, the comparison focuses on Granger causality measures that reduce the state space dimension when many variables are observed. Further, the linear and nonlinear Granger causality measures of dimension reduction are compared to a standard Granger causality measure on electroencephalographic (EEG) recordings containing episodes of epileptiform discharges.

Effects of torsional deformation on the microstructures and mechanical properties of a CoCrFeNiMo0.15 high-entropy alloy

NASA Astrophysics Data System (ADS)

Wu, Wenqian; Guo, Lin; Liu, Bin; Ni, Song; Liu, Yong; Song, Min

2017-12-01

The effects of torsional deformation on the microstructures and mechanical properties of a CoCrFeNiMo0.15 high-entropy alloy have been investigated. The torsional deformation generates a gradient microstructure distribution due to the gradient torsional strain. Both dislocation activity and deformation twinning dominated the torsional deformation process. With increasing the torsional equivalent strain, the microstructural evolution can be described as follows: (1) formation of pile-up dislocations parallel to the trace of {1 1 1}-type slip planes; (2) formation of Taylor lattices; (3) formation of highly dense dislocation walls; (3) formation of microbands and deformation twins. The extremely high deformation strain (strained to fracture) results in the activation of wavy slip. The tensile strength is very sensitive to the torsional deformation, and increases significantly with increasing the torsional angle.

Constraints on rapidity-dependent initial conditions from charged-particle pseudorapidity densities and two-particle correlations

NASA Astrophysics Data System (ADS)

Ke, Weiyao; Moreland, J. Scott; Bernhard, Jonah E.; Bass, Steffen A.

2017-10-01

We study the initial three-dimensional spatial configuration of the quark-gluon plasma (QGP) produced in relativistic heavy-ion collisions using centrality and pseudorapidity-dependent measurements of the medium's charged particle density and two-particle correlations. A cumulant-generating function is first used to parametrize the rapidity dependence of local entropy deposition and extend arbitrary boost-invariant initial conditions to nonzero beam rapidities. The model is then compared to p +Pb and Pb + Pb charged-particle pseudorapidity densities and two-particle pseudorapidity correlations and systematically optimized using Bayesian parameter estimation to extract high-probability initial condition parameters. The optimized initial conditions are then compared to a number of experimental observables including the pseudorapidity-dependent anisotropic flows, event-plane decorrelations, and flow correlations. We find that the form of the initial local longitudinal entropy profile is well constrained by these experimental measurements.

Plane Transformations in a Complex Setting II: Isometries

ERIC Educational Resources Information Center

Dana-Picard, Thierry

2007-01-01

This paper is the second part of a study of plane transformations using a complex setting. The first part was devoted to homotheties and translations, now attention is turned towards plane isometries. The group theoretic properties of plane isometries are easy to derive and images of classical geometrical objects by these transformations are…

Crystallization in melts of short, semiflexible hard polymer chains: An interplay of entropies and dimensions

NASA Astrophysics Data System (ADS)

Shakirov, T.; Paul, W.

2018-04-01

What is the thermodynamic driving force for the crystallization of melts of semiflexible polymers? We try to answer this question by employing stochastic approximation Monte Carlo simulations to obtain the complete thermodynamic equilibrium information for a melt of short, semiflexible polymer chains with purely repulsive nonbonded interactions. The thermodynamics is obtained based on the density of states of our coarse-grained model, which varies by up to 5600 orders of magnitude. We show that our polymer melt undergoes a first-order crystallization transition upon increasing the chain stiffness at fixed density. This crystallization can be understood by the interplay of the maximization of different entropy contributions in different spatial dimensions. At sufficient stiffness and density, the three-dimensional orientational interactions drive the orientational ordering transition, which is accompanied by a two-dimensional translational ordering transition in the plane perpendicular to the chains resulting in a hexagonal crystal structure. While the three-dimensional ordering can be understood in terms of Onsager theory, the two-dimensional transition can be understood in terms of the liquid-hexatic transition of hard disks. Due to the domination of lateral two-dimensional translational entropy over the one-dimensional translational entropy connected with columnar displacements, the chains form a lamellar phase. Based on this physical understanding, orientational ordering and translational ordering should be separable for polymer melts. A phenomenological theory based on this understanding predicts a qualitative phase diagram as a function of volume fraction and stiffness in good agreement with results from the literature.

Inference of topology and the nature of synapses, and the flow of information in neuronal networks

NASA Astrophysics Data System (ADS)

Borges, F. S.; Lameu, E. L.; Iarosz, K. C.; Protachevicz, P. R.; Caldas, I. L.; Viana, R. L.; Macau, E. E. N.; Batista, A. M.; Baptista, M. S.

2018-02-01

The characterization of neuronal connectivity is one of the most important matters in neuroscience. In this work, we show that a recently proposed informational quantity, the causal mutual information, employed with an appropriate methodology, can be used not only to correctly infer the direction of the underlying physical synapses, but also to identify their excitatory or inhibitory nature, considering easy to handle and measure bivariate time series. The success of our approach relies on a surprising property found in neuronal networks by which nonadjacent neurons do "understand" each other (positive mutual information), however, this exchange of information is not capable of causing effect (zero transfer entropy). Remarkably, inhibitory connections, responsible for enhancing synchronization, transfer more information than excitatory connections, known to enhance entropy in the network. We also demonstrate that our methodology can be used to correctly infer directionality of synapses even in the presence of dynamic and observational Gaussian noise, and is also successful in providing the effective directionality of intermodular connectivity, when only mean fields can be measured.

Crossing the phantom divide with dissipative normal matter in the Israel-Stewart formalism

NASA Astrophysics Data System (ADS)

Cruz, Norman; Lepe, Samuel

2017-04-01

A phantom solution in the framework of the causal Israel-Stewart (IS) formalism is discussed. We assume a late time behavior of the cosmic evolution by considering only one dominant matter fluid with viscosity. In the model it is assumed a bulk viscosity of the form ξ =ξ0ρ 1 / 2, where ρ is the energy density of the fluid. We evaluate and discuss the behavior of the thermodynamical parameters associated to this solution, like the temperature, rate of entropy, entropy, relaxation time, effective pressure and effective EoS. A discussion about the assumption of near equilibrium of the formalism and the accelerated expansion of the solution is presented. The solution allows to cross the phantom divide without evoking an exotic matter fluid and the effective EoS parameter is always lesser than -1 and time independent. A future singularity (big rip) occurs, but different from the Type I (big rip) solution classified in S. Nojiri, S.D. Odintsov and S. Tsujikawa (2005) [2], if we consider other thermodynamics parameters like, for example, the effective pressure in the presence of viscosity or the relaxation time.

Generalized Entanglement Entropies of Quantum Designs.

PubMed

Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun

2018-03-30

The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.

Generalized Entanglement Entropies of Quantum Designs

NASA Astrophysics Data System (ADS)

Liu, Zi-Wen; Lloyd, Seth; Zhu, Elton Yechao; Zhu, Huangjun

2018-03-01

The entanglement properties of random quantum states or dynamics are important to the study of a broad spectrum of disciplines of physics, ranging from quantum information to high energy and many-body physics. This Letter investigates the interplay between the degrees of entanglement and randomness in pure states and unitary channels. We reveal strong connections between designs (distributions of states or unitaries that match certain moments of the uniform Haar measure) and generalized entropies (entropic functions that depend on certain powers of the density operator), by showing that Rényi entanglement entropies averaged over designs of the same order are almost maximal. This strengthens the celebrated Page's theorem. Moreover, we find that designs of an order that is logarithmic in the dimension maximize all Rényi entanglement entropies and so are completely random in terms of the entanglement spectrum. Our results relate the behaviors of Rényi entanglement entropies to the complexity of scrambling and quantum chaos in terms of the degree of randomness, and suggest a generalization of the fast scrambling conjecture.

A Theoretical Basis for Entropy-Scaling Effects in Human Mobility Patterns.

PubMed

Osgood, Nathaniel D; Paul, Tuhin; Stanley, Kevin G; Qian, Weicheng

2016-01-01

Characterizing how people move through space has been an important component of many disciplines. With the advent of automated data collection through GPS and other location sensing systems, researchers have the opportunity to examine human mobility at spatio-temporal resolution heretofore impossible. However, the copious and complex data collected through these logging systems can be difficult for humans to fully exploit, leading many researchers to propose novel metrics for encapsulating movement patterns in succinct and useful ways. A particularly salient proposed metric is the mobility entropy rate of the string representing the sequence of locations visited by an individual. However, mobility entropy rate is not scale invariant: entropy rate calculations based on measurements of the same trajectory at varying spatial or temporal granularity do not yield the same value, limiting the utility of mobility entropy rate as a metric by confounding inter-experimental comparisons. In this paper, we derive a scaling relationship for mobility entropy rate of non-repeating straight line paths from the definition of Lempel-Ziv compression. We show that the resulting formulation predicts the scaling behavior of simulated mobility traces, and provides an upper bound on mobility entropy rate under certain assumptions. We further show that this formulation has a maximum value for a particular sampling rate, implying that optimal sampling rates for particular movement patterns exist.

Harmonic analysis of electric locomotive and traction power system based on wavelet singular entropy

NASA Astrophysics Data System (ADS)

Dun, Xiaohong

2018-05-01

With the rapid development of high-speed railway and heavy-haul transport, the locomotive and traction power system has become the main harmonic source of China's power grid. In response to this phenomenon, the system's power quality issues need timely monitoring, assessment and governance. Wavelet singular entropy is an organic combination of wavelet transform, singular value decomposition and information entropy theory, which combines the unique advantages of the three in signal processing: the time-frequency local characteristics of wavelet transform, singular value decomposition explores the basic modal characteristics of data, and information entropy quantifies the feature data. Based on the theory of singular value decomposition, the wavelet coefficient matrix after wavelet transform is decomposed into a series of singular values that can reflect the basic characteristics of the original coefficient matrix. Then the statistical properties of information entropy are used to analyze the uncertainty of the singular value set, so as to give a definite measurement of the complexity of the original signal. It can be said that wavelet entropy has a good application prospect in fault detection, classification and protection. The mat lab simulation shows that the use of wavelet singular entropy on the locomotive and traction power system harmonic analysis is effective.

Classical many-particle systems with unique disordered ground states

NASA Astrophysics Data System (ADS)

Zhang, G.; Stillinger, F. H.; Torquato, S.

2017-10-01

Classical ground states (global energy-minimizing configurations) of many-particle systems are typically unique crystalline structures, implying zero enumeration entropy of distinct patterns (aside from trivial symmetry operations). By contrast, the few previously known disordered classical ground states of many-particle systems are all high-entropy (highly degenerate) states. Here we show computationally that our recently proposed "perfect-glass" many-particle model [Sci. Rep. 6, 36963 (2016), 10.1038/srep36963] possesses disordered classical ground states with a zero entropy: a highly counterintuitive situation . For all of the system sizes, parameters, and space dimensions that we have numerically investigated, the disordered ground states are unique such that they can always be superposed onto each other or their mirror image. At low energies, the density of states obtained from simulations matches those calculated from the harmonic approximation near a single ground state, further confirming ground-state uniqueness. Our discovery provides singular examples in which entropy and disorder are at odds with one another. The zero-entropy ground states provide a unique perspective on the celebrated Kauzmann-entropy crisis in which the extrapolated entropy of a supercooled liquid drops below that of the crystal. We expect that our disordered unique patterns to be of value in fields beyond glass physics, including applications in cryptography as pseudorandom functions with tunable computational complexity.

Neuromuscular Alterations After Ankle Sprains: An Animal Model to Establish Causal Links After Injury.

PubMed

Lepley, Lindsey K; McKeon, Patrick O; Fitzpatrick, Shane G; Beckemeyer, Catherine L; Uhl, Timothy L; Butterfield, Timothy A

2016-10-01

The mechanisms that contribute to the development of chronic ankle instability are not understood. Investigators have developed a hypothetical model in which neuromuscular alterations that stem from damaged ankle ligaments are thought to affect periarticular and proximal muscle activity. However, the retrospective nature of these studies does not allow a causal link to be established. To assess temporal alterations in the activity of 2 periarticular muscles of the rat ankle and 2 proximal muscles of the rat hind limb after an ankle sprain. Controlled laboratory study. Laboratory. Five healthy adult male Long Evans rats (age = 16 weeks, mass = 400.0 ± 13.5 g). Indwelling fine-wire electromyography (EMG) electrodes were implanted surgically into the biceps femoris, medial gastrocnemius, vastus lateralis, and tibialis anterior muscles of the rats. We recorded baseline EMG measurements while the rats walked on a motor-driven treadmill and then induced a closed lateral ankle sprain by overextending the lateral ankle ligaments. After ankle sprain, the rats were placed on the treadmill every 24 hours for 7 days, and we recorded postsprain EMG data. Onset time of muscle activity, phase duration, sample entropy, and minimal detectable change (MDC) were assessed and compared with baseline using 2-tailed dependent t tests. Compared with baseline, delayed onset time of muscle activity was exhibited in the biceps femoris (baseline = -16.7 ± 54.0 milliseconds [ms]) on day 0 (5.2 ± 64.1 ms; t 4 = -4.655, P = .043) and tibialis anterior (baseline = 307.0 ± 64.2 ms) muscles on day 3 (362.5 ± 55.9 ms; t 4 = -5.427, P = .03) and day 6 (357.3 ± 39.6 ms; t 4 = -3.802, P = .02). Longer phase durations were observed for the vastus lateralis (baseline = 321.9 ± 92.6 ms) on day 3 (401.3 ± 101.2 ms; t 3 = -4.001, P = .03), day 4 (404.1 ± 93.0 ms; t 3 = -3.320, P = .048), and day 5 (364.6 ± 105.2 ms; t 3 = -3.963, P = .03) and for the tibialis anterior (baseline = 103.9 ± 16.4 ms) on day 4 (154.9 ± 7.8 ms; t 3 = -4.331, P = .050) and day 6 (141.9 ± 16.2 ms; t 3 = -3.441, P = .03). After sprain, greater sample entropy was found for the vastus lateralis (baseline = 0.7 ± 0.3) on day 6 (0.9 ± 0.4; t 4 = -3.481, P = .03) and day 7 (0.9 ± 0.3; t 4 = -2.637, P = .050) and for the tibialis anterior (baseline = 0.6 ± 0.4) on day 4 (0.9 ± 0.5; t 4 = -3.224, P = .03). The MDC analysis revealed increased sample entropy values for the vastus lateralis and tibialis anterior. Manually inducing an ankle sprain in a rat by overextending the lateral ankle ligaments altered the complexity of muscle-activation patterns, and the alterations exceeded the MDC of the baseline data.

Stationary properties of maximum-entropy random walks.

PubMed

Dixit, Purushottam D

2015-10-01

Maximum-entropy (ME) inference of state probabilities using state-dependent constraints is popular in the study of complex systems. In stochastic systems, how state space topology and path-dependent constraints affect ME-inferred state probabilities remains unknown. To that end, we derive the transition probabilities and the stationary distribution of a maximum path entropy Markov process subject to state- and path-dependent constraints. A main finding is that the stationary distribution over states differs significantly from the Boltzmann distribution and reflects a competition between path multiplicity and imposed constraints. We illustrate our results with particle diffusion on a two-dimensional landscape. Connections with the path integral approach to diffusion are discussed.

Differential network entropy reveals cancer system hallmarks

PubMed Central

West, James; Bianconi, Ginestra; Severini, Simone; Teschendorff, Andrew E.

2012-01-01

The cellular phenotype is described by a complex network of molecular interactions. Elucidating network properties that distinguish disease from the healthy cellular state is therefore of critical importance for gaining systems-level insights into disease mechanisms and ultimately for developing improved therapies. By integrating gene expression data with a protein interaction network we here demonstrate that cancer cells are characterised by an increase in network entropy. In addition, we formally demonstrate that gene expression differences between normal and cancer tissue are anticorrelated with local network entropy changes, thus providing a systemic link between gene expression changes at the nodes and their local correlation patterns. In particular, we find that genes which drive cell-proliferation in cancer cells and which often encode oncogenes are associated with reductions in network entropy. These findings may have potential implications for identifying novel drug targets. PMID:23150773

Deviation from high-entropy configurations in the atomic distributions of a multi-principal-element alloy

DOE PAGES

Santodonato, Louis J.; Zhang, Yang; Feygenson, Mikhail; ...

2015-01-20

The alloy-design strategy of combining multiple elements in near-equimolar ratios has shown great potential for producing exceptional engineering materials, often known as “high-entropy alloys”. Understanding the elemental distribution, and, thus, the evolution of the configurational entropy during solidification, is undertaken in the present study using the Al 1.3CoCrCuFeNi model alloy. Here we show that even when the material undergoes elemental segregation, precipitation, chemical ordering, and spinodal decomposition, a significant amount of disorder remains, due to the distributions of multiple elements in the major phases. In addition, the results suggest that the high-entropy-alloy-design strategy may be applied to a wide rangemore » of complex materials, and should not be limited to the goal of creating single-phase solid solutions.« less

Information thermodynamics of near-equilibrium computation

NASA Astrophysics Data System (ADS)

Prokopenko, Mikhail; Einav, Itai

2015-06-01

In studying fundamental physical limits and properties of computational processes, one is faced with the challenges of interpreting primitive information-processing functions through well-defined information-theoretic as well as thermodynamic quantities. In particular, transfer entropy, characterizing the function of computational transmission and its predictability, is known to peak near critical regimes. We focus on a thermodynamic interpretation of transfer entropy aiming to explain the underlying critical behavior by associating information flows intrinsic to computational transmission with particular physical fluxes. Specifically, in isothermal systems near thermodynamic equilibrium, the gradient of the average transfer entropy is shown to be dynamically related to Fisher information and the curvature of system's entropy. This relationship explicitly connects the predictability, sensitivity, and uncertainty of computational processes intrinsic to complex systems and allows us to consider thermodynamic interpretations of several important extreme cases and trade-offs.

Using genetic data to strengthen causal inference in observational research.

PubMed

Pingault, Jean-Baptiste; O'Reilly, Paul F; Schoeler, Tabea; Ploubidis, George B; Rijsdijk, Frühling; Dudbridge, Frank

2018-06-05

Causal inference is essential across the biomedical, behavioural and social sciences.By progressing from confounded statistical associations to evidence of causal relationships, causal inference can reveal complex pathways underlying traits and diseases and help to prioritize targets for intervention. Recent progress in genetic epidemiology - including statistical innovation, massive genotyped data sets and novel computational tools for deep data mining - has fostered the intense development of methods exploiting genetic data and relatedness to strengthen causal inference in observational research. In this Review, we describe how such genetically informed methods differ in their rationale, applicability and inherent limitations and outline how they should be integrated in the future to offer a rich causal inference toolbox.

Assessing Command and Control System Vulnerabilities in Underdeveloped, Degraded and Denied Operational Environments

DTIC Science & Technology

2013-06-01

simulation of complex systems (Sterman 2000, Meadows 2008): a) Causal Loop Diagrams. A Causal Loop Diagram ( CLD ) is used to represent the feedback...structure of the dynamic system. CLDs consist of variables in the system being connected by arrows to show their causal influences and relationships. It is...distribution of orders will be included in the model. 6.4.2 Causal Loop Diagrams The CLD , as seen in Figure 5, is derived from the WDA constructs for the

Reconstruction of Bulk Operators within the Entanglement Wedge in Gauge-Gravity Duality

NASA Astrophysics Data System (ADS)

Dong, Xi; Harlow, Daniel; Wall, Aron C.

2016-07-01

In this Letter we prove a simple theorem in quantum information theory, which implies that bulk operators in the anti-de Sitter/conformal field theory (AdS/CFT) correspondence can be reconstructed as CFT operators in a spatial subregion A , provided that they lie in its entanglement wedge. This is an improvement on existing reconstruction methods, which have at most succeeded in the smaller causal wedge. The proof is a combination of the recent work of Jafferis, Lewkowycz, Maldacena, and Suh on the quantum relative entropy of a CFT subregion with earlier ideas interpreting the correspondence as a quantum error correcting code.

Reconstruction of Bulk Operators within the Entanglement Wedge in Gauge-Gravity Duality.

PubMed

Dong, Xi; Harlow, Daniel; Wall, Aron C

2016-07-08

In this Letter we prove a simple theorem in quantum information theory, which implies that bulk operators in the anti-de Sitter/conformal field theory (AdS/CFT) correspondence can be reconstructed as CFT operators in a spatial subregion A, provided that they lie in its entanglement wedge. This is an improvement on existing reconstruction methods, which have at most succeeded in the smaller causal wedge. The proof is a combination of the recent work of Jafferis, Lewkowycz, Maldacena, and Suh on the quantum relative entropy of a CFT subregion with earlier ideas interpreting the correspondence as a quantum error correcting code.

Dynamic Approximate Entropy Electroanatomic Maps Detect Rotors in a Simulated Atrial Fibrillation Model

PubMed Central

Ugarte, Juan P.; Orozco-Duque, Andrés; Tobón, Catalina; Kremen, Vaclav; Novak, Daniel; Saiz, Javier; Oesterlein, Tobias; Schmitt, Clauss; Luik, Armin; Bustamante, John

2014-01-01

There is evidence that rotors could be drivers that maintain atrial fibrillation. Complex fractionated atrial electrograms have been located in rotor tip areas. However, the concept of electrogram fractionation, defined using time intervals, is still controversial as a tool for locating target sites for ablation. We hypothesize that the fractionation phenomenon is better described using non-linear dynamic measures, such as approximate entropy, and that this tool could be used for locating the rotor tip. The aim of this work has been to determine the relationship between approximate entropy and fractionated electrograms, and to develop a new tool for rotor mapping based on fractionation levels. Two episodes of chronic atrial fibrillation were simulated in a 3D human atrial model, in which rotors were observed. Dynamic approximate entropy maps were calculated using unipolar electrogram signals generated over the whole surface of the 3D atrial model. In addition, we optimized the approximate entropy calculation using two real multi-center databases of fractionated electrogram signals, labeled in 4 levels of fractionation. We found that the values of approximate entropy and the levels of fractionation are positively correlated. This allows the dynamic approximate entropy maps to localize the tips from stable and meandering rotors. Furthermore, we assessed the optimized approximate entropy using bipolar electrograms generated over a vicinity enclosing a rotor, achieving rotor detection. Our results suggest that high approximate entropy values are able to detect a high level of fractionation and to locate rotor tips in simulated atrial fibrillation episodes. We suggest that dynamic approximate entropy maps could become a tool for atrial fibrillation rotor mapping. PMID:25489858

Thermodynamic characterization of hydrogen interaction with iridium polyhydride complexes

DOE Office of Scientific and Technical Information (OSTI.GOV)

Zidan, R.A.; Rocheleau, R.E.

1999-01-01

Hydrogen interaction with solid iridium complexes IrXH{sub 2}(PPr3{sup i}){sub 2} (X=Cl, I) was investigated. Gaseous hydrogen was found to react reversibly with solid chloro-iridium complex IrClH{sub 2}(PPr3{sup i}){sub 2} forming IrClH{sub 2}(PPr3{sup i}){sub 2}H{sub 2}. The relative partial molal enthalpy and entropy were obtained from equilibrium isotherms at different hydrogen concentrations. The decrease in entropy with increasing hydrogen concentration and the absence of plateaus in the equilibrium isotherms were consistent with a single phase solid solution with two chemical components. Hydrogen release from solid iodo-iridium complex IrIH{sub 2}(PPr3{sup i}){sub 2}H{sub 2} was not observed at temperatures up to 350 K,more » indicating stronger hydrogen bonding. {copyright} {ital 1999 Materials Research Society.}« less

Complex character analysis of heart rate variability following brain asphyxia.

PubMed

Cai, Yuanyuan; Qiu, Yihong; Wei, Lan; Zhang, Wei; Hu, Sijun; Smith, Peter R; Crabtree, Vincent P; Tong, Shanbao; Thakor, Nitish V; Zhu, Yisheng

2006-05-01

In the present study Renyi entropy and L-Z complexity were used to characterize heart rate variability (HRV) of rats that were suffered from brain asphyxia and ischemia. Two groups of rats were studied: (a) rats (n=5) injected with NAALADase inhibitor, 2-PMPA, which has been proven neuroprotective in asphyxia injury and (b) control subjects (n=5) without medication. Renyi entropy and L-Z complexity of the R-R intervals (RRI) at different experiment stages were investigated in the two groups. The results show that both measures indicate less injury and better recovery in the drug injection group. The dynamic change of 90 min RRI signal after the asphyxia was investigated. The sudden reduction of the two parameters shows their sensitivity to the asphyxia insult.

Reflecting on explanatory ability: A mechanism for detecting gaps in causal knowledge.

PubMed

Johnson, Dan R; Murphy, Meredith P; Messer, Riley M

2016-05-01

People frequently overestimate their understanding-with a particularly large blind-spot for gaps in their causal knowledge. We introduce a metacognitive approach to reducing overestimation, termed reflecting on explanatory ability (REA), which is briefly thinking about how well one could explain something in a mechanistic, step-by-step, causally connected manner. Nine experiments demonstrated that engaging in REA just before estimating one's understanding substantially reduced overestimation. Moreover, REA reduced overestimation with nearly the same potency as generating full explanations, but did so 20 times faster (although only for high complexity objects). REA substantially reduced overestimation by inducing participants to quickly evaluate an object's inherent causal complexity (Experiments 4-7). REA reduced overestimation by also fostering step-by-step, causally connected processing (Experiments 2 and 3). Alternative explanations for REA's effects were ruled out including a general conservatism account (Experiments 4 and 5) and a covert explanation account (Experiment 8). REA's overestimation-reduction effect generalized beyond objects (Experiments 1-8) to sociopolitical policies (Experiment 9). REA efficiently detects gaps in our causal knowledge with implications for improving self-directed learning, enhancing self-insight into vocational and academic abilities, and even reducing extremist attitudes. (c) 2016 APA, all rights reserved).

On deformation of complex continuum immersed in a plane space

NASA Astrophysics Data System (ADS)

Kovalev, V. A.; Murashkin, E. V.; Radayev, Y. N.

2018-05-01

The present paper is devoted to mathematical modelling of complex continua deformations considered as immersed in an external plane space. The complex continuum is defined as a differential manifold supplied with metrics induced by the external space. A systematic derivation of strain tensors by notion of isometric immersion of the complex continuum into a plane space of a higher dimension is proposed. Problem of establishing complete systems of irreducible objective strain and extrastrain tensors for complex continuum immersed in an external plane space is resolved. The solution to the problem is obtained by methods of the field theory and the theory of rational algebraic invariants. Strain tensors of the complex continuum are derived as irreducible algebraic invariants of contravariant vectors of the external space emerging as functional arguments in the complex continuum action density. Present analysis is restricted to rational algebraic invariants. Completeness of the considered systems of rational algebraic invariants is established for micropolar elastic continua. Rational syzygies for non-quadratic invariants are discussed. Objective strain tensors (indifferent to frame rotations in the external plane space) for micropolar continuum are alternatively obtained by properly combining multipliers of polar decompositions of deformation and extra-deformation gradients. The latter is realized only for continua immersed in a plane space of the equal mathematical dimension.

Entropy of network ensembles

NASA Astrophysics Data System (ADS)

Bianconi, Ginestra

2009-03-01

In this paper we generalize the concept of random networks to describe network ensembles with nontrivial features by a statistical mechanics approach. This framework is able to describe undirected and directed network ensembles as well as weighted network ensembles. These networks might have nontrivial community structure or, in the case of networks embedded in a given space, they might have a link probability with a nontrivial dependence on the distance between the nodes. These ensembles are characterized by their entropy, which evaluates the cardinality of networks in the ensemble. In particular, in this paper we define and evaluate the structural entropy, i.e., the entropy of the ensembles of undirected uncorrelated simple networks with given degree sequence. We stress the apparent paradox that scale-free degree distributions are characterized by having small structural entropy while they are so widely encountered in natural, social, and technological complex systems. We propose a solution to the paradox by proving that scale-free degree distributions are the most likely degree distribution with the corresponding value of the structural entropy. Finally, the general framework we present in this paper is able to describe microcanonical ensembles of networks as well as canonical or hidden-variable network ensembles with significant implications for the formulation of network-constructing algorithms.

A duality principle for the multi-block entanglement entropy of free fermion systems.

PubMed

Carrasco, J A; Finkel, F; González-López, A; Tempesta, P

2017-09-11

The analysis of the entanglement entropy of a subsystem of a one-dimensional quantum system is a powerful tool for unravelling its critical nature. For instance, the scaling behaviour of the entanglement entropy determines the central charge of the associated Virasoro algebra. For a free fermion system, the entanglement entropy depends essentially on two sets, namely the set A of sites of the subsystem considered and the set K of excited momentum modes. In this work we make use of a general duality principle establishing the invariance of the entanglement entropy under exchange of the sets A and K to tackle complex problems by studying their dual counterparts. The duality principle is also a key ingredient in the formulation of a novel conjecture for the asymptotic behavior of the entanglement entropy of a free fermion system in the general case in which both sets A and K consist of an arbitrary number of blocks. We have verified that this conjecture reproduces the numerical results with excellent precision for all the configurations analyzed. We have also applied the conjecture to deduce several asymptotic formulas for the mutual and r-partite information generalizing the known ones for the single block case.

Sample entropy applied to the analysis of synthetic time series and tachograms

NASA Astrophysics Data System (ADS)

Muñoz-Diosdado, A.; Gálvez-Coyt, G. G.; Solís-Montufar, E.

2017-01-01

Entropy is a method of non-linear analysis that allows an estimate of the irregularity of a system, however, there are different types of computational entropy that were considered and tested in order to obtain one that would give an index of signals complexity taking into account the data number of the analysed time series, the computational resources demanded by the method, and the accuracy of the calculation. An algorithm for the generation of fractal time-series with a certain value of β was used for the characterization of the different entropy algorithms. We obtained a significant variation for most of the algorithms in terms of the series size, which could result counterproductive for the study of real signals of different lengths. The chosen method was sample entropy, which shows great independence of the series size. With this method, time series of heart interbeat intervals or tachograms of healthy subjects and patients with congestive heart failure were analysed. The calculation of sample entropy was carried out for 24-hour tachograms and time subseries of 6-hours for sleepiness and wakefulness. The comparison between the two populations shows a significant difference that is accentuated when the patient is sleeping.

Maximum Entropy/Optimal Projection (MEOP) control design synthesis: Optimal quantification of the major design tradeoffs

NASA Technical Reports Server (NTRS)

Hyland, D. C.; Bernstein, D. S.

1987-01-01

The underlying philosophy and motivation of the optimal projection/maximum entropy (OP/ME) stochastic modeling and reduced control design methodology for high order systems with parameter uncertainties are discussed. The OP/ME design equations for reduced-order dynamic compensation including the effect of parameter uncertainties are reviewed. The application of the methodology to several Large Space Structures (LSS) problems of representative complexity is illustrated.

Resistance Training Exercise Program for Intervention to Enhance Gait Function in Elderly Chronically Ill Patients: Multivariate Multiscale Entropy for Center of Pressure Signal Analysis

PubMed Central

Jiang, Bernard C.

2014-01-01

Falls are unpredictable accidents, and the resulting injuries can be serious in the elderly, particularly those with chronic diseases. Regular exercise is recommended to prevent and treat hypertension and other chronic diseases by reducing clinical blood pressure. The “complexity index” (CI), based on multiscale entropy (MSE) algorithm, has been applied in recent studies to show a person's adaptability to intrinsic and external perturbations and widely used measure of postural sway or stability. The multivariate multiscale entropy (MMSE) was advanced algorithm used to calculate the complexity index (CI) values of the center of pressure (COP) data. In this study, we applied the MSE & MMSE to analyze gait function of 24 elderly, chronically ill patients (44% female; 56% male; mean age, 67.56 ± 10.70 years) with either cardiovascular disease, diabetes mellitus, or osteoporosis. After a 12-week training program, postural stability measurements showed significant improvements. Our results showed beneficial effects of resistance training, which can be used to improve postural stability in the elderly and indicated that MMSE algorithms to calculate CI of the COP data were superior to the multiscale entropy (MSE) algorithm to identify the sense of balance in the elderly. PMID:25295070

Refined composite multiscale weighted-permutation entropy of financial time series

NASA Astrophysics Data System (ADS)

Zhang, Yongping; Shang, Pengjian

2018-04-01

For quantifying the complexity of nonlinear systems, multiscale weighted-permutation entropy (MWPE) has recently been proposed. MWPE has incorporated amplitude information and been applied to account for the multiple inherent dynamics of time series. However, MWPE may be unreliable, because its estimated values show large fluctuation for slight variation of the data locations, and a significant distinction only for the different length of time series. Therefore, we propose the refined composite multiscale weighted-permutation entropy (RCMWPE). By comparing the RCMWPE results with other methods' results on both synthetic data and financial time series, RCMWPE method shows not only the advantages inherited from MWPE but also lower sensitivity to the data locations, more stable and much less dependent on the length of time series. Moreover, we present and discuss the results of RCMWPE method on the daily price return series from Asian and European stock markets. There are significant differences between Asian markets and European markets, and the entropy values of Hang Seng Index (HSI) are close to but higher than those of European markets. The reliability of the proposed RCMWPE method has been supported by simulations on generated and real data. It could be applied to a variety of fields to quantify the complexity of the systems over multiple scales more accurately.

Complexity of heart rate fluctuations in near-term sheep and human fetuses during sleep.

PubMed

Frank, Birgit; Frasch, Martin G; Schneider, Uwe; Roedel, Marcus; Schwab, Matthias; Hoyer, Dirk

2006-10-01

We investigated how the complexity of fetal heart rate fluctuations (fHRF) is related to the sleep states in sheep and human fetuses. The complexity as a function of time scale for fetal heart rate data for 7 sheep and 27 human fetuses was estimated in rapid eye movement (REM) and non-REM sleep by means of permutation entropy and the associated Kullback-Leibler entropy. We found that in humans, fHRF complexity is higher in non-REM than REM sleep, whereas in sheep this relationship is reversed. To show this relation, choice of the appropriate time scale is crucial. In sheep fetuses, we found differences in the complexity of fHRF between REM and non-REM sleep only for larger time scales (above 2.5 s), whereas in human fetuses the complexity was clearly different between REM and non-REM sleep over the whole range of time scales. This may be due to inherent time scales of complexity, which reflect species-specific functions of the autonomic nervous system. Such differences have to be considered when animal data are translated to the human situation.

Situation models and memory: the effects of temporal and causal information on recall sequence.

PubMed

Brownstein, Aaron L; Read, Stephen J

2007-10-01

Participants watched an episode of the television show Cheers on video and then reported free recall. Recall sequence followed the sequence of events in the story; if one concept was observed immediately after another, it was recalled immediately after it. We also made a causal network of the show's story and found that recall sequence followed causal links; effects were recalled immediately after their causes. Recall sequence was more likely to follow causal links than temporal sequence, and most likely to follow causal links that were temporally sequential. Results were similar at 10-minute and 1-week delayed recall. This is the most direct and detailed evidence reported on sequential effects in recall. The causal network also predicted probability of recall; concepts with more links and concepts on the main causal chain were most likely to be recalled. This extends the causal network model to more complex materials than previous research.

Scale-dependent intrinsic entropies of complex time series.

PubMed

Yeh, Jia-Rong; Peng, Chung-Kang; Huang, Norden E

2016-04-13

Multi-scale entropy (MSE) was developed as a measure of complexity for complex time series, and it has been applied widely in recent years. The MSE algorithm is based on the assumption that biological systems possess the ability to adapt and function in an ever-changing environment, and these systems need to operate across multiple temporal and spatial scales, such that their complexity is also multi-scale and hierarchical. Here, we present a systematic approach to apply the empirical mode decomposition algorithm, which can detrend time series on various time scales, prior to analysing a signal's complexity by measuring the irregularity of its dynamics on multiple time scales. Simulated time series of fractal Gaussian noise and human heartbeat time series were used to study the performance of this new approach. We show that our method can successfully quantify the fractal properties of the simulated time series and can accurately distinguish modulations in human heartbeat time series in health and disease. © 2016 The Author(s).

Thermodynamics of quantum spacetime histories

NASA Astrophysics Data System (ADS)

Smolin, Lee

2017-11-01

We show that the simplicity constraints, which define the dynamics of spin foam models, imply, and are implied by, the first law of thermodynamics, when the latter is applied to causal diamonds in the quantum spacetime. This result reveals an intimate connection between the holographic nature of gravity, as reflected by the Bekenstein entropy, and the fact that general relativity and other gravitational theories can be understood as constrained topological field theories. To state and derive this correspondence we describe causal diamonds in the causal structure of spin foam histories and generalize arguments given for the near horizon region of black holes by Frodden, Gosh and Perez [Phys. Rev. D 87, 121503 (2013); , 10.1103/PhysRevD.87.121503Phys. Rev. D 89, 084069 (2014); , 10.1103/PhysRevD.89.084069Phys. Rev. Lett. 107, 241301 (2011); , 10.1103/PhysRevLett.107.241301Phys. Rev. Lett.108, 169901(E) (2012)., 10.1103/PhysRevLett.108.169901] and Bianchi [arXiv:1204.5122.]. This allows us to apply a recent argument of Jacobson [Phys. Rev. Lett. 116, 201101 (2016).10.1103/PhysRevLett.116.201101] to show that if a spin foam history has a semiclassical limit described in terms of a smooth metric geometry, that geometry satisfies the Einstein equations. These results suggest also a proposal for a quantum equivalence principle.

Causality as a Rigorous Notion and Quantitative Causality Analysis with Time Series

NASA Astrophysics Data System (ADS)

Liang, X. S.

2017-12-01

Given two time series, can one faithfully tell, in a rigorous and quantitative way, the cause and effect between them? Here we show that this important and challenging question (one of the major challenges in the science of big data), which is of interest in a wide variety of disciplines, has a positive answer. Particularly, for linear systems, the maximal likelihood estimator of the causality from a series X2 to another series X1, written T2→1, turns out to be concise in form: T2→1 = [C11 C12 C2,d1 — C112 C1,d1] / [C112 C22 — C11C122] where Cij (i,j=1,2) is the sample covariance between Xi and Xj, and Ci,dj the covariance between Xi and ΔXj/Δt, the difference approximation of dXj/dt using the Euler forward scheme. An immediate corollary is that causation implies correlation, but not vice versa, resolving the long-standing debate over causation versus correlation. The above formula has been validated with touchstone series purportedly generated with one-way causality that evades the classical approaches such as Granger causality test and transfer entropy analysis. It has also been applied successfully to the investigation of many real problems. Through a simple analysis with the stock series of IBM and GE, an unusually strong one-way causality is identified from the former to the latter in their early era, revealing to us an old story, which has almost faded into oblivion, about "Seven Dwarfs" competing with a "Giant" for the computer market. Another example presented here regards the cause-effect relation between the two climate modes, El Niño and Indian Ocean Dipole (IOD). In general, these modes are mutually causal, but the causality is asymmetric. To El Niño, the information flowing from IOD manifests itself as a propagation of uncertainty from the Indian Ocean. In the third example, an unambiguous one-way causality is found between CO2 and the global mean temperature anomaly. While it is confirmed that CO2 indeed drives the recent global warming, on paleoclimate scales the cause-effect relation may be completely reversed. Key words: Causation, Information flow, Uncertainty Generation, El Niño, IOD, CO2/Global warming Reference : Liang, 2014: Unraveling the cause-effect relation between time series. PRE 90, 052150 News Report: http://scitation.aip.org/content/aip/magazine/physicstoday/news/10.1063/PT.5.7124

Refined Composite Multiscale Dispersion Entropy and its Application to Biomedical Signals.

PubMed

Azami, Hamed; Rostaghi, Mostafa; Abasolo, Daniel; Escudero, Javier

2017-12-01

We propose a novel complexity measure to overcome the deficiencies of the widespread and powerful multiscale entropy (MSE), including, MSE values may be undefined for short signals, and MSE is slow for real-time applications. We introduce multiscale dispersion entropy (DisEn-MDE) as a very fast and powerful method to quantify the complexity of signals. MDE is based on our recently developed DisEn, which has a computation cost of O(N), compared with O(N 2 ) for sample entropy used in MSE. We also propose the refined composite MDE (RCMDE) to improve the stability of MDE. We evaluate MDE, RCMDE, and refined composite MSE (RCMSE) on synthetic signals and three biomedical datasets. The MDE, RCMDE, and RCMSE methods show similar results, although the MDE and RCMDE are faster, lead to more stable results, and discriminate different types of physiological signals better than MSE and RCMSE. For noisy short and long time series, MDE and RCMDE are noticeably more stable than MSE and RCMSE, respectively. For short signals, MDE and RCMDE, unlike MSE and RCMSE, do not lead to undefined values. The proposed MDE and RCMDE are significantly faster than MSE and RCMSE, especially for long signals, and lead to larger differences between physiological conditions known to alter the complexity of the physiological recordings. MDE and RCMDE are expected to be useful for the analysis of physiological signals thanks to their ability to distinguish different types of dynamics. The MATLAB codes used in this paper are freely available at http://dx.doi.org/10.7488/ds/1982.

Binding free energy analysis of protein-protein docking model structures by evERdock.

PubMed

Takemura, Kazuhiro; Matubayasi, Nobuyuki; Kitao, Akio

2018-03-14

To aid the evaluation of protein-protein complex model structures generated by protein docking prediction (decoys), we previously developed a method to calculate the binding free energies for complexes. The method combines a short (2 ns) all-atom molecular dynamics simulation with explicit solvent and solution theory in the energy representation (ER). We showed that this method successfully selected structures similar to the native complex structure (near-native decoys) as the lowest binding free energy structures. In our current work, we applied this method (evERdock) to 100 or 300 model structures of four protein-protein complexes. The crystal structures and the near-native decoys showed the lowest binding free energy of all the examined structures, indicating that evERdock can successfully evaluate decoys. Several decoys that show low interface root-mean-square distance but relatively high binding free energy were also identified. Analysis of the fraction of native contacts, hydrogen bonds, and salt bridges at the protein-protein interface indicated that these decoys were insufficiently optimized at the interface. After optimizing the interactions around the interface by including interfacial water molecules, the binding free energies of these decoys were improved. We also investigated the effect of solute entropy on binding free energy and found that consideration of the entropy term does not necessarily improve the evaluations of decoys using the normal model analysis for entropy calculation.

Binding free energy analysis of protein-protein docking model structures by evERdock

NASA Astrophysics Data System (ADS)

Takemura, Kazuhiro; Matubayasi, Nobuyuki; Kitao, Akio

2018-03-01

To aid the evaluation of protein-protein complex model structures generated by protein docking prediction (decoys), we previously developed a method to calculate the binding free energies for complexes. The method combines a short (2 ns) all-atom molecular dynamics simulation with explicit solvent and solution theory in the energy representation (ER). We showed that this method successfully selected structures similar to the native complex structure (near-native decoys) as the lowest binding free energy structures. In our current work, we applied this method (evERdock) to 100 or 300 model structures of four protein-protein complexes. The crystal structures and the near-native decoys showed the lowest binding free energy of all the examined structures, indicating that evERdock can successfully evaluate decoys. Several decoys that show low interface root-mean-square distance but relatively high binding free energy were also identified. Analysis of the fraction of native contacts, hydrogen bonds, and salt bridges at the protein-protein interface indicated that these decoys were insufficiently optimized at the interface. After optimizing the interactions around the interface by including interfacial water molecules, the binding free energies of these decoys were improved. We also investigated the effect of solute entropy on binding free energy and found that consideration of the entropy term does not necessarily improve the evaluations of decoys using the normal model analysis for entropy calculation.

Measures, Probability and Holography in Cosmology

NASA Astrophysics Data System (ADS)

Phillips, Daniel

This dissertation compiles four research projects on predicting values for cosmological parameters and models of the universe on the broadest scale. The first examines the Causal Entropic Principle (CEP) in inhomogeneous cosmologies. The CEP aims to predict the unexpectedly small value of the cosmological constant Lambda using a weighting by entropy increase on causal diamonds. The original work assumed a purely isotropic and homogeneous cosmology. But even the level of inhomogeneity observed in our universe forces reconsideration of certain arguments about entropy production. In particular, we must consider an ensemble of causal diamonds associated with each background cosmology and we can no longer immediately discard entropy production in the far future of the universe. Depending on our choices for a probability measure and our treatment of black hole evaporation, the prediction for Lambda may be left intact or dramatically altered. The second related project extends the CEP to universes with curvature. We have found that curvature values larger than rho k = 40rhom are disfavored by more than $99.99% and a peak value at rhoLambda = 7.9 x 10-123 and rhok =4.3rho m for open universes. For universes that allow only positive curvature or both positive and negative curvature, we find a correlation between curvature and dark energy that leads to an extended region of preferred values. Our universe is found to be disfavored to an extent depending the priors on curvature. We also provide a comparison to previous anthropic constraints on open universes and discuss future directions for this work. The third project examines how cosmologists should formulate basic questions of probability. We argue using simple models that all successful practical uses of probabilities originate in quantum fluctuations in the microscopic physical world around us, often propagated to macroscopic scales. Thus we claim there is no physically verified fully classical theory of probability. We comment on the general implications of this view, and specifically question the application of classical probability theory to cosmology in cases where key questions are known to have no quantum answer. We argue that the ideas developed here may offer a way out of the notorious measure problems of eternal inflation. The fourth project looks at finite universes as alternatives to multiverse theories of cosmology. We compare two holographic arguments that impose especially strong bounds on the amount of inflation. One comes from the de Sitter Equilibrium cosmology and the other from the work of Banks and Fischler. We find that simple versions of these two approaches yield the same bound on the number of e-foldings. A careful examination reveals that while these pictures are similar in spirit, they are not necessarily identical prescriptions. We apply the two pictures to specific cosmologies which expose potentially important differences and which also demonstrate ways these seemingly simple proposals can be tricky to implement in practice.

Using complex networks to characterize international business cycles.

PubMed

Caraiani, Petre

2013-01-01

There is a rapidly expanding literature on the application of complex networks in economics that focused mostly on stock markets. In this paper, we discuss an application of complex networks to study international business cycles. We construct complex networks based on GDP data from two data sets on G7 and OECD economies. Besides the well-known correlation-based networks, we also use a specific tool for presenting causality in economics, the Granger causality. We consider different filtering methods to derive the stationary component of the GDP series for each of the countries in the samples. The networks were found to be sensitive to the detrending method. While the correlation networks provide information on comovement between the national economies, the Granger causality networks can better predict fluctuations in countries' GDP. By using them, we can obtain directed networks allows us to determine the relative influence of different countries on the global economy network. The US appears as the key player for both the G7 and OECD samples. The use of complex networks is valuable for understanding the business cycle comovements at an international level.

The fuzzy cube and causal efficacy: representation of concomitant mechanisms in stroke.

PubMed

Jobe, Thomas H.; Helgason, Cathy M.

1998-04-01

Twentieth century medical science has embraced nineteenth century Boolean probability theory based upon two-valued Aristotelian logic. With the later addition of bit-based, von Neumann structured computational architectures, an epistemology based on randomness has led to a bivalent epidemiological methodology that dominates medical decision making. In contrast, fuzzy logic, based on twentieth century multi-valued logic, and computational structures that are content addressed and adaptively modified, has advanced a new scientific paradigm for the twenty-first century. Diseases such as stroke involve multiple concomitant causal factors that are difficult to represent using conventional statistical methods. We tested which paradigm best represented this complex multi-causal clinical phenomenon-stroke. We show that the fuzzy logic paradigm better represented clinical complexity in cerebrovascular disease than current probability theory based methodology. We believe this finding is generalizable to all of clinical science since multiple concomitant causal factors are involved in nearly all known pathological processes.

Investigation into nanoscratching mechanical response of AlCrCuFeNi high-entropy alloys using atomic simulations

NASA Astrophysics Data System (ADS)

Wang, Zining; Li, Jia; Fang, QiHong; Liu, Bin; Zhang, Liangchi

2017-09-01

The mechanical behaviors and deformation mechanisms of scratched AlCrCuFeNi high entropy alloys (HEAs) have been studied by molecular dynamics (MD) simulations, in terms of the scratching forces, atomic strain, atomic displacement, microstructural evolution and dislocation density. The results show that the larger tangential and normal forces and higher friction coefficient take place in AlCrCuFeNi HEA due to its outstanding strength and hardness, and high adhesion and fracture toughness over the pure metal materials. Moreover, the stacking fault energy (SFE) in HEA increases the probability to initiate dislocation and twinning, which is conducive to the formation of complex deformation modes. Compared to the single element metal workpieces, the segregation potency of solutes into twinning boundary (TB) is raised due to the decreasing segregation energy of TB, resulting in the stronger solute effects on improving twinning properties for HEA workpiece. The higher dislocation density and the more activated slipping planes lead to the outstanding plasticity of AlCrCuFeNi HEA. The solute atoms as barriers to hinder the motion of dislocation and the severe lattice distortion to suppress the free slipping of dislocation are significantly stronger obstacles to strengthen HEA. The excellent comprehensive scratching properties of the bulk AlCrCuFeNi HEAs are associated with the combined effects of multiple strengthening mechanisms, such as dislocation strengthening, deformation twinning strengthening as well as solute strengthening. This work provides a basis for further understanding and tailoring SFE in mechanical properties and deformation mechanism of HEAs, which maybe facilitate the design and preparation of new HEAs with high performance.